Answer 1

You'd probably want to use some kind of machine learning to recognise the numbers on the plan. In the end you need to know what features you want and how to implement them. Then you can search for libraries that help you with your program.
P. S. this sounds like a pretty complex project