The fintech company has a loan origination platform. The loan applicants upload the bank statements to apply for the loan. The Client already had an OCR solution to extract the data from Bank statements. However, the OCR solution was unable to give desired accuracy if the Bank statement was complex. Also, with the change in the Bank statement format, it required coding efforts. The Client was looking for a solution where new Bank statements format can be accommodated with minimum or no coding efforts
Python, CTPN, OpenCV, Deep Learning, Tesseract, Node.JS, React.JS, MongoDB
The traditional OCR based data extraction works on the co-ordinates. If there is a change in the structure on the input, the OCR solutions fails. Also if the image is very noise, the OCR based solution gives a very poor extraction accuracy.
To address this complex business problem we used a combination of Deep Learning and OCR to get the desired results. The deep learning based OCR solution involved image pre-processing to improve image resolution, automatically marking region of interest, text extraction and recognition. OpenCV was used for image processing, CTPN was used for automatically marking region of interest and text detection. For text extraction, Tesseract was used. Application was developed using NodeJS & ReactJS
The business problem was challenging. Especially, handling the changing format of the input document. We successfully delivered the solution with a great extraction accuracy and saved massive human efforts involved in the data extraction process.
The General insurance company in Europe, wanted to extract certain key fields like vehicle number, insurance number and few other key fields from a handwritten accidental insurance claims form. The desired text extraction accuracy level was 70% ,but the insurance company was getting it around 40%.
Python, CTPN, Google OCR, Flask, OpenCV, Deep Learning
The Handwritten Claims form were in the form of images. The complexity was to recognize the region of interest in the form, extract the text and recognize the digits and characters which were in Spanish Language.
The technical solution was divided into reading image, automatically marking region of interest, text extraction and recognition. OpenCV was used for image processing, CTPN was used for automatically marking region of interest and text detection. CTPN uses deep learning for text detection. For text extraction, we tried Tesseract, however, we did not get the desired accuracy. It was hence decided to use the Google OCR. With Google OCR, the we could achieve an acceptable text extraction accuracy. The model was invoked in the using Flask API.
The overall solution was complex, however, by carefully weaving up solutions components, we could deliver the solution with an accuracy of over 80%, thus exceeding the Clients expectation.
Piping & Instrumentation diagram (P&ID) is used extensively in process industry. The data extraction from this diagram is used for preparing bill of material. This is a manual activity, which is time consuming and error prone. The customer wanted to automate this process.
Python, OpenCV, Tensorflow, Tesseract OCR
The solution is developed using deep learning technique for object detection. The symbol recognition process is implemented using Faster-RCNN algorithm. The document image is pre-processed using openCV based image augmentation techniques. The encoding in the symbol is extracted using OCR approach. The tabular text outside the main image is extracted using Python based Tesseract OCR component.
The CCTV implementation company partnered with us to implement automatic number plate recognition system for a premium club in Pune, India.
The club members need to manually verify the vehicle at the entry gate. This is time consuming and lead to inconvenience to the club members. The management wanted to automate the vehicle verification & entry at the entrance.
Python, OpenCV, Tensorflow, Deep Learning
The solution involved detection of the number plate and character recognition in the number plate. The detection of the number plate on the car is implemented using deep learning based Faster-RCNN object detection model. The detected number plate is extracted as an image. The character recognition is implemented for english language in the current phase. The character recognition is implemented using deep neural network which identifies individual character and number from the number plate.