Analyze receipts with the Form Recognizer service

Question 1

Azure’s Form Recognizer service

Answer 1

can solve for this issue by digitizing fields from forms using optical character recognition (OCR). Azure’s OCR technologies extract the contents and structure from forms, such as key, value pairs (eg. Quantity: 3).

Question 2

Form Recognizer

Answer 2

in Azure provides intelligent form processing capabilities that you can use to automate the processing of data in documents such as forms, invoices, and receipts. It combines state-of-the-art optical character recognition (OCR) with predictive models that can interpret form data by:

Matching field names to values.
Processing tables of data.
Identifying specific types of field, such as dates, telephone numbers, addresses, totals, and others.

Question 3

Form Recognizer supports automated document processing through:

Answer 3

1. A pre-built receipt model that is provided out-of-the-box, and is trained to recognize and extract data from sales receipts.
2. Custom models, which enable you to extract what are known as key/value pairs and table data from forms. Custom models are trained using your own data, which helps to tailor this model to your specific forms. Starting with only five samples of your forms, you can train the custom model. After the first training exercise, you can evaluate the results and consider if you need to add more samples and re-train.

Question 4

Azure resources to access Form Recognizer services

Answer 4

To use the Form recognizer, you need to either create a Form Recognizer resource or a Cognitive Services resource in your Azure subscription. Both resource types give access to the Form Recognizer service.

After the resource has been created, you can create client applications that use its key and endpoint to connect submit forms for analysis.

Question 5

Using the pre-built receipt model

Answer 5

The model is able to extract key information from the receipt slip:

1. time of transaction
2. date of transaction
3. merchant information
4. taxes paid
5. receipt totals
6. other pertinent information that may be present on the receipt
7. all text on the receipt is recognized and returned as well