AI and MCP

How AI receipt scanning works and when it fails

How AI receipt scanning turns a photo into amount, date and shop, why Indian bills often trip it up, and photo habits that reduce wrong totals.

Editorial illustration for How AI receipt scanning works and when it fails

AI receipt scanning works in three steps: it reads the photo as text, guesses which pieces of text are the shop, date, total and tax, and fills those fields for you to confirm. It fails most often when the print is faded, the paper is creased, or the bill mixes scripts and lines the software has to choose between. Treat the result as a draft and check the total every time.

How does a photo become a set of fields?

  1. Capture. The camera image is cleaned up: cropped, straightened and sharpened so text stands out from the background.
  2. Reading. Software recognises characters and groups them into lines. This is where blur or shadow does the most damage, because a smudged 8 can become a 3.
  3. Interpretation. Another step decides which line is the total. It looks for words like total or amount payable, the largest number near the bottom, and so on.
  4. Filling. The guessed values are placed into amount, date, merchant and sometimes tax fields, and you are asked to confirm.

Notice that the second and third steps can each be wrong independently. The text can be read perfectly while the wrong number is picked as the total.

Why do Indian bills cause trouble?

  • Thermal print. Many shop and petrol-pump slips fade within weeks, and a slip left in a wallet near heat may be blank by the time you scan it.
  • Crumpled paper. Folds put shadows across digits, and a crease through a number can hide it.
  • Mixed languages. A bill with Hindi or a regional language beside English item names forces the reader to switch scripts mid-line.
  • GST lines. A bill with CGST, SGST and a round-off line has several amounts near the bottom. The software may choose the tax amount or the pre-tax subtotal as the total.
  • Handwritten bills. A kirana notebook total or a hand-filled bill is much harder to read than printed text.
  • Many totals. A restaurant bill with a service charge, a discount and a tip line has more than one candidate.

What does a wrong scan look like?

Say a bill has a subtotal of 1,450 rupees, CGST of 36.25, SGST of 36.25 and a total of 1,523 after rounding. Check the arithmetic: 1,450 + 36.25 + 36.25 = 1,522.50, which rounds to 1,523. A scanner that picks 1,450 as the total underreports by 73 rupees, and one that reads the faded 3 as 8 records 1,528. Both are small errors, and both quietly shift your month.

How do you take a photo that scans well?

  • Lay the bill flat on a plain dark or light surface, not on a patterned table.
  • Shoot in daylight or under a lamp from above, so that your hand does not cast a shadow on the paper.
  • Keep the whole bill in the frame, including the total line and the date.
  • Hold the phone parallel to the paper, not at an angle.
  • For long bills, take two photos, top and bottom, or fold the middle section out of the way.
  • Scan on the day you get the bill, before the print fades.

What should you do with the receipts you keep?

A scanned receipt is useful as evidence, not only as data. Keeping the photo attached to the transaction means you can find the bill later when you need to check a return, a warranty or a business expense. SpendixAI keeps receipts with their transactions, so the amount you saved and the picture of the bill stay together.

What about digital receipts?

Emailed invoices and app-generated PDFs are easier to read than paper because the text is already there. Save them straight to the transaction instead of printing and re-photographing them. If a payment has both a paper slip and an email invoice, keep the invoice, since it is more likely to show the tax lines clearly.

A short checklist before you trust a scan

  • Does the amount match the payment you made?
  • Is the date the date of purchase, not the date printed for a different purpose, such as a batch number?
  • Is the merchant name something you will recognise next month?
  • Is the category sensible, or did the tool guess from a shop name?
  • Is the original photo still saved, in case you need it?

If the answer to any of these is no, edit the entry before it enters your reports.

SPENDIXAI JOURNAL

Useful ideas start with a clearer picture of your own spending.

Explore your reports