Best approach for automatically processing bank receipt images on iOS using on-device OCR?

What is the best approach to automatically process bank receipt images on iOS while respecting user privacy?
I'm exploring ways to automatically extract transaction details from receipt images using on-device OCR. I'd like to discuss which Apple APIs and permission models would be appropriate for this functionality.

Answered by DTS Engineer in 911211022

The model Vision uses is on-device. Alternatively, you can explore the Foundation Models framework + SystemLanguageModel (if that fits your use and the context size allows), which is on-device as well. Because the data doesn't leave the device, I am curious what privacy concern you have, if you don't mind to share.

Best,
——
Ziqiao Chen
 Worldwide Developer Relations.

Accepted Answer

The model Vision uses is on-device. Alternatively, you can explore the Foundation Models framework + SystemLanguageModel (if that fits your use and the context size allows), which is on-device as well. Because the data doesn't leave the device, I am curious what privacy concern you have, if you don't mind to share.

Best,
——
Ziqiao Chen
 Worldwide Developer Relations.