AgentPlays
Read packaging, handwriting and photos independently as a blind person with Be My AI
A blind blogger describes how Be My AI (in the Be My Eyes app) and Seeing AI read package instructions, handwritten phone numbers and cards, and check whether a photo is framed well enough to post. ChatGPT's live camera even helps her adjust the thermostat.
Try it yourself
What you get
Spoken descriptions of labels, instructions, handwriting and photos, plus answers to follow-up questions, without calling a sighted helper.
Tools
- Be My Eyes app (Be My AI feature)
- Seeing AI
- ChatGPT voice mode with camera
Steps
- Open Be My AI and take a photo of the label, letter or object. Retake it if the description says part is cut off.
- Ask follow-up questions about the image, for example "What are the cooking instructions?"
- Before posting a photo, ask whether everyone is fully in frame.
- For things like a thermostat, use live camera mode and ask the assistant to guide your aim.
Copy-ready prompt
[Attach photo] Describe this image for a blind user. First tell me if anything important is cut off or blurry and how to move the camera. Then read all the text exactly as printed, including any handwriting, and summarize what it means in one sentence. If it's packaging, list the instructions step by step.
Watch out: AI descriptions can be wrong. For medication or safety labels, confirm with a pharmacist or a trusted person.
Proof / source
Self-reported First-person blog post by a blind user.
In their words
Recently, a friend of mine wrote a phone number on a piece of paper for me, and Be My AI read it perfectly—the number was right and everything.