Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

automatic ocr on elements without description. #17558

Open
fernando-jose-silva opened this issue Dec 19, 2024 · 2 comments
Open

automatic ocr on elements without description. #17558

fernando-jose-silva opened this issue Dec 19, 2024 · 2 comments

Comments

@fernando-jose-silva
Copy link

Is your feature request related to a problem? Please describe.

Describe the solution you'd like

Voice Over for iPhone automatically detects when a control in focus has no label, and possibly reports xxxx
Where xxx is the text obtained from an OCR.
The suggestion would be to implement a feature similar to NVDA, when the reader detects a control without a label, it tries to run the OCR and inform the user of the text obtained if possible.

Second suggestion:
Voice Over even has a basic feature to detect control shapes, such as right arrows, and informs the user of possibly going back.
If NVDA could recognize commonly used icon shapes and describe them, it would be interesting.
I am not suggesting photo recognition here, because I think we would be talking about artificial intelligence, a subject for another much more complex call.

The most plausible suggestion, if any, would be the first.

Describe alternatives you've considered

Additional context

@Adriani90
Copy link
Collaborator

Jaws has this feature too in its 2025 update, works only when using the Jaws cursor or the invisible cursor.
This would be a great improvement in NVDA. I guess it could work at least for navigator / review cursor.
Cc: @jcsteh is this technically possible at all? Voice over does this on unlabelled buttons at least. I didn‘t test with Jaws in detail yet.

@Emil-18
Copy link
Contributor

Emil-18 commented Dec 21, 2024

@Adriani90 I haven't tested this feature in JAWS either, but from the what's new page, it seams like it is just continuous OCR for JAWS, wich NVDA allready has. Voiceover can detect things such as the role and states of objects, e.g that the recognized text is the label of a check box, and that the checkbox is checked.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants