Are We There Yet? Assessing Computer-Use Agents for Blind Users' Accessible Interaction with Desktop Applications
4.40T1 sourcearXiv cs.HC
Source record
Published by arXiv cs.HC (T1 source). The original is at https://arxiv.org/abs/2609.00524.
Pipeline notes
The summary and note below are generated by the signal pipeline — they are Beyond Desk’s reading, not quotations from the source.
SummaryA three-week diary study with 8 blind screen-reader users evaluated OLLA, a computer-use agent prototype, across 1,258 commands in 12 desktop applications. GPT-5 achieved the highest success rate at 52.5%, with trace analysis identifying grounding, planning, constraint-tracking, and termination failures.
Why it mattersFirst diary study with blind users on real desktop workflows; names specific failure modes and benchmarks five models, useful for agent builders and accessibility practitioners.
Cited by
No citations on record.
