Lost in Instructions: Study of Blind Users' Experiences with DIY Manuals and AI-Rewritten Instructions for Assembly, Operation, and Troubleshooting of Tangible Products
Organizations: Department of Computer Science, Stony Brook University, Stony Brook, New York, USA · Computer Science, Stony Brook University, Stony Brook, New York, USA · Applied Math and Statistics, Stony Brook University, Stony Brook, New York, USA · Department of Computer Science, Old Dominion University, Norfolk, Virginia, USA
AI tools like ChatGPT and Be-My-AI are increasingly being used by blind individuals. Although prior work has explored their use in some Do-It-Yourself (DIY) tasks by blind individuals, little is known about how they use these tools and the available product-manual resources to assemble, operate, and troubleshoot physical or tangible products - tasks requiring spatial reasoning, structural understanding, and precise execution. We address this knowledge gap via an interview study and a usability study with blind participants, investigating how they leverage AI tools and product manuals for DIY tasks with physical products. Findings show that manuals are essential resources, but product-manual instructions are often inadequate for blind users. AI tools presently do not adequately address this insufficiency; in fact, we observed that they often exacerbate this issue with incomplete, incoherent, or misleading guidance. Lastly, we suggest improvements to AI tools for generating tailored instructions for blind users' DIY tasks involving tangible products.
Department of Computer Science, Stony Brook University, Stony Brook, New York, USA · Applied Math and Statistics, Stony Brook University, Stony Brook, New York, USA · Computer Science, Stony Brook University, Stony Brook, New York, USA +1