Goto

Collaborating Authors

 visually impaired people


Eye Care You: Voice Guidance Application Using Social Robot for Visually Impaired People

arXiv.org Artificial Intelligence

In the study, the device of social robot was designed for visually impaired users, and along with a mobile application for provide functions to assist their lives. Both physical and mental conditions of visually impaired users are considered, and the mobile application provides functions: photo record, mood lift, greeting guest and today highlight. The application was designed for visually impaired users, and uses voice control to provide a friendly interface. Photo record function allows visually impaired users to capture image immediately when they encounter danger situations. Mood lift function accompanies visually impaired users by asking questions, playing music and reading articles. Greeting guest function answers to the visitors for the inconvenient physical condition of visually impaired users. In addition, today highlight function read news including weather forecast, daily horoscopes and daily reminder for visually impaired users. Multiple tools were adopted for developing the mobile application, and a website was developed for caregivers to check statues of visually impaired users and for marketing of the application.


AltCanvas: A Tile-Based Image Editor with Generative AI for Blind or Visually Impaired People

arXiv.org Artificial Intelligence

People with visual impairments often struggle to create content that relies heavily on visual elements, particularly when conveying spatial and structural information. Existing accessible drawing tools, which construct images line by line, are suitable for simple tasks like math but not for more expressive artwork. On the other hand, emerging generative AI-based text-to-image tools can produce expressive illustrations from descriptions in natural language, but they lack precise control over image composition and properties. To address this gap, our work integrates generative AI with a constructive approach that provides users with enhanced control and editing capabilities. Our system, AltCanvas, features a tile-based interface enabling users to construct visual scenes incrementally, with each tile representing an object within the scene. Users can add, edit, move, and arrange objects while receiving speech and audio feedback. Once completed, the scene can be rendered as a color illustration or as a vector for tactile graphic generation. Involving 14 blind or low-vision users in design and evaluation, we found that participants effectively used the AltCanvas workflow to create illustrations.


Banknote Recognition for Visually Impaired People (Case of Ethiopian note)

arXiv.org Artificial Intelligence

Currency is used almost everywhere to facilitate business. In most developing countries, especially the ones in Africa, tangible notes are predominantly used in everyday financial transactions. One of these countries, Ethiopia, is believed to have one of the world highest rates of blindness (1.6%) and low vision (3.7%). There are around 4 million visually impaired people; With 1.7 million people being in complete vision loss. Those people face a number of challenges when they are in a bus station, in shopping centers, or anywhere which requires the physical exchange of money. In this paper, we try to provide a solution to this issue using AI/ML applications. We developed an Android and IOS compatible mobile application with a model that achieved 98.9% classification accuracy on our dataset. The application has a voice integrated feature that tells the type of the scanned currency in Amharic, the working language of Ethiopia. The application is developed to be easily accessible by its users. It is build to reduce the burden of visually impaired people in Ethiopia.


New AI Models Could Personalise Object Recognition for Visually Impaired People

#artificialintelligence

Microsoft AI for Accessibility is funding the Object Recognition for Blind Image Training (ORBIT) project, led by City, University of London's Dr Simone Stumpf. Currently, the project is recruiting blind and low vision users in the UK to record videos of things that are important to them. The collected video data will enable the team to construct a large data set from users who are blind or have low vision which can be used for training and testing AI models that personalise object recognition - and ultimately help build better AI for everyone. Collecting this video data from users who are blind and low vision is, as Dr Stumpf notes, a "tricky process", because it, "must be simultaneously easy for blind users to record the videos and the data must be useful for machine learning." Experience from a pilot study showed users were able to take videos in different settings in their home using different filming techniques.