Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

StreetReaderAI: Making Street View Accessible Using Context-Aware Multimodal AI

Created by
  • Haebom

Author

Jon E. Froehlich, Alexander Fiannaca, Nimer Jaber, Victor Tsaran, Shaun Kane

Outline

This paper presents StreetReaderAI, the first accessible Street View tool for the visually impaired. It combines contextual awareness, multimodal AI, accessible navigation controls, and interactive voice to address the accessibility challenges of existing tools like Google Street View (GSV). StreetReaderAI allows visually impaired users to virtually navigate destinations, explore vast environments, and virtually travel across GSV's 220 billion imagery and 100+ countries. Iteratively designed with a mixed-vision team, it has been evaluated with 11 visually impaired users to demonstrate its value in assisting with POI surveys and remote route planning.

Takeaways, Limitations

Takeaways:
Suggests the possibility of developing an accessible Street View tool for the visually impaired.
Proven useful for POI surveys and remote route planning support.
Emphasize the importance of user-centered design through collaboration with mixed-vision teams.
Limitations:
There is no specific mention of Limitations in the paper.
👍