Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

StreetLens: Enabling Human-Centered AI Agents for Neighborhood Assessment from Street View Imagery

Created by
  • Haebom

Author

Jina Kim, Leeje Jang, Yao-Yi Chiang, Guanyu Wang, Michelle C. Pasco

StreetLens: A User-Configurable VLM for Scalable Neighborhood Environmental Assessments

Outline

To overcome the limitations of traditional community research, this paper presents StreetLens, a customizable workflow that leverages Vision Language Models (VLMs) to perform scalable neighborhood environmental assessments. StreetLens retrieves street view images, focusing on questions derived from interview protocols, and generates semantic annotations ranging from objective features to subjective perceptions. By empowering researchers to leverage domain knowledge to define the role of VLMs, it places domain knowledge at the core of the analysis process, while integrating existing survey data enhances the robustness of the analysis across diverse environments.

Takeaways, Limitations

Takeaways:
Leveraging VLM to automate and scalable community research
Customizable workflows empower researchers to directly leverage domain knowledge.
Integrating existing survey data to expand the robustness and scope of analysis.
Efficient research through collaboration between researchers and AI systems
Limitations:
The specific Limitations is not presented in the paper. (It is impossible to determine based on the abstract alone.)
👍