Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

A Risk Taxonomy and Reflection Tool for Large Language Model Adoption in Public Health

Created by
  • Haebom

Author

Jiawei Zhou, Amy Z. Chen, Darshi Shah, Laura M. Schwab Reese, Munmun De Choudhury

Outline

This paper presents a structured approach to assessing the risks associated with applying large-scale language models (LLMs) to public health. Focus group interviews were conducted with public health professionals and individuals with practical experience, focusing on three key public health issues: infectious disease prevention (vaccines), chronic disease and well-being management (opioid use disorder), and community health and safety (intimate violence). This approach identified concerns regarding the use of LLMs. This resulted in a risk classification system encompassing four dimensions—individual, person-centered care, information ecosystems, and technology accountability—and proposed a reflective approach to risk assessment by providing specific risks and reflection questions for each dimension. This paper reexamines existing information behavior models and emphasizes the need to incorporate external validity and domain expertise into assessments based on real-world experience and practices. Ultimately, this study provides a shared vocabulary and reflective tools for computing and public health professionals to collaboratively anticipate, evaluate, and mitigate the potential harms of LLMs.

Takeaways, Limitations

Takeaways:
Provides a practical framework for systematically assessing and managing potential risks when applying LLM to public health.
Clarify risk factors through a risk classification system across four dimensions (individual, human-centered care, information ecosystem, and technology accountability) and provide reflective questions for each risk to strengthen practitioners' risk management capabilities.
Integrating the perspectives of public health experts and practitioners to provide realistic risk assessment and management solutions.
A review of the information behavior model considering the characteristics of LLM and a proposal for securing external validity.
Providing a shared vocabulary and tools for collaboration between computing and public health.
Limitations:
Because the study involved a limited number of focus group participants, there are limitations to generalizability.
Because the study results were limited to a specific public health issue, further research is needed to generalize them to other fields.
The risk classification system and reflection questions presented may not be applicable to all situations.
Given the rapid pace of advancement in LLM technology, there is a question of timeliness of research results.
👍