Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Trustworthy AI Psychotherapy: Multi-Agent LLM Workflow for Counseling and Explainable Mental Disorder Diagnosis

Created by
  • Haebom

Author

Mithat Can Ozgun, Jiahuan Pei, Koen Hindriks, Lucia Donatelli, Qingzhi Liu, Junxiao Wang

Outline

LLM-based agents have emerged as innovative tools capable of performing complex tasks through iterative planning and action, making significant advances in understanding and addressing user needs. However, their effectiveness is limited in specialized areas such as mental health diagnosis, as they underperform compared to general applications. Current approaches to integrating diagnostic capabilities into LLM rely on rare and highly sensitive mental health datasets, which are difficult to obtain. Furthermore, these methods fail to mimic clinicians' pre-questioning skills, lack multi-session conversational comprehension, and struggle to align their results with expert clinical reasoning. To address these challenges, this study proposes DSM5AgentFlow, the first LLM-based agent workflow designed to autonomously generate DSM-5 Level-1 diagnostic questionnaires. By simulating therapist-client conversations with specific client profiles, this framework provides transparent, step-by-step disorder predictions, generating explainable and reliable results. This workflow serves as a complementary tool for mental health diagnosis that adheres to ethical and legal standards. Through comprehensive experiments, we evaluate key LLMs across three key dimensions: conversational realism, diagnostic accuracy, and explainability. The dataset and implementation are fully open source.

Takeaways, Limitations

Takeaways:
Presenting the possibility of developing a mental health diagnostic tool using LLM.
Provides a systematic and explainable diagnostic process based on the DSM-5
Realistic diagnostic support through therapist-client conversation simulations
Ensuring reproducibility and scalability of research through open source data and implementations.
Limitations:
Reliance on rare and sensitive mental health datasets
It cannot completely replace the professional judgment and experience of a clinician.
The performance of LLM is highly dependent on the quality and quantity of data used.
Further research is needed to determine generalizability across diverse cultural and linguistic backgrounds.
👍