Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Script-Strategy Aligned Generation: Aligning LLMs with Expert-Crafted Dialogue Scripts and Therapeutic Strategies for Psychotherapy

Created by
  • Haebom

Author

Xin Sun, Jan de Wit, Zhuying Li, Jiahuan Pei, Abdallah El Ali, Jos A. Bosch

Outline

This paper explores the performance enhancement of psychotherapy chatbots using large-scale language models (LLMs). To overcome the limitations of existing rule-based chatbots, we present two studies that apply expert-written conversational scripts to LLMs. The first study compared rule-based, pure LLMs, and LLMs incorporating expert scripts through fine-tuning and prompting. We found that the scripted LLMs demonstrated superior performance in terms of empathy, conversational relevance, and adherence to therapeutic principles. The second study proposed a more flexible script-strategy-aligned generation (SSAG) method, reducing reliance on expert scripts while maintaining therapeutic effectiveness. SSAG can contribute to reducing expert effort and enhancing the scalability of psychotherapy chatbots.

Takeaways, Limitations

Takeaways:
Experimentally demonstrating the effectiveness of an LLM-based psychotherapy chatbot utilizing expert scripts.
To present a method for maintaining the therapeutic effect and controllability of LLM while minimizing the effort of the specialist through the SSAG technique.
Presenting the potential for scalability and accessibility enhancement of an LLM-based psychotherapy chatbot.
Enables more efficient collaborative development by enabling domain experts to align LLMs through high-level strategies rather than full scripts.
Limitations:
The number of study participants was relatively small (Study 1: N=43, Study 2: N=21).
Limitations in generalizability due to limitations in the experimental environment.
Further studies are needed to determine the long-term efficacy and safety of SSAG.
Applicability to various psychological problems and treatment approaches needs to be verified.
👍