Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Ask Good Questions for Large Language Models

Created by
  • Haebom

Author

Qi Wu, Zhongqi Lu

Outline

This paper aims to improve the topic guidance performance of a large-scale language model (LLM)-based dialogue system. To address the lack of conceptual identification in existing methods, which are characterized by user confusion (__T60324_____), we propose the Ask-Good-Question (AGQ) framework, which utilizes an improved Concept-Enhanced Item Response Theory (CEIRT) model. AGQ combines the CEIRT model and LLM to assess the user's knowledge level and generate guidance questions to efficiently retrieve relevant information. Experimental results show that the proposed method improves the user's information retrieval experience compared to existing methods.

Takeaways, Limitations

Takeaways:
Contributes to improving the topic guidance performance of LLM-based conversation systems.
Effective combination of the CEIRT model and LLM enables question generation tailored to the user's knowledge level.
Improve user experience by increasing information retrieval efficiency.
Limitations:
Further validation of the accuracy of the CEIRT model is needed.
Generalization performance evaluations are needed for various types of user questions and situations.
Since the experimental results are limited to a specific domain, research is needed on the possibility of extending them to other domains.
👍