Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

DMN-Guided Prompting: A Framework for Controlling LLM Behavior

Created by
  • Haebom

Author

Shaghayegh Abedi, Amin Jalali

Outline

This paper proposes a Decision Model and Notation (DMN)-based prompting framework, leveraging the potential of large-scale language models (LLMs) for automating decision logic in knowledge-intensive processes. It is designed to decompose complex decision logic into small, manageable components, guiding the LLM along a structured decision path. Experiments were conducted to apply this framework to assignment submission and feedback processes in graduate classes, demonstrating superior performance compared to chain-of-thought (CoT) prompting, and student surveys also confirmed its high usability.

Takeaways, Limitations

Takeaways:
We present the possibility of improving the performance of decision logic automation in LLM through DMN-based prompting.
Solve the challenges of designing complex prompts and provide a user-friendly interface.
Validation of effectiveness through application in actual educational environments.
Confirmed performance advantage over CoT prompting.
Confirmation of high student satisfaction.
Limitations:
Further validation of generalizability is needed through case studies in limited educational settings.
The complexity and expertise required to design DMN models.
Further research is needed to determine the generalizability of different types of decision logic and LLM.
Lack of extensive experimentation and validation using large datasets.
👍