Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Reliable generation of isomorphic physics problems using ChatGPT with prompt-chaining and tool use

Created by
  • Haebom

Author

Zhongzhou Chen

Outline

This paper presents a method for mass-generating isomorphic physics problems using ChatGPT. Using prompt chaining and tools, it precisely controls structural variations, such as numerical values and spatial relationships, while supporting diverse contextual variations in the problem body. It addresses key limitations of existing LLM-based methods by leveraging a Python code interpreter to support automatic solution verification and simple diagram generation. By generating two isomorphic problem banks and comparing them to simple prompt-based methods, we demonstrate that prompt chaining produces significantly higher quality and more consistent results. This study demonstrates an efficient problem generation method accessible to even the average instructor and opens new possibilities for personalized adaptive testing and automated content development.

Takeaways, Limitations

Takeaways:
Demonstrating the efficiency of generating homomorphic physics problems using ChatGPT and prompt chaining.
Solving the problem of automatic solution verification and diagram generation of existing LLM-based methods Limitations.
Opening up new possibilities for personalized adaptive testing and automated content development.
Provides a method of creating problems that is easily accessible even to the average instructor.
Limitations:
Further research is needed to determine the generality and scalability of the proposed method.
Applicability to various types of physics problems needs to be verified.
Potential platform limitations due to dependency on Python code interpreter.
Further evaluation of the educational effectiveness of the problems created is needed.
👍