Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

The AlphaPhysics Term Rewriting System for Marking Algebraic Expressions in Physics Exams

Created by
  • Haebom

Author

Peter Baumgartner, Lachlan McGinness

Outline

This paper presents a method for automating physics exam grading by combining a computer algebra system, an SMT solver, and a term rewriting system. A large-scale language model (LLM) is used to remove errors from student answers and rewrite them in a machine-readable format. The accuracy of these answers is then assessed using automated theorem-proving techniques (SMT solving and a term rewriting system tailored to physics problems). The system is evaluated using over 1,500 real student answers from the 2023 Australian Physics Olympiad. In particular, a detailed description of the development of the term rewriting system and the establishment of its finality and confluence properties is provided.

Takeaways, Limitations

Takeaways:
A New Method for Automating Physics Exam Grading
Effective combination of LLM, SMT solver, and term rewriting system
Experimental validation using a large-scale real-world dataset
Application of automatic theorem proof techniques to solving physics problems
Limitations:
Difficulties in developing and characterizing a rewriting system
Dependence on the accuracy of LLM
Possible bias for certain types of physics problems
Further research is needed to determine the generalizability of the system.
👍