[공지사항]을 빙자한 안부와 근황 
Show more

Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Buggy rule diagnosis for combined steps through final answer evaluation in stepwise tasks

Created by
  • Haebom

Author

Gerben van der Hoek, Johan Jeuring, Rogier Bos

Outline

This paper is a study on solving combinatorial explosion problems that occur when students combine multiple steps into one in an intelligent tutoring system that supports step-by-step problem solving. In order to overcome the limitations of the existing method of analyzing the connection between continuous inputs as a single rule, we propose an error diagnosis approach using the final answer. We designed a service that diagnoses error rules based on the final answer, and evaluated its performance by applying it to the quadratic equation solving process (n=1939) dataset. As a result, 29.4% of the steps could be diagnosed through the final answer evaluation, and the agreement rate with the teacher diagnosis (n=115) was 97%.

Takeaways, Limitations

Takeaways: We demonstrate that a final-answer-based error diagnosis approach is effective in alleviating combinatorial explosion problems in intelligent tutoring systems. It enables diagnosis of a significant portion of student errors that were not diagnosable by conventional methods. It shows high agreement with teacher diagnosis.
Limitations: The percentage of diagnosable errors based on the final answer-based diagnosis is limited to 29.4%. The dataset is limited to quadratic equation solutions, which limits the generalizability to other types of tasks. Further research on larger datasets and various types of tasks is needed.
👍