Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

A Meta-Analysis of LLM Effects on Students across Qualification, Socialization, and Subjectification

Created by
  • Haebom

Author

Jiayu Huang, Ruoxin Ritter Wang, Jen-Hao Liu, Boming Xia, Yue Huang, Ruoxi Sun, Jason Minhui Xue, Jinan Zou

Outline

A meta-analysis of the impact of LLMs on education. Based on Biesta's three-fold construct of good education (qualification, socialization, and subjectivation), 133 experimental and quasi-experimental studies (k = 188) were analyzed. Overall, positive effects were observed, but the effect on qualification was particularly strong when a tutor was present. Socialization was variable, and subjectivation was improved only in small-scale, long-term studies. Without a structure for engagement and subjectivation, LLMs may focus on easily measurable aspects and overlook the broader goals of education. It is crucial to question not only the effectiveness of LLMs in HCI and education, but also the future they enable.

Takeaways, Limitations

Takeaways:
An LLM can have a positive impact on your educational qualifications, especially if you are working in a tutoring role.
Through continuous and reflective intervention, we can also expect positive effects in terms of socialization.
Aspects of subjectivation related to subjectivity and learner development showed limited improvement in small, long-term studies.
When designing an LLM to achieve educational goals, structures for participation and agency are important.
Limitations:
The educational impact of LLMs is not uniform and varies depending on the type and design of the intervention.
The effects on subjectivation are limited and require further research.
An LLM may focus on easily measurable aspects of achieving the broader goals of education.
👍