Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Large language models for automated scholarly paper review: A survey

Created by
  • Haebom

Author

Zhenzhen Zhuang, Jiandong Chen, Hongfeng Xu, Yuwen Jiang, Jialiang Lin

Outline

This paper is a comprehensive survey paper on the impact of large-scale language models (LLMs) on academia, especially on the process of academic paper review. It addresses the potential of automated academic paper review (ASPR) using LLMs, along with new issues and challenges. It reviews models used in LLM-based ASPR, technical bottlenecks addressed, new methodologies, datasets, source codes, and online systems, and discusses the performance and challenges of LLMs, responses from publishers and academics, and future challenges and directions. It aims to inspire researchers and promote the development of ASPR for practical implementation.

Takeaways, Limitations

Takeaways:
You can comprehensively understand the current status and potential of ASPR by utilizing LLM.
It clearly presents the technical issues resolved and remaining tasks in ASPR development.
You can learn about the latest trends in LLM-based ASPR methodologies, datasets, systems, etc.
By analyzing the attitudes and reactions of the academic and publishing world toward ASPR, we suggest future directions for development.
Limitations:
Since this paper is based on a questionnaire, it may lack an objective evaluation of the actual effectiveness of LLM-based ASPR.
There may be a lack of in-depth discussion of the bias, reliability, and ethical issues of LLMs.
There may be a lack of specific strategies for the actual implementation and application of ASPR.
👍