This paper is a comprehensive survey paper on the impact of large-scale language models (LLMs) on academia, especially on the process of academic paper review. It addresses the potential of automated academic paper review (ASPR) using LLMs, along with new issues and challenges. It reviews models used in LLM-based ASPR, technical bottlenecks addressed, new methodologies, datasets, source codes, and online systems, and discusses the performance and challenges of LLMs, responses from publishers and academics, and future challenges and directions. It aims to inspire researchers and promote the development of ASPR for practical implementation.