Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

WALL: A Web Application for Automated Quality Assurance using Large Language Models

Created by
  • Haebom

Author

Seyed Moein Abtahi, Akramul Azim

Outline

This paper presents WALL, a web application that integrates SonarQube with large-scale language models (LLMs), such as GPT-3.5 Turbo and GPT-4, to address the challenges of code issue management amidst the increasing complexity of software projects. WALL provides an automated pipeline for code issue detection, remediation, and evaluation, consisting of three modules: issue extraction, code remediation, and code comparison. Experimental results on 563 files and over 7,599 issues demonstrate that WALL reduces human input while maintaining high-quality fixes. A hybrid approach utilizing cost-effective LLMs and advanced LLMs achieves cost savings and improved remediation rates. Future research aims to fully automate code quality management by integrating open-source LLMs and eliminating human intervention.

Takeaways, Limitations

Takeaways:
Integrating SonarQube with LLM presents the potential for automating and improving the efficiency of software issue management.
A hybrid approach of cost-effective LLM and advanced LLM to demonstrate cost savings and improved revision rates.
Presenting the possibility of building a fully automated code quality management system.
Limitations:
Currently, there is no integration of open source LLMs, and some human intervention exists.
Further review of the size and diversity of the experimental dataset is needed.
Further research is needed to determine generalizability across different types of software projects and programming languages.
👍