Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

FinSphere, a Real-Time Stock Analysis Agent Powered by Instruction-Tuned LLMs and Domain Tools

Created by
  • Haebom

Author

Shijie Han, Jingshu Zhang, Yiqing Shen, Kaiyuan Yan, Hongguang Li

Outline

In this paper, we present FinSphere, a stock analysis agent, to overcome two major limitations: the absence of objective evaluation metrics for assessing the quality of stock analysis reports and the lack of depth in stock analysis that hinders the generation of expert-level insights. FinSphere consists of AnalyScore, a systematic evaluation framework for assessing stock analysis quality; Stocksis, a dataset curated by industry experts to enhance the stock analysis capabilities of LLM; and FinSphere itself, an AI agent that can generate high-quality stock analysis reports in response to user queries. Experimental results show that FinSphere achieves superior performance compared to existing agent-based systems as well as improved general and domain-specific LLMs with real-time data access and few-shot guidance. Combining real-time data feeds, quantitative tools, and fine-tuned LLMs with instructions, the integrated framework significantly improves the analysis quality and practicality for real-world stock analysis.

Takeaways, Limitations

Takeaways:
Introducing a new evaluation framework (AnalyScore) that can objectively evaluate the quality of stock analysis reports.
Providing expert-curated datasets (Stocksis) to improve LLM's stock analysis performance.
Development of a high-performance stock analysis agent (FinSphere) integrating real-time data, quantitative tools, and fine-tuned LLM.
Demonstrated superior stock analysis performance compared to existing systems.
Contributes to improving the analysis quality and practicality of actual stock analysis.
Limitations:
Further research is needed on the generalizability and versatility of AnalyScore.
The Stocksis dataset needs to be expanded in size and diversity.
Additional validation of FinSphere's long-term performance and stability is needed.
Lack of evaluation of actual investment performance, such as forecast accuracy and returns.
Lack of consideration of model bias and ethical issues.
👍