Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

SHERLOCK: Towards Dynamic Knowledge Adaptation in LLM-enhanced E-commerce Risk Management

Created by
  • Haebom

Author

Nan Lu, Yurong Hu, Jiaquan Fang, Yan Liu, Rui Dong, Yiming Wang, Rui Lin, Shaoyi Xu

Outline

As the growth of the e-commerce industry intensifies the conflict between shadow economy actors and risk management teams, we propose the SHERLOCK framework, which leverages the inference capabilities of large-scale language models (LLMs) to support risk analysis. This framework extracts risk management knowledge from multi-modal data, builds a domain knowledge base (KB), and builds an intelligent platform that integrates operations, expert annotations, and model evaluation based on the data flywheel paradigm. It also introduces the Reflect & Refine (R&R) module to establish a rapid response mechanism to evolving risk patterns. Experiments on JD.com's real-world transaction dataset demonstrate that SHERLOCK significantly improves the accuracy of fact alignment and risk location in LLM analysis results. Deploying the SHERLOCK-based LLM system on JD.com significantly enhances the efficiency of risk managers' case investigation workflows.

Takeaways, Limitations

Takeaways:
Leverage your LLM to improve the effectiveness of your risk management analysts.
Strengthen risk detection and response capabilities through knowledge base construction, intelligent platform, and R&R modules.
The effectiveness of the methodology was verified through experiments using real transaction datasets.
Improve workflow efficiency by applying it to actual service environments.
Limitations:
The paper lacks specific technical details (e.g., LLM model, dataset size, exact performance improvement figures, etc.).
There is a lack of specific discussion on its applicability in a general e-commerce environment.
No comparative analysis with other risk management methodologies is presented.
👍