Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systems

Created by
  • Haebom

Author

Shaina Raza, Ranjan Sapkota, Manoj Karkee, Christos Emmanuilidis

Outline

This paper presents a structural analysis of trust, risk, and security management (TRiSM) in agent-based multi-agent systems (AMAS) based on large-scale language models (LLMs). We investigate the conceptual foundations of agent AI, highlighting its structural differences from traditional AI agents, and apply and extend the AI TRiSM framework for agent AI centered on four core pillars: explainability, ModelOps, security, privacy, and governance. We propose a novel risk classification scheme to capture the unique threats and vulnerabilities of agent AI (ranging from failures of collaboration to prompt-based adversarial manipulation), and introduce two new metrics: component synergy score (CSS) and tool utilization effectiveness (TUE) to support practical evaluation of agent AI tasks. We also discuss strategies to improve the explainability of agent AI, and ways to enhance security and privacy through encryption, adversarial robustness, and regulatory compliance. Finally, we present a research roadmap for responsible development and deployment of agent AI, which provides important directions for aligning emerging systems with TRiSM principles for safe, transparent, and responsible operation.

Takeaways, Limitations

Takeaways:
Providing a systematic analysis framework for TRiSM of LLM-based AMAS
A new risk classification scheme that captures the unique risks of agent AI is presented.
Proposing new metrics (CSS, TUE) to measure the quality of collaboration between agents and the efficiency of tool utilization
Presenting strategies for improving explainability, security, and privacy of agent AI
Presenting a research roadmap for developing and deploying responsible agent AI
Limitations:
Further research is needed on the practical applicability and universality of the presented indicators (CSS, TUE).
Need to verify generalizability to various agent AI systems
Empirical studies are needed on the practical application and effectiveness of the proposed TRiSM framework.
Continuous updates and modifications are needed to address rapidly changing agent AI technology advancements.
👍