Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Can AI be Auditable?

Created by
  • Haebom

Author

Himanshu Verma, Kirtan Padh, Eva Thelisson

Outline

This paper addresses the debate on the auditability of artificial intelligence (AI) systems. Auditability refers to the ability to independently assess compliance with ethical, legal, and technical standards throughout the AI system's lifecycle. It explores how emerging regulatory frameworks, such as the EU AI Act, are formalizing auditability and mandating documentation, risk assessment, and governance structures. It also analyzes various challenges facing AI auditability, including technical opacity, inconsistent documentation practices, a lack of standardized audit tools and metrics, and conflicting principles within existing responsible AI frameworks. It emphasizes the need for clear guidelines, harmonized international regulations, and robust socio-technical methodologies for implementing auditability at scale, and emphasizes the importance of multi-stakeholder collaboration and auditor capacity building to build an effective AI audit ecosystem. It argues for the integration of auditability into AI development practices and governance infrastructure to ensure that AI systems are not only functional but also ethically and legally compliant.

Takeaways, Limitations

Takeaways:
Emerging regulatory frameworks, such as the EU AI Act, demonstrate that the auditability of AI systems is becoming more formalized.
It suggests the need for clear guidelines, harmonized international regulations, and robust socio-technical methodologies for AI auditability.
Emphasizes the importance of building an effective AI audit ecosystem through multi-stakeholder cooperation and strengthening auditor capacity.
We argue that auditability should be integrated into AI development practices and governance infrastructure.
Limitations:
Lack of suggestions for specific audit tools and metrics.
There is a lack of concrete discussions on ways to cooperate among various stakeholders.
There is a lack of practical measures to achieve international regulatory harmonization.
Lack of specific descriptions of socio-technical methodologies for AI auditability.
👍