Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

AI Risk-Management Standards Profile for General-Purpose AI (GPAI) and Foundation Models

Created by
  • Haebom

Author

Anthony M. Barrett, Jessica Newman, Brandie Nonnecke, Nada Madkour, Dan Hendrycks, Evan R. Murphy, Krystal Jackson, Deepika Raman

Outline

This paper addresses the many benefits and risks of potentially serious adverse outcomes offered by multi-purpose AI models, such as state-of-the-art large-scale language models or other general-purpose AI (GPAI) models, base models, generative AI models, and cutting-edge models (hereafter collectively referred to as “GPAI/base models” except in special cases). It presents risk management methods or controls to identify, analyze, and mitigate risks in GPAI/base models. While the guidance is primarily intended for developers of large-scale, cutting-edge GPAI/base models, downstream developers of end-use applications built on top of GPAI/base models can also benefit from the guidance. Building on the NIST AI Risk Management Framework and the general voluntary guidance of ISO/IEC 23894, it focuses on the unique challenges faced by GPAI/base model developers to facilitate compliance with or use of key AI risk management-related standards.

Takeaways, Limitations

Takeaways: Provides a concrete risk management framework for GPAI/based model development, facilitates compliance and use of standards through alignment with the NIST AI Risk Management Framework and ISO/IEC 23894 standard, and provides useful guidance for both large-scale AI model developers and downstream developers.
Limitations: Lack of empirical verification of the effectiveness of the risk management method presented in the paper, lack of review of the generalizability of the risk management method to a specific type of GPAI/based model, and need for additional research on adaptability to continuously evolving AI technology and long-term effectiveness.
👍