Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Autonomy by Design: Preserving Human Autonomy in AI Decision-Support

Created by
  • Haebom

Author

Stefan Buijsman, Sarah E. Carter, Juan Pablo Bermudez

Outline

This paper analyzes the impact of AI systems on domain-specific autonomy (the ability to act autonomously within a specific domain of skills or expertise) in situations where AI systems support human decision-making in professional, technical, and personal domains. In particular, we focus on two key elements of domain-specific autonomy: skilled competence (the ability to make informed judgments within a given domain) and true value formation (the ability to form true values and preferences related to a domain). Through empirical case studies in healthcare, finance, and education, we demonstrate that the absence of reliable error indicators and the potential for unconscious value changes can erode domain-specific autonomy in the short and long term. Furthermore, we present a compositional framework for AI-assisted systems that preserve autonomy, and provide concrete guidance for developing AI systems that enhance rather than diminish human agency within specialized domains of action through sociotechnical design patterns such as role specification, implementation of override mechanisms, and support for reflective practice.

Takeaways, Limitations

Takeaways:
Provides an in-depth analysis of the impact of AI on domain-specific autonomy.
We reveal that the absence of reliable error indicators and unconscious value changes are major causes of autonomy erosion.
We present specific sociotechnical design patterns for designing AI-enabled systems that preserve autonomy.
The validity of research results is enhanced through empirical cases in various fields such as medicine, finance, and education.
Limitations:
There is a lack of validation of the practical effectiveness of the proposed sociotechnical design patterns.
Further discussion is needed on the definition and measurement of domain-specific autonomy.
There may be a lack of consideration of diverse cultural and social contexts.
Sufficient consideration is needed for the complexity and uncertainty of AI systems.
👍