This paper proposes a novel audit framework to address the lack of systematic understanding of the labor market implications of the rapid development of complex artificial intelligence systems (AI agents). The framework assesses the alignment between tasks that workers want to be automated or augmented by AI agents and their current technical capabilities. We capture subtle worker desires through audio-enhanced mini-interviews and introduce the Human Agency Scale (HAS) to quantify the level of human involvement. We collect the preferences of 1,500 domain workers and AI expert competency ratings for over 844 tasks across 104 occupations from the WORKBank database, built on the U.S. Department of Labor’s O*NET database. By considering desires and technical capabilities together, we categorize tasks into automation “green light” zones, automation “red light” zones, R&D opportunity zones, and low priority zones. Beyond a simple automation-or-nothing dichotomy, we show diverse HAS profiles across occupations, reflecting heterogeneous expectations of human involvement. We also provide early signals of how the integration of AI agents may reconfigure core human competencies from information-centric to interpersonal skills. In conclusion, we emphasize the importance of tailoring AI agent development to human needs and preparing for changing workplace dynamics.