This paper argues that the deployment of capable AI agents raises new questions about safety, human-machine relationships, and social coordination. It argues that scientists, academics, engineers, and policymakers must become more engaged with the implications of a world increasingly populated by AI agents. It explores key challenges that must be addressed to ensure that interactions between humans and agents, and among agents, are broadly beneficial.