Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Generating Novelty in Open-World Multi-Agent Strategic Board Games

Created by
  • Haebom

Author

Mayank Kejriwal, Shilpa Thomas

Outline

GNOME (Generating Novelty in Open-world Multi-agent Environments) is an experimental platform designed to test the effectiveness of multi-agent AI systems when faced with novel situations (novelty). It separates the development of AI game-playing agents from the simulator, allowing for unexpected novelty (novelty that is not affected by model selection bias). GNOME, which uses a web GUI, was demonstrated at NeurIPS 2020 using the Monopoly game to stimulate open discussion about AI robustness and the nature of novelty in real-world environments. In this paper, we detail the key elements of that demonstration and provide an overview of the experimental design that is currently being used by external teams developing novelty-adaptive game-playing agents under the DARPA SAIL-ON program.

Takeaways, Limitations

Takeaways:
We present GNOME, a new platform for robustness evaluation of novelties in multi-agent AI systems.
Evaluate the true robustness of AI systems by generating unexpected novelties without model selection bias.
Facilitating participation and open discussion among diverse researchers through web GUI-based accessibility.
Validation of practical applicability through linkage with the DARPA SAIL-ON program.
Limitations:
The current experimental design is limited to the Monopoly game. It needs to be expanded to various games and environments.
Further research is needed on the generalizability of the GNOME platform and its applicability to other domains.
There is a need to establish clear criteria for defining and measuring “unanticipated novelty.”
👍