Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Net2Brain: A Toolbox to compare artificial vision models with human brain responses

Created by
  • Haebom

Author

Domenic Bersch, Kshitij Dwivedi, Martina Vilas, Radoslaw M. Cichy, Gemma Roig

Outline

Net2Brain is a graphical and command-line user interface toolbox for comparing the representational spaces of deep neural networks (DNNs) with human EEG recordings. Unlike existing toolboxes that support only a single function or focus on a small subset of supervised image classification models, Net2Brain extracts activations from over 600 DNNs trained to perform various vision-related tasks (e.g., semantic segmentation, depth estimation, action recognition, etc.) from image and video datasets. The toolbox computes a representational similarity matrix (RDM) for these activations and compares them to EEG recordings using a representational similarity analysis (RSA) using specific regions of interest (ROIs) and searchlight search, as well as a weighted RSA. Furthermore, new stimulus and EEG recording datasets can be added to the toolbox for evaluation. This paper demonstrates the capabilities and advantages of Net2Brain through an example demonstrating how to test hypotheses in cognitive computational neuroscience.

Takeaways, Limitations

Takeaways: Provides a comprehensive toolbox for comparing the representational spaces of various DNNs and EEG recordings. Supports various analysis methods using RSA and weighted RSA. New datasets can be added. Provides a useful tool for cognitive computational neuroscience research.
Limitations: Currently focused on vision-related tasks. Lack of support for other modalities (e.g., auditory). Long-term planning is needed for toolbox scalability and maintenance. Potential bias toward specific DNN architectures or datasets.
👍