Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

Pyhgf: A neural network library for predictive coding

Created by
  • Haebom

Author

Nicolas Legrand, Lilian Weber, Peter Thestrup Waade, Anna Hedvig M{\o}ller Daugaard, Mojtaba Khodadadi, Nace Miku\v{s}, Chris Mathys

Outline

This paper focuses on applying Bayesian models from cognitive science to artificial intelligence. Specifically, based on predictive coding theory, we propose a model that explains learning and behavior through hierarchical probabilistic inference about the causes of sensory input. Considering biological realism, we utilize precision-weighted predictions and prediction errors based on simple local computations. To overcome the limitations of existing neural network libraries, we introduce pyhgf , a Python package based on JAX and Rust. pyhgf encapsulates network components as transparent, modular, and mutable variables during message passing, enabling the implementation of arbitrarily complex computations. Furthermore, adapting the network structure enables inference processes utilizing self-organization principles, structural learning, meta-learning, and causal inference.

Takeaways, Limitations

Takeaways:
Providing a new predictive coding model implementation framework that overcomes the limitations of existing neural network libraries.
Suggests the possibility of implementing higher-order cognitive functions such as self-organization, meta-learning, and causal inference.
Implementing efficient models that satisfy biologically realistic constraints.
Improved accessibility and reproducibility through the pyhgf package.
Limitations:
Additional experimental verification of the performance and scalability of pyhgf is needed.
Further research is needed to determine the generalizability of modeling to complex cognitive processes.
Lack of comparative analysis with other predictive coding frameworks.
👍