Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Learning Equivariant Functions via Quadratic Forms

Created by
  • Haebom

Author

Pavan Karjol, Vivek V Kashyap, Rohan Kashyap, Prathosh A.P.

Introduction to learning group isovean functions

Outline

In this paper, we present a method for learning group isomorphic functions by learning a quadratic form $x^TA x$ corresponding to a group (known or unknown) from data. We exploit this by assuming that the underlying symmetry group is orthogonal, assuming that the underlying symmetry group is orthogonal. Using the corresponding eigensymmetric matrix and eigendiagonal form, we develop a simple and efficient model by incorporating appropriate inductive biases into the neural network architecture. This approach yields norm-preserving invariant models, which are expressed as the product of a norm-invariant model and a scale-invariant model, where "product" denotes a group action. Furthermore, we extend this approach to the more general setting of applying diagonal (or multiplicative) group actions to tuples of input vectors. In this extension, the isomorphic function is decomposed into angular components extracted from the normalized first vector and scale-invariant components that depend on the entire Gram matrix of the tuple. This decomposition captures interdependencies between multiple inputs while preserving the underlying group symmetry. We evaluate the effectiveness of our framework on several tasks, including polynomial regression, top-quark tagging, and moment of inertia matrix prediction. Comparative analysis with baseline methods demonstrates that our model consistently outperforms baseline methods in discovering underlying symmetries and efficiently learning corresponding isoval functions.

Takeaways, Limitations

Takeaways:
We present a novel method for learning group symmetry directly from data.
Building efficient equilateral models by leveraging the properties of orthogonal groups.
Extending the flexibility of the model through common settings for input tuples.
Demonstrated performance excellence in a variety of real-world tasks.
Limitations:
Valid only if the assumption about orthogonal groups is applicable.
The possibility of computational costs associated with learning the second form.
Further research is needed on the model's generalization ability.
👍