Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Compact Rule-Based Classifier Learning via Gradient Descent

Created by
  • Haebom

Author

Javier Fumanal-Idocin, Raquel Fernandez-Peralta, Javier Andreu-Perez

Outline

This paper proposes a novel gradient-based rule learning system, the Fuzzy Rule-based Reasoner (FRR), to address optimization and scalability challenges while maintaining the transparency and interpretability of rule-based models. Unlike existing neurofuzzy approaches, FRR maximizes interpretability by utilizing semantically meaningful fuzzy logic segmentation and sufficient (single-rule) decision-making. Through extensive evaluations on 40 datasets, FRR demonstrates superior performance over existing rule-based methods (with an average accuracy improvement of 5% over RIPPER), comparable accuracy to tree-based models (using a 90% smaller rule base), and achieving 96% of the accuracy of state-of-the-art additive rule-based models (using only 3% of the rule base size).

Takeaways, Limitations

Takeaways:
A novel method is presented to simultaneously improve the interpretability and performance of rule-based models.
Provides more efficient and competitive performance than existing rule-based and tree-based models.
High interpretability through semantically meaningful fuzzy logic segmentation.
Reduce complexity and improve scalability through single-rule decision making.
Limitations:
Generalization performance needs to be verified on datasets other than the 40 presented.
Further explanation and verification of the semantic meaning of fuzzy logic partitioning is needed.
Further research is needed on performance and stability when applied to actual high-risk decision-making systems.
👍