-
Crisp complexity of fuzzy classifiers
Authors:
Raquel Fernandez-Peralta,
Javier Fumanal-Idocin,
Javier Andreu-Perez
Abstract:
Rule-based systems are a very popular form of explainable AI, particularly in the fuzzy community, where fuzzy rules are widely used for control and classification problems. However, fuzzy rule-based classifiers struggle to reach bigger traction outside of fuzzy venues, because users sometimes do not know about fuzzy and because fuzzy partitions are not so easy to interpret in some situations. In…
▽ More
Rule-based systems are a very popular form of explainable AI, particularly in the fuzzy community, where fuzzy rules are widely used for control and classification problems. However, fuzzy rule-based classifiers struggle to reach bigger traction outside of fuzzy venues, because users sometimes do not know about fuzzy and because fuzzy partitions are not so easy to interpret in some situations. In this work, we propose a methodology to reduce fuzzy rule-based classifiers to crisp rule-based classifiers. We study different possible crisp descriptions and implement an algorithm to obtain them. Also, we analyze the complexity of the resulting crisp classifiers. We believe that our results can help both fuzzy and non-fuzzy practitioners understand better the way in which fuzzy rule bases partition the feature space and how easily one system can be translated to another and vice versa. Our complexity metric can also help to choose between different fuzzy classifiers based on what the equivalent crisp partitions look like.
△ Less
Submitted 22 April, 2025;
originally announced April 2025.
-
Fuzzy Implicative Rules: A Unified Approach
Authors:
Raquel Fernandez-Peralta
Abstract:
Rule mining algorithms are one of the fundamental techniques in data mining for disclosing significant patterns in terms of linguistic rules expressed in natural language. In this paper, we revisit the concept of fuzzy implicative rule to provide a solid theoretical framework for any fuzzy rule mining algorithm interested in capturing patterns in terms of logical conditionals rather than the co-oc…
▽ More
Rule mining algorithms are one of the fundamental techniques in data mining for disclosing significant patterns in terms of linguistic rules expressed in natural language. In this paper, we revisit the concept of fuzzy implicative rule to provide a solid theoretical framework for any fuzzy rule mining algorithm interested in capturing patterns in terms of logical conditionals rather than the co-occurrence of antecedent and consequent. In particular, we study which properties should satisfy the fuzzy operators to ensure a coherent behavior of different quality measures. As a consequence of this study, we introduce a new property of fuzzy implication functions related to a monotone behavior of the generalized modus ponens for which we provide different valid solutions. Also, we prove that our modeling generalizes others if an adequate choice of the fuzzy implication function is made, so it can be seen as an unifying framework. Further, we provide an open-source implementation in Python for mining fuzzy implicative associative rules. We test the applicability and relevance of our framework for different real datasets and fuzzy operators.
△ Less
Submitted 3 April, 2025;
originally announced April 2025.
-
A Comprehensive Survey of Fuzzy Implication Functions
Authors:
Raquel Fernandez-Peralta
Abstract:
Fuzzy implication functions are a key area of study in fuzzy logic, extending the classical logical conditional to handle truth degrees in the interval $[0,1]$. While existing literature often focuses on a limited number of families, in the last ten years many new families have been introduced, each defined by specific construction methods and having different key properties. This survey aims to p…
▽ More
Fuzzy implication functions are a key area of study in fuzzy logic, extending the classical logical conditional to handle truth degrees in the interval $[0,1]$. While existing literature often focuses on a limited number of families, in the last ten years many new families have been introduced, each defined by specific construction methods and having different key properties. This survey aims to provide a comprehensive and structured overview of the diverse families of fuzzy implication functions, emphasizing their motivations, properties, and potential applications. By organizing the information schematically, this document serves as a valuable resource for both theoretical researchers seeking to avoid redundancy and practitioners looking to select appropriate operators for specific applications.
△ Less
Submitted 6 February, 2025;
originally announced March 2025.
-
Compact Rule-Based Classifier Learning via Gradient Descent
Authors:
Javier Fumanal-Idocin,
Raquel Fernandez-Peralta,
Javier Andreu-Perez
Abstract:
Rule-based models play a crucial role in scenarios that require transparency and accountable decision-making. However, they primarily consist of discrete parameters and structures, which presents challenges for scalability and optimization. In this work, we introduce a new rule-based classifier trained using gradient descent, in which the user can control the maximum number and length of the rules…
▽ More
Rule-based models play a crucial role in scenarios that require transparency and accountable decision-making. However, they primarily consist of discrete parameters and structures, which presents challenges for scalability and optimization. In this work, we introduce a new rule-based classifier trained using gradient descent, in which the user can control the maximum number and length of the rules. For numerical partitions, the user can also control the partitions used with fuzzy sets, which also helps keep the number of partitions small. We perform a series of exhaustive experiments on $40$ datasets to show how this classifier performs in terms of accuracy and rule base size. Then, we compare our results with a genetic search that fits an equivalent classifier and with other explainable and non-explainable state-of-the-art classifiers. Our results show how our method can obtain compact rule bases that use significantly fewer patterns than other rule-based methods and perform better than other explainable classifiers.
△ Less
Submitted 3 February, 2025;
originally announced February 2025.