-
A Dynamic Fuzzy Rule and Attribute Management Framework for Fuzzy Inference Systems in High-Dimensional Data
Authors:
Ke Liu,
Jing Ma,
Edmund M-K Lai
Abstract:
This paper presents an Adaptive Dynamic Attribute and Rule (ADAR) framework designed to address the challenges posed by high-dimensional data in neuro-fuzzy inference systems. By integrating dual weighting mechanisms-assigning adaptive importance to both attributes and rules-together with automated growth and pruning strategies, ADAR adaptively streamlines complex fuzzy models without sacrificing…
▽ More
This paper presents an Adaptive Dynamic Attribute and Rule (ADAR) framework designed to address the challenges posed by high-dimensional data in neuro-fuzzy inference systems. By integrating dual weighting mechanisms-assigning adaptive importance to both attributes and rules-together with automated growth and pruning strategies, ADAR adaptively streamlines complex fuzzy models without sacrificing performance or interpretability. Experimental evaluations on four diverse datasets - Auto MPG (7 variables), Beijing PM2.5 (10 variables), Boston Housing (13 variables), and Appliances Energy Consumption (27 variables) show that ADAR-based models achieve consistently lower Root Mean Square Error (RMSE) compared to state-of-the-art baselines. On the Beijing PM2.5 dataset, for instance, ADAR-SOFENN attained an RMSE of 56.87 with nine rules, surpassing traditional ANFIS [12] and SOFENN [16] models. Similarly, on the high-dimensional Appliances Energy dataset, ADAR-ANFIS reached an RMSE of 83.25 with nine rules, outperforming established fuzzy logic approaches and interpretability-focused methods such as APLR. Ablation studies further reveal that combining rule-level and attribute-level weight assignment significantly reduces model overlap while preserving essential features, thereby enhancing explainability. These results highlight ADAR's effectiveness in dynamically balancing rule complexity and feature importance, paving the way for scalable, high-accuracy, and transparent neuro-fuzzy systems applicable to a range of real-world scenarios.
△ Less
Submitted 27 April, 2025;
originally announced April 2025.
-
Residual Learning Inspired Crossover Operator and Strategy Enhancements for Evolutionary Multitasking
Authors:
Ruilin Wang,
Xiang Feng,
Huiqun Yu,
Edmund M-K Lai
Abstract:
In evolutionary multitasking, strategies such as crossover operators and skill factor assignment are critical for effective knowledge transfer. Existing improvements to crossover operators primarily focus on low-dimensional variable combinations, such as arithmetic crossover or partially mapped crossover, which are insufficient for modeling complex high-dimensional interactions.Moreover, static or…
▽ More
In evolutionary multitasking, strategies such as crossover operators and skill factor assignment are critical for effective knowledge transfer. Existing improvements to crossover operators primarily focus on low-dimensional variable combinations, such as arithmetic crossover or partially mapped crossover, which are insufficient for modeling complex high-dimensional interactions.Moreover, static or semi-dynamic crossover strategies fail to adapt to the dynamic dependencies among tasks. In addition, current Multifactorial Evolutionary Algorithm frameworks often rely on fixed skill factor assignment strategies, lacking flexibility. To address these limitations, this paper proposes the Multifactorial Evolutionary Algorithm-Residual Learning (MFEA-RL) method based on residual learning. The method employs a Very Deep Super-Resolution (VDSR) model to generate high-dimensional residual representations of individuals, enhancing the modeling of complex relationships within dimensions. A ResNet-based mechanism dynamically assigns skill factors to improve task adaptability, while a random mapping mechanism efficiently performs crossover operations and mitigates the risk of negative transfer. Theoretical analysis and experimental results show that MFEA-RL outperforms state-of-the-art multitasking algorithms. It excels in both convergence and adaptability on standard evolutionary multitasking benchmarks, including CEC2017-MTSO and WCCI2020-MTSO. Additionally, its effectiveness is validated through a real-world application scenario.
△ Less
Submitted 27 March, 2025;
originally announced March 2025.
-
AaKOS: Aspect-adaptive Knowledge-based Opinion Summarization
Authors:
Guan Wang,
Weihua Li,
Edmund M-K. Lai,
Quan Bai
Abstract:
The rapid growth of information on the Internet has led to an overwhelming amount of opinions and comments on various activities, products, and services. This makes it difficult and time-consuming for users to process all the available information when making decisions. Text summarization, a Natural Language Processing (NLP) task, has been widely explored to help users quickly retrieve relevant in…
▽ More
The rapid growth of information on the Internet has led to an overwhelming amount of opinions and comments on various activities, products, and services. This makes it difficult and time-consuming for users to process all the available information when making decisions. Text summarization, a Natural Language Processing (NLP) task, has been widely explored to help users quickly retrieve relevant information by generating short and salient content from long or multiple documents. Recent advances in pre-trained language models, such as ChatGPT, have demonstrated the potential of Large Language Models (LLMs) in text generation. However, LLMs require massive amounts of data and resources and are challenging to implement as offline applications. Furthermore, existing text summarization approaches often lack the ``adaptive" nature required to capture diverse aspects in opinion summarization, which is particularly detrimental to users with specific requirements or preferences. In this paper, we propose an Aspect-adaptive Knowledge-based Opinion Summarization model for product reviews, which effectively captures the adaptive nature required for opinion summarization. The model generates aspect-oriented summaries given a set of reviews for a particular product, efficiently providing users with useful information on specific aspects they are interested in, ensuring the generated summaries are more personalized and informative. Extensive experiments have been conducted using real-world datasets to evaluate the proposed model. The results demonstrate that our model outperforms state-of-the-art approaches and is adaptive and efficient in generating summaries that focus on particular aspects, enabling users to make well-informed decisions and catering to their diverse interests and preferences.
△ Less
Submitted 25 May, 2023;
originally announced June 2023.
-
Enhanced Particle Swarm Optimization Algorithms for Multiple-Input Multiple-Output System Modelling using Convolved Gaussian Process Models
Authors:
Gang Cao,
Edmund M-K Lai,
Fakhrul Alam
Abstract:
Convolved Gaussian Process (CGP) is able to capture the correlations not only between inputs and outputs but also among the outputs. This allows a superior performance of using CGP than standard Gaussian Process (GP) in the modelling of Multiple-Input Multiple-Output (MIMO) systems when observations are missing for some of outputs. Similar to standard GP, a key issue of CGP is the learning of hype…
▽ More
Convolved Gaussian Process (CGP) is able to capture the correlations not only between inputs and outputs but also among the outputs. This allows a superior performance of using CGP than standard Gaussian Process (GP) in the modelling of Multiple-Input Multiple-Output (MIMO) systems when observations are missing for some of outputs. Similar to standard GP, a key issue of CGP is the learning of hyperparameters from a set of input-output observations. It typically performed by maximizing the Log-Likelihood (LL) function which leads to an unconstrained nonlinear and non-convex optimization problem. Algorithms such as Conjugate Gradient (CG) or Broyden-Fletcher-Goldfarb-Shanno (BFGS) are commonly used but they often get stuck in local optima, especially for CGP where there are more hyperparameters. In addition, the LL value is not a reliable indicator for judging the quality intermediate models in the optimization process. In this paper, we propose to use enhanced Particle Swarm Optimization (PSO) algorithms to solve this problem by minimizing the model output error instead. This optimization criterion enables the quality of intermediate solutions to be directly observable during the optimization process. Two enhancements to the standard PSO algorithm which make use of gradient information and the multi- start technique are proposed. Simulation results on the modelling of both linear and nonlinear systems demonstrate the effectiveness of minimizing the model output error to learn hyperparameters and the performance of using enhanced algorithms.
△ Less
Submitted 12 July, 2017;
originally announced September 2017.
-
A Low Complexity Spectrum Sensing Scheme for Estimating Frequency Band Edges in Multi-Standard Military Communication Receivers
Authors:
S. J. Darak,
A. P. Vinod,
E. M-K. Lai
Abstract:
In a typical multi-standard military communication receiver, fast and reliable spectrum sensing unit is required to extract the information of multiple channels (frequency bands) present in a wideband input signal. In this paper, an energy detector based on our reconfigurable filter bank, in [5], for detecting the edge frequencies of the channels is proposed. Simulation results are presented to sh…
▽ More
In a typical multi-standard military communication receiver, fast and reliable spectrum sensing unit is required to extract the information of multiple channels (frequency bands) present in a wideband input signal. In this paper, an energy detector based on our reconfigurable filter bank, in [5], for detecting the edge frequencies of the channels is proposed. Simulation results are presented to show the trade-off between the time required to calculate edge frequencies of all the channels and the maximum normalized error in estimating the edge frequencies. The proposed method is compared with existing energy detector methods for complexity and performance. It is shown that, for a fixed number of input samples, error decreases with time in the proposed algorithm as compared to other methods where error is constant. Design examples and simulations show that the complexity of the proposed method is lower than the other methods for a given error in estimating the edge frequencies
△ Less
Submitted 14 August, 2016;
originally announced August 2016.
-
Design of Variable Bandpass Filters Using First Order Allpass Transformation And Coefficient Decimation
Authors:
S. J. Darak,
A. P. Vinod,
E. M-K. Lai
Abstract:
In this paper, the design of a computationally efficient variable bandpass digital filter is presented. The center frequency and bandwidth of this filter can be changed online without updating the filter coefficients. The warped filters, obtained by replacing each unit delay of a digital filter with an allpass filter, are widely used for various audio processing applications. However, warped filte…
▽ More
In this paper, the design of a computationally efficient variable bandpass digital filter is presented. The center frequency and bandwidth of this filter can be changed online without updating the filter coefficients. The warped filters, obtained by replacing each unit delay of a digital filter with an allpass filter, are widely used for various audio processing applications. However, warped filters fail to provide variable bandwidth bandpass responses for a given center frequency using first order allpass transformation. To overcome this drawback, our design is accomplished by combining warped filter with the coefficient decimation technique. The design example shows that the proposed variable digital filter is simple to design and offers a total gate count reduction of 36% and 65% over the warped filters compared to the designs presented in [3] and [1] respectively
△ Less
Submitted 14 August, 2016;
originally announced August 2016.
