Showing 1–7 of 7 results for author: Papadopouli, M

Dynamic Activation with Knowledge Distillation for Energy-Efficient Spiking NN Ensembles

Authors: Orestis Konstantaropoulos, Theodoris Mallios, Maria Papadopouli

Abstract: While foundation AI models excel at tasks like classification and decision-making, their high energy consumption makes them unsuitable for energy-constrained applications. Inspired by the brain's efficiency, spiking neural networks (SNNs) have emerged as a viable alternative due to their event-driven nature and compatibility with neuromorphic chips. This work introduces a novel system that combine… ▽ More While foundation AI models excel at tasks like classification and decision-making, their high energy consumption makes them unsuitable for energy-constrained applications. Inspired by the brain's efficiency, spiking neural networks (SNNs) have emerged as a viable alternative due to their event-driven nature and compatibility with neuromorphic chips. This work introduces a novel system that combines knowledge distillation and ensemble learning to bridge the performance gap between artificial neural networks (ANNs) and SNNs. A foundation AI model acts as a teacher network, guiding smaller student SNNs organized into an ensemble, called Spiking Neural Ensemble (SNE). SNE enables the disentanglement of the teacher's knowledge, allowing each student to specialize in predicting a distinct aspect of it, while processing the same input. The core innovation of SNE is the adaptive activation of a subset of SNN models of an ensemble, leveraging knowledge-distillation, enhanced with an informed-partitioning (disentanglement) of the teacher's feature space. By dynamically activating only a subset of these student SNNs, the system balances accuracy and energy efficiency, achieving substantial energy savings with minimal accuracy loss. Moreover, SNE is significantly more efficient than the teacher network, reducing computational requirements by up to 20x with only a 2% drop in accuracy on the CIFAR-10 dataset. This disentanglement procedure achieves an accuracy improvement of up to 2.4% on the CIFAR-10 dataset compared to other partitioning schemes. Finally, we comparatively analyze SNE performance under noisy conditions, demonstrating enhanced robustness compared to its ANN teacher. In summary, SNE offers a promising new direction for energy-constrained applications. △ Less

Submitted 19 February, 2025; originally announced February 2025.

Adversarial dictionary learning for a robust analysis and modelling of spontaneous neuronal activity

Authors: Eirini Troullinou, Grigorios Tsagkatakis, Ganna Palagina, Maria Papadopouli, Stelios Manolis Smirnakis, Panagiotis Tsakalides

Abstract: The field of neuroscience is experiencing rapid growth in the complexity and quantity of the recorded neural activity allowing us unprecedented access to its dynamics in different brain areas. The objective of this work is to discover directly from the experimental data rich and comprehensible models for brain function that will be concurrently robust to noise. Considering this task from the persp… ▽ More The field of neuroscience is experiencing rapid growth in the complexity and quantity of the recorded neural activity allowing us unprecedented access to its dynamics in different brain areas. The objective of this work is to discover directly from the experimental data rich and comprehensible models for brain function that will be concurrently robust to noise. Considering this task from the perspective of dimensionality reduction, we develop an innovative, robust to noise dictionary learning framework based on adversarial training methods for the identification of patterns of synchronous firing activity as well as within a time lag. We employ real-world binary datasets describing the spontaneous neuronal activity of laboratory mice over time, and we aim to their efficient low-dimensional representation. The results on the classification accuracy for the discrimination between the clean and the adversarial-noisy activation patterns obtained by an SVM classifier highlight the efficacy of the proposed scheme compared to other methods, and the visualization of the dictionary's distribution demonstrates the multifarious information that we obtain from it. △ Less

Submitted 24 December, 2019; v1 submitted 5 November, 2019; originally announced November 2019.

GestureKeeper: Gesture Recognition for Controlling Devices in IoT Environments

Authors: Vasileios Sideridis, Andrew Zacharakis, George Tzagkarakis, Maria Papadopouli

Abstract: This paper introduces and evaluates the GestureKeeper, a robust hand-gesture recognition system based on a wearable inertial measurements unit (IMU). The identification of the time windows where the gestures occur, without relying on an explicit user action or a special gesture marker, is a very challenging task. To address this problem, GestureKeeper identifies the start of a gesture by exploitin… ▽ More This paper introduces and evaluates the GestureKeeper, a robust hand-gesture recognition system based on a wearable inertial measurements unit (IMU). The identification of the time windows where the gestures occur, without relying on an explicit user action or a special gesture marker, is a very challenging task. To address this problem, GestureKeeper identifies the start of a gesture by exploiting the underlying dynamics of the associated time series using a recurrence quantification analysis (RQA). RQA is a powerful method for nonlinear time-series analysis, which enables the detection of critical transitions in the system's dynamical behavior. Most importantly, it does not make any assumption about the underlying distribution or model that governs the data. Having estimated the gesture window, a support vector machine is employed to recognize the specific gesture. Our proposed method is evaluated by means of a small-scale pilot study at FORTH and demonstrated that GestureKeeper can identify correctly the start of a gesture with a 87\% mean balanced accuracy and classify correctly the specific hand-gesture with a mean accuracy of over 96\%. To the best of our knowledge, GestureKeeper is the first automatic hand-gesture identification system based only on accelerometer. The performance analysis reveals the predictive power of the features and the system's robustness in the presence of additive noise. We also performed a sensitivity analysis to examine the impact of various parameters and a comparative analysis of different classifiers (SVM, random forests). Most importantly, the system can be extended to incorporate a large dictionary of gestures and operate without further calibration for a new user. △ Less

Submitted 15 March, 2019; originally announced March 2019.

DysLexML: Screening Tool for Dyslexia Using Machine Learning

Authors: Thomais Asvestopoulou, Victoria Manousaki, Antonis Psistakis, Ioannis Smyrnakis, Vassilios Andreadakis, Ioannis M. Aslanides, Maria Papadopouli

Abstract: Eye movements during text reading can provide insights about reading disorders. Via eye-trackers, we can measure when, where and how eyes move with relation to the words they read. Machine Learning (ML) algorithms can decode this information and provide differential analysis. This work developed DysLexML, a screening tool for developmental dyslexia that applies various ML algorithms to analyze fix… ▽ More Eye movements during text reading can provide insights about reading disorders. Via eye-trackers, we can measure when, where and how eyes move with relation to the words they read. Machine Learning (ML) algorithms can decode this information and provide differential analysis. This work developed DysLexML, a screening tool for developmental dyslexia that applies various ML algorithms to analyze fixation points recorded via eye-tracking during silent reading of children. It comparatively evaluated its performance using measurements collected in a systematic field study with 69 native Greek speakers, children, 32 of which were diagnosed as dyslexic by the official governmental agency for diagnosing learning and reading difficulties in Greece. We examined a large set of features based on statistical properties of fixations and saccadic movements and identified the ones with prominent predictive power, performing dimensionality reduction. Specifically, DysLexML achieves its best performance using linear SVM, with an a accuracy of 97 %, with a small feature set, namely saccade length, number of short forward movements, and number of multiply fixated words. Furthermore, we analyzed the impact of noise on the fixation positions and showed that DysLexML is accurate and robust in the presence of noise. These encouraging results set the basis for developing screening tools in less controlled, larger-scale environments, with inexpensive eye-trackers, potentially reaching a larger population for early intervention. △ Less

Submitted 14 March, 2019; originally announced March 2019.

Multi-layer Game-Theoretical Analysis of Wireless Markets with Market Segmentation

Authors: Georgios Fortetsanakis, Maria Papadopouli

Abstract: New larger and more diverse wireless markets have emerged. Modelling them can be challenging due to various business and network aspects. Existing models of wireless markets are either microscopic, focusing on a specific technical aspect (e.g., network topology) at a fine scale or macroscopic modelling wireless markets at a large-scale, e.g., considering homogeneous populations. In contrast to the… ▽ More New larger and more diverse wireless markets have emerged. Modelling them can be challenging due to various business and network aspects. Existing models of wireless markets are either microscopic, focusing on a specific technical aspect (e.g., network topology) at a fine scale or macroscopic modelling wireless markets at a large-scale, e.g., considering homogeneous populations. In contrast to these approaches, this work develops a multi-layer game-theoretical framework, which allows providers to model users at multiple-level of detail by considering a different number of user sub-populations. It also models the mobility, traffic demand, and networks of providers. A population game using Logit dynamics models the user selection of the dataplan and provider, capturing the diversity in customer profile and relaxing the assumption about the user rationality. It analytically computes the equilibriums of users and providers and numerically evaluates the performance of the market as a function of the traffic demand, the number of available dataplans, and the knowledge about customer population. Significant benefits in revenue can be achieved by a provider when it integrates more detailed information about the user population. The number of disconnected users also decreases. Moreover the availability of several dataplans further enhances the gains. The stronger the provider, the more prominent the benefits. However the benefits diminish when all the providers model the customer population at the same degree of detail due to an increased competition. The analysis highlights the strategies of the providers depending on their capacity, level of knowledge about the customer population, and traffic conditions. It illustrates how a provider changes its strategy under different conditions, focusing potentially on different customer segments and also the pressure introduced by specific customer types. △ Less

Submitted 9 January, 2019; originally announced January 2019.

Should I stay or should I go: Analysis of the impact of application QoS on user engagement in YouTube

Authors: Maria Plakia, Evripides Tzamousis, Thomais Asvestopoulou, Giorgos Pantermakis, Nick Filippakis, Henning Schulzrinne, Yana Kane-Esrig, Maria Papadopouli

Abstract: To improve the quality of experience (QoE), especially under moderate to high traffic demand, it is important to understand the impact of the network and application QoS on user experience. This paper comparatively evaluates the impact of impairments, their intensity and temporal dynamics, on user engagement in the context of video streaming. The analysis employed two large YouTube datasets. To ch… ▽ More To improve the quality of experience (QoE), especially under moderate to high traffic demand, it is important to understand the impact of the network and application QoS on user experience. This paper comparatively evaluates the impact of impairments, their intensity and temporal dynamics, on user engagement in the context of video streaming. The analysis employed two large YouTube datasets. To characterize the user engagement and the impact of impairments, several new metrics were defined. We assessed whether or not there is a statistically significant relationship between different types of impairments and QoE and user engagement metrics, taking into account not only the characteristics of the impairments but also the covariates of the session (e.g., video duration, mean datarate). After observing the relationships across the entire dataset, we tested whether these relationships also persist under specific conditions with respect to the covariates. The introduction of several new metrics and of various covariates in the analysis are two innovative aspects of this work. We found that the number of negative bitrate changes (BR-) is a stronger predictor of abandonment than rebufferrings (RB). Even positive bitrate changes (BR+) are associated with increases in abandonment. Specifically, BR+ in low resolution sessions is not well received. Temporal dynamics of the impairments have also an impact: a BR- that follows much later a RB appears to be perceived as a worse impairment than a BR- that occurs immediately after a RB. These results can be used to guide the design of the video streaming adaptation as well as suggest which parameters should be varied in controlled field studies. △ Less

Submitted 15 March, 2019; v1 submitted 6 January, 2019; originally announced January 2019.

On hybrid modular recommendation systems for video streaming

Authors: Evripidis Tzamousis, Maria Papadopouli

Abstract: The recommendation systems aim to improve the user engagement by recommending appropriate personalized content to users, exploiting information about their preferences. We propose the enabler, a hybrid recommendation system which employs various machine-learning (ML) algorithms for learning an efficient combination of several recommendation algorithms and selects the best blending for a given inpu… ▽ More The recommendation systems aim to improve the user engagement by recommending appropriate personalized content to users, exploiting information about their preferences. We propose the enabler, a hybrid recommendation system which employs various machine-learning (ML) algorithms for learning an efficient combination of several recommendation algorithms and selects the best blending for a given input.Specifically, it integrates three layers, namely, the trainer which trains the underlying recommenders, the blender which determines the most efficient combination of the recommenders, and the tester for assessing the performance of the system. The enabler incorporates a variety of recommendation algorithms that span from collaborative filtering and content-based techniques to ones based on neural networks. It uses the nested cross validation for automatically selecting the best ML algorithm along with its hyper-parameter values for the given input, according to a specific metric. The enabler can be easily extended to include other recommenders and blenders. The enabler has been extensively evaluated in the context of video-streaming. It outperforms various other algorithms, when tested on the Movielens 1M benchmark dataset.encouraging results. Moreover For example, it achieves an RMSE of 0.8206, compared to the state-of-the-art performance of the AutoRec and SVD, 0.827 and 0.845, respectively. A pilot web-based recommendation system was developed and tested in the production environment of a large telecom operator in Greece. Volunteer customers of the video-streaming service provided by the telecom operator employed the system in the context of an out-in-the-wild field study with a post-analysis of the enabler, using the collected ratings of the pilot, demonstrated that it significantly outperforms several popular recommendation algorithms. △ Less

Submitted 5 January, 2019; originally announced January 2019.