-
Reimagining Linear Probing: Kolmogorov-Arnold Networks in Transfer Learning
Authors:
Sheng Shen,
Rabih Younes
Abstract:
This paper introduces Kolmogorov-Arnold Networks (KAN) as an enhancement to the traditional linear probing method in transfer learning. Linear probing, often applied to the final layer of pre-trained models, is limited by its inability to model complex relationships in data. To address this, we propose substituting the linear probing layer with KAN, which leverages spline-based representations to…
▽ More
This paper introduces Kolmogorov-Arnold Networks (KAN) as an enhancement to the traditional linear probing method in transfer learning. Linear probing, often applied to the final layer of pre-trained models, is limited by its inability to model complex relationships in data. To address this, we propose substituting the linear probing layer with KAN, which leverages spline-based representations to approximate intricate functions. In this study, we integrate KAN with a ResNet-50 model pre-trained on ImageNet and evaluate its performance on the CIFAR-10 dataset. We perform a systematic hyperparameter search, focusing on grid size and spline degree (k), to optimize KAN's flexibility and accuracy. Our results demonstrate that KAN consistently outperforms traditional linear probing, achieving significant improvements in accuracy and generalization across a range of configurations. These findings indicate that KAN offers a more powerful and adaptable alternative to conventional linear probing techniques in transfer learning.
△ Less
Submitted 12 September, 2024;
originally announced September 2024.
-
"Hunt Takes Hare": Theming Games Through Game-Word Vector Translation
Authors:
Rabii Younès,
Cook Michael
Abstract:
A game's theme is an important part of its design -- it conveys narrative information, rhetorical messages, helps the player intuit strategies, aids in tutorialisation and more. Thematic elements of games are notoriously difficult for AI systems to understand and manipulate, however, and often rely on large amounts of hand-written interpretations and knowledge. In this paper we present a technique…
▽ More
A game's theme is an important part of its design -- it conveys narrative information, rhetorical messages, helps the player intuit strategies, aids in tutorialisation and more. Thematic elements of games are notoriously difficult for AI systems to understand and manipulate, however, and often rely on large amounts of hand-written interpretations and knowledge. In this paper we present a technique which connects game embeddings, a recent method for modelling game dynamics from log data, and word embeddings, which models semantic information about language. We explain two different approaches for using game embeddings in this way, and show evidence that game embeddings enhance the linguistic translations of game concepts from one theme to another, opening up exciting new possibilities for reasoning about the thematic elements of games in the future.
△ Less
Submitted 16 May, 2024;
originally announced May 2024.
-
ChatGPT v.s. Media Bias: A Comparative Study of GPT-3.5 and Fine-tuned Language Models
Authors:
Zehao Wen,
Rabih Younes
Abstract:
In our rapidly evolving digital sphere, the ability to discern media bias becomes crucial as it can shape public sentiment and influence pivotal decisions. The advent of large language models (LLMs), such as ChatGPT, noted for their broad utility in various natural language processing (NLP) tasks, invites exploration of their efficacy in media bias detection. Can ChatGPT detect media bias? This st…
▽ More
In our rapidly evolving digital sphere, the ability to discern media bias becomes crucial as it can shape public sentiment and influence pivotal decisions. The advent of large language models (LLMs), such as ChatGPT, noted for their broad utility in various natural language processing (NLP) tasks, invites exploration of their efficacy in media bias detection. Can ChatGPT detect media bias? This study seeks to answer this question by leveraging the Media Bias Identification Benchmark (MBIB) to assess ChatGPT's competency in distinguishing six categories of media bias, juxtaposed against fine-tuned models such as BART, ConvBERT, and GPT-2. The findings present a dichotomy: ChatGPT performs at par with fine-tuned models in detecting hate speech and text-level context bias, yet faces difficulties with subtler elements of other bias detections, namely, fake news, racial, gender, and cognitive biases.
△ Less
Submitted 29 March, 2024;
originally announced March 2024.
-
Recovering Surveillance Video Using RF Cues
Authors:
Xiang Li,
Rabih Younes
Abstract:
Video capture is the most extensively utilized human perception source due to its intuitively understandable nature. A desired video capture often requires multiple environmental conditions such as ample ambient-light, unobstructed space, and proper camera angle. In contrast, wireless measurements are more ubiquitous and have fewer environmental constraints. In this paper, we propose CSI2Video, a…
▽ More
Video capture is the most extensively utilized human perception source due to its intuitively understandable nature. A desired video capture often requires multiple environmental conditions such as ample ambient-light, unobstructed space, and proper camera angle. In contrast, wireless measurements are more ubiquitous and have fewer environmental constraints. In this paper, we propose CSI2Video, a novel cross-modal method that leverages only WiFi signals from commercial devices and a source of human identity information to recover fine-grained surveillance video in a real-time manner. Specifically, two tailored deep neural networks are designed to conduct cross-modal mapping and video generation tasks respectively. We make use of an auto-encoder-based structure to extract pose features from WiFi frames. Afterward, both extracted pose features and identity information are merged to generate synthetic surveillance video. Our solution generates realistic surveillance videos without any expensive wireless equipment and has ubiquitous, cheap, and real-time characteristics.
△ Less
Submitted 26 December, 2022;
originally announced December 2022.
-
Self-supervised Multi-Modal Video Forgery Attack Detection
Authors:
Chenhui Zhao,
Xiang Li,
Rabih Younes
Abstract:
Video forgery attack threatens the surveillance system by replacing the video captures with unrealistic synthesis, which can be powered by the latest augment reality and virtual reality technologies. From the machine perception aspect, visual objects often have RF signatures that are naturally synchronized with them during recording. In contrast to video captures, the RF signatures are more diffic…
▽ More
Video forgery attack threatens the surveillance system by replacing the video captures with unrealistic synthesis, which can be powered by the latest augment reality and virtual reality technologies. From the machine perception aspect, visual objects often have RF signatures that are naturally synchronized with them during recording. In contrast to video captures, the RF signatures are more difficult to attack given their concealed and ubiquitous nature. In this work, we investigate multimodal video forgery attack detection methods using both vision and wireless modalities. Since wireless signal-based human perception is environmentally sensitive, we propose a self-supervised training strategy to enable the system to work without external annotation and thus can adapt to different environments. Our method achieves a perfect human detection accuracy and a high forgery attack detection accuracy of 94.38% which is comparable with supervised methods.
△ Less
Submitted 23 December, 2022; v1 submitted 13 September, 2022;
originally announced September 2022.
-
An Application of BnB-NSGAII: Initializing NSGAII to Solve 3 Stage Reducer Problem
Authors:
Ahmed Jaber,
Pascal Lafon,
Rafic Younes
Abstract:
The 3 stage reducer problem is a point of interest for many researchers. In this paper, this problem is reformulated to a bi-objective problem with additional constraints to meet the ISO mechanical standards. Those additional constraints increase the complexity of the problem, such that, NSGAII performance is not sufficient. To overcome this, we propose to use BnB-NSGAII method - a hybrid multi-cr…
▽ More
The 3 stage reducer problem is a point of interest for many researchers. In this paper, this problem is reformulated to a bi-objective problem with additional constraints to meet the ISO mechanical standards. Those additional constraints increase the complexity of the problem, such that, NSGAII performance is not sufficient. To overcome this, we propose to use BnB-NSGAII method - a hybrid multi-criteria branch and bound with NSGAII - to initialize NSGAII before solving the problem, seeking for a better initial population. A new feature is also proposed to enhance BnB-NSGAII method, called the legacy feature. The legacy feature permits the inheritance of the elite individuals between - branch and bound - parent and children nodes. NSGAII and BnB-NSGAII with and without the legacy feature are tested on the 3 stage reducer problem. Results demonstrate the competitive performance of BnB-NSGAII with the legacy feature.
△ Less
Submitted 14 May, 2021;
originally announced May 2021.
-
A Branch and Bound Based on NSGAII Algorithm for Multi-Objective Mixed Integer Non Linear Optimization Problems
Authors:
Ahmed Jaber,
Pascal Lafon,
Rafic Younes
Abstract:
Multi-Objective Mixed-Integer Non-Linear Programming problems (MO-MINLPs) appear in several real-world applications, especially in the mechanical engineering field. To determine a good approximated Pareto front for this type of problems, we propose a general hybrid approach based on a Multi-Criteria Branch-and-Bound (MCBB) and Non-dominated Sorting Genetic Algorithm 2 (NSGAII). We present a comput…
▽ More
Multi-Objective Mixed-Integer Non-Linear Programming problems (MO-MINLPs) appear in several real-world applications, especially in the mechanical engineering field. To determine a good approximated Pareto front for this type of problems, we propose a general hybrid approach based on a Multi-Criteria Branch-and-Bound (MCBB) and Non-dominated Sorting Genetic Algorithm 2 (NSGAII). We present a computational experiment based on a statistical assessment to compare the performance of the proposed algorithm (BnB-NSGAII) with NSGAII using well-known metrics from literature. We propose a new metric, Investment Ratio (IR), that relate the quality of the solution to the consumed effort. We consider five real-world mechanical engineering problems and two mathematical ones to be used as test problems in this experiment. Experimental results indicate that BnB-NSGAII could be a competitive alternative for solving MO-MINLPs.
△ Less
Submitted 30 November, 2020;
originally announced December 2020.
-
A Constraint-Handling Technique for Genetic Algorithms using a Violation Factor
Authors:
Adam Chehouri,
Rafic Younes,
Jean Perron,
Adrian Ilinca
Abstract:
Over the years, several meta-heuristic algorithms were proposed and are now emerging as common methods for constrained optimization problems. Among them, genetic algorithms (GA's) shine as popular evolutionary algorithms (EA's) in engineering optimization. Most engineering design problems are difficult to resolve with conventional optimization algorithms because they are highly nonlinear and conta…
▽ More
Over the years, several meta-heuristic algorithms were proposed and are now emerging as common methods for constrained optimization problems. Among them, genetic algorithms (GA's) shine as popular evolutionary algorithms (EA's) in engineering optimization. Most engineering design problems are difficult to resolve with conventional optimization algorithms because they are highly nonlinear and contain constraints. In order to handle these constraints, the most common technique is to apply penalty functions. The major drawback is that they require tuning of parameters, which can be very challenging. In this paper, we present a constraint-handling technique for GA's solely using the violation factor, called VCH (Violation Constraint-Handling) method. Several benchmark problems from the literature are examined. The VCH technique was able to provide a consistent performance and match results from other GA-based techniques.
△ Less
Submitted 4 October, 2016;
originally announced October 2016.
-
Wind Turbine Design: Multi-Objective Optimization
Authors:
Adam Chehouri,
Rafic Younes,
Adrian Ilinca,
Jean Perron
Abstract:
Within the last 20 years, wind turbines have reached matured and the growing worldwide wind energy market will allow further improvements. In the recent decades, the numbers of research papers that have applied optimization techniques in the attempt to obtain an optimal design have increased. The main target of manufacturers has been to minimize the cost of energy of wind turbines in order to comp…
▽ More
Within the last 20 years, wind turbines have reached matured and the growing worldwide wind energy market will allow further improvements. In the recent decades, the numbers of research papers that have applied optimization techniques in the attempt to obtain an optimal design have increased. The main target of manufacturers has been to minimize the cost of energy of wind turbines in order to compete with fossil-fuel sources. Therefore, it has been argued that it is more stimulating to evaluate the wind turbine design as an optimization problem consisting of more than one objective. Using multi-objective optimization algo- rithms, the designers are able to identify a trade-off curve called Pareto front that reveals the weaknesses, anomalies and rewards of certain targets. In this chapter, we present the fundamental principles of multi-objective optimization in wind turbine design and solve a classic multi-objective wind turbine optimization problem using a genetic algorithm.
△ Less
Submitted 4 October, 2016;
originally announced October 2016.
-
Construction of Triply Periodic Minimal Surfaces
Authors:
Rami Younes
Abstract:
Given a tiling $\mathcal{T}$ of the plane by straight edge polygons, which is invariant by two independent translations, we construct a family of embedded triply periodic minimal surfaces which desingularizes $\mathcal{T}\times\mathbb{R}$. For this purpose, inspired by the work of Martin Traizet, we open the nodes of singular Riemann surfaces to glue together simply periodic Karcher saddle tower…
▽ More
Given a tiling $\mathcal{T}$ of the plane by straight edge polygons, which is invariant by two independent translations, we construct a family of embedded triply periodic minimal surfaces which desingularizes $\mathcal{T}\times\mathbb{R}$. For this purpose, inspired by the work of Martin Traizet, we open the nodes of singular Riemann surfaces to glue together simply periodic Karcher saddle towers, each placed at a vertex of the tiling in such a way that its wings go along the corresponding edges of the tiling ending at that vertex.
△ Less
Submitted 12 March, 2010; v1 submitted 25 February, 2010;
originally announced February 2010.
-
Minimal Surfaces in $\widetilde{PSL_2(\mathbb{R})}$
Authors:
Rami Younes
Abstract:
We study minimal graphs in the homogeneous Riemannian 3-manifold $\widetilde{PSL_2(\mathbb{R})}$ and we give examples of invariant surfaces. We derive a gradient estimate for solutions of the minimal surface equation in this space and develop the machinery necessary to prove a Jenkins-Serrin type theorem for solutions defined over bounded domains of the hyperbolic plane.
We study minimal graphs in the homogeneous Riemannian 3-manifold $\widetilde{PSL_2(\mathbb{R})}$ and we give examples of invariant surfaces. We derive a gradient estimate for solutions of the minimal surface equation in this space and develop the machinery necessary to prove a Jenkins-Serrin type theorem for solutions defined over bounded domains of the hyperbolic plane.
△ Less
Submitted 24 February, 2010;
originally announced February 2010.
