-
A Survey of Generative Categories and Techniques in Multimodal Large Language Models
Authors:
Longzhen Han,
Awes Mubarak,
Almas Baimagambetov,
Nikolaos Polatidis,
Thar Baker
Abstract:
Multimodal Large Language Models (MLLMs) have rapidly evolved beyond text generation, now spanning diverse output modalities including images, music, video, human motion, and 3D objects, by integrating language with other sensory modalities under unified architectures. This survey categorises six primary generative modalities and examines how foundational techniques, namely Self-Supervised Learnin…
▽ More
Multimodal Large Language Models (MLLMs) have rapidly evolved beyond text generation, now spanning diverse output modalities including images, music, video, human motion, and 3D objects, by integrating language with other sensory modalities under unified architectures. This survey categorises six primary generative modalities and examines how foundational techniques, namely Self-Supervised Learning (SSL), Mixture of Experts (MoE), Reinforcement Learning from Human Feedback (RLHF), and Chain-of-Thought (CoT) prompting, enable cross-modal capabilities. We analyze key models, architectural trends, and emergent cross-modal synergies, while highlighting transferable techniques and unresolved challenges. Architectural innovations like transformers and diffusion models underpin this convergence, enabling cross-modal transfer and modular specialization. We highlight emerging patterns of synergy, and identify open challenges in evaluation, modularity, and structured reasoning. This survey offers a unified perspective on MLLM development and identifies critical paths toward more general-purpose, adaptive, and interpretable multimodal systems.
△ Less
Submitted 13 June, 2025; v1 submitted 29 May, 2025;
originally announced June 2025.
-
Evolving Machine Learning: A Survey
Authors:
Ignacio Cabrera Martin,
Subhaditya Mukherjee,
Almas Baimagambetov,
Joaquin Vanschoren,
Nikolaos Polatidis
Abstract:
In an era defined by rapid data evolution, traditional machine learning (ML) models often fall short in adapting to dynamic environments. Evolving Machine Learning (EML) has emerged as a critical paradigm, enabling continuous learning and adaptation in real-time data streams. This survey presents a comprehensive analysis of EML, focusing on five core challenges: data drift, concept drift, catastro…
▽ More
In an era defined by rapid data evolution, traditional machine learning (ML) models often fall short in adapting to dynamic environments. Evolving Machine Learning (EML) has emerged as a critical paradigm, enabling continuous learning and adaptation in real-time data streams. This survey presents a comprehensive analysis of EML, focusing on five core challenges: data drift, concept drift, catastrophic forgetting, skewed learning, and network adaptation. We systematically review over 120 studies, categorizing state-of-the-art methods across supervised, unsupervised, and semi-supervised approaches. The survey explores diverse evaluation metrics, benchmark datasets, and real-world applications, offering a comparative lens on the effectiveness and limitations of current techniques. Additionally, we highlight the growing role of adaptive neural architectures, meta-learning, and ensemble strategies in addressing evolving data complexities. By synthesizing insights from recent literature, this work not only maps the current landscape of EML but also identifies critical gaps and opportunities for future research. Our findings aim to guide researchers and practitioners in developing robust, ethical, and scalable EML systems for real-world deployment.
△ Less
Submitted 23 May, 2025;
originally announced May 2025.
-
Mobile recommender systems: Identifying the major concepts
Authors:
Elias Pimenidis,
Nikolaos Polatidis,
Haralambos Mouratidis
Abstract:
This paper identifies the factors that have an impact on mobile recommender systems. Recommender systems have become a technology that has been widely used by various online applications in situations where there is an information overload problem. Numerous applications such as e-Commerce, video platforms and social networks provide personalized recommendations to their users and this has improved…
▽ More
This paper identifies the factors that have an impact on mobile recommender systems. Recommender systems have become a technology that has been widely used by various online applications in situations where there is an information overload problem. Numerous applications such as e-Commerce, video platforms and social networks provide personalized recommendations to their users and this has improved the user experience and vendor revenues. The development of recommender systems has been focused mostly on the proposal of new algorithms that provide more accurate recommendations. However, the use of mobile devices and the rapid growth of the internet and networking infrastructure has brought the necessity of using mobile recommender systems. The links between web and mobile recommender systems are described along with how the recommendations in mobile environments can be improved. This work is focused on identifying the links between web and mobile recommender systems and to provide solid future directions that aim to lead in a more integrated mobile recommendation domain.
△ Less
Submitted 6 May, 2018;
originally announced May 2018.
-
From product recommendation to cyber-attack prediction: Generating attack graphs and predicting future attacks
Authors:
Nikolaos Polatidis,
Elias Pimenidis,
Michalis Pavlidis,
Spyridon Papastergiou,
Haralambos Mouratidis
Abstract:
Modern information society depends on reliable functionality of information systems infrastructure, while at the same time the number of cyber-attacks has been increasing over the years and damages have been caused. Furthermore, graphs can be used to show paths than can be exploited by attackers to intrude into systems and gain unauthorized access through vulnerability exploitation. This paper pre…
▽ More
Modern information society depends on reliable functionality of information systems infrastructure, while at the same time the number of cyber-attacks has been increasing over the years and damages have been caused. Furthermore, graphs can be used to show paths than can be exploited by attackers to intrude into systems and gain unauthorized access through vulnerability exploitation. This paper presents a method that builds attack graphs using data supplied from the maritime supply chain infrastructure. The method delivers all possible paths that can be exploited to gain access. Then, a recommendation system is utilized to make predictions about future attack steps within the network. We show that recommender systems can be used in cyber defense by predicting attacks. The goal of this paper is to identify attack paths and show how a recommendation method can be used to classify future cyber-attacks in terms of risk management. The proposed method has been experimentally evaluated and validated, with the results showing that it is both practical and effective.
△ Less
Submitted 26 April, 2018;
originally announced April 2018.
-
A multi-level collaborative filtering method that improves recommendations
Authors:
Nikolaos Polatidis,
Christos K. Georgiadis
Abstract:
Collaborative filtering is one of the most used approaches for providing recommendations in various online environments. Even though collaborative recommendation methods have been widely utilized due to their simplicity and ease of use, accuracy is still an issue. In this paper we propose a multi-level recommendation method with its main purpose being to assist users in decision making by providin…
▽ More
Collaborative filtering is one of the most used approaches for providing recommendations in various online environments. Even though collaborative recommendation methods have been widely utilized due to their simplicity and ease of use, accuracy is still an issue. In this paper we propose a multi-level recommendation method with its main purpose being to assist users in decision making by providing recommendations of better quality. The proposed method can be applied in different online domains that use collaborative recommender systems, thus improving the overall user experience. The efficiency of the proposed method is shown by providing an extensive experimental evaluation using five real datasets and with comparisons to alternatives.
△ Less
Submitted 24 April, 2018;
originally announced April 2018.
-
A dynamic multi-level collaborative filtering method for improved recommendations
Authors:
Nikolaos Polatidis,
Christos K. Georgiadis
Abstract:
One of the most used approaches for providing recommendations in various online environments such as e-commerce is collaborative filtering. Although, this is a simple method for recommending items or services, accuracy and quality problems still exist. Thus, we propose a dynamic multi-level collaborative filtering method that improves the quality of the recommendations. The proposed method is base…
▽ More
One of the most used approaches for providing recommendations in various online environments such as e-commerce is collaborative filtering. Although, this is a simple method for recommending items or services, accuracy and quality problems still exist. Thus, we propose a dynamic multi-level collaborative filtering method that improves the quality of the recommendations. The proposed method is based on positive and negative adjustments and can be used in different domains that utilize collaborative filtering to increase the quality of the user experience. Furthermore, the effectiveness of the proposed method is shown by providing an extensive experimental evaluation based on three real datasets and by comparisons to alternative methods.
△ Less
Submitted 6 February, 2017;
originally announced February 2017.
-
Mobile recommender systems: An overview of technologies and challenges
Authors:
Nikolaos Polatidis,
Christos K. Georgiadis
Abstract:
The use of mobile devices in combination with the rapid growth of the internet has generated an information overload problem. Recommender systems is a necessity to decide which of the data are relevant to the user. However in mobile devices there are different factors who are crucial to information retrieval, such as the location, the screen size and the processor speed. This paper gives an overvi…
▽ More
The use of mobile devices in combination with the rapid growth of the internet has generated an information overload problem. Recommender systems is a necessity to decide which of the data are relevant to the user. However in mobile devices there are different factors who are crucial to information retrieval, such as the location, the screen size and the processor speed. This paper gives an overview of the technologies related to mobile recommender systems and a more detailed description of the challenged faced.
△ Less
Submitted 29 August, 2014;
originally announced August 2014.
-
Factors Influencing the Quality of the User Experience in Ubiquitous Recommender Systems
Authors:
Nikolaos Polatidis,
Christos K. Georgiadis
Abstract:
The use of mobile devices and the rapid growth of the internet and networking infrastructure has brought the necessity of using Ubiquitous recommender systems. However in mobile devices there are different factors that need to be considered in order to get more useful recommendations and increase the quality of the user experience. This paper gives an overview of the factors related to the quality…
▽ More
The use of mobile devices and the rapid growth of the internet and networking infrastructure has brought the necessity of using Ubiquitous recommender systems. However in mobile devices there are different factors that need to be considered in order to get more useful recommendations and increase the quality of the user experience. This paper gives an overview of the factors related to the quality and proposes a new hybrid recommendation model.
△ Less
Submitted 29 August, 2014;
originally announced August 2014.
-
Chatbot for admissions
Authors:
Nikolaos Polatidis
Abstract:
The communication of potential students with a university department is performed manually and it is a very time consuming procedure. The opportunity to communicate with on a one-to-one basis is highly valued. However with many hundreds of applications each year, one-to-one conversations are not feasible in most cases. The communication will require a member of academic staff to expend several hou…
▽ More
The communication of potential students with a university department is performed manually and it is a very time consuming procedure. The opportunity to communicate with on a one-to-one basis is highly valued. However with many hundreds of applications each year, one-to-one conversations are not feasible in most cases. The communication will require a member of academic staff to expend several hours to find suitable answers and contact each student. It would be useful to reduce his costs and time.
The project aims to reduce the burden on the head of admissions, and potentially other users, by developing a convincing chatbot. A suitable algorithm must be devised to search through the set of data and find a potential answer. The program then replies to the user and provides a relevant web link if the user is not satisfied by the answer. Furthermore a web interface is provided for both users and an administrator.
The achievements of the project can be summarised as follows. To prepare the background of the project a literature review was undertaken, together with an investigation of existing tools, and consultation with the head of admissions. The requirements of the system were established and a range of algorithms and tools were investigated, including keyword and template matching. An algorithm that combines keyword matching with string similarity has been developed. A usable system using the proposed algorithm has been implemented. The system was evaluated by keeping logs of questions and answers and by feedback received by potential students that used it.
△ Less
Submitted 28 August, 2014;
originally announced August 2014.
-
SFA Referee Allocation Scheme
Authors:
Nikolaos Polatidis
Abstract:
For many sports, the allocation of officials to matches is performed manually and is a very time consuming procedure. For the Scottish Football Association (SFA), the allocation of referees and other officials to matches is governed by a number of rules specifying the expertise required from the different types of official at each level, e.g. Scottish Premiership League referee must be a grade 1 w…
▽ More
For many sports, the allocation of officials to matches is performed manually and is a very time consuming procedure. For the Scottish Football Association (SFA), the allocation of referees and other officials to matches is governed by a number of rules specifying the expertise required from the different types of official at each level, e.g. Scottish Premiership League referee must be a grade 1 with high experience. The allocation requires an SFA secretary to expend several hours to find suitable officials, contact them and assign them. Most of the time, the secretary is a volunteer who performs the allocation as a hobby and it would be useful to reduce his costs and time.
The project aims to reduce the burden on SFA, and potentially other secretaries, by developing a program to assign SFA officials. A suitable algorithm must be devised to search through the set of data about matches and officials and find a potential allocation. The program then updates the database with the new data, and provides a web interface for both secretaries and officials.
A prototype system using the new greedy algorithm has been implemented and evaluated with SFA secretaries. A final usable referee allocation system has been designed that uses the greedy algorithm, and is extended after evaluation of the prototype. The final allocation system based provides both a command line and a web interface and has also been evaluated by SFA secretaries. In their letters of recommendation in Appendix F the SFA secretaries indicate that the final allocation system it will be used again in the future.
△ Less
Submitted 28 August, 2014;
originally announced August 2014.