-
Towards a Generic Multimodal Architecture for Batch and Streaming Big Data Integration
Authors:
Siham Yousfi,
Maryem Rhanoui,
Dalila Chiadmi
Abstract:
Big Data are rapidly produced from various heterogeneous data sources. They are of different types (text, image, video or audio) and have different levels of reliability and completeness. One of the most interesting architectures that deal with the large amount of emerging data at high velocity is called the lambda architecture. In fact, it combines two different processing layers namely batch and…
▽ More
Big Data are rapidly produced from various heterogeneous data sources. They are of different types (text, image, video or audio) and have different levels of reliability and completeness. One of the most interesting architectures that deal with the large amount of emerging data at high velocity is called the lambda architecture. In fact, it combines two different processing layers namely batch and speed layers, each providing specific views of data while ensuring robustness, fast and scalable data processing. However, most papers dealing with the lambda architecture are focusing one single type of data generally produced by a single data source. Besides, the layers of the architecture are implemented independently, or, at best, are combined to perform basic processing without assessing either the data reliability or completeness. Therefore, inspired by the lambda architecture, we propose in this paper a generic multimodal architecture that combines both batch and streaming processing in order to build a complete, global and accurate insight in near-real-time based on the knowledge extracted from multiple heterogeneous Big Data sources. Our architecture uses batch processing to analyze the data structures and contents, build the learning models and calculate the reliability index of the involved sources, while the streaming processing uses the built-in models of the batch layer to immediately process incoming data and rapidly provide results. We validate our architecture in the context of urban traffic management systems in order to detect congestions.
△ Less
Submitted 9 August, 2021;
originally announced August 2021.
-
2P-Med: Building a Personalization Platform for Mediation Systems
Authors:
Imane Zaoui,
Dalila Chiadmi,
Laila Benhlima
Abstract:
Nowadays, with the increasing number of integrated data sources, there is a real trend to personalize mediation systems to improve user satisfaction. To make these systems user sensitive, we propose a personalization platform called 2P-Med. 2P-Med allows personalizing any mediation system used in any domain following a cyclic process. The process includes building and managing adequate user profil…
▽ More
Nowadays, with the increasing number of integrated data sources, there is a real trend to personalize mediation systems to improve user satisfaction. To make these systems user sensitive, we propose a personalization platform called 2P-Med. 2P-Med allows personalizing any mediation system used in any domain following a cyclic process. The process includes building and managing adequate user profiles and sources profiles, content and quality matching, source selection, adapting the mediator responses to user preferences and handling user feedbacks. In this paper, we describe 2P-Med architecture and highlight its main functionalities. We also illustrate the operation of the platform through personalizing source selection in a travel planning assistant.
△ Less
Submitted 22 December, 2011;
originally announced December 2011.
-
Graph based E-Government web service composition
Authors:
Hajar Elmaghraoui,
Imane Zaoui,
Dalila Chiadmi,
Laila Benhlima
Abstract:
Nowadays, e-government has emerged as a government policy to improve the quality and efficiency of public administrations. By exploiting the potential of new information and communication technologies, government agencies are providing a wide spectrum of online services. These services are composed of several web services that comply with well defined processes. One of the big challenges is the ne…
▽ More
Nowadays, e-government has emerged as a government policy to improve the quality and efficiency of public administrations. By exploiting the potential of new information and communication technologies, government agencies are providing a wide spectrum of online services. These services are composed of several web services that comply with well defined processes. One of the big challenges is the need to optimize the composition of the elementary web services. In this paper, we present a solution for optimizing the computation effort in web service composition. Our method is based on Graph Theory. We model the semantic relationship between the involved web services through a directed graph. Then, we compute all shortest paths using for the first time, an extended version of the Floyd-Warshall algorithm.
△ Less
Submitted 28 November, 2011;
originally announced November 2011.
