Bridging Industrial Expertise and XR with LLM-Powered Conversational Agents
Authors:
Despina Tomkou,
George Fatouros,
Andreas Andreou,
Georgios Makridis,
Fotis Liarokapis,
Dimitrios Dardanis,
Athanasios Kiourtis,
John Soldatos,
Dimosthenis Kyriazis
Abstract:
This paper introduces a novel integration of Retrieval-Augmented Generation (RAG) enhanced Large Language Models (LLMs) with Extended Reality (XR) technologies to address knowledge transfer challenges in industrial environments. The proposed system embeds domain-specific industrial knowledge into XR environments through a natural language interface, enabling hands-free, context-aware expert guidan…
▽ More
This paper introduces a novel integration of Retrieval-Augmented Generation (RAG) enhanced Large Language Models (LLMs) with Extended Reality (XR) technologies to address knowledge transfer challenges in industrial environments. The proposed system embeds domain-specific industrial knowledge into XR environments through a natural language interface, enabling hands-free, context-aware expert guidance for workers. We present the architecture of the proposed system consisting of an LLM Chat Engine with dynamic tool orchestration and an XR application featuring voice-driven interaction. Performance evaluation of various chunking strategies, embedding models, and vector databases reveals that semantic chunking, balanced embedding models, and efficient vector stores deliver optimal performance for industrial knowledge retrieval. The system's potential is demonstrated through early implementation in multiple industrial use cases, including robotic assembly, smart infrastructure maintenance, and aerospace component servicing. Results indicate potential for enhancing training efficiency, remote assistance capabilities, and operational guidance in alignment with Industry 5.0's human-centric and resilient approach to industrial development.
△ Less
Submitted 7 April, 2025;
originally announced April 2025.
PolicyCLOUD: A prototype of a Cloud Serverless Ecosystem for Policy Analytics
Authors:
Ofer Biran,
Oshrit Feder,
Yosef Moatti,
Athanasios Kiourtis,
Dimosthenis Kyriazis,
George Manias,
Argyro Mavrogiorgou,
Nikitas M. Sgouros,
Martim Taborda Barata,
Isabella Oldani,
María Angeles Sanguino,
Pavlos Kranas
Abstract:
We present PolicyCLOUD, a prototype for an extensible, serverless cloud-based system that supports evidence-based elaboration and analysis of policies. PolicyCLOUD allows flexible exploitation and management of policy-relevant dataflows by enabling the practitioner to register datasets and specify a sequence of transformations and/or information extraction through registered ingest functions. Once…
▽ More
We present PolicyCLOUD, a prototype for an extensible, serverless cloud-based system that supports evidence-based elaboration and analysis of policies. PolicyCLOUD allows flexible exploitation and management of policy-relevant dataflows by enabling the practitioner to register datasets and specify a sequence of transformations and/or information extraction through registered ingest functions. Once a possibly transformed dataset has been ingested, additional insights can be retrieved by further applying registered analytic functions. PolicyCLOUD was built as an extensible framework toward the creation of an analytic ecosystem. As of now, we developed several essential ingest and analytic functions that are built-in within the framework. They include data cleaning, enhanced interoperability, and sentiment analysis generic functions. PolicyCLOUD has also the ability to tap on the analytic capabilities of external tools. We demonstrate this with a Social Analytics tool implemented in conjunction with PolicyCLOUD and show how to benefit from policy modeling, design and simulation capabilities. Furthermore, PolicyCLOUD has developed a first of its kind legal and ethical framework that covers the usage and dissemination of datasets and analytic functions throughout its policy-relevant dataflows. The article describes and evaluates the application of PolicyCLOUD to four families of pilots that cover a wide range of policy scenarios.
△ Less
Submitted 16 January, 2022;
originally announced January 2022.
