-
RAG-based Explainable Prediction of Road Users Behaviors for Automated Driving using Knowledge Graphs and Large Language Models
Authors:
Mohamed Manzour Hussien,
Angie Nataly Melo,
Augusto Luis Ballardini,
Carlota Salinas Maldonado,
Rubén Izquierdo,
Miguel Ángel Sotelo
Abstract:
Prediction of road users' behaviors in the context of autonomous driving has gained considerable attention by the scientific community in the last years. Most works focus on predicting behaviors based on kinematic information alone, a simplification of the reality since road users are humans, and as such they are highly influenced by their surrounding context. In addition, a large plethora of rese…
▽ More
Prediction of road users' behaviors in the context of autonomous driving has gained considerable attention by the scientific community in the last years. Most works focus on predicting behaviors based on kinematic information alone, a simplification of the reality since road users are humans, and as such they are highly influenced by their surrounding context. In addition, a large plethora of research works rely on powerful Deep Learning techniques, which exhibit high performance metrics in prediction tasks but may lack the ability to fully understand and exploit the contextual semantic information contained in the road scene, not to mention their inability to provide explainable predictions that can be understood by humans. In this work, we propose an explainable road users' behavior prediction system that integrates the reasoning abilities of Knowledge Graphs (KG) and the expressiveness capabilities of Large Language Models (LLM) by using Retrieval Augmented Generation (RAG) techniques. For that purpose, Knowledge Graph Embeddings (KGE) and Bayesian inference are combined to allow the deployment of a fully inductive reasoning system that enables the issuing of predictions that rely on legacy information contained in the graph as well as on current evidence gathered in real time by onboard sensors. Two use cases have been implemented following the proposed approach: 1) Prediction of pedestrians' crossing actions; 2) Prediction of lane change maneuvers. In both cases, the performance attained surpasses the current state of the art in terms of anticipation and F1-score, showing a promising avenue for future research in this field.
△ Less
Submitted 1 May, 2024;
originally announced May 2024.
-
Experimental Insights Towards Explainable and Interpretable Pedestrian Crossing Prediction
Authors:
Angie Nataly Melo,
Carlota Salinas,
Miguel Angel Sotelo
Abstract:
In the context of autonomous driving, pedestrian crossing prediction is a key component for improving road safety. Presently, the focus of these predictions extends beyond achieving trustworthy results; it is shifting towards the explainability and interpretability of these predictions. This research introduces a novel neuro-symbolic approach that combines deep learning and fuzzy logic for an expl…
▽ More
In the context of autonomous driving, pedestrian crossing prediction is a key component for improving road safety. Presently, the focus of these predictions extends beyond achieving trustworthy results; it is shifting towards the explainability and interpretability of these predictions. This research introduces a novel neuro-symbolic approach that combines deep learning and fuzzy logic for an explainable and interpretable pedestrian crossing prediction. We have developed an explainable predictor (ExPedCross), which utilizes a set of explainable features and employs a fuzzy inference system to predict whether the pedestrian will cross or not. Our approach was evaluated on both the PIE and JAAD datasets. The results offer experimental insights into achieving explainability and interpretability in the pedestrian crossing prediction task. Furthermore, the testing results yield a set of guidelines and recommendations regarding the process of dataset selection, feature selection, and explainability.
△ Less
Submitted 5 December, 2023;
originally announced December 2023.
-
Non-Pauli Observables for CWS Codes
Authors:
Douglas F. G. Santiago,
Renato Portugal,
Nolmar Melo
Abstract:
It is known that nonadditive quantum codes are more optimal for error correction when compared to stabilizer codes. The class of codeword stabilized codes (CWS) provides tools to obtain new nonadditive quantum codes by reducing the problem to finding nonlinear classical codes. In this work, we establish some results on the kind of non-Pauli operators that can be used as decoding observables for CW…
▽ More
It is known that nonadditive quantum codes are more optimal for error correction when compared to stabilizer codes. The class of codeword stabilized codes (CWS) provides tools to obtain new nonadditive quantum codes by reducing the problem to finding nonlinear classical codes. In this work, we establish some results on the kind of non-Pauli operators that can be used as decoding observables for CWS codes and describe a procedure to obtain these observables.
△ Less
Submitted 7 June, 2012;
originally announced June 2012.
-
Decoder for Nonbinary CWS Quantum Codes
Authors:
Nolmar Melo,
Douglas F. G. Santiago,
Renato Portugal
Abstract:
We present a decoder for nonbinary CWS quantum codes using the structure of union codes. The decoder runs in two steps: first we use a union of stabilizer codes to detect a sequence of errors, and second we build a new code, called union code, that allows to correct the errors.
We present a decoder for nonbinary CWS quantum codes using the structure of union codes. The decoder runs in two steps: first we use a union of stabilizer codes to detect a sequence of errors, and second we build a new code, called union code, that allows to correct the errors.
△ Less
Submitted 10 April, 2012;
originally announced April 2012.
-
Goppa goemetry codes via elementary methods (In Portuguese)
Authors:
Nolmar Melo
Abstract:
The central objective of this dissertation was to present the Goppa Geometry Codes via elementary methods which were introduced by J.H. van Lint ,R.Pellikaan and T. Hohold about 1998. On the first part of such dissertation are presented the fundamental concepts about bodies of rational functions of an algebraic curve in the direction as to define the Goppa Codes on a classical manner. In this stud…
▽ More
The central objective of this dissertation was to present the Goppa Geometry Codes via elementary methods which were introduced by J.H. van Lint ,R.Pellikaan and T. Hohold about 1998. On the first part of such dissertation are presented the fundamental concepts about bodies of rational functions of an algebraic curve in the direction as to define the Goppa Codes on a classical manner. In this study we based ourselves mainly on the book ? Algebraic Function Fields and Codes? of H. Stichtenoth. The second part is initiated with an introduction about
the functions weight, degree and order which are fundamental for the study of the Goppa Codes through elementary methods of linear algebra and of semigroups and such study was based on ? Algebraic Geometry Codes ? of J.H. van Lint,R.Pellikaan and T. Hohold.
△ Less
Submitted 6 April, 2012;
originally announced April 2012.