Towards Automated Safety Requirements Derivation Using Agent-based RAG
Authors:
Balahari Vignesh Balu,
Florian Geissler,
Francesco Carella,
Joao-Vitor Zacchi,
Josef Jiru,
Nuria Mata,
Reinhard Stolle
Abstract:
We study the automated derivation of safety requirements in a self-driving vehicle use case, leveraging LLMs in combination with agent-based retrieval-augmented generation. Conventional approaches that utilise pre-trained LLMs to assist in safety analyses typically lack domain-specific knowledge. Existing RAG approaches address this issue, yet their performance deteriorates when handling complex q…
▽ More
We study the automated derivation of safety requirements in a self-driving vehicle use case, leveraging LLMs in combination with agent-based retrieval-augmented generation. Conventional approaches that utilise pre-trained LLMs to assist in safety analyses typically lack domain-specific knowledge. Existing RAG approaches address this issue, yet their performance deteriorates when handling complex queries and it becomes increasingly harder to retrieve the most relevant information. This is particularly relevant for safety-relevant applications. In this paper, we propose the use of agent-based RAG to derive safety requirements and show that the retrieved information is more relevant to the queries. We implement an agent-based approach on a document pool of automotive standards and the Apollo case study, as a representative example of an automated driving perception system. Our solution is tested on a data set of safety requirement questions and answers, extracted from the Apollo data. Evaluating a set of selected RAG metrics, we present and discuss advantages of a agent-based approach compared to default RAG methods.
△ Less
Submitted 15 April, 2025;
originally announced April 2025.
Facilitating Change Implementation for Continuous ML-Safety Assurance
Authors:
Chih-Hong Cheng,
Nguyen Anh Vu Doan,
Balahari Balu,
Franziska Schwaiger,
Emmanouil Seferis,
Simon Burton,
Yassine Qamsane,
Ankit Shukla,
Yinchong Yang,
Zhiliang Wu,
Andreas Hapfelmeier,
Ingo Thon
Abstract:
We propose a method for deploying a safety-critical machine-learning component into continuously evolving environments where an increased degree of automation in the engineering process is desired. We associate semantic tags with the safety case argumentation and turn each piece of evidence into a quantitative metric or a logic formula. With proper tool support, the impact can be characterized by…
▽ More
We propose a method for deploying a safety-critical machine-learning component into continuously evolving environments where an increased degree of automation in the engineering process is desired. We associate semantic tags with the safety case argumentation and turn each piece of evidence into a quantitative metric or a logic formula. With proper tool support, the impact can be characterized by a query over the safety argumentation tree to highlight evidence turning invalid. The concept is exemplified using a vision-based emergency braking system of an autonomous guided vehicle for factory automation.
△ Less
Submitted 23 September, 2022;
originally announced September 2022.
