-
Intention-aware policy graphs: answering what, how, and why in opaque agents
Authors:
Victor Gimenez-Abalos,
Sergio Alvarez-Napagao,
Adrian Tormos,
Ulises Cortés,
Javier Vázquez-Salceda
Abstract:
Agents are a special kind of AI-based software in that they interact in complex environments and have increased potential for emergent behaviour. Explaining such emergent behaviour is key to deploying trustworthy AI, but the increasing complexity and opaque nature of many agent implementations makes this hard. In this work, we propose a Probabilistic Graphical Model along with a pipeline for desig…
▽ More
Agents are a special kind of AI-based software in that they interact in complex environments and have increased potential for emergent behaviour. Explaining such emergent behaviour is key to deploying trustworthy AI, but the increasing complexity and opaque nature of many agent implementations makes this hard. In this work, we propose a Probabilistic Graphical Model along with a pipeline for designing such model -- by which the behaviour of an agent can be deliberated about -- and for computing a robust numerical value for the intentions the agent has at any moment. We contribute measurements that evaluate the interpretability and reliability of explanations provided, and enables explainability questions such as `what do you want to do now?' (e.g. deliver soup) `how do you plan to do it?' (e.g. returning a plan that considers its skills and the world), and `why would you take this action at this state?' (e.g. explaining how that furthers or hinders its own goals). This model can be constructed by taking partial observations of the agent's actions and world states, and we provide an iterative workflow for increasing the proposed measurements through better design and/or pointing out irrational agent behaviour.
△ Less
Submitted 27 September, 2024;
originally announced September 2024.
-
A Hierarchical Framework for Collaborative Artificial Intelligence
Authors:
James L. Crowley,
Joëlle L Coutaz,
Jasmin Grosinger,
Javier Vázquez-Salceda,
Cecilio Angulo,
Alberto Sanfeliu,
Luca Iocchi,
Anthony G. Cohn
Abstract:
We propose a hierarchical framework for collaborative intelligent systems. This framework organizes research challenges based on the nature of the collaborative activity and the information that must be shared, with each level building on capabilities provided by lower levels. We review research paradigms at each level, with a description of classical engineering-based approaches and modern altern…
▽ More
We propose a hierarchical framework for collaborative intelligent systems. This framework organizes research challenges based on the nature of the collaborative activity and the information that must be shared, with each level building on capabilities provided by lower levels. We review research paradigms at each level, with a description of classical engineering-based approaches and modern alternatives based on machine learning, illustrated with a running example using a hypothetical personal service robot. We discuss cross-cutting issues that occur at all levels, focusing on the problem of communicating and sharing comprehension, the role of explanation and the social nature of collaboration. We conclude with a summary of research challenges and a discussion of the potential for economic and societal impact provided by technologies that enhance human abilities and empower people and society through collaboration with Intelligent Systems.
△ Less
Submitted 14 December, 2022;
originally announced December 2022.
-
On some Foundational Aspects of Human-Centered Artificial Intelligence
Authors:
Luciano Serafini,
Raul Barbosa,
Jasmin Grosinger,
Luca Iocchi,
Christian Napoli,
Salvatore Rinzivillo,
Jacques Robin,
Alessandro Saffiotti,
Teresa Scantamburlo,
Peter Schueller,
Paolo Traverso,
Javier Vazquez-Salceda
Abstract:
The burgeoning of AI has prompted recommendations that AI techniques should be "human-centered". However, there is no clear definition of what is meant by Human Centered Artificial Intelligence, or for short, HCAI. This paper aims to improve this situation by addressing some foundational aspects of HCAI. To do so, we introduce the term HCAI agent to refer to any physical or software computational…
▽ More
The burgeoning of AI has prompted recommendations that AI techniques should be "human-centered". However, there is no clear definition of what is meant by Human Centered Artificial Intelligence, or for short, HCAI. This paper aims to improve this situation by addressing some foundational aspects of HCAI. To do so, we introduce the term HCAI agent to refer to any physical or software computational agent equipped with AI components and that interacts and/or collaborates with humans. This article identifies five main conceptual components that participate in an HCAI agent: Observations, Requirements, Actions, Explanations and Models. We see the notion of HCAI agent, together with its components and functions, as a way to bridge the technical and non-technical discussions on human-centered AI. In this paper, we focus our analysis on scenarios consisting of a single agent operating in dynamic environments in presence of humans.
△ Less
Submitted 29 December, 2021;
originally announced December 2021.
-
Towards a Goal-oriented Agent-based Simulation framework for High-Performance Computing
Authors:
Dmitry Gnatyshak,
Luis Oliva-Felipe,
Sergio Álvarez-Napagao,
Julian Padget,
Javier Vázquez-Salceda,
Dario Garcia-Gasulla,
Ulises Cortés
Abstract:
Currently, agent-based simulation frameworks force the user to choose between simulations involving a large number of agents (at the expense of limited agent reasoning capability) or simulations including agents with increased reasoning capabilities (at the expense of a limited number of agents per simulation). This paper describes a first attempt at putting goal-oriented agents into large agent-b…
▽ More
Currently, agent-based simulation frameworks force the user to choose between simulations involving a large number of agents (at the expense of limited agent reasoning capability) or simulations including agents with increased reasoning capabilities (at the expense of a limited number of agents per simulation). This paper describes a first attempt at putting goal-oriented agents into large agent-based (micro-)simulations. We discuss a model for goal-oriented agents in High-Performance Computing (HPC) and then briefly discuss its implementation in PyCOMPSs (a library that eases the parallelisation of tasks) to build such a platform that benefits from a large number of agents with the capacity to execute complex cognitive agents.
△ Less
Submitted 22 November, 2019;
originally announced November 2019.
