-
The Impact of Imperfect XAI on Human-AI Decision-Making
Authors:
Katelyn Morrison,
Philipp Spitzer,
Violet Turri,
Michelle Feng,
Niklas Kühl,
Adam Perer
Abstract:
Explainability techniques are rapidly being developed to improve human-AI decision-making across various cooperative work settings. Consequently, previous research has evaluated how decision-makers collaborate with imperfect AI by investigating appropriate reliance and task performance with the aim of designing more human-centered computer-supported collaborative tools. Several human-centered expl…
▽ More
Explainability techniques are rapidly being developed to improve human-AI decision-making across various cooperative work settings. Consequently, previous research has evaluated how decision-makers collaborate with imperfect AI by investigating appropriate reliance and task performance with the aim of designing more human-centered computer-supported collaborative tools. Several human-centered explainable AI (XAI) techniques have been proposed in hopes of improving decision-makers' collaboration with AI; however, these techniques are grounded in findings from previous studies that primarily focus on the impact of incorrect AI advice. Few studies acknowledge the possibility of the explanations being incorrect even if the AI advice is correct. Thus, it is crucial to understand how imperfect XAI affects human-AI decision-making. In this work, we contribute a robust, mixed-methods user study with 136 participants to evaluate how incorrect explanations influence humans' decision-making behavior in a bird species identification task, taking into account their level of expertise and an explanation's level of assertiveness. Our findings reveal the influence of imperfect XAI and humans' level of expertise on their reliance on AI and human-AI team performance. We also discuss how explanations can deceive decision-makers during human-AI collaboration. Hence, we shed light on the impacts of imperfect XAI in the field of computer-supported cooperative work and provide guidelines for designers of human-AI collaboration systems.
△ Less
Submitted 8 May, 2024; v1 submitted 25 July, 2023;
originally announced July 2023.
-
Measuring AI Systems Beyond Accuracy
Authors:
Violet Turri,
Rachel Dzombak,
Eric Heim,
Nathan VanHoudnos,
Jay Palat,
Anusha Sinha
Abstract:
Current test and evaluation (T&E) methods for assessing machine learning (ML) system performance often rely on incomplete metrics. Testing is additionally often siloed from the other phases of the ML system lifecycle. Research investigating cross-domain approaches to ML T&E is needed to drive the state of the art forward and to build an Artificial Intelligence (AI) engineering discipline. This pap…
▽ More
Current test and evaluation (T&E) methods for assessing machine learning (ML) system performance often rely on incomplete metrics. Testing is additionally often siloed from the other phases of the ML system lifecycle. Research investigating cross-domain approaches to ML T&E is needed to drive the state of the art forward and to build an Artificial Intelligence (AI) engineering discipline. This paper advocates for a robust, integrated approach to testing by outlining six key questions for guiding a holistic T&E strategy.
△ Less
Submitted 7 April, 2022;
originally announced April 2022.
-
Truck Platoon Formation at Hubs: An Optimal Release Time Rule
Authors:
Alexander Johansson,
Valerio Turri,
Ehsan Nekouei,
Karl H. Johansson,
Jonas Mårtensson
Abstract:
We consider a hub-based platoon coordination problem in which vehicles arrive at a hub according to an independent and identically distributed stochastic arrival process. The vehicles wait at the hub, and a platoon coordinator, at each time-step, decides whether to release the vehicles from the hub in the form of a platoon or wait for more vehicles to arrive. The platoon release time problem is mo…
▽ More
We consider a hub-based platoon coordination problem in which vehicles arrive at a hub according to an independent and identically distributed stochastic arrival process. The vehicles wait at the hub, and a platoon coordinator, at each time-step, decides whether to release the vehicles from the hub in the form of a platoon or wait for more vehicles to arrive. The platoon release time problem is modeled as a stopping rule problem wherein the objective is to maximize the average platooning benefit of the vehicles located at the hub and there is a cost of having vehicles waiting at the hub. We show that the stopping rule problem is monotone and the optimal platoon release time policy will therefore be in the form of a one time-step look-ahead rule. The performance of the optimal release rule is numerically compared with (i) a periodic release time rule and (ii) a non-causal release time rule where the coordinator knows all the future realizations of the arrival process. Our numerical results show that the optimal release time rule achieves a close performance to that of the non-causal rule and outperforms the periodic rule, especially when the arrival rate is low.
△ Less
Submitted 18 February, 2022;
originally announced February 2022.
-
Cyber-physical Control of Road Freight Transport
Authors:
B. Besselink,
V. Turri,
S. H. van de Hoef,
K. -Y. Liang,
A. Alam,
J. Mårtensson,
K. H. Johansson
Abstract:
Freight transportation is of outmost importance for our society and is continuously increasing. At the same time, transporting goods on roads accounts for about 26% of all energy consumption and 18% of all greenhouse gas emissions in the European Union. Despite the influence the transportation system has on our energy consumption and the environment, road transportation is mainly done by individua…
▽ More
Freight transportation is of outmost importance for our society and is continuously increasing. At the same time, transporting goods on roads accounts for about 26% of all energy consumption and 18% of all greenhouse gas emissions in the European Union. Despite the influence the transportation system has on our energy consumption and the environment, road transportation is mainly done by individual long-haulage trucks with no real-time coordination or global optimization. In this paper, we review how modern information and communication technology supports a cyber-physical transportation system architecture with an integrated logistic system coordinating fleets of trucks traveling together in vehicle platoons. From the reduced air drag, platooning trucks traveling close together can save about 10% of their fuel consumption. Utilizing road grade information and vehicle-to-vehicle communication, a safe and fuel-optimized cooperative look-ahead control strategy is implemented on top of the existing cruise controller. By optimizing the interaction between vehicles and platoons of vehicles, it is shown that significant improvements can be achieved. An integrated transport planning and vehicle routing in the fleet management system allows both small and large fleet owners to benefit from the collaboration. A realistic case study with 200 heavy-duty vehicles performing transportation tasks in Sweden is described. Simulations show overall fuel savings at more than 5% thanks to coordinated platoon planning. It is also illustrated how well the proposed cooperative look-ahead controller for heavy-duty vehicle platoons manages to optimize the velocity profiles of the vehicles over a hilly segment of the considered road network.
△ Less
Submitted 13 July, 2015;
originally announced July 2015.
-
Cooperative look-ahead control for fuel-efficient and safe heavy-duty vehicle platooning
Authors:
Valerio Turri,
Bart Besselink,
Karl H. Johansson
Abstract:
The operation of groups of heavy-duty vehicles (HDVs) at a small inter-vehicular distance (known as platoon) allows to lower the overall aerodynamic drag and, therefore, to reduce fuel consumption and greenhouse gas emissions. However, due to the large mass and limited engine power of HDVs, slopes have a significant impact on the feasible and optimal speed profiles that each vehicle can and should…
▽ More
The operation of groups of heavy-duty vehicles (HDVs) at a small inter-vehicular distance (known as platoon) allows to lower the overall aerodynamic drag and, therefore, to reduce fuel consumption and greenhouse gas emissions. However, due to the large mass and limited engine power of HDVs, slopes have a significant impact on the feasible and optimal speed profiles that each vehicle can and should follow. Therefore maintaining a short inter-vehicular distance as required by platooning without coordination between vehicles can often result in inefficient or even unfeasible trajectories. In this paper we propose a two-layer control architecture for HDV platooning aimed to safely and fuel-efficiently coordinate the vehicles in the platoon. Here, the layers are responsible for the inclusion of preview information on road topography and the real-time control of the vehicles, respectively. Within this architecture, dynamic programming is used to compute the fuel-optimal speed profile for the entire platoon and a distributed model predictive control framework is developed for the real-time control of the vehicles. The effectiveness of the proposed controller is analyzed by means of simulations of several realistic scenarios that suggest a possible fuel saving of up to 12% for the follower vehicles compared to the use of standard platoon controllers.
△ Less
Submitted 3 May, 2015;
originally announced May 2015.
