Showing 1–1 of 1 results for author: Nakka, S K S

A Multi-Agent Deep Reinforcement Learning Coordination Framework for Connected and Automated Vehicles at Merging Roadways

Authors: Sai Krishna Sumanth Nakka, Behdad Chalaki, Andreas Malikopoulos

Abstract: The steady increase in the number of vehicles operating on the highways continues to exacerbate congestion, accidents, energy consumption, and greenhouse gas emissions. Emerging mobility systems, e.g., connected and automated vehicles (CAVs), have the potential to directly address these issues and improve transportation network efficiency and safety. In this paper, we consider a highway merging sc… ▽ More The steady increase in the number of vehicles operating on the highways continues to exacerbate congestion, accidents, energy consumption, and greenhouse gas emissions. Emerging mobility systems, e.g., connected and automated vehicles (CAVs), have the potential to directly address these issues and improve transportation network efficiency and safety. In this paper, we consider a highway merging scenario and propose a framework for coordinating CAVs such that stop-and-go driving is eliminated. We use a decentralized form of the actor-critic approach to deep reinforcement learning$-$multi-agent deep deterministic policy gradient. We demonstrate the coordination of CAVs through numerical simulations and show that a smooth traffic flow is achieved by eliminating stop-and-go driving. Videos and plots of the simulation results can be found at this supplemental $\href{https://sites.google.com/view/ud-ids-lab/MADRL}{\text{site}}$. △ Less

Submitted 13 March, 2022; v1 submitted 23 September, 2021; originally announced September 2021.

Comments: 6 pages, 6 figures

ACM Class: I.2.1; I.2.4; I.2.6; I.2.10; I.2.11; I.6.5

Journal ref: 2022 American Control Conference (ACC), (2022), 3297-3302