-
Dual Control for Interactive Autonomous Merging with Model Predictive Diffusion
Authors:
Jacob Knaup,
Jovin D'sa,
Behdad Chalaki,
Hossein Nourkhiz Mahjoub,
Ehsan Moradi-Pari,
Panagiotis Tsiotras
Abstract:
Interactive decision-making is essential in applications such as autonomous driving, where the agent must infer the behavior of nearby human drivers while planning in real-time. Traditional predict-then-act frameworks are often insufficient or inefficient because accurate inference of human behavior requires a continuous interaction rather than isolated prediction. To address this, we propose an a…
▽ More
Interactive decision-making is essential in applications such as autonomous driving, where the agent must infer the behavior of nearby human drivers while planning in real-time. Traditional predict-then-act frameworks are often insufficient or inefficient because accurate inference of human behavior requires a continuous interaction rather than isolated prediction. To address this, we propose an active learning framework in which we rigorously derive predicted belief distributions. Additionally, we introduce a novel model-based diffusion solver tailored for online receding horizon control problems, demonstrated through a complex, non-convex highway merging scenario. Our approach extends previous high-fidelity dual control simulations to hardware experiments, which may be viewed at https://youtu.be/Q_JdZuopGL4, and verifies behavior inference in human-driven traffic scenarios, moving beyond idealized models. The results show improvements in adaptive planning under uncertainty, advancing the field of interactive decision-making for real-world applications.
△ Less
Submitted 14 February, 2025;
originally announced February 2025.
-
Modeling the Lane-Change Reactions to Merging Vehicles for Highway On-Ramp Simulations
Authors:
Dustin Holley,
Jovin Dsa,
Hossein Nourkhiz Mahjoub,
Gibran Ali,
Tyler Naes,
Ehsan Moradi-Pari,
Pawan Sai Kallepalli
Abstract:
Enhancing simulation environments to replicate real-world driver behavior is essential for developing Autonomous Vehicle technology. While some previous works have studied the yielding reaction of lag vehicles in response to a merging car at highway on-ramps, the possible lane-change reaction of the lag car has not been widely studied. In this work we aim to improve the simulation of the highway m…
▽ More
Enhancing simulation environments to replicate real-world driver behavior is essential for developing Autonomous Vehicle technology. While some previous works have studied the yielding reaction of lag vehicles in response to a merging car at highway on-ramps, the possible lane-change reaction of the lag car has not been widely studied. In this work we aim to improve the simulation of the highway merge scenario by including the lane-change reaction in addition to yielding behavior of main-lane lag vehicles, and we evaluate two different models for their ability to capture this reactive lane-change behavior. To tune the payoff functions of these models, a novel naturalistic dataset was collected on U.S. highways that provided several hours of merge-specific data to learn the lane change behavior of U.S. drivers. To make sure that we are collecting a representative set of different U.S. highway geometries in our data, we surveyed 50,000 U.S. highway on-ramps and then selected eight representative sites. The data were collected using roadside-mounted lidar sensors to capture various merge driver interactions. The models were demonstrated to be configurable for both keep-straight and lane-change behavior. The models were finally integrated into a high-fidelity simulation environment and confirmed to have adequate computation time efficiency for use in large-scale simulations to support autonomous vehicle development.
△ Less
Submitted 26 July, 2024; v1 submitted 15 April, 2024;
originally announced April 2024.
-
MR-IDM -- Merge Reactive Intelligent Driver Model: Towards Enhancing Laterally Aware Car-following Models
Authors:
Dustin Holley,
Jovin D'sa,
Hossein Nourkhiz Mahjoub,
Gibran Ali,
Behdad Chalaki,
Ehsan Moradi-Pari
Abstract:
This paper discusses the limitations of existing microscopic traffic models in accounting for the potential impacts of on-ramp vehicles on the car-following behavior of main-lane vehicles on highways. We first surveyed U.S. on-ramps to choose a representative set of on-ramps and then collected real-world observational data from the merging vehicle's perspective in various traffic conditions rangin…
▽ More
This paper discusses the limitations of existing microscopic traffic models in accounting for the potential impacts of on-ramp vehicles on the car-following behavior of main-lane vehicles on highways. We first surveyed U.S. on-ramps to choose a representative set of on-ramps and then collected real-world observational data from the merging vehicle's perspective in various traffic conditions ranging from free-flowing to rush-hour traffic jams. Next, as our core contribution, we introduce a novel car-following model, called MR-IDM, for highway driving that reacts to merging vehicles in a realistic way. This proposed driving model can either be used in traffic simulators to generate realistic highway driving behavior or integrated into a prediction module for autonomous vehicles attempting to merge onto the highway. We quantitatively evaluated the effectiveness of our model and compared it against several other methods. We show that MR-IDM has the least error in mimicking the real-world data, while having features such as smoothness, stability, and lateral awareness.
△ Less
Submitted 19 May, 2023;
originally announced May 2023.
-
Minimally Disruptive Cooperative Lane-change Maneuvers
Authors:
Behdad Chalaki,
Vaishnav Tadiparthi,
Hossein Nourkhiz Mahjoub,
Jovin D'sa,
Ehsan Moradi-Pari,
Andres S. Chavez Armijos,
Anni Li,
Christos G. Cassandras
Abstract:
A lane-change maneuver on a congested highway could be severely disruptive or even infeasible without the cooperation of neighboring cars. However, cooperation with other vehicles does not guarantee that the performed maneuver will not have a negative impact on traffic flow unless it is explicitly considered in the cooperative controller design. In this letter, we present a socially compliant fram…
▽ More
A lane-change maneuver on a congested highway could be severely disruptive or even infeasible without the cooperation of neighboring cars. However, cooperation with other vehicles does not guarantee that the performed maneuver will not have a negative impact on traffic flow unless it is explicitly considered in the cooperative controller design. In this letter, we present a socially compliant framework for cooperative lane-change maneuvers for an arbitrary number of CAVs on highways that aims to interrupt traffic flow as minimally as possible. Moreover, we explicitly impose feasibility constraints in the optimization formulation by using reachability set theory, leading to a unified design that removes the need for an iterative procedure used in prior work. We quantitatively evaluate the effectiveness of our framework and compare it against previously offered approaches in terms of maneuver time and incurred throughput disruption.
△ Less
Submitted 10 March, 2023;
originally announced March 2023.
-
Cooperative Energy and Time-Optimal Lane Change Maneuvers with Minimal Highway Traffic Disruption
Authors:
Andres S. Chavez Armijos,
Anni Li,
Christos G. Cassandras,
Yasir K. Al-Nadawi,
Hidekazu Araki,
Behdad Chalaki,
Ehsan Moradi-Pari,
Hossein Nourkhiz Mahjoub,
Vaishnav Tadiparthi
Abstract:
We derive optimal control policies for a Connected Automated Vehicle (CAV) and cooperating neighboring CAVs to carry out a lane change maneuver consisting of a longitudinal phase where the CAV properly positions itself relative to the cooperating neighbors and a lateral phase where it safely changes lanes. In contrast to prior work on this problem, where the CAV "selfishly" only seeks to minimize…
▽ More
We derive optimal control policies for a Connected Automated Vehicle (CAV) and cooperating neighboring CAVs to carry out a lane change maneuver consisting of a longitudinal phase where the CAV properly positions itself relative to the cooperating neighbors and a lateral phase where it safely changes lanes. In contrast to prior work on this problem, where the CAV "selfishly" only seeks to minimize its maneuver time, we seek to ensure that the fast-lane traffic flow is minimally disrupted (through a properly defined metric). Additionally, when performing lane-changing maneuvers, we optimally select the cooperating vehicles from a set of feasible neighboring vehicles and experimentally show that the highway throughput is improved compared to the baseline case of human-driven vehicles changing lanes with no cooperation. When feasible solutions do not exist for a given maximal allowable disruption, we include a time relaxation method trading off a longer maneuver time with reduced disruption. Our analysis is also extended to multiple sequential maneuvers. Simulation results show the effectiveness of our controllers in terms of safety guarantees and up to 16% and 90% average throughput and maneuver time improvement respectively when compared to maneuvers with no cooperation.
△ Less
Submitted 15 November, 2022;
originally announced November 2022.
-
Sequential Cooperative Energy and Time-Optimal Lane Change Maneuvers for Highway Traffic
Authors:
Andres S. Chavez Armijos,
Rui Chen,
Christos G. Cassandras,
Yasir K. Al-Nadawi,
Hossein Noukhiz Mahjoub,
Hidekazu Araki
Abstract:
We derive optimal control policies for a Connected Automated Vehicle (CAV) and cooperating neighboring CAVs to carry out a lane change maneuver consisting of a longitudinal phase where the CAV properly positions itself relative to the cooperating neighbors and a lateral phase where it safely changes lanes. In contrast to prior work on this problem, where the CAV "selfishly" seeks to minimize its m…
▽ More
We derive optimal control policies for a Connected Automated Vehicle (CAV) and cooperating neighboring CAVs to carry out a lane change maneuver consisting of a longitudinal phase where the CAV properly positions itself relative to the cooperating neighbors and a lateral phase where it safely changes lanes. In contrast to prior work on this problem, where the CAV "selfishly" seeks to minimize its maneuver time, we seek to ensure that the fast-lane traffic flow is minimally disrupted (through a properly defined metric) and that highway throughput is improved by optimally selecting the cooperating vehicles. We show that analytical solutions for the optimal trajectories can be derived and are guaranteed to satisfy safety constraints for all vehicles involved in the maneuver. When feasible solutions do not exist, we include a time relaxation method trading off a longer maneuver time with reduced disruption. Our analysis is also extended to multiple sequential maneuvers. Simulation results where the controllers are implemented show their effectiveness in terms of safety guarantees and up to 35% throughput improvement compared to maneuvers with no vehicle cooperation.
△ Less
Submitted 31 March, 2022;
originally announced March 2022.
-
Representing Realistic Human Driver Behaviors using a Finite Size Gaussian Process Kernel Bank
Authors:
Hossein Nourkhiz Mahjoub,
Arash Raftari,
Rodolfo Valiente,
Yaser P. Fallah,
Syed K. Mahmud
Abstract:
The performance of cooperative vehicular applications is tightly dependent on the reliability of the underneath Vehicle-to-Everything (V2X) communication technology. V2X standards, such as Dedicated Short-Range Communications (DSRC) and Cellular-V2X (C-V2X), which are passing their research phase before being mandated in the US, are supposed to serve as reliable circulatory systems for the time-cr…
▽ More
The performance of cooperative vehicular applications is tightly dependent on the reliability of the underneath Vehicle-to-Everything (V2X) communication technology. V2X standards, such as Dedicated Short-Range Communications (DSRC) and Cellular-V2X (C-V2X), which are passing their research phase before being mandated in the US, are supposed to serve as reliable circulatory systems for the time-critical information in vehicular networks; however, they are still heavily suffering from scalability issues in real traffic scenarios. The technology-agnostic notion of Model-Based Communications (MBC) has been proposed in our previous works as a promising paradigm to address the scalability issue and its performance, while acquiring different modeling strategies, has been vastly studied. In this work, the modeling capabilities of a powerful non-parametric Bayesian inference scheme, i.e., Gaussian Processes (GPs), is investigated within the MBC context with more details. Our observations reveal an important potential strength of GP-based MBC scheme, i.e., its capability of accurately modeling different driving behavioral patterns by utilizing only a limited size GP kernel bank. This interesting aspect of integrating GP inference with MBC framework, which has been verified in this work using realistic driving data sets, introduces this architecture as a strong and appealing candidate to address the scalability challenge. The results confirm that our proposed approach over-performs the state of the art research in terms of the required communication rate and GP kernel bank size.
△ Less
Submitted 30 March, 2020;
originally announced March 2020.
-
V2X System Architecture Utilizing Hybrid Gaussian Process-based Model Structures
Authors:
Hossein Nourkhiz Mahjoub,
Behrad Toghi,
S M Osman Gani,
Yaser P. Fallah
Abstract:
Scalable communication is of utmost importance for reliable dissemination of time-sensitive information in cooperative vehicular ad-hoc networks (VANETs), which is, in turn, an essential prerequisite for the proper operation of the critical cooperative safety applications. The model-based communication (MBC) is a recently-explored scalability solution proposed in the literature, which has shown a…
▽ More
Scalable communication is of utmost importance for reliable dissemination of time-sensitive information in cooperative vehicular ad-hoc networks (VANETs), which is, in turn, an essential prerequisite for the proper operation of the critical cooperative safety applications. The model-based communication (MBC) is a recently-explored scalability solution proposed in the literature, which has shown a promising potential to reduce the channel congestion to a great extent. In this work, based on the MBC notion, a technology-agnostic hybrid model selection policy for Vehicle-to-Everything (V2X) communication is proposed which benefits from the characteristics of the non-parametric Bayesian inference techniques, specifically Gaussian Processes. The results show the effectiveness of the proposed communication architecture on both reducing the required message exchange rate and increasing the remote agent tracking precision.
△ Less
Submitted 5 March, 2019; v1 submitted 4 March, 2019;
originally announced March 2019.
-
Composite α-μ Based DSRC Channel Model Using Large Data Set of RSSI Measurements
Authors:
Hossein Nourkhiz Mahjoub,
Amin Tahmasbi-Sarvestani,
S M Osman Gani,
Yaser P. Fallah
Abstract:
Channel modeling is essential for design and performance evaluation of numerous protocols in vehicular networks. In this work, we study and provide results for largescale and small-scale modeling of communication channel in dense vehicular networks. We first propose an approach to remove the effect of fading on deterministic part of the large-scale model and verify its accuracy using a single tran…
▽ More
Channel modeling is essential for design and performance evaluation of numerous protocols in vehicular networks. In this work, we study and provide results for largescale and small-scale modeling of communication channel in dense vehicular networks. We first propose an approach to remove the effect of fading on deterministic part of the large-scale model and verify its accuracy using a single transmitter-receiver scenario. Two-ray model is then utilized for path-loss characterization and its parameters are derived from the empirical data based on a newly proposed method. Afterward, we use α-μ distribution to model the fading behavior of vehicular networks for the first time, and validate its precision by Kolmogorov-Smirnov (K-S) goodness-of-fit test. To this end, the significantly better performance of utilizing α-μ distribution over the most adopted fading distribution in the vehicular channels literature, i.e. Nakagami-m, in terms of passing K-S test has been investigated and statistically verified in this paper. A large received signal strength indicator (RSSI) dataset from a measurement campaign is used to evaluate our claims. Moreover, the whole model is implemented in a reliable discrete event network simulator which is widely used in the academic and industrial research for network analysis, i.e. network simulator-3 (ns-3), to show the outcome of the proposed model in the presence of upper layer network protocols.
△ Less
Submitted 1 August, 2018;
originally announced August 2018.
-
A Driver Behavior Modeling Structure Based on Non-parametric Bayesian Stochastic Hybrid Architecture
Authors:
Hossein Nourkhiz Mahjoub,
Behrad Toghi,
Yaser P. Fallah
Abstract:
Heterogeneous nature of the vehicular networks, which results from the co-existence of human-driven, semi-automated, and fully autonomous vehicles, is a challenging phenomenon toward the realization of the intelligent transportation systems with an acceptable level of safety, comfort, and efficiency. Safety applications highly suffer from communication resource limitations, specifically in dense a…
▽ More
Heterogeneous nature of the vehicular networks, which results from the co-existence of human-driven, semi-automated, and fully autonomous vehicles, is a challenging phenomenon toward the realization of the intelligent transportation systems with an acceptable level of safety, comfort, and efficiency. Safety applications highly suffer from communication resource limitations, specifically in dense and congested vehicular networks. The idea of model-based communication (MBC) has been recently proposed to address this issue. In this work, we propose Gaussian Process-based Stochastic Hybrid System with Cumulative Relevant History (CRH-GP-SHS) framework, which is a hierarchical stochastic hybrid modeling structure, built upon a non-parametric Bayesian inference method, i.e. Gaussian processes. This framework is proposed in order to be employed within the MBC context to jointly model driver/vehicle behavior as a stochastic object. Non-parametric Bayesian methods relieve the limitations imposed by non-evolutionary model structures and enable the proposed framework to properly capture different stochastic behaviors. The performance of the proposed CRH-GP-SHS framework at the inter-mode level has been evaluated over a set of realistic lane change maneuvers from NGSIM-US101 dataset. The results show a noticeable performance improvement for GP in comparison to the baseline constant speed model, specifically in critical situations such as highly congested networks. Moreover, an augmented model has also been proposed which is a composition of GP and constant speed models and capable of capturing the driver behavior under various network reliability conditions.
△ Less
Submitted 10 July, 2018;
originally announced July 2018.
-
A Learning-based Stochastic MPC Design for Cooperative Adaptive Cruise Control to Handle Interfering Vehicles
Authors:
Hadi Kazemi,
Hossein Nourkhiz Mahjoub,
Amin Tahmasbi-Sarvestani,
Yaser P. Fallah
Abstract:
Vehicle to Vehicle (V2V) communication has a great potential to improve reaction accuracy of different driver assistance systems in critical driving situations. Cooperative Adaptive Cruise Control (CACC), which is an automated application, provides drivers with extra benefits such as traffic throughput maximization and collision avoidance. CACC systems must be designed in a way that are sufficient…
▽ More
Vehicle to Vehicle (V2V) communication has a great potential to improve reaction accuracy of different driver assistance systems in critical driving situations. Cooperative Adaptive Cruise Control (CACC), which is an automated application, provides drivers with extra benefits such as traffic throughput maximization and collision avoidance. CACC systems must be designed in a way that are sufficiently robust against all special maneuvers such as cutting-into the CACC platoons by interfering vehicles or hard braking by leading cars. To address this problem, a Neural- Network (NN)-based cut-in detection and trajectory prediction scheme is proposed in the first part of this paper. Next, a probabilistic framework is developed in which the cut-in probability is calculated based on the output of the mentioned cut-in prediction block. Finally, a specific Stochastic Model Predictive Controller (SMPC) is designed which incorporates this cut-in probability to enhance its reaction against the detected dangerous cut-in maneuver. The overall system is implemented and its performance is evaluated using realistic driving scenarios from Safety Pilot Model Deployment (SPMD).
△ Less
Submitted 26 February, 2018;
originally announced February 2018.
-
A Stochastic Hybrid Framework for Driver Behavior Modeling Based on Hierarchical Dirichlet Process
Authors:
Hossein Nourkhiz Mahjoub,
Behrad Toghi,
Yaser P. Fallah
Abstract:
Scalability is one of the major issues for real-world Vehicle-to-Vehicle network realization. To tackle this challenge, a stochastic hybrid modeling framework based on a non-parametric Bayesian inference method, i.e., hierarchical Dirichlet process (HDP), is investigated in this paper. This framework is able to jointly model driver/vehicle behavior through forecasting the vehicle dynamical time-se…
▽ More
Scalability is one of the major issues for real-world Vehicle-to-Vehicle network realization. To tackle this challenge, a stochastic hybrid modeling framework based on a non-parametric Bayesian inference method, i.e., hierarchical Dirichlet process (HDP), is investigated in this paper. This framework is able to jointly model driver/vehicle behavior through forecasting the vehicle dynamical time-series. This modeling framework could be merged with the notion of model-based information networking, which is recently proposed in the vehicular literature, to overcome the scalability challenges in dense vehicular networks via broadcasting the behavioral models instead of raw information dissemination. This modeling approach has been applied on several scenarios from the realistic Safety Pilot Model Deployment (SPMD) driving data set and the results show a higher performance of this model in comparison with the zero-hold method as the baseline.
△ Less
Submitted 10 July, 2018; v1 submitted 15 November, 2017;
originally announced November 2017.