-
A Generative Physics-Informed Reinforcement Learning-Based Approach for Construction of Representative Drive Cycle
Authors:
Amirreza Yasami,
Mohammadali Tofigh,
Mahdi Shahbakhti,
Charles Robert Koch
Abstract:
Accurate driving cycle construction is crucial for vehicle design, fuel economy analysis, and environmental impact assessments. A generative Physics-Informed Expected SARSA-Monte Carlo (PIESMC) approach that constructs representative driving cycles by capturing transient dynamics, acceleration, deceleration, idling, and road grade transitions while ensuring model fidelity is introduced. Leveraging…
▽ More
Accurate driving cycle construction is crucial for vehicle design, fuel economy analysis, and environmental impact assessments. A generative Physics-Informed Expected SARSA-Monte Carlo (PIESMC) approach that constructs representative driving cycles by capturing transient dynamics, acceleration, deceleration, idling, and road grade transitions while ensuring model fidelity is introduced. Leveraging a physics-informed reinforcement learning framework with Monte Carlo sampling, PIESMC delivers efficient cycle construction with reduced computational cost. Experimental evaluations on two real-world datasets demonstrate that PIESMC replicates key kinematic and energy metrics, achieving up to a 57.3% reduction in cumulative kinematic fragment errors compared to the Micro-trip-based (MTB) method and a 10.5% reduction relative to the Markov-chain-based (MCB) method. Moreover, it is nearly an order of magnitude faster than conventional techniques. Analyses of vehicle-specific power distributions and wavelet-transformed frequency content further confirm its ability to reproduce experimental central tendencies and variability.
△ Less
Submitted 9 June, 2025;
originally announced June 2025.
-
Machine Learning Integrated with Model Predictive Control for Imitative Optimal Control of Compression Ignition Engines
Authors:
Armin Norouzi,
Saeid Shahpouri,
David Gordon,
Alexander Winkler,
Eugen Nuss,
Dirk Abel,
Jakob Andert,
Mahdi Shahbakhti,
Charles Robert Koch
Abstract:
The high thermal efficiency and reliability of the compression-ignition engine makes it the first choice for many applications. For this to continue, a reduction of the pollutant emissions is needed. One solution is the use of machine learning (ML) and model predictive control (MPC) to minimize emissions and fuel consumption, without adding substantial computational cost to the engine controller.…
▽ More
The high thermal efficiency and reliability of the compression-ignition engine makes it the first choice for many applications. For this to continue, a reduction of the pollutant emissions is needed. One solution is the use of machine learning (ML) and model predictive control (MPC) to minimize emissions and fuel consumption, without adding substantial computational cost to the engine controller. ML is developed in this paper for both modeling engine performance and emissions and for imitating the behaviour of an Linear Parameter Varying (LPV) MPC. Using a support vector machine-based linear parameter varying model of the engine performance and emissions, a model predictive controller is implemented for a 4.5 Cummins diesel engine. This online optimized MPC solution offers advantages in minimizing the \nox~emissions and fuel consumption compared to the baseline feedforward production controller. To reduce the computational cost of this MPC, a deep learning scheme is designed to mimic the behavior of the developed controller. The performance in reducing NOx emissions at a constant load by the imitative controller is similar to that of the online optimized MPC compared to the Cummins production controller. In addition, the imitative controller requires 50 times less computation time compared to that of the online MPC optimization.
△ Less
Submitted 2 August, 2022; v1 submitted 31 March, 2022;
originally announced April 2022.
-
Deep Learning based Model Predictive Control for Compression Ignition Engines
Authors:
Armin Norouzi,
Saeid Shahpouri,
David Gordon,
Alexander Winkler,
Eugen Nuss,
Dirk Abel,
Jakob Andert,
Mahdi Shahbakhti,
Charles Robert Koch
Abstract:
Machine learning (ML) and a nonlinear model predictive controller (NMPC) are used in this paper to minimize the emissions and fuel consumption of a compression ignition engine. In this work machine learning is applied in two methods. In the first application, ML is used to identify a model for implementation in model predictive control optimization problems. In the second application, ML is used a…
▽ More
Machine learning (ML) and a nonlinear model predictive controller (NMPC) are used in this paper to minimize the emissions and fuel consumption of a compression ignition engine. In this work machine learning is applied in two methods. In the first application, ML is used to identify a model for implementation in model predictive control optimization problems. In the second application, ML is used as a replacement of the NMPC where the ML controller learns the optimal control action by imitating or mimicking the behavior of the model predictive controller. In this study, a deep recurrent neural network including long-short term memory (LSTM) layers are used to model the emissions and performance of an industrial 4.5 liter 4-cylinder Cummins diesel engine. This model is then used for model predictive controller implementation. Then, a deep learning scheme is deployed to clone the behavior of the developed controller. In the LSTM integration, a novel scheme is used by augmenting hidden and cell states of the network in an NMPC optimization problem. The developed LSTM-NMPC and the imitative NMPC are compared with the Cummins calibrated Engine Control Unit (ECU) model in an experimentally validated engine simulation platform. Results show a significant reduction in Nitrogen Oxides (\nox) emissions and a slight decrease in the injected fuel quantity while maintaining the same load. In addition, the imitative NMPC has a similar performance as the NMPC but with a two orders of magnitude reduction of the computation time.
△ Less
Submitted 4 August, 2022; v1 submitted 31 March, 2022;
originally announced April 2022.
-
Predictive Second Order Sliding Control of Constrained Linear Systems with Application to Automotive Control Systems
Authors:
Mohammad Reza Amini,
Mahdi Shahbakhti,
Jing Sun
Abstract:
This paper presents a new predictive second order sliding controller (PSSC) formulation for setpoint tracking of constrained linear systems. The PSSC scheme is developed by combining the concepts of model predictive control (MPC) and second order discrete sliding mode control. In order to guarantee the feasibility of the PSSC during setpoint changes, a virtual reference variable is added to the PS…
▽ More
This paper presents a new predictive second order sliding controller (PSSC) formulation for setpoint tracking of constrained linear systems. The PSSC scheme is developed by combining the concepts of model predictive control (MPC) and second order discrete sliding mode control. In order to guarantee the feasibility of the PSSC during setpoint changes, a virtual reference variable is added to the PSSC cost function to calculate the closest admissible set point. The states of the system are then driven asymptotically to this admissible setpoint by the control action of the PSSC. The performance of the proposed PSSC is evaluated for an advanced automotive engine case study, where a high fidelity physics-based model of a reactivity controlled compression ignition (RCCI) engine is utilized to serve as the virtual test-bed for the simulations. Considering the hard physical constraints on the RCCI engine states and control inputs, simultaneous tracking of engine load and optimal combustion phasing is a challenging objective to achieve. The simulation results of testing the proposed PSSC on the high fidelity RCCI model show that the developed predictive controller is able to track desired engine load and combustion phasing setpoints, with minimum steady state error, and no overshoot. Moreover, the simulation results confirm the robust tracking performance of the PSSC during transient operations, in the presence of engine cyclic variability.
△ Less
Submitted 5 February, 2018;
originally announced February 2018.
-
Design of an SI Engine Cold Start Controller based on Dynamic Coupling Analysis
Authors:
Mohammad Reza Amini,
Mahdi Shahbakhti
Abstract:
In this paper, the dynamic couplings among different inputs and outputs of a highly nonlinear spark ignition (SI) engine control problem during the cold start phase are evaluated by using relative gain array (RGA) technique. First, based on the experimental data, a multi-input multi-output model is developed to represent the engine dynamics. Second, the coupling among different inputs and outputs…
▽ More
In this paper, the dynamic couplings among different inputs and outputs of a highly nonlinear spark ignition (SI) engine control problem during the cold start phase are evaluated by using relative gain array (RGA) technique. First, based on the experimental data, a multi-input multi-output model is developed to represent the engine dynamics. Second, the coupling among different inputs and outputs of the model is evaluated by using RGA technique in both open-loop and closed-loop structures. The results show that although there is an internal coupling within the engine dynamics in the open-loop framework, the closed-loop engine controller can be designed using a decentralized structure without significantly affecting the system performance. In the next step, based on a nonlinear physics-based model of the engine, a set of single-input single-output (SISO) adaptive second order discrete sliding mode controllers (DSMC) are designed to drive the states of the engine model to their pre-defined desired trajectories and minimize the tailpipe HC emission, under modelling and implementation (data sampling and quantization) uncertainties. The real-time test results on an actual engine control unit (ECU) show that the proposed SISO adaptive second order DSMC provides accurate and fast tracking performance for the highly nonlinear and internally coupled engine dynamics, and can meet the HC emission limit by controlling the engine-out emissions and exhaust catalytic converter efficiency.
△ Less
Submitted 9 October, 2017;
originally announced October 2017.
