-
Multi-Task Lane-Free Driving Strategy for Connected and Automated Vehicles: A Multi-Agent Deep Reinforcement Learning Approach
Authors:
Mehran Berahman,
Majid Rostami-Shahrbabaki,
Klaus Bogenberger
Abstract:
Deep reinforcement learning has shown promise in various engineering applications, including vehicular traffic control. The non-stationary nature of traffic, especially in the lane-free environment with more degrees of freedom in vehicle behaviors, poses challenges for decision-making since a wrong action might lead to a catastrophic failure. In this paper, we propose a novel driving strategy for…
▽ More
Deep reinforcement learning has shown promise in various engineering applications, including vehicular traffic control. The non-stationary nature of traffic, especially in the lane-free environment with more degrees of freedom in vehicle behaviors, poses challenges for decision-making since a wrong action might lead to a catastrophic failure. In this paper, we propose a novel driving strategy for Connected and Automated Vehicles (CAVs) based on a competitive Multi-Agent Deep Deterministic Policy Gradient approach. The developed multi-agent deep reinforcement learning algorithm creates a dynamic and non-stationary scenario, mirroring real-world traffic complexities and making trained agents more robust. The algorithm's reward function is strategically and uniquely formulated to cover multiple vehicle control tasks, including maintaining desired speeds, overtaking, collision avoidance, and merging and diverging maneuvers. Moreover, additional considerations for both lateral and longitudinal passenger comfort and safety criteria are taken into account. We employed inter-vehicle forces, known as nudging and repulsive forces, to manage the maneuvers of CAVs in a lane-free traffic environment. The proposed driving algorithm is trained and evaluated on lane-free roads using the Simulation of Urban Mobility platform. Experimental results demonstrate the algorithm's efficacy in handling different objectives, highlighting its potential to enhance safety and efficiency in autonomous driving within lane-free traffic environments.
△ Less
Submitted 20 June, 2024;
originally announced June 2024.
-
SVR Algorithm as a Tool for More Optimal Intergalactic Medium Simulation in the Epoch of Reionization
Authors:
Mahsa Berahman,
Seyed Sajad Tabasi,
Javad T. Firouzjaee,
S. Mobina Hosseini
Abstract:
All kinds of simulations of the intergalactic medium, such as hydrodynamic simulation, N-body simulation, numerical and semi-numerical simulation, etc., have been used to realize the history of this medium. In addition, emulators also have become widely used in recent years. Especially because they are very fast, they are used in many works instead of actual complete simulations. Emulators are tra…
▽ More
All kinds of simulations of the intergalactic medium, such as hydrodynamic simulation, N-body simulation, numerical and semi-numerical simulation, etc., have been used to realize the history of this medium. In addition, emulators also have become widely used in recent years. Especially because they are very fast, they are used in many works instead of actual complete simulations. Emulators are trained with the help of simulator results and can work with very high accuracy similar to real simulators. Usually, reliable machine learning algorithms, such as neural networks, are used to program these emulators. In this work, we show that one of the best machine learning algorithms that can be used in general and have extremely high accuracy is the Support Vector Regression algorithm. This algorithm works better than the Multilayer Perceptron algorithm not only from the practical point of view but also from the theoretical point of view. To prove this issue, we have considered the 21SSD hydrodynamical simulation in addition to the theoretical arguments, and we have used both algorithms to be trained by this simulation for comparison. Finally, we have shown that the Support Vector Regression algorithm can be a much better and more accurate algorithm than neural network algorithms in future emulations, and by mastering it, one can neglect other algorithms with full confidence. Although this work is focused only on an intergalactic medium simulation in the Epoch of Reionization, it can be used for all other simulations regardless of their type. In other words, it can be employed for all hydrodynamic simulations, N-body simulations, etc. in all cosmic epochs and rely on its results.
△ Less
Submitted 26 December, 2024; v1 submitted 26 October, 2023;
originally announced October 2023.
-
New Accretion Constraint on the Evaporation of Primordial Black Holes
Authors:
Seyed Sajad Tabas,
Mahsa Berahman,
Javad T. Firouzjaee
Abstract:
In this paper, we have investigated the processes of evaporation and accretion of primordial black holes during the radiation-dominated era and the matter-dominated era. This subject is very important since usually these two processes are considered independent of each other. In other words, previous works consider them in such a way that they do not have a direct effect on each other, and as a re…
▽ More
In this paper, we have investigated the processes of evaporation and accretion of primordial black holes during the radiation-dominated era and the matter-dominated era. This subject is very important since usually these two processes are considered independent of each other. In other words, previous works consider them in such a way that they do not have a direct effect on each other, and as a result, their effects on the mass of primordial black holes are calculated separately. The calculations of this paper indicate that assuming these two processes independently of each other will lead to wrong results that only give correct answers within certain limits. In fact, in general, it is a mistake to consider the static state for the event horizon of primordial black holes and perform calculations related to their evaporation, while the radius of primordial black holes is constantly changing due to accretion. In addition, we have shown that considering the dynamic event horizon in some masses and in some times can lead to the shutdown of the Hawking evaporation process. This study is much more accurate and detailed than our previous study. These calculations show well the mass evolution of primordial black holes from the time of formation to the end of the matter-dominated era, taking into account both the main processes governing black holes, evaporation and accretion.
△ Less
Submitted 8 August, 2022;
originally announced August 2022.
-
Scanning Tunneling Spectroscopy of MoS2 monolayer in presence of ethanol gas
Authors:
Seyed Ali Hosseini,
Azam Irajizad,
Masud Berahman,
Farzaneh Aghakhani Mahyari,
Seyed Hossein Hosseini Shokouh
Abstract:
Due to high surface to volume ratio and tunable band gap, 2 Dimensional (2D) layered materials such as MoS2, is good candidate for gas sensing applications. This research mainly focuses on variation of Density of States (DOS) of MoS2 nanosheets caused by ethanol adsorption. The nanosheets are synthesized by liquid exfoliation, and then using Scanning Tunneling Spectroscopy (STS) and Density Functi…
▽ More
Due to high surface to volume ratio and tunable band gap, 2 Dimensional (2D) layered materials such as MoS2, is good candidate for gas sensing applications. This research mainly focuses on variation of Density of States (DOS) of MoS2 nanosheets caused by ethanol adsorption. The nanosheets are synthesized by liquid exfoliation, and then using Scanning Tunneling Spectroscopy (STS) and Density Functional Theory (DFT), local electronic characteristic such as DOS and band gap in non-vacuum condition are analyzed. The results show that ethanol adsorption enhances DOS and deform orbitals near the valence and conduction bands that increase transport of carriers on the sheet.
△ Less
Submitted 15 February, 2018; v1 submitted 2 September, 2017;
originally announced September 2017.
-
Optical Properties of Chiral Graphene Nanoribbons: a First Principal Study
Authors:
M. Berahman,
M. Asad,
M. H. Sheikhi
Abstract:
In this paper, optical properties of Chiral Graphene Nanoribbons both in longitude and transverse polarization have been studied using density functional theory calculation. It has been shown that the selection rule which have been reported before for Armchair and Zigzag Graphene Nanoribbons are no longer valid due to breaking symmetry on these new categorize of graphene nanoribbons. However, stil…
▽ More
In this paper, optical properties of Chiral Graphene Nanoribbons both in longitude and transverse polarization have been studied using density functional theory calculation. It has been shown that the selection rule which have been reported before for Armchair and Zigzag Graphene Nanoribbons are no longer valid due to breaking symmetry on these new categorize of graphene nanoribbons. However, still the edge states play a critical role in optical absorption. It have been illustrated that depending on the polarization of incident beam the absorption peaks are different while it is spread in the same energy range. It is also suggested that the absorption of light is sensitive to the chiral vector on the edges and direction of the light polarization. Due to breaking symmetry in chiral graphene nanoribbons, absorption peak is changed and it would be around 1000nm, introducing a new potential of graphene nanoribbons for optoelectronic devices.
△ Less
Submitted 19 May, 2012;
originally announced May 2012.
