-
A state reduction approach for learning-based model predictive control for train rescheduling
Authors:
Caio Fabio Oliveira da Silva,
Xiaoyu Liu,
Azita Dabiri,
Bart De Schutter
Abstract:
This paper proposes a state reduction method for learning-based model predictive control (MPC) for train rescheduling in urban rail transit systems. The state reduction integrates into a control framework where the discrete decision variables are determined by a learning-based classifier and the continuous decision variables are computed by MPC. Herein, the state representation is designed separat…
▽ More
This paper proposes a state reduction method for learning-based model predictive control (MPC) for train rescheduling in urban rail transit systems. The state reduction integrates into a control framework where the discrete decision variables are determined by a learning-based classifier and the continuous decision variables are computed by MPC. Herein, the state representation is designed separately for each component of the control framework. While a reduced state is employed for learning, a full state is used in MPC. Simulations on a large-scale train network highlight the effectiveness of the state reduction mechanism in improving the performance and reducing the memory usage.
△ Less
Submitted 28 April, 2025;
originally announced April 2025.
-
Learning-based Model Predictive Control for Passenger-Oriented Train Rescheduling with Flexible Train Composition
Authors:
Xiaoyu Liu,
Caio Fabio Oliveira da Silva,
Azita Dabiri,
Yihui Wang,
Bart De Schutter
Abstract:
This paper focuses on passenger-oriented real-time train rescheduling, considering flexible train composition and rolling stock circulation, by integrating learning-based and optimization-based approaches. A learning-based model predictive control (MPC) approach is developed for real-time train rescheduling with flexible train composition and rolling stock circulation to address time-varying passe…
▽ More
This paper focuses on passenger-oriented real-time train rescheduling, considering flexible train composition and rolling stock circulation, by integrating learning-based and optimization-based approaches. A learning-based model predictive control (MPC) approach is developed for real-time train rescheduling with flexible train composition and rolling stock circulation to address time-varying passenger demands. In the proposed approach, first, the values of the integer variables are obtained by pre-trained long short-term memory (LSTM) networks; next, they are fixed and the values of continuous variables are determined via nonlinear constrained optimization. The learning-based MPC approach enables us to jointly consider efficiency and constraint satisfaction by combining learning-based and optimization-based approaches. In order to reduce the number of integer variables, four presolve techniques are developed to prune a subset of integer decision variables. Numerical simulations based on real-life data from the Beijing urban rail transit system are conducted to illustrate the effectiveness of the developed learning-based MPC approach.
△ Less
Submitted 21 February, 2025;
originally announced February 2025.
-
Integrating Reinforcement Learning and Model Predictive Control with Applications to Microgrids
Authors:
Caio Fabio Oliveira da Silva,
Azita Dabiri,
Bart De Schutter
Abstract:
This work proposes an approach that integrates reinforcement learning and model predictive control (MPC) to solve finite-horizon optimal control problems in mixed-logical dynamical systems efficiently. Optimization-based control of such systems with discrete and continuous decision variables entails the online solution of mixed-integer linear programs, which suffer from the curse of dimensionality…
▽ More
This work proposes an approach that integrates reinforcement learning and model predictive control (MPC) to solve finite-horizon optimal control problems in mixed-logical dynamical systems efficiently. Optimization-based control of such systems with discrete and continuous decision variables entails the online solution of mixed-integer linear programs, which suffer from the curse of dimensionality. Our approach aims to mitigate this issue by decoupling the decision on the discrete variables from the decision on the continuous variables. In the proposed approach, reinforcement learning determines the discrete decision variables and simplifies the online optimization problem of the MPC controller from a mixed-integer linear program to a linear program, significantly reducing the computational time. A fundamental contribution of this work is the definition of the decoupled Q-function, which plays a crucial role in making the learning problem tractable in a combinatorial action space. We motivate the use of recurrent neural networks to approximate the decoupled Q-function and show how they can be employed in a reinforcement learning setting. Simulation experiments on a microgrid system using real-world data demonstrate that the proposed method substantially reduces the online computation time of MPC while maintaining high feasibility and low suboptimality.
△ Less
Submitted 14 April, 2025; v1 submitted 17 September, 2024;
originally announced September 2024.
-
Enhancing Network Slicing Architectures with Machine Learning, Security, Sustainability and Experimental Networks Integration
Authors:
Joberto S. B. Martins,
Tereza C. Carvalho,
Rodrigo Moreira,
Cristiano Both,
Adnei Donatti,
João H. Corrêa,
José A. Suruagy,
Sand L. Corrêa,
Antonio J. G. Abelem,
Moisés R. N. Ribeiro,
Jose-Marcos Nogueira,
Luiz C. S. Magalhães,
Juliano Wickboldt,
Tiago Ferreto,
Ricardo Mello,
Rafael Pasquini,
Marcos Schwarz,
Leobino N. Sampaio,
Daniel F. Macedo,
José F. de Rezende,
Kleber V. Cardoso,
Flávio O. Silva
Abstract:
Network Slicing (NS) is an essential technique extensively used in 5G networks computing strategies, mobile edge computing, mobile cloud computing, and verticals like the Internet of Vehicles and industrial IoT, among others. NS is foreseen as one of the leading enablers for 6G futuristic and highly demanding applications since it allows the optimization and customization of scarce and disputed re…
▽ More
Network Slicing (NS) is an essential technique extensively used in 5G networks computing strategies, mobile edge computing, mobile cloud computing, and verticals like the Internet of Vehicles and industrial IoT, among others. NS is foreseen as one of the leading enablers for 6G futuristic and highly demanding applications since it allows the optimization and customization of scarce and disputed resources among dynamic, demanding clients with highly distinct application requirements. Various standardization organizations, like 3GPP's proposal for new generation networks and state-of-the-art 5G/6G research projects, are proposing new NS architectures. However, new NS architectures have to deal with an extensive range of requirements that inherently result in having NS architecture proposals typically fulfilling the needs of specific sets of domains with commonalities. The Slicing Future Internet Infrastructures (SFI2) architecture proposal explores the gap resulting from the diversity of NS architectures target domains by proposing a new NS reference architecture with a defined focus on integrating experimental networks and enhancing the NS architecture with Machine Learning (ML) native optimizations, energy-efficient slicing, and slicing-tailored security functionalities. The SFI2 architectural main contribution includes the utilization of the slice-as-a-service paradigm for end-to-end orchestration of resources across multi-domains and multi-technology experimental networks. In addition, the SFI2 reference architecture instantiations will enhance the multi-domain and multi-technology integrated experimental network deployment with native ML optimization, energy-efficient aware slicing, and slicing-tailored security functionalities for the practical domain.
△ Less
Submitted 18 July, 2023;
originally announced July 2023.
-
Nonlinear MPC for Offset-Free Tracking of systems learned by GRU Neural Networks
Authors:
Fabio Bonassi,
C. F. Oliveira da Silva,
Riccardo Scattolini
Abstract:
The use of Recurrent Neural Networks (RNNs) for system identification has recently gathered increasing attention, thanks to their black-box modeling capabilities.Albeit RNNs have been fruitfully adopted in many applications, only few works are devoted to provide rigorous theoretical foundations that justify their use for control purposes. The aim of this paper is to describe how stable Gated Recur…
▽ More
The use of Recurrent Neural Networks (RNNs) for system identification has recently gathered increasing attention, thanks to their black-box modeling capabilities.Albeit RNNs have been fruitfully adopted in many applications, only few works are devoted to provide rigorous theoretical foundations that justify their use for control purposes. The aim of this paper is to describe how stable Gated Recurrent Units (GRUs), a particular RNN architecture, can be trained and employed in a Nonlinear MPC framework to perform offset-free tracking of constant references with guaranteed closed-loop stability. The proposed approach is tested on a pH neutralization process benchmark, showing remarkable performances.
△ Less
Submitted 25 January, 2022; v1 submitted 3 March, 2021;
originally announced March 2021.
-
Generalized Scalar Field Cosmologies: A Global Dynamical Systems Formulation
Authors:
Genly Leon,
Felipe Orlando Franz Silva
Abstract:
Local and global phase-space descriptions and averaging methods are used to find qualitative features of solutions for the FLRW and the Bianchi I metrics in the context of scalar field cosmologies with arbitrary potentials and arbitrary couplings to matter. The stability of the equilibrium points in a phase-space as well as the dynamics in the regime where the scalar field diverges are studied. Eq…
▽ More
Local and global phase-space descriptions and averaging methods are used to find qualitative features of solutions for the FLRW and the Bianchi I metrics in the context of scalar field cosmologies with arbitrary potentials and arbitrary couplings to matter. The stability of the equilibrium points in a phase-space as well as the dynamics in the regime where the scalar field diverges are studied. Equilibrium points that represent some solutions of cosmological interest such as: several types of scaling solutions, a kinetic dominated solution representing a stiff fluid, a solution dominated by an effective energy density of geometric origin, a quintessence scalar field dominated solution, the vacuum de Sitter solution associated to the minimum of the potential, and a non-interacting matter dominated solution are obtained. All reveal a very rich cosmological phenomenology.
△ Less
Submitted 24 September, 2020; v1 submitted 21 July, 2020;
originally announced July 2020.
-
Generalized scalar field cosmologies: theorems on asymptotic behavior
Authors:
Genly Leon,
Felipe Orlando Franz Silva
Abstract:
Phase-space descriptions are used to find qualitative features of the solutions of generalized scalar field cosmologies with arbitrary potentials and arbitrary couplings to matter. Previous results are summarized and new ones are presented as theorems, which include the previous ones as corollaries. Examples of these results are presented as well as counterexamples when the hypotheses of the theor…
▽ More
Phase-space descriptions are used to find qualitative features of the solutions of generalized scalar field cosmologies with arbitrary potentials and arbitrary couplings to matter. Previous results are summarized and new ones are presented as theorems, which include the previous ones as corollaries. Examples of these results are presented as well as counterexamples when the hypotheses of the theorems are not fulfilled. Potentials with small cosine-like corrections motivated by inflationary loop-quantum cosmology are discussed. Finally, the Hubble-normalized formulation for the FRW metric and for the Bianchi I metric is applied to a scalar field cosmology with a generalized harmonic potential, non-minimally coupled to matter, and the stability of the solutions is discussed.
△ Less
Submitted 27 November, 2020; v1 submitted 21 July, 2020;
originally announced July 2020.
-
A Perturbative Analysis of Interacting Scalar Field Cosmologies
Authors:
Genly Leon,
Esteban González,
Alfredo D. Millano,
Felipe Orlando Franz Silva
Abstract:
Scalar field cosmologies with a generalized harmonic potential are investigated in flat and negatively curved Friedmann-Lemaître-Robertson-Walker and Bianchi I metrics. An interaction between the scalar field and matter is considered. Asymptotic methods and averaging theory are used to obtain relevant information about the solution space. In this approach, the Hubble parameter plays the role of a…
▽ More
Scalar field cosmologies with a generalized harmonic potential are investigated in flat and negatively curved Friedmann-Lemaître-Robertson-Walker and Bianchi I metrics. An interaction between the scalar field and matter is considered. Asymptotic methods and averaging theory are used to obtain relevant information about the solution space. In this approach, the Hubble parameter plays the role of a time-dependent perturbation parameter which controls the magnitude of the error between full-system and time-averaged solutions as it decreases. Our approach is used to show that full and time-averaged systems have the same asymptotic behavior. Numerical simulations are presented as evidence of such behavior. Moreover, the asymptotic behavior of the solutions is independent of the coupling function.
△ Less
Submitted 15 January, 2022; v1 submitted 7 March, 2020;
originally announced March 2020.
-
Generalized scalar field cosmologies
Authors:
Genly Leon,
Felipe Orlando Franz Silva
Abstract:
In this paper, we use both local and global phase-space descriptions and averaging methods to find qualitative features of solutions for the FLRW and Bianchi I metrics in the context of scalar field cosmologies with arbitrary potentials and arbitrary couplings to matter. We prove new theorems and also retrieve previous results that can be seen as corollaries of the present results. We study the st…
▽ More
In this paper, we use both local and global phase-space descriptions and averaging methods to find qualitative features of solutions for the FLRW and Bianchi I metrics in the context of scalar field cosmologies with arbitrary potentials and arbitrary couplings to matter. We prove new theorems and also retrieve previous results that can be seen as corollaries of the present results. We study the stability of the equilibrium points in a phase-space, as well as the dynamics in the regime where the scalar field diverges. We obtain equilibrium points that represent some solutions of cosmological interest, such as several types of scaling solutions, a kinetic dominated solution representing a stiff fluid, a solution dominated by an effective energy density of geometric origin, a quintessence scalar field dominated solution, the vacuum de Sitter solution associated to the minimum of the potential, and a non-interacting matter dominated solution. All reveal a very rich cosmological phenomenology. Finally, we present some examples that violate one or more hypotheses of the Theorems proved, obtaining some counterexamples. In particular, we incorporate small cosine-like corrections motivated by inflationary loop-quantum cosmology, and we study the oscillatory behavior.
△ Less
Submitted 10 June, 2020; v1 submitted 20 December, 2019;
originally announced December 2019.
-
A Scalable Shared-Memory Parallel Simplex for Large-Scale Linear Programming
Authors:
Demetrios Coutinho,
Felipe O. Lins e Silva,
Daniel Aloise,
Samuel,
Xavier-de-Souza
Abstract:
The Simplex tableau has been broadly used and investigated in the industry and academia. With the advent of the big data era, ever larger problems are posed to be solved in ever larger machines whose architecture type did not exist in the conception of this algorithm. In this paper, we present a shared-memory parallel implementation of the Simplex tableau algorithm for dense large-scale Linear Pro…
▽ More
The Simplex tableau has been broadly used and investigated in the industry and academia. With the advent of the big data era, ever larger problems are posed to be solved in ever larger machines whose architecture type did not exist in the conception of this algorithm. In this paper, we present a shared-memory parallel implementation of the Simplex tableau algorithm for dense large-scale Linear Programming (LP) problems for use in modern multi-core architectures. We present the general scheme and explain the strategies taken to parallelize each step of the standard simplex algorithm, emphasizing the solutions found to solve performance bottlenecks. We analyzed the speedup and the parallel efficiency for the proposed implementation relative to the standard Simplex algorithm using a shared-memory system with 64 processing cores. The experiments were performed for several different problems, with up to 8192 variables and constraints, in their primal and dual formulations. The results show that the performance is mostly much better when we use the formulation with more variables than inequality constraints. Also, they show that the parallelization strategies applied to avoid bottlenecks lead the implementation to scale well with the problem size and the core count up to a certain limit of problem size. Further analysis showed that this scaling limit was an effect of resource limitation. Even though, our implementation was able to reach speedups in the order of 19x.
△ Less
Submitted 27 May, 2019; v1 submitted 12 April, 2018;
originally announced April 2018.
