-
Aging suppression in Multistrip Multigap Resistive Plate Chambers for high counting rate experiments
Authors:
M. Petris,
V. Aprodu,
D. Bartos,
D. Dorobantu,
V. Duta,
M. Petrovici,
A. Radu
Abstract:
A long term operation of Multi-Strip Multi-Gap Resistive Plate Chambers (MSMGRPC) with gas mixtures based on C2H2F4 and SF6 leads to aging effects, observed as depositions on the surface of the resistive electrodes. Moreover, enhanced depositions and higher noise rates were evidenced around the nylon spacers used for defining the gas gaps between the resistive electrodes. The aging effects are ref…
▽ More
A long term operation of Multi-Strip Multi-Gap Resistive Plate Chambers (MSMGRPC) with gas mixtures based on C2H2F4 and SF6 leads to aging effects, observed as depositions on the surface of the resistive electrodes. Moreover, enhanced depositions and higher noise rates were evidenced around the nylon spacers used for defining the gas gaps between the resistive electrodes. The aging effects are reflected in an increase of the dark current and dark counting rate, with negative impact on the long term performance of the chamber and data volume in a free running readout mode operation. MSMGRPC prototypes designed with a direct gas flow through the gas gaps and minimization of the number of spacers in the active area were developed as mitigation solution. Prototypes with this new design and different granularities were assembled using fishing line as spacers and investigated for aging effects. Although a significant reduction in the dark current and dark counting rate was evidenced, dark counting rate localized around the fishing line spacers remains. In this paper, a new generation of direct flow chambers based on discrete spacers is presented. The results of their aging investigations show that, even at lower gas flows, the aging effects become negligible.
△ Less
Submitted 21 March, 2024;
originally announced March 2024.
-
Nonlinear Model Predictive Control of a 3D Hopping Robot: Leveraging Lie Group Integrators for Dynamically Stable Behaviors
Authors:
Noel Csomay-Shanklin,
Victor D. Dorobantu,
Aaron D. Ames
Abstract:
Achieving stable hopping has been a hallmark challenge in the field of dynamic legged locomotion. Controlled hopping is notably difficult due to extended periods of underactuation combined with very short ground phases wherein ground interactions must be modulated to regulate global state. In this work, we explore the use of hybrid nonlinear model predictive control paired with a low-level feedbac…
▽ More
Achieving stable hopping has been a hallmark challenge in the field of dynamic legged locomotion. Controlled hopping is notably difficult due to extended periods of underactuation combined with very short ground phases wherein ground interactions must be modulated to regulate global state. In this work, we explore the use of hybrid nonlinear model predictive control paired with a low-level feedback controller in a multi-rate hierarchy to achieve dynamically stable motions on a 3D hopping robot. In order to demonstrate richer behaviors on the manifold of rotations, both the planning and feedback layers must be designed in a geometrically consistent fashion; therefore, we develop the necessary tools to employ Lie group integrators and appropriate feedback controllers. We experimentally demonstrate stable 3D hopping, as well as trajectory tracking and flipping in simulation.
△ Less
Submitted 6 June, 2023; v1 submitted 23 September, 2022;
originally announced September 2022.
-
Compactly Restrictable Metric Policy Optimization Problems
Authors:
Victor D. Dorobantu,
Kamyar Azizzadenesheli,
Yisong Yue
Abstract:
We study policy optimization problems for deterministic Markov decision processes (MDPs) with metric state and action spaces, which we refer to as Metric Policy Optimization Problems (MPOPs). Our goal is to establish theoretical results on the well-posedness of MPOPs that can characterize practically relevant continuous control systems. To do so, we define a special class of MPOPs called Compactly…
▽ More
We study policy optimization problems for deterministic Markov decision processes (MDPs) with metric state and action spaces, which we refer to as Metric Policy Optimization Problems (MPOPs). Our goal is to establish theoretical results on the well-posedness of MPOPs that can characterize practically relevant continuous control systems. To do so, we define a special class of MPOPs called Compactly Restrictable MPOPs (CR-MPOPs), which are flexible enough to capture the complex behavior of robotic systems but specific enough to admit solutions using dynamic programming methods such as value iteration. We show how to arrive at CR-MPOPs using forward-invariance. We further show that our theoretical results on CR-MPOPs can be used to characterize feedback linearizable control affine systems.
△ Less
Submitted 12 July, 2022;
originally announced July 2022.
-
Safety of Sampled-Data Systems with Control Barrier Functions via Approximate Discrete Time Models
Authors:
Andrew J. Taylor,
Victor D. Dorobantu,
Ryan K. Cosner,
Yisong Yue,
Aaron D. Ames
Abstract:
Control Barrier Functions (CBFs) have been demonstrated to be a powerful tool for safety-critical controller design for nonlinear systems. Existing design paradigms do not address the gap between theory (controller design with continuous time models) and practice (the discrete time sampled implementation of the resulting controllers); this can lead to poor performance and violations of safety for…
▽ More
Control Barrier Functions (CBFs) have been demonstrated to be a powerful tool for safety-critical controller design for nonlinear systems. Existing design paradigms do not address the gap between theory (controller design with continuous time models) and practice (the discrete time sampled implementation of the resulting controllers); this can lead to poor performance and violations of safety for hardware instantiations. We propose an approach to close this gap by synthesizing sampled-data counterparts to these CBF-based controllers using approximate discrete time models and Sampled-Data Control Barrier Functions (SD-CBFs). Using properties of a system's continuous time model, we establish a relationship between SD-CBFs and a notion of practical safety for sampled-data systems. Furthermore, we construct convex optimization-based controllers that formally endow nonlinear systems with safety guarantees in practice. We demonstrate the efficacy of these controllers in simulation.
△ Less
Submitted 13 June, 2022; v1 submitted 22 March, 2022;
originally announced March 2022.
-
Ageing studies of Multi-Strip Multi-Gap Resistive Plate Counters based on low resistivity glass electrodes in high irradiation dose
Authors:
D. Bartos,
C. Burducea,
I. Burducea,
G. Caragheorgheopol,
F. Constantin,
L. Craciun,
D. Dorobantu,
M. Ghena,
D. Iancu,
A. Marcu,
G. Mateescu,
P. Mereuta,
V. Moise,
C. Negrila,
D. Negut,
M. Petris,
M. Petrovici,
L. Radulescu,
V. Aprodu,
L. Prodan,
A. radu,
G. Stoian
Abstract:
Detailed tests and analysis of ageing effects of high irradiation dose on Multi-Strip Multi-Gap Resistive Plate Counters based on low resistivity glass electrodes were performed. MSMGRPC efficiency and cluster size before irradiation are measured and compared with their values after irradiation in a high irradiation dose accessed at a multi-purpose irradiation facility of IFIN-HH based on $^{60}$C…
▽ More
Detailed tests and analysis of ageing effects of high irradiation dose on Multi-Strip Multi-Gap Resistive Plate Counters based on low resistivity glass electrodes were performed. MSMGRPC efficiency and cluster size before irradiation are measured and compared with their values after irradiation in a high irradiation dose accessed at a multi-purpose irradiation facility of IFIN-HH based on $^{60}$Co source. The composition and properties of the deposited layers on the glass electrodes, studied based on a multitude of analysis methods, i.e. SEM, XPS, foil-ERDA, RBS, AFM and THz-TDS, are presented.
△ Less
Submitted 25 August, 2021; v1 submitted 24 May, 2021;
originally announced May 2021.
-
Sampled-Data Stabilization with Control Lyapunov Functions via Quadratically Constrained Quadratic Programs
Authors:
Andrew J. Taylor,
Victor D. Dorobantu,
Yisong Yue,
Paulo Tabuada,
Aaron D. Ames
Abstract:
Controller design for nonlinear systems with Control Lyapunov Function (CLF) based quadratic programs has recently been successfully applied to a diverse set of difficult control tasks. These existing formulations do not address the gap between design with continuous time models and the discrete time sampled implementation of the resulting controllers, often leading to poor performance on hardware…
▽ More
Controller design for nonlinear systems with Control Lyapunov Function (CLF) based quadratic programs has recently been successfully applied to a diverse set of difficult control tasks. These existing formulations do not address the gap between design with continuous time models and the discrete time sampled implementation of the resulting controllers, often leading to poor performance on hardware platforms. We propose an approach to close this gap by synthesizing sampled-data counterparts to these CLF-based controllers, specified as quadratically constrained quadratic programs (QCQPs). Assuming feedback linearizability and stable zero-dynamics of a system's continuous time model, we derive practical stability guarantees for the resulting sampled-data system. We demonstrate improved performance of the proposed approach over continuous time counterparts in simulation.
△ Less
Submitted 5 March, 2021;
originally announced March 2021.
-
Towards Robust Data-Driven Control Synthesis for Nonlinear Systems with Actuation Uncertainty
Authors:
Andrew J. Taylor,
Victor D. Dorobantu,
Sarah Dean,
Benjamin Recht,
Yisong Yue,
Aaron D. Ames
Abstract:
Modern nonlinear control theory seeks to endow systems with properties such as stability and safety, and has been deployed successfully across various domains. Despite this success, model uncertainty remains a significant challenge in ensuring that model-based controllers transfer to real world systems. This paper develops a data-driven approach to robust control synthesis in the presence of model…
▽ More
Modern nonlinear control theory seeks to endow systems with properties such as stability and safety, and has been deployed successfully across various domains. Despite this success, model uncertainty remains a significant challenge in ensuring that model-based controllers transfer to real world systems. This paper develops a data-driven approach to robust control synthesis in the presence of model uncertainty using Control Certificate Functions (CCFs), resulting in a convex optimization based controller for achieving properties like stability and safety. An important benefit of our framework is nuanced data-dependent guarantees, which in principle can yield sample-efficient data collection approaches that need not fully determine the input-to-state relationship. This work serves as a starting point for addressing important questions at the intersection of nonlinear control theory and non-parametric learning, both theoretical and in application. We validate the proposed method in simulation with an inverted pendulum in multiple experimental configurations.
△ Less
Submitted 31 March, 2021; v1 submitted 21 November, 2020;
originally announced November 2020.
-
A Control Lyapunov Perspective on Episodic Learning via Projection to State Stability
Authors:
Andrew J. Taylor,
Victor D. Dorobantu,
Meera Krishnamoorthy,
Hoang M. Le,
Yisong Yue,
Aaron D. Ames
Abstract:
The goal of this paper is to understand the impact of learning on control synthesis from a Lyapunov function perspective. In particular, rather than consider uncertainties in the full system dynamics, we employ Control Lyapunov Functions (CLFs) as low-dimensional projections. To understand and characterize the uncertainty that these projected dynamics introduce in the system, we introduce a new no…
▽ More
The goal of this paper is to understand the impact of learning on control synthesis from a Lyapunov function perspective. In particular, rather than consider uncertainties in the full system dynamics, we employ Control Lyapunov Functions (CLFs) as low-dimensional projections. To understand and characterize the uncertainty that these projected dynamics introduce in the system, we introduce a new notion: Projection to State Stability (PSS). PSS can be viewed as a variant of Input to State Stability defined on projected dynamics, and enables characterizing robustness of a CLF with respect to the data used to learn system uncertainties. We use PSS to bound uncertainty in affine control, and demonstrate that a practical episodic learning approach can use PSS to characterize uncertainty in the CLF for robust control synthesis.
△ Less
Submitted 17 March, 2019;
originally announced March 2019.
-
Episodic Learning with Control Lyapunov Functions for Uncertain Robotic Systems
Authors:
Andrew J. Taylor,
Victor D. Dorobantu,
Hoang M. Le,
Yisong Yue,
Aaron D. Ames
Abstract:
Many modern nonlinear control methods aim to endow systems with guaranteed properties, such as stability or safety, and have been successfully applied to the domain of robotics. However, model uncertainty remains a persistent challenge, weakening theoretical guarantees and causing implementation failures on physical systems. This paper develops a machine learning framework centered around Control…
▽ More
Many modern nonlinear control methods aim to endow systems with guaranteed properties, such as stability or safety, and have been successfully applied to the domain of robotics. However, model uncertainty remains a persistent challenge, weakening theoretical guarantees and causing implementation failures on physical systems. This paper develops a machine learning framework centered around Control Lyapunov Functions (CLFs) to adapt to parametric uncertainty and unmodeled dynamics in general robotic systems. Our proposed method proceeds by iteratively updating estimates of Lyapunov function derivatives and improving controllers, ultimately yielding a stabilizing quadratic program model-based controller. We validate our approach on a planar Segway simulation, demonstrating substantial performance improvements by iteratively refining on a base model-free controller.
△ Less
Submitted 4 March, 2019;
originally announced March 2019.
-
Risk assessment using suprema data
Authors:
Christophette Blanchet-Scalliet,
Diana Dorobantu,
Laura Gay,
Véronique Maume-Deschamps,
Pierre Ribereau
Abstract:
This paper proposes a stochastic approach to model temperature dynamic and study related risk measures. The dynamic of temperatures can be modelled by a mean-reverting process such as an Ornstein-Uhlenbeck one. In this study, we estimate the parameters of this process thanks to daily observed suprema of temperatures, which are the only data gathered by some weather stations. The expression of the…
▽ More
This paper proposes a stochastic approach to model temperature dynamic and study related risk measures. The dynamic of temperatures can be modelled by a mean-reverting process such as an Ornstein-Uhlenbeck one. In this study, we estimate the parameters of this process thanks to daily observed suprema of temperatures, which are the only data gathered by some weather stations. The expression of the cumulative distribution function of the supremum is obtained thanks to the law of the hitting time. The parameters are estimated by a least square method quantiles based on this function. Theoretical results, including mixing property and consistency of model parameters estimation, are provided. The parameters estimation is assessed on simulated data and performed on real ones. Numerical illustrations are given for both data. This estimation will allow us to estimate risk measures, such as the probability of heat wave and the mean duration of an heat wave.
△ Less
Submitted 16 October, 2018; v1 submitted 12 October, 2017;
originally announced October 2017.
-
First passage time law for some jump-diffusion processes : existence of a density
Authors:
Laure Coutin,
Diana Dorobantu
Abstract:
Let (Xt, t >= 0) be a diffusion process with jumps, sum of a Brownian motion with drift and a compound Poisson process. We consider T_x the first hitting time of a fixed level x > 0 by (Xt, t >= 0). We prove that the law of T_x has a density (defective when E(X1) < 0) with respect to the Lebesgue measure.
Let (Xt, t >= 0) be a diffusion process with jumps, sum of a Brownian motion with drift and a compound Poisson process. We consider T_x the first hitting time of a fixed level x > 0 by (Xt, t >= 0). We prove that the law of T_x has a density (defective when E(X1) < 0) with respect to the Lebesgue measure.
△ Less
Submitted 11 January, 2012; v1 submitted 10 April, 2009;
originally announced April 2009.
-
An extension of Davis and Lo's contagion model
Authors:
Didier Rullière,
Diana Dorobantu,
Areski Cousin
Abstract:
The present paper provides a multi-period contagion model in the credit risk field. Our model is an extension of Davis and Lo's infectious default model. We consider an economy of n firms which may default directly or may be infected by other defaulting firms (a domino effect being also possible). The spontaneous default without external influence and the infections are described by not necessar…
▽ More
The present paper provides a multi-period contagion model in the credit risk field. Our model is an extension of Davis and Lo's infectious default model. We consider an economy of n firms which may default directly or may be infected by other defaulting firms (a domino effect being also possible). The spontaneous default without external influence and the infections are described by not necessarily independent Bernoulli-type random variables. Moreover, several contaminations could be required to infect another firm. In this paper we compute the probability distribution function of the total number of defaults in a dependency context. We also give a simple recursive algorithm to compute this distribution in an exchangeability context. Numerical applications illustrate the impact of exchangeability among direct defaults and among contaminations, on different indicators calculated from the law of the total number of defaults. We then examine the calibration of the model on iTraxx data before and during the crisis. The dynamic feature together with the contagion effect seem to have a significant impact on the model performance, especially during the recent distressed period.
△ Less
Submitted 1 February, 2010; v1 submitted 10 April, 2009;
originally announced April 2009.
-
A class of optimal stopping problems for Markov processes
Authors:
Diana Dorobantu
Abstract:
Our purpose is to study a particular class of optimal stopping problems for Markov processes. We justify the value function convexity and we deduce that there exists a boundary function such that the smallest optimal stopping time is the first time when the Markov process passes over the boundary depending on time. Moreover, we propose a method to find the optimal boundary function.
Our purpose is to study a particular class of optimal stopping problems for Markov processes. We justify the value function convexity and we deduce that there exists a boundary function such that the smallest optimal stopping time is the first time when the Markov process passes over the boundary depending on time. Moreover, we propose a method to find the optimal boundary function.
△ Less
Submitted 29 September, 2008;
originally announced September 2008.
-
Arrêt optimal pour les processus de Markov forts et les fonctions affines
Authors:
Diana Dorobantu
Abstract:
In this Note we study optimal stopping problems for strong Markov processes and affine functions. We give a justification of the Snell envelope form using standard results of optimal stopping. We also justify the convexity of the value function, and without a priori restriction to a particular class of stopping times, we deduce that the smallest optimal stopping time is necessarily a hitting tim…
▽ More
In this Note we study optimal stopping problems for strong Markov processes and affine functions. We give a justification of the Snell envelope form using standard results of optimal stopping. We also justify the convexity of the value function, and without a priori restriction to a particular class of stopping times, we deduce that the smallest optimal stopping time is necessarily a hitting time.
△ Less
Submitted 22 April, 2008;
originally announced April 2008.
-
Optimal stopping for Lévy processes and affine functions
Authors:
Diana Dorobantu
Abstract:
This paper studies an optimal stopping problem for Lévy processes. We give a justification of the form of the Snell envelope using standard results of optimal stopping. We also justify the convexity of the value function, and without a priori restriction to a particular class of stopping times, we deduce that the smallest optimal stopping time is necessarily a hitting time. We propose a method w…
▽ More
This paper studies an optimal stopping problem for Lévy processes. We give a justification of the form of the Snell envelope using standard results of optimal stopping. We also justify the convexity of the value function, and without a priori restriction to a particular class of stopping times, we deduce that the smallest optimal stopping time is necessarily a hitting time. We propose a method which allows to obtain the optimal threshold. Moreover this method allows to avoid long calculations of the integro-differential operatorused in the usual proofs.
△ Less
Submitted 21 April, 2008;
originally announced April 2008.
