-
Risk Analysis and Design Against Adversarial Actions
Authors:
Marco C. Campi,
Algo Carè,
Luis G. Crespo,
Simone Garatti,
Federico A. Ramponi
Abstract:
Learning models capable of providing reliable predictions in the face of adversarial actions has become a central focus of the machine learning community in recent years. This challenge arises from observing that data encountered at deployment time often deviate from the conditions under which the model was trained. In this paper, we address deployment-time adversarial actions and propose a versat…
▽ More
Learning models capable of providing reliable predictions in the face of adversarial actions has become a central focus of the machine learning community in recent years. This challenge arises from observing that data encountered at deployment time often deviate from the conditions under which the model was trained. In this paper, we address deployment-time adversarial actions and propose a versatile, well-principled framework to evaluate the model's robustness against attacks of diverse types and intensities. While we initially focus on Support Vector Regression (SVR), the proposed approach extends naturally to the broad domain of learning via relaxed optimization techniques. Our results enable an assessment of the model vulnerability without requiring additional test data and operate in a distribution-free setup. These results not only provide a tool to enhance trust in the model's applicability but also aid in selecting among competing alternatives. Later in the paper, we show that our findings also offer useful insights for establishing new results within the out-of-distribution framework.
△ Less
Submitted 2 May, 2025;
originally announced May 2025.
-
Isospectral flows on a class of finite-dimensional Jacobi matrices
Authors:
Tobias Sutter,
Debasish Chatterjee,
Federico Ramponi,
John Lygeros
Abstract:
We present a new matrix-valued isospectral ordinary differential equation that asymptotically block-diagonalizes $n\times n$ zero-diagonal Jacobi matrices employed as its initial condition. This o.d.e.\ features a right-hand side with a nested commutator of matrices, and structurally resembles the double-bracket o.d.e.\ studied by R.W.\ Brockett in 1991. We prove that its solutions converge asympt…
▽ More
We present a new matrix-valued isospectral ordinary differential equation that asymptotically block-diagonalizes $n\times n$ zero-diagonal Jacobi matrices employed as its initial condition. This o.d.e.\ features a right-hand side with a nested commutator of matrices, and structurally resembles the double-bracket o.d.e.\ studied by R.W.\ Brockett in 1991. We prove that its solutions converge asymptotically, that the limit is block-diagonal, and above all, that the limit matrix is defined uniquely as follows: For $n$ even, a block-diagonal matrix containing $2\times 2$ blocks, such that the super-diagonal entries are sorted by strictly increasing absolute value. Furthermore, the off-diagonal entries in these $2\times 2$ blocks have the same sign as the respective entries in the matrix employed as initial condition. For $n$ odd, there is one additional $1\times 1$ block containing a zero that is the top left entry of the limit matrix. The results presented here extend some early work of Kac and van Moerbeke.
△ Less
Submitted 15 November, 2012; v1 submitted 8 February, 2012;
originally announced February 2012.
-
On mean-square boundedness of stochastic linear systems with quantized observations
Authors:
Debasish Chatterjee,
Peter Hokayem,
Federico Ramponi,
John Lygeros
Abstract:
We propose a procedure to design a state-quantizer with finitely many bins for a marginally stable stochastic linear system evolving in $\R^d$, and a bounded policy based on the resulting quantized state measurements to ensure bounded second moment in closed-loop.
We propose a procedure to design a state-quantizer with finitely many bins for a marginally stable stochastic linear system evolving in $\R^d$, and a bounded policy based on the resulting quantized state measurements to ensure bounded second moment in closed-loop.
△ Less
Submitted 20 April, 2011; v1 submitted 25 March, 2011;
originally announced March 2011.
-
Stochastic receding horizon control with output feedback and bounded control inputs
Authors:
Peter Hokayem,
Eugenio Cinquemani,
Debasish Chatterjee,
Federico Ramponi,
John Lygeros
Abstract:
We provide a solution to the problem of receding horizon control for stochastic discrete-time systems with bounded control inputs and imperfect state measurements. For a suitable choice of control policies, we show that the finite-horizon optimization problem to be solved on-line is convex and successively feasible. Due to the inherent nonlinearity of the feedback loop, a slight extension of the…
▽ More
We provide a solution to the problem of receding horizon control for stochastic discrete-time systems with bounded control inputs and imperfect state measurements. For a suitable choice of control policies, we show that the finite-horizon optimization problem to be solved on-line is convex and successively feasible. Due to the inherent nonlinearity of the feedback loop, a slight extension of the Kalman filter is exploited to estimate the state optimally in mean-square sense. We show that the receding horizon implementation of the resulting control policies renders the state of the overall system mean-square bounded under mild assumptions. Finally, we discuss how some of the quantities required by the finite-horizon optimization problem can be computed off-line, reducing the on-line computation, and present some numerical examples.
△ Less
Submitted 14 April, 2010; v1 submitted 18 January, 2010;
originally announced January 2010.
-
On the well-posedness of multivariate spectrum approximation and convergence of high-resolution spectral estimators
Authors:
Federico Ramponi,
Augusto Ferrante,
Michele Pavon
Abstract:
In this paper, we establish the well-posedness of the generalized moment problems recently studied by Byrnes-Georgiou-Lindquist and coworkers, and by Ferrante-Pavon-Ramponi. We then apply these continuity results to prove almost sure convergence of a sequence of high-resolution spectral estimators indexed by the sample size.
In this paper, we establish the well-posedness of the generalized moment problems recently studied by Byrnes-Georgiou-Lindquist and coworkers, and by Ferrante-Pavon-Ramponi. We then apply these continuity results to prove almost sure convergence of a sequence of high-resolution spectral estimators indexed by the sample size.
△ Less
Submitted 2 November, 2009;
originally announced November 2009.
-
On the convergence of an efficient algorithm for Kullback-Leibler approximation of spectral densities
Authors:
Augusto Ferrante,
Federico Ramponi,
Francesco Ticozzi
Abstract:
This paper deals with a method for the approximation of a spectral density function among the solutions of a generalized moment problem a` la Byrnes/Georgiou/Lindquist. The approximation is pursued with respect to the Kullback-Leibler pseudo-distance, which gives rise to a convex optimization problem. After developing the variational analysis, we discuss the properties of an efficient algorithm…
▽ More
This paper deals with a method for the approximation of a spectral density function among the solutions of a generalized moment problem a` la Byrnes/Georgiou/Lindquist. The approximation is pursued with respect to the Kullback-Leibler pseudo-distance, which gives rise to a convex optimization problem. After developing the variational analysis, we discuss the properties of an efficient algorithm for the solution of the corresponding dual problem, based on the iteration of a nonlinear map in a bounded subset of the dual space. Our main result is the proof of local convergence of the latter, established as a consequence of the Central Manifold Theorem. Supported by numerical evidence, we conjecture that, in the mentioned bounded set, the convergence is actually global.
△ Less
Submitted 2 November, 2009;
originally announced November 2009.
-
On the connections between PCTL and Dynamic Programming
Authors:
Federico Ramponi,
Debasish Chatterjee,
Sean Summers,
John Lygeros
Abstract:
Probabilistic Computation Tree Logic (PCTL) is a well-known modal logic which has become a standard for expressing temporal properties of finite-state Markov chains in the context of automated model checking. In this paper, we give a definition of PCTL for noncountable-space Markov chains, and we show that there is a substantial affinity between certain of its operators and problems of Dynamic P…
▽ More
Probabilistic Computation Tree Logic (PCTL) is a well-known modal logic which has become a standard for expressing temporal properties of finite-state Markov chains in the context of automated model checking. In this paper, we give a definition of PCTL for noncountable-space Markov chains, and we show that there is a substantial affinity between certain of its operators and problems of Dynamic Programming. After proving some uniqueness properties of the solutions to the latter, we conclude the paper with two examples to show that some recovery strategies in practical applications, which are naturally stated as reach-avoid problems, can be actually viewed as particular cases of PCTL formulas.
△ Less
Submitted 25 October, 2009;
originally announced October 2009.
-
Attaining mean square boundedness of a marginally stable noisy linear system with a bounded control input
Authors:
Federico Ramponi,
Debasish Chatterjee,
Andreas Milias-Argeitis,
Peter Hokayem,
John Lygeros
Abstract:
We construct control policies that ensure bounded variance of a noisy marginally stable linear system in closed-loop. It is assumed that the noise sequence is a mutually independent sequence of random vectors, enters the dynamics affinely, and has bounded fourth moment. The magnitude of the control is required to be of the order of the first moment of the noise, and the policies we obtain are si…
▽ More
We construct control policies that ensure bounded variance of a noisy marginally stable linear system in closed-loop. It is assumed that the noise sequence is a mutually independent sequence of random vectors, enters the dynamics affinely, and has bounded fourth moment. The magnitude of the control is required to be of the order of the first moment of the noise, and the policies we obtain are simple and computable.
△ Less
Submitted 26 January, 2010; v1 submitted 9 July, 2009;
originally announced July 2009.
-
A globally convergent matricial algorithm for multivariate spectral estimation
Authors:
Federico Ramponi,
Augusto Ferrante,
Michele Pavon
Abstract:
In this paper, we first describe a matricial Newton-type algorithm designed to solve the multivariable spectrum approximation problem. We then prove its global convergence. Finally, we apply this approximation procedure to multivariate spectral estimation, and test its effectiveness through simulation. Simulation shows that, in the case of short observation records, this method may provide a val…
▽ More
In this paper, we first describe a matricial Newton-type algorithm designed to solve the multivariable spectrum approximation problem. We then prove its global convergence. Finally, we apply this approximation procedure to multivariate spectral estimation, and test its effectiveness through simulation. Simulation shows that, in the case of short observation records, this method may provide a valid alternative to standard multivariable identification techniques such as MATLAB's PEM and MATLAB's N4SID.
△ Less
Submitted 29 September, 2008;
originally announced September 2008.
-
Hellinger vs. Kullback-Leibler multivariable spectrum approximation
Authors:
A. Ferrante,
M. Pavon,
F. Ramponi
Abstract:
In this paper, we study a matricial version of the Byrnes-Georgiou-Lindquist generalized moment problem with complexity constraint. We introduce a new metric on multivariable spectral densities induced by the family of their spectral factors which, in the scalar case, reduces to the Hellinger distance. We solve the corresponding constrained optimization problem via duality theory. A highly nontr…
▽ More
In this paper, we study a matricial version of the Byrnes-Georgiou-Lindquist generalized moment problem with complexity constraint. We introduce a new metric on multivariable spectral densities induced by the family of their spectral factors which, in the scalar case, reduces to the Hellinger distance. We solve the corresponding constrained optimization problem via duality theory. A highly nontrivial existence theorem for the dual problem is established in the Byrnes-Lindquist spirit. A matricial Newton-type algorithm is finally provided for the numerical solution of the dual problem. Simulation indicates that the algorithm performs effectively and reliably.
△ Less
Submitted 8 February, 2007;
originally announced February 2007.
