-
Transition of $α$-mixing in Random Iterations with Applications in Queuing Theory
Authors:
Attila Lovas
Abstract:
Nonlinear time series models with exogenous regressors are essential in econometrics, queuing theory, and machine learning, though their statistical analysis remains incomplete. Key results, such as the law of large numbers and the functional central limit theorem, are known for weakly dependent variables. We demonstrate the transfer of mixing properties from the exogenous regressor to the respons…
▽ More
Nonlinear time series models with exogenous regressors are essential in econometrics, queuing theory, and machine learning, though their statistical analysis remains incomplete. Key results, such as the law of large numbers and the functional central limit theorem, are known for weakly dependent variables. We demonstrate the transfer of mixing properties from the exogenous regressor to the response via coupling arguments. Additionally, we study Markov chains in random environments with drift and minorization conditions, even under non-stationary environments with favorable mixing properties, and apply this framework to single-server queuing models.
△ Less
Submitted 22 April, 2025; v1 submitted 7 October, 2024;
originally announced October 2024.
-
On the strong stability of ergodic iterations
Authors:
László Györfi,
Attila Lovas,
Miklós Rásonyi
Abstract:
We revisit processes generated by iterated random functions driven by a stationary and ergodic sequence. Such a process is called strongly stable if a random initialization exists, for which the process is stationary and ergodic, and for any other initialization, the difference between the two processes converges to zero almost surely. Under some mild conditions on the corresponding recursive map,…
▽ More
We revisit processes generated by iterated random functions driven by a stationary and ergodic sequence. Such a process is called strongly stable if a random initialization exists, for which the process is stationary and ergodic, and for any other initialization, the difference between the two processes converges to zero almost surely. Under some mild conditions on the corresponding recursive map, without any condition on the driving sequence, we show the strong stability of iterations. Several applications are surveyed such as generalized autoregression and queuing. Furthermore, new results are deduced for Langevin-type iterations with dependent noise and for multitype branching processes.
△ Less
Submitted 5 February, 2024; v1 submitted 10 April, 2023;
originally announced April 2023.
-
Functional Central Limit Theorem and Strong Law of Large Numbers for Stochastic Gradient Langevin Dynamics
Authors:
Attila Lovas,
Miklós Rásonyi
Abstract:
We study the mixing properties of an important optimization algorithm of machine learning: the stochastic gradient Langevin dynamics (SGLD) with a fixed step size. The data stream is not assumed to be independent hence the SGLD is not a Markov chain, merely a \emph{Markov chain in a random environment}, which complicates the mathematical treatment considerably. We derive a strong law of large numb…
▽ More
We study the mixing properties of an important optimization algorithm of machine learning: the stochastic gradient Langevin dynamics (SGLD) with a fixed step size. The data stream is not assumed to be independent hence the SGLD is not a Markov chain, merely a \emph{Markov chain in a random environment}, which complicates the mathematical treatment considerably. We derive a strong law of large numbers and a functional central limit theorem for SGLD.
△ Less
Submitted 29 July, 2023; v1 submitted 5 October, 2022;
originally announced October 2022.
-
Ergodic aspects of trading with threshold strategies
Authors:
Attila Lovas,
Miklós Rásonyi
Abstract:
To profit from price oscillations, investors frequently use threshold-type strategies where changes in the portfolio position are triggered by some indicators reaching prescribed levels. In this paper, we investigate threshold-type strategies in the context of ergodic control. We make the first steps towards their optimization by proving the ergodic properties of related functionals. Assuming Mark…
▽ More
To profit from price oscillations, investors frequently use threshold-type strategies where changes in the portfolio position are triggered by some indicators reaching prescribed levels. In this paper, we investigate threshold-type strategies in the context of ergodic control. We make the first steps towards their optimization by proving the ergodic properties of related functionals. Assuming Markovian price increments satisfying a minorization condition and (one-sided) boundedness we show, in particular, that for given thresholds, the distribution of the gains converges in the long run. We also extend recent results on the stability of overshoots of random walks from the i.i.d.\ increment case to Markovian increments, under suitable conditions.
△ Less
Submitted 15 July, 2022; v1 submitted 29 November, 2021;
originally announced November 2021.
-
Taming neural networks with TUSLA: Non-convex learning via adaptive stochastic gradient Langevin algorithms
Authors:
Attila Lovas,
Iosif Lytras,
Miklós Rásonyi,
Sotirios Sabanis
Abstract:
Artificial neural networks (ANNs) are typically highly nonlinear systems which are finely tuned via the optimization of their associated, non-convex loss functions. In many cases, the gradient of any such loss function has superlinear growth, making the use of the widely-accepted (stochastic) gradient descent methods, which are based on Euler numerical schemes, problematic. We offer a new learning…
▽ More
Artificial neural networks (ANNs) are typically highly nonlinear systems which are finely tuned via the optimization of their associated, non-convex loss functions. In many cases, the gradient of any such loss function has superlinear growth, making the use of the widely-accepted (stochastic) gradient descent methods, which are based on Euler numerical schemes, problematic. We offer a new learning algorithm based on an appropriately constructed variant of the popular stochastic gradient Langevin dynamics (SGLD), which is called tamed unadjusted stochastic Langevin algorithm (TUSLA). We also provide a nonasymptotic analysis of the new algorithm's convergence properties in the context of non-convex learning problems with the use of ANNs. Thus, we provide finite-time guarantees for TUSLA to find approximate minimizers of both empirical and population risks. The roots of the TUSLA algorithm are based on the taming technology for diffusion processes with superlinear coefficients as developed in \citet{tamed-euler, SabanisAoAP} and for MCMC algorithms in \citet{tula}. Numerical experiments are presented which confirm the theoretical findings and illustrate the need for the use of the new algorithm in comparison to vanilla SGLD within the framework of ANNs.
△ Less
Submitted 15 January, 2023; v1 submitted 25 June, 2020;
originally announced June 2020.
-
Ergodic theorems for queuing systems with dependent inter-arrival times
Authors:
Attila Lovas,
Miklós Rásonyi
Abstract:
We study a G/GI/1 single-server queuing model with i.i.d.\ service times that are independent of a stationary process of inter-arrival times. We show that the distribution of the waiting time converges to a stationary law as time tends to infinity provided that inter-arrival times satisfy a Gärtner-Ellis type condition. A convergence rate is given and a law of large numbers established. These resu…
▽ More
We study a G/GI/1 single-server queuing model with i.i.d.\ service times that are independent of a stationary process of inter-arrival times. We show that the distribution of the waiting time converges to a stationary law as time tends to infinity provided that inter-arrival times satisfy a Gärtner-Ellis type condition. A convergence rate is given and a law of large numbers established. These results provide tools for the statistical analysis of such systems, transcending the standard case with independent inter-arrival times.
△ Less
Submitted 3 December, 2020; v1 submitted 3 April, 2020;
originally announced April 2020.
-
Quantum Aitchison geometry
Authors:
Attila Andai,
Attila Lovas
Abstract:
Multiplying a likelihood function with a positive number makes no difference in Bayesian statistical inference, therefore after normalization the likelihood function in many cases can be considered as probability distribution. This idea led Aitchison to define a vector space structure on the probability simplex in 1986. Pawlowsky-Glahn and Egozcue gave a statistically relevant scalar product on th…
▽ More
Multiplying a likelihood function with a positive number makes no difference in Bayesian statistical inference, therefore after normalization the likelihood function in many cases can be considered as probability distribution. This idea led Aitchison to define a vector space structure on the probability simplex in 1986. Pawlowsky-Glahn and Egozcue gave a statistically relevant scalar product on this space in 2001, endowing the probability simplex with a Hilbert space structure. In this paper we present the noncommutative counterpart of this geometry. We introduce a real Hilbert space structure on the quantum mechanical finite dimensional state space. We show that the scalar product in quantum setting respects the tensor product structure and can be expressed in terms of modular operators and Hamilton operators. Using the quantum analogue of the log-ratio transformation it turns out that all the newly introduced operations emerge naturally in the language of Gibbs states. We show an orthonormal basis in the state space and study the introduced geometry on the space of qubits in details.
△ Less
Submitted 24 March, 2020; v1 submitted 19 March, 2020;
originally announced March 2020.
-
Markov chains in random environment with applications in queueing theory and machine learning
Authors:
Attila Lovas,
Miklós Rásonyi
Abstract:
We prove the existence of limiting distributions for a large class of Markov chains on a general state space in a random environment. We assume suitable versions of the standard drift and minorization conditions. In particular, the system dynamics should be contractive on the average with respect to the Lyapunov function and large enough small sets should exist with large enough minorization const…
▽ More
We prove the existence of limiting distributions for a large class of Markov chains on a general state space in a random environment. We assume suitable versions of the standard drift and minorization conditions. In particular, the system dynamics should be contractive on the average with respect to the Lyapunov function and large enough small sets should exist with large enough minorization constants. We also establish that a law of large numbers holds for bounded functionals of the process. Applications to queuing systems, to machine learning algorithms and to autoregressive processes are presented.
△ Less
Submitted 3 December, 2020; v1 submitted 11 November, 2019;
originally announced November 2019.
-
On the notion of quantum copulas
Authors:
Attila Lovas,
Attila Andai
Abstract:
Working with multivariate probability distributions Sklar introduced the notion of copula in 1959, which turned out to be a key concept to understand the structure of distributions of composite systems. Roughly speaking Sklar proved that a joint distribution can be represented with its marginals and a copula. The main goal of this paper is to present a quantum analogue of the notion of copula. Our…
▽ More
Working with multivariate probability distributions Sklar introduced the notion of copula in 1959, which turned out to be a key concept to understand the structure of distributions of composite systems. Roughly speaking Sklar proved that a joint distribution can be represented with its marginals and a copula. The main goal of this paper is to present a quantum analogue of the notion of copula. Our main theorem states that for any state of a composite quantum system there exists a unique copula such that they are connected to each other by invertible matrices, moreover, they are both separable or both entangled. So considering copulas instead of states is a separability preserving transformation and efficiently decreases the dimension of the state space of composite systems. The method how we prove these results draws attention to the fact that theorem for states can be achieved by considering the states as quantum channels and using theorems for channels and different kind of positive maps.
△ Less
Submitted 23 December, 2019; v1 submitted 22 February, 2019;
originally announced February 2019.
-
Emergence of non-Fourier hierarchies
Authors:
Tamás Fülöp,
Róbert Kovács,
Ádám Lovas,
Ágnes Rieth,
Tamás Fodor,
Mátyás Szücs,
Péter Ván,
Gyula Gróf
Abstract:
The non-Fourier heat conduction phenomenon on room temperature is analyzed from various aspects. The first one shows its experimental side, in what form it occurs and how we treated it. It is demonstrated that the Guyer-Krumhansl equation can be the next appropriate extension of Fourier's law for room temperature phenomena in modeling of heterogeneous materials. The second approach provides an int…
▽ More
The non-Fourier heat conduction phenomenon on room temperature is analyzed from various aspects. The first one shows its experimental side, in what form it occurs and how we treated it. It is demonstrated that the Guyer-Krumhansl equation can be the next appropriate extension of Fourier's law for room temperature phenomena in modeling of heterogeneous materials. The second approach provides an interpretation of generalized heat conduction equations using a simple thermomechanical background. Here, Fourier heat conduction is coupled to elasticity via thermal expansion, resulting in a particular generalized heat equation for the temperature field. Both of the aforementioned approaches show the size dependency of non-Fourier heat conduction. Finally, a third approach is presented, called pseudo-temperature modeling. It is shown that non-Fourier temperature history can be produced by mixing different solutions of Fourier's law. That kind of explanation indicates the interpretation of underlying heat conduction mechanics behind non-Fourier phenomena.
△ Less
Submitted 21 August, 2018;
originally announced August 2018.
-
Volume of the space of qubit-qubit channels and state transformations under random quantum channels
Authors:
Attila Lovas,
Attila Andai
Abstract:
The simplest building blocks for quantum computations are the qubit-qubit quantum channels. In this paper, we analyze the structure of these channels via their Choi representation. The restriction of a quantum channel to the space of classical states (i.e. probability distributions) is called the underlying classical channel. The structure of quantum channels over a fixed classical channel is stud…
▽ More
The simplest building blocks for quantum computations are the qubit-qubit quantum channels. In this paper, we analyze the structure of these channels via their Choi representation. The restriction of a quantum channel to the space of classical states (i.e. probability distributions) is called the underlying classical channel. The structure of quantum channels over a fixed classical channel is studied, the volume of general and unital qubit channels with respect to the Lebesgue measure is computed and explicit formulas are presented for the distribution of the volume of quantum channels over given classical channels. We study the state transformation under uniformly random quantum channels. If one applies a uniformly random quantum channel (general or unital) to a given qubit state, the distribution of the resulted quantum states is presented.
△ Less
Submitted 23 August, 2017;
originally announced August 2017.
-
Guyer-Krumhansl-type heat conduction at room temperature
Authors:
P. Ván,
A. Berezovski,
T. Fülöp,
Gy. Gróf,
R. Kovács,
Á. Lovas,
J. Verhás
Abstract:
Results of heat pulse experiments in various artificial and natural materials are reported in the paper. The experiments are performed at room temperature with macroscopic samples. It is shown that temperature evolution does not follow the Fourier's law but well explained by the Guyer-Krumhansl equation. The observations confirm the ability of non-equilibrium thermodynamics to formulate universal…
▽ More
Results of heat pulse experiments in various artificial and natural materials are reported in the paper. The experiments are performed at room temperature with macroscopic samples. It is shown that temperature evolution does not follow the Fourier's law but well explained by the Guyer-Krumhansl equation. The observations confirm the ability of non-equilibrium thermodynamics to formulate universal constitutive relations for thermomechanical processes.
△ Less
Submitted 2 April, 2017;
originally announced April 2017.
-
Invariance of separability probability over reduced states in 4x4 bipartite systems
Authors:
Attila Lovas,
Attila Andai
Abstract:
The geometric separability probability of composite quantum systems is extensively studied in the last decades. One of most simple but strikingly difficult problem is to compute the separability probability of qubit-qubit and rebit-rebit quantum states with respect to the Hilbert-Schmidt measure. A lot of numerical simulations confirm the P(rebit-rebit)=29/64 and P(qubit-qubit)=8/33 conjectured pr…
▽ More
The geometric separability probability of composite quantum systems is extensively studied in the last decades. One of most simple but strikingly difficult problem is to compute the separability probability of qubit-qubit and rebit-rebit quantum states with respect to the Hilbert-Schmidt measure. A lot of numerical simulations confirm the P(rebit-rebit)=29/64 and P(qubit-qubit)=8/33 conjectured probabilities. Milz and Strunz studied the separability probability with respect to given subsystems. They conjectured that the separability probability of qubit-qubit (and qubit-qutrit) depends on sum of single qubit subsystems (D), moreover it depends just on the Bloch radii (r) of D and it is constant in r. Using the Peres-Horodecki criterion for separability we give mathematical proof for the P(rebit-rebit)=29/64 probability and we present an integral formula for the complex case which hopefully will help to prove the P(qubit-qubit)=8/33 probability too. We prove Milz and Strunz's conjecture for rebit-rebit and qubit-qubit states. The case, when the state space is endowed with the volume form generated by the operator monotone function f(x)=sqrt(x) is studied too in detail. We show, that even in this setting the Milz and Strunz's conjecture holds and we give an integral formula for separability probability according to this measure.
△ Less
Submitted 4 January, 2017; v1 submitted 5 October, 2016;
originally announced October 2016.
-
Volume of the space of qubit channels and some new results about the distribution of the quantum Dobrushin coefficient
Authors:
Attila Lovas,
Attila Andai
Abstract:
The simplest building blocks for quantum computations are the qbit-qbit quantum channels. In this paper we analyse the structure of these channels via their Choi representation. The restriction of a quantum channel to the space of classical states (i.e. probability distributions) is called the underlying classical channel. The structure of quantum channels over a fixed classical channel is studied…
▽ More
The simplest building blocks for quantum computations are the qbit-qbit quantum channels. In this paper we analyse the structure of these channels via their Choi representation. The restriction of a quantum channel to the space of classical states (i.e. probability distributions) is called the underlying classical channel. The structure of quantum channels over a fixed classical channel is studied, the volume of general and unital qubit channels over real and complex state spaces with respect to the Lebesgue measure is computed and explicit formulas are presented for the distribution of the volume of quantum channels over given classical channels. Moreover an algorithm is presented to generate uniformly distributed channels with respect to the Lebesgue measure, which enables further studies. With this algorithm the distribution of trace-distance contraction coefficient (Dobrushin) is investigated numerically by Monte-Carlo simulations, which leads to some conjectures and points out the strange behaviour of the real state space.
△ Less
Submitted 5 July, 2016;
originally announced July 2016.
-
Numerical reconstruction of pulsatile blood flow from 4D computer tomography angiography data
Authors:
Attila Lovas,
Róbert Nagy,
Elek Csobo,
Brigitta Szilágyi,
Péter Sótonyi
Abstract:
We present a novel numerical algorithm developed to reconstuct pulsatile blood flow from ECG-gated CT angiography data. A block-based optimization method was constructed to solve the inverse problem corresponding to the Riccati-type ordinary differential equation that can be deduced from conservation principles and Hooke's law. Local flow rate for 5 patients was computed in 10cm long aorta segment…
▽ More
We present a novel numerical algorithm developed to reconstuct pulsatile blood flow from ECG-gated CT angiography data. A block-based optimization method was constructed to solve the inverse problem corresponding to the Riccati-type ordinary differential equation that can be deduced from conservation principles and Hooke's law. Local flow rate for 5 patients was computed in 10cm long aorta segments that are located 1cm below the heart. The wave form of the local flow rate curves seems to be realistic. Our approach is suitable for estimating characteristics of pulsatile blood flow in aorta based on ECG gated CT scan thereby contributing to more accurate description of several cardiovascular lesions.
△ Less
Submitted 25 November, 2015;
originally announced November 2015.
-
Measure on gauge invariant symmetric norms
Authors:
Attila Lovas,
Attila Andai
Abstract:
The concept of a gauge invariant symmetric random norm is elaborated in this paper. We introduce norm processes and show that this kind of stochastic processes are closely related to gauge invariant symmetric random norms. We construct a gauge invariant symmetric random norm on the plain. We define two different extensions of these random norms to higher (even infinite) dimensions. We calculate nu…
▽ More
The concept of a gauge invariant symmetric random norm is elaborated in this paper. We introduce norm processes and show that this kind of stochastic processes are closely related to gauge invariant symmetric random norms. We construct a gauge invariant symmetric random norm on the plain. We define two different extensions of these random norms to higher (even infinite) dimensions. We calculate numerically unit spheres of expected norms in two and three dimensions for the constructed random norm.
△ Less
Submitted 16 April, 2015;
originally announced April 2015.
-
Refinement of Robertson-type uncertainty principles with geometric interpretation
Authors:
Attila Lovas,
Attila Andai
Abstract:
A generalisation of the classical covariance for quantum mechanical observables has previously been presented by Gibilisco, Hiai and Petz. Gibilisco and Isola has proved that the usual quantum covariance gives the sharpest inequalities for the determinants of covariance matrices. We introduce a new generalisation of the classical covariance which gives better inequalities than the classical one fu…
▽ More
A generalisation of the classical covariance for quantum mechanical observables has previously been presented by Gibilisco, Hiai and Petz. Gibilisco and Isola has proved that the usual quantum covariance gives the sharpest inequalities for the determinants of covariance matrices. We introduce a new generalisation of the classical covariance which gives better inequalities than the classical one furthermore it has a direct geometric interpretation.
△ Less
Submitted 21 May, 2015; v1 submitted 20 November, 2013;
originally announced November 2013.
