Showing 1–50 of 63 results for author: Ramanan, K

A case study of the long-time behavior of the Gaussian local-field equation

Authors: Kevin Hu, Kavita Ramanan

Abstract: For any integer $κ\geq 2$, the $κ$-local-field equation ($κ$-LFE) characterizes the limit of the neighborhood path empirical measure of interacting diffusions on $κ$-regular random graphs, as the graph size goes to infinity. It has been conjectured that the long-time behavior of the (in general non-Markovian) $κ$-LFE coincides with that of a certain more tractable Markovian analog, the Markov $κ$-… ▽ More For any integer $κ\geq 2$, the $κ$-local-field equation ($κ$-LFE) characterizes the limit of the neighborhood path empirical measure of interacting diffusions on $κ$-regular random graphs, as the graph size goes to infinity. It has been conjectured that the long-time behavior of the (in general non-Markovian) $κ$-LFE coincides with that of a certain more tractable Markovian analog, the Markov $κ$-local-field equation. In the present article, we prove this conjecture for the case when $κ= 2$ and the diffusions are one-dimensional with affine drifts. As a by-product of our proof, we also show that for interacting diffusions on the $n$-cycle (or 2-regular random graph on $n$ vertices), the limits $n \rightarrow \infty$ and $t\rightarrow \infty$ commute. Along the way, we also establish well-posedness of the Markov $κ$-local field equations with affine drifts for all $κ\geq 2$, which may be of independent interest. △ Less

Submitted 10 April, 2025; v1 submitted 8 April, 2025; originally announced April 2025.

Comments: No changes, other than adding funding acknowledgement

MSC Class: 60K35; 60J60

Tractable description of hydrodynamic limits of a class of interacting jump processes on sparse graphs

Authors: Juniper Cocomello, Michel Davydov, Kavita Ramanan

Abstract: We consider dynamics of the empirical measure of vertex neighborhood states of Markov interacting jump processes on sparse random graphs, in a suitable asymptotic limit as the graph size goes to infinity. Under the assumption of a certain acyclic structure on single-particle transitions, we provide a tractable autonomous description of the evolution of this hydrodynamic limit in terms of a finite… ▽ More We consider dynamics of the empirical measure of vertex neighborhood states of Markov interacting jump processes on sparse random graphs, in a suitable asymptotic limit as the graph size goes to infinity. Under the assumption of a certain acyclic structure on single-particle transitions, we provide a tractable autonomous description of the evolution of this hydrodynamic limit in terms of a finite coupled system of ordinary differential equations. Key ingredients of the proof include a characterization of the hydrodynamic limit of the neighborhood empirical measure in terms of a certain local-field equation, well-posedness of its Markovian projection, and a Markov random field property of the time-marginals, which may be of independent interest. We also show how our results lead to principled approximations for classes of interacting jump processes and illustrate its efficacy via simulations on several examples, including an idealized model of seizure spread in the brain. △ Less

Submitted 7 February, 2025; originally announced February 2025.

MSC Class: Primary: 60K35 Secondary: 60J74; 60J27

An H-theorem for a conditional McKean-Vlasov process related to interacting diffusions on regular trees

Authors: Kevin Hu, Kavita Ramanan

Abstract: We study the long-time behavior of the $κ$-Markov local-field equation ($κ$-MLFE), which is a conditional McKean-Vlasov equation associated with interacting diffusions on the $κ$-regular tree. Under suitable assumptions on the coefficients, we prove well-posedness of the $κ$-MLFE. We also establish an H-theorem by identifying an energy functional, referred to as the sparse free energy, whose deriv… ▽ More We study the long-time behavior of the $κ$-Markov local-field equation ($κ$-MLFE), which is a conditional McKean-Vlasov equation associated with interacting diffusions on the $κ$-regular tree. Under suitable assumptions on the coefficients, we prove well-posedness of the $κ$-MLFE. We also establish an H-theorem by identifying an energy functional, referred to as the sparse free energy, whose derivative along the measure flow of the $κ$-MLFE is given by a nonnegative functional that can be viewed as a modified Fisher information. Moreover, we show that the zeros of the latter functional coincide with the set of stationary distributions of the $κ$-MLFE and are also marginals of splitting Gibbs measures on the $κ$-regular tree. Furthermore, we show that for a natural class of initial conditions, the corresponding measure flow converges to one of the stationary distributions, thus demonstrating that the sparse free energy acts as a global Lyapunov function. Under mild additional conditions, in the case $κ= 2$ we prove that the sparse free energy arises naturally as the renormalized limit of certain relative entropies. We exploit this characterization to prove a modified logarithmic Sobolev inequality and establish an exponential rate of convergence of the $2$-MLFE measure flow to its unique stationary distribution. △ Less

Submitted 31 December, 2024; v1 submitted 10 December, 2024; originally announced December 2024.

Comments: 59 pages, 2 figures

MSC Class: 60K35; 60J60 (Primary) 60J70; 82C22; 35Q84; 82C31 (Secondary)

A Mimicking Theorem for processes driven by fractional Brownian motion

Authors: Kevin Hu, Kavita Ramanan, William Salkeld

Abstract: In this paper, we prove a mimicking theorem for stochastic processes with an additive Gaussian noise along with some entropy and transport type estimates. As an application of these results, we prove sharp quantitative propagation of chaos result and derive a formula for the marginal dynamics of collections of locally interacting stochastic differential equations with additive Gaussian noise. In this paper, we prove a mimicking theorem for stochastic processes with an additive Gaussian noise along with some entropy and transport type estimates. As an application of these results, we prove sharp quantitative propagation of chaos result and derive a formula for the marginal dynamics of collections of locally interacting stochastic differential equations with additive Gaussian noise. △ Less

Submitted 14 May, 2024; originally announced May 2024.

The fundamental martingale with applications to Markov Random Fields

Authors: Kevin Hu, Kavita Ramanan, William Salkeld

Abstract: We consider collections of SDEs indexed by a graph. Each SDE is driven by an additive Gaussian noise and each drift term interacts with all other SDEs within the graph neighbourhood. We derive the fundamental martingale for a class of Gaussian processes and use this to prove a Girsanov type theorem. Further, we use this to construct a clique factorisation to prove that the law of the interacting S… ▽ More We consider collections of SDEs indexed by a graph. Each SDE is driven by an additive Gaussian noise and each drift term interacts with all other SDEs within the graph neighbourhood. We derive the fundamental martingale for a class of Gaussian processes and use this to prove a Girsanov type theorem. Further, we use this to construct a clique factorisation to prove that the law of the interacting SDEs forms a 2-Markov Random Field. △ Less

Submitted 14 May, 2024; originally announced May 2024.

The $\ell_r$-Levy-Grothendieck problem and $r\rightarrow p$ norms of Levy matrices

Authors: Kavita Ramanan, Xiaoyu Xie

Abstract: Given an $n\times n$ matrix $A_n$ and $1\leq r, p \leq\infty$, consider the following quadratic optimization problem referred to as the $\ell_r$-Grothendieck problem: \begin{align}M_r(A_n)\coloneqq\max_{\boldsymbol{x}\in\mathbb{R}^n:\|\boldsymbol{x}\|_r\leq1}\boldsymbol{x}^{\top} A_n \boldsymbol{x},\end{align} as well as the $r\rightarrow p$ operator norm of the matrix $A_n$, defined as \begin{ali… ▽ More Given an $n\times n$ matrix $A_n$ and $1\leq r, p \leq\infty$, consider the following quadratic optimization problem referred to as the $\ell_r$-Grothendieck problem: \begin{align}M_r(A_n)\coloneqq\max_{\boldsymbol{x}\in\mathbb{R}^n:\|\boldsymbol{x}\|_r\leq1}\boldsymbol{x}^{\top} A_n \boldsymbol{x},\end{align} as well as the $r\rightarrow p$ operator norm of the matrix $A_n$, defined as \begin{align}\|A_n\|_{r \rightarrow p}\coloneqq \sup _{\boldsymbol{x}\in\mathbb{R}^n:\|\boldsymbol{x}\|_r \leq 1}\|A_n \boldsymbol{x}\|_p,\end{align} where $\|\boldsymbol{x}\|_r$ denotes the $\ell_r$-norm of the vector $\boldsymbol{x}$. This work analyzes high-dimensional asymptotics of these quantities when $A_n$ are symmetric random matrices with independent and identically distributed heavy-tailed upper-triangular entries with index $α$. When $1\leq r\leq 2$ (respectively, $1\leq r\leq p$) and $α\in(0,2)$, suitably scaled versions of $M_r(A_n)$ and $\|A_n\|_{r\rightarrow p}$ are shown to converge to a Fréchet distribution as $n\rightarrow\infty$. In contrast, when $2< r<\infty$ (respectively, $1\leq p< r$), it is shown that there exists $α_*\in(1,2)$ such that for every $α\in(0,α_*)$, suitably scaled versions of $M_r(A_n)$ and $\|A_n\|_{r\rightarrow p}$ converge to the power of a stable distribution. Furthermore, it is shown that there exists $\barα_*>α_*$ such that when $α\in(α_*,\barα_*)$, the latter convergence result holds only when the matrix entries are centered; when the entries have non-zero mean, a different limit arises after additional centering and scaling. As a corollary, these results yield a characterization of the limiting ground state of the Levy spin glass when $α\in (0,1)$. The analysis uses a combination of tools from the theory of heavy-tailed distributions, the nonlinear power method and concentration inequalities. △ Less

Submitted 28 April, 2024; originally announced April 2024.

Comments: 38 pages, 3 figures

MSC Class: Primary: 60B20; 60E07; Secondary: 60F05; 15A60; 46B09

Interacting stochastic processes on sparse random graphs

Authors: Kavita Ramanan

Abstract: Large ensembles of stochastically evolving interacting particles describe phenomena in diverse fields including statistical physics, neuroscience, biology, and engineering. In such systems, the infinitesimal evolution of each particle depends only on its own state (or history) and the states (or histories) of neighboring particles with respect to an underlying, possibly random, interaction graph.… ▽ More Large ensembles of stochastically evolving interacting particles describe phenomena in diverse fields including statistical physics, neuroscience, biology, and engineering. In such systems, the infinitesimal evolution of each particle depends only on its own state (or history) and the states (or histories) of neighboring particles with respect to an underlying, possibly random, interaction graph. While these high-dimensional processes are typically too complex to be amenable to exact analysis, their dynamics are quite well understood when the interaction graph is the complete graph. In this case, classical theorems show that in the limit as the number of particles goes to infinity, the dynamics of the empirical measure and the law of a typical particle coincide and can be characterized in terms of a much more tractable dynamical system of reduced dimension called the mean-field limit. In contrast, until recently not much was known about corresponding convergence results in the complementary case when the interaction graph is sparse (i.e., with uniformly bounded average degree). This article provides a brief survey of classical work and then describes recent progress on the sparse regime that relies on a combination of techniques from random graph theory, Markov random fields, and stochastic analysis. The article concludes by discussing ramifications for applications and posing several open problems. △ Less

Submitted 29 December, 2023; originally announced January 2024.

Comments: 26 pages, 4 figures; a version of this article will appear in the 2022 ICM Proceedings

MSC Class: Primary 60G60; 60J60; 60J27; 60J80; 60F15; Secondary 60K35

On the large deviation rate function for marked sparse random graphs

Authors: Kavita Ramanan, Sarath Yasodharan

Abstract: We consider (annealed) large deviation principles for component empirical measures of several families of marked sparse random graphs, including (i) uniform graphs on $n$ vertices with a fixed degree distribution; (ii) uniform graphs on $n$ vertices with a fixed number of edges; (iii) Erdős-Rényi $G(n, c/n)$ random graphs. Assuming that edge and vertex marks are independent, identically distribute… ▽ More We consider (annealed) large deviation principles for component empirical measures of several families of marked sparse random graphs, including (i) uniform graphs on $n$ vertices with a fixed degree distribution; (ii) uniform graphs on $n$ vertices with a fixed number of edges; (iii) Erdős-Rényi $G(n, c/n)$ random graphs. Assuming that edge and vertex marks are independent, identically distributed, and take values in a finite state space, we show that the large deviation rate function admits a concise representation as a sum of relative entropies that quantify the cost of deviation of a probability measure on marked rooted graphs from certain auxiliary independent and conditionally independent versions. The proof exploits unimodularity, the consequent mass transport principle, and random tree labelings to express certain combinatorial quantities as expectations with respect to size-biased distributions, and to identify unimodular extensions with suitable conditional laws. We also illustrate how this representation can be used to establish Gibbs conditioning principles that provide insight into the structure of marked random graphs conditioned on a rare event. Additional motivation for this work arises from the fact that such a representation is also useful for characterizing the annealed pressure of statistical physics models with general spins, and large deviations of evolving interacting particle systems on sparse random graphs. △ Less

Submitted 26 December, 2023; originally announced December 2023.

Comments: 46 pages, 3 figures

MSC Class: 60F10; 05C80

Exact description of limiting SIR and SEIR dynamics on locally tree-like graphs

Authors: Juniper Cocomello, Kavita Ramanan

Abstract: We study the Susceptible-Infected-Recovered (SIR) and the Susceptible-Exposed-Infected-Recovered (SEIR) models of epidemics, with possibly time-varying rates, on a class of networks that are locally tree-like, which includes sparse Erdős-Rènyi random graphs, random regular graphs, and other configuration models. We identify tractable systems of ODEs that exactly describe the dynamics of the SIR an… ▽ More We study the Susceptible-Infected-Recovered (SIR) and the Susceptible-Exposed-Infected-Recovered (SEIR) models of epidemics, with possibly time-varying rates, on a class of networks that are locally tree-like, which includes sparse Erdős-Rènyi random graphs, random regular graphs, and other configuration models. We identify tractable systems of ODEs that exactly describe the dynamics of the SIR and SEIR processes in a suitable asymptotic regime in which the population size goes to infinity. Moreover, in the case of constant recovery and infection rates, we characterize the outbreak size as the unique zero of an explicit functional. We use this to show that a (suitably defined) mean-field prediction always overestimates the outbreak size, and that the outbreak sizes for SIR and SEIR processes with the same initial condition and constant infection and recovery rates coincide. In contrast, we show that the outbreak sizes for SIR and SEIR processes with the same time-varying infection and recovery rates can in general be quite different. We also demonstrate via simulations the efficacy of our approximations for populations of moderate size. △ Less

Submitted 15 September, 2023; originally announced September 2023.

Comments: 45 pages, 8 figures

MSC Class: 60K35; 60F17 (Primary); 60G60; 60J2 (Secondary)

Quenched large deviation principles for random projections of $\ell_p^n$ balls

Authors: Patrick Lopatto, Kavita Ramanan, Xiaoyu Xie

Abstract: Let $(k_n)_{n \in \mathbb{N}}$ be a sequence of positive integers growing to infinity at a sublinear rate, $k_n \rightarrow \infty$ and $k_n/n \rightarrow 0$ as $n \rightarrow \infty$. Given a sequence of $n$-dimensional random vectors $\{Y^{(n)}\}_{n \in \mathbb{N}}$ belonging to a certain class, which includes uniform distributions on suitably scaled $\ell_p^n$-balls or $\ell_p^n$-spheres,… ▽ More Let $(k_n)_{n \in \mathbb{N}}$ be a sequence of positive integers growing to infinity at a sublinear rate, $k_n \rightarrow \infty$ and $k_n/n \rightarrow 0$ as $n \rightarrow \infty$. Given a sequence of $n$-dimensional random vectors $\{Y^{(n)}\}_{n \in \mathbb{N}}$ belonging to a certain class, which includes uniform distributions on suitably scaled $\ell_p^n$-balls or $\ell_p^n$-spheres, $p \geq 2$, and product distributions with sub-Gaussian marginals, we study the large deviations behavior of the corresponding sequence of $k_n$-dimensional orthogonal projections $n^{-1/2} \boldsymbol{a}_{n,k_n} Y^{(n)}$, where $\boldsymbol{a}_{n,k_n}$ is an $(n \times k_n)$-dimensional projection matrix lying in the Stiefel manifold of orthonormal $k_n$-frames in $\mathbb{R}^n$. For almost every sequence of projection matrices, we establish a large deviation principle (LDP) for the corresponding sequence of projections, with a fairly explicit rate function that does not depend on the sequence of projection matrices. As corollaries, we also obtain quenched LDPs for sequences of $\ell_2$-norms and $\ell_\infty$-norms of the coordinates of the projections. Past work on LDPs for projections with growing dimension has mainly focused on the annealed setting, where one also averages over the random projection matrix, chosen from the Haar measure, in which case the coordinates of the projection are exchangeable. The quenched setting lacks such symmetry properties, and gives rise to significant new challenges in the setting of growing projection dimension. Along the way, we establish new Gaussian approximation results on the Stiefel manifold that may be of independent interest. Such LDPs are of relevance in asymptotic convex geometry, statistical physics and high-dimensional statistics. △ Less

Submitted 1 August, 2023; originally announced August 2023.

Comments: 53 pages

Interacting Jump Processes Preserve Semi-Global Markov Random Fields on Path Space

Authors: Ankan Ganguly, Kavita Ramanan

Abstract: Consider a system of interacting particles indexed by the nodes of a graph whose vertices are equipped with marks representing parameters of the model such as the environment or initial data. Each particle takes values in a countable state space and evolves according to a (possibly non-Markovian) continuous-time pure jump process whose jump intensities depend only on its own state (or history) and… ▽ More Consider a system of interacting particles indexed by the nodes of a graph whose vertices are equipped with marks representing parameters of the model such as the environment or initial data. Each particle takes values in a countable state space and evolves according to a (possibly non-Markovian) continuous-time pure jump process whose jump intensities depend only on its own state (or history) and marks as well as the states (or histories) and marks of particles and edges in its neighborhood in the graph. Under mild conditions on the jump intensities, it is shown that the trajectories of the interacting particle system exhibit a certain local or semi-global Markov random field property whenever the initial condition satisfies the same property. Our results complement recent works that establish the preservation of a local second-order Markov random field property for interacting diffusions. Our proof methodology in the context of jump processes is different, and works directly on infinite graphs, thereby bypassing any limiting arguments. Our results apply to models arising in diverse fields including statistical physics, neuroscience, epidemiology and opinion dynamics, and have direct applications to the study of marginal distributions of interacting particle systems on Cayley trees. △ Less

Submitted 17 October, 2022; originally announced October 2022.

Comments: 30 pages

MSC Class: 60K35; 60J74; 60J80 (Primary) 60K25 (Secondary)

Hydrodynamic Limits of non-Markovian Interacting Particle Systems on Sparse Graphs

Authors: Ankan Ganguly, Kavita Ramanan

Abstract: Consider an interacting particle system indexed by the vertices of a (possibly random) locally finite graph whose vertices and edges are equipped with marks representing parameters of the model such as the environment and initial conditions. Each particle takes values in a countable state space and evolves according to a pure jump process whose jump intensities depend on only the states (or histor… ▽ More Consider an interacting particle system indexed by the vertices of a (possibly random) locally finite graph whose vertices and edges are equipped with marks representing parameters of the model such as the environment and initial conditions. Each particle takes values in a countable state space and evolves according to a pure jump process whose jump intensities depend on only the states (or histories) and marks of itself and particles and edges in its neighborhood. Under mild conditions, it is shown that if the sequence of (marked) interaction graphs converges locally in probability to a limit (marked) graph that satisfies a certain finite dissociability property, then the corresponding sequence of empirical measures of the particle trajectories converges weakly to the law of the marginal dynamics at the root vertex of the limit graph. The proof of this limit relies on several results of independent interest. First, such interacting particle systems are shown to be well-posed on almost surely finitely dissociable graphs, which include graphs of maximal bounded degree and any Galton-Watson tree whose offspring distribution has a finite first moment. A counterexample is provided to show that well-posedness can fail for dynamics on graphs outside this class. Second, the dynamics on a locally convergent sequence of graphs are shown to converge in the local weak sense to the dynamics on the limit graph when the latter is finitely dissociable. Finally, the dynamics are also shown to exhibit an (annealed) asymptotic correlation decay property. These results complement recent work that establishes hydrodynamic limits of locally interacting probabilistic cellular automata and diffusions on sparse random graphs. However, the analysis of jump processes requires very different techniques, including percolation arguments and notions such as (consistent) spatial localization and causal chains. △ Less

Submitted 29 July, 2024; v1 submitted 3 May, 2022; originally announced May 2022.

Comments: Made significant modifications for clarity. Length: 64 pages

MSC Class: 60K35; 60J74; 60J80 (Primary) 60K25; 60F15 (Secondary)

Large-time limit of nonlinearly coupled measure-valued equations that model many-server queues with reneging

Authors: Rami Atar, Weining Kang, Haya Kaspi, Kavita Ramanan

Abstract: The large-time behavior of a nonlinearly coupled pair of measure-valued transport equations with discontinuous boundary conditions, parameterized by a positive real-valued parameter $λ$, is considered. These equations describe the hydrodynamic or fluid limit of many-server queues with reneging (with traffic intensity $λ$), which model phenomena in diverse disciplines, including biology and operati… ▽ More The large-time behavior of a nonlinearly coupled pair of measure-valued transport equations with discontinuous boundary conditions, parameterized by a positive real-valued parameter $λ$, is considered. These equations describe the hydrodynamic or fluid limit of many-server queues with reneging (with traffic intensity $λ$), which model phenomena in diverse disciplines, including biology and operations research. For a broad class of reneging distributions with finite mean and service distributions with finite mean and hazard rate function that is either decreasing or bounded away from zero and infinity, it is shown that if the fluid equations have a unique invariant state, then the Dirac measure at this state is the unique random fixed point of the fluid equations, which implies that the stationary distributions of scaled $N$-server systems converge to the unique invariant state of the corresponding fluid equations. Moreover, when $λ\ne 1$, it is shown that the solution to the fluid equation starting from any initial condition converges to this unique invariant state in the large time limit. The proof techniques are different under the two sets of assumptions on the service distribution. When the hazard rate function is decreasing, a reformulation of the dynamics in terms of a certain renewal equation is used, in conjunction with recursive asymptotic estimates. When the hazard rate function is bounded away from zero and infinity, the proof uses an extended relative entropy functional as a Lyapunov function. Analogous large-time convergence results are also established for a system of coupled measure-valued equations modeling a multiclass queue. △ Less

Submitted 12 July, 2021; originally announced July 2021.

MSC Class: 60F17; 60K25; 90B22; 60H99; 35D99

Large deviation principles induced by the Stiefel manifold, and random multi-dimensional projections

Authors: Steven Soojin Kim, Kavita Ramanan

Abstract: Given an $n$-dimensional random vector $X^{(n)}$ , for $k < n$, consider its $k$-dimensional projection $\mathbf{a}_{n,k}X^{(n)}$, where $\mathbf{a}_{n,k}$ is an $n \times k$-dimensional matrix belonging to the Stiefel manifold $\mathbb{V}_{n,k}$ of orthonormal $k$-frames in $\mathbb{R}^n$. For a class of sequences $\{X^{(n)}\}$ that includes the uniform distributions on scaled $\ell_p^n$ balls,… ▽ More Given an $n$-dimensional random vector $X^{(n)}$ , for $k < n$, consider its $k$-dimensional projection $\mathbf{a}_{n,k}X^{(n)}$, where $\mathbf{a}_{n,k}$ is an $n \times k$-dimensional matrix belonging to the Stiefel manifold $\mathbb{V}_{n,k}$ of orthonormal $k$-frames in $\mathbb{R}^n$. For a class of sequences $\{X^{(n)}\}$ that includes the uniform distributions on scaled $\ell_p^n$ balls, $p \in (1,\infty]$, and product measures with sufficiently light tails, it is shown that the sequence of projected vectors $\{\mathbf{a}_{n,k}^\intercal X^{(n)}\}$ satisfies a large deviation principle whenever the empirical measures of the rows of $\sqrt{n} \mathbf{a}_{n,k}$ converge, as $n \rightarrow \infty$, to a probability measure on $\mathbb{R}^k$. In particular, when $\mathbf{A}_{n,k}$ is a random matrix drawn from the Haar measure on $\mathbb{V}_{n,k}$, this is shown to imply a large deviation principle for the sequence of random projections $\{\mathbf{A}_{n,k}^\intercal X^{(n)}\}$ in the quenched sense (that is, conditioned on almost sure realizations of $\{\mathbf{A}_{n,k}\}$). Moreover, a variational formula is obtained for the rate function of the large deviation principle for the annealed projections $\{\mathbf{A}_{n,k}^\intercal X^{(n)}\}$, which is expressed in terms of a family of quenched rate functions and a modified entropy term. A key step in this analysis is a large deviation principle for the sequence of empirical measures of rows of $\sqrt{n} \mathbf{A}_{n,k}$, which may be of independent interest. The study of multi-dimensional random projections of high-dimensional measures is of interest in asymptotic functional analysis, convex geometry and statistics. Prior results on quenched large deviations for random projections of $\ell_p^n$ balls have been essentially restricted to the one-dimensional setting. △ Less

Submitted 10 May, 2021; originally announced May 2021.

Comments: 18 pages

MSC Class: 60F10; 60B20; 52A23

Large Deviation Principles for Lacunary Sums

Authors: Christoph Aistleitner, Nina Gantert, Zakhar Kabluchko, Joscha Prochno, Kavita Ramanan

Abstract: Let $(a_k)_{k\in\mathbb N}$ be a sequence of integers satisfying the Hadamard gap condition $a_{k+1}/a_k>q>1$ for all $k\in\mathbb N$, and let $$ S_n(ω) = \sum_{k=1}^n\cos(2πa_k ω),\qquad n\in\mathbb N,\;ω\in [0,1]. $$ The lacunary trigonometric sum $S_n$ is known to exhibit several properties typical for sums of independent random variables. In this paper we initiate the investigation of large de… ▽ More Let $(a_k)_{k\in\mathbb N}$ be a sequence of integers satisfying the Hadamard gap condition $a_{k+1}/a_k>q>1$ for all $k\in\mathbb N$, and let $$ S_n(ω) = \sum_{k=1}^n\cos(2πa_k ω),\qquad n\in\mathbb N,\;ω\in [0,1]. $$ The lacunary trigonometric sum $S_n$ is known to exhibit several properties typical for sums of independent random variables. In this paper we initiate the investigation of large deviation principles (LDPs) for $S_n$. Under the large gap condition $a_{k+1}/a_k\to\infty$, we prove that $(S_n/n)_{n\in\mathbb N}$ satisfies an LDP with speed $n$ and the same rate function $\tilde{I}$ as for sums of independent random variables with the arcsine distribution, but show that the LDP may fail to hold when we only assume the Hadamard gap condition. However, we prove that in the special case $a_k=q^k$ for some $q\in \{2,3,\ldots\}$, $(S_n/n)_{n\in\mathbb N}$ satisfies an LDP with speed $n$ and a rate function $I_q$ different from $\tilde{I}$. We also show that $I_q$ converges pointwise to $\tilde I$ as $q\to\infty$ and construct a random perturbation $(a_k)_{k\in\mathbb N}$ of the sequence $(2^k)_{k\in\mathbb N}$ for which $a_{k+1}/a_k\to 2$ as $k\to\infty$, but for which $(S_n/n)_{n\in\mathbb N}$ satisfies an LDP with the rate function $\tilde{I}$ as in the independent case and not, as one might na{ï}vely expect, with rate function $I_2$. We relate this fact to the number of solutions of certain Diophantine equations. Our results show that LDPs for lacunary trigonometric sums are sensitive to the arithmetic properties of $(a_k)_{k\in\mathbb N}$. This is particularly noteworthy since no such arithmetic effects are visible in the central limit theorem by Salem and Zygmund or in the law of the iterated logarithm by Erdös and Gál. Our proofs use a combination of tools from probability theory, harmonic analysis, and dynamical systems. △ Less

Submitted 9 December, 2020; originally announced December 2020.

Comments: 44 pages, 1 figure

MSC Class: Primary 42A55; 60F10; 11L03; Secondary 37A05; 11D45; 11K70

Marginal dynamics of interacting diffusions on unimodular Galton-Watson trees

Authors: Daniel Lacker, Kavita Ramanan, Ruoyu Wu

Abstract: Consider a system of homogeneous interacting diffusive particles labeled by the nodes of a unimodular Galton-Watson (UGW) tree, where the state of each node evolves like a d-dimensional diffusion whose drift coefficient depends on (the histories of) its own state and the states of neighboring nodes, and whose diffusion coefficient depends only on (the history of) its own state. Under suitable regu… ▽ More Consider a system of homogeneous interacting diffusive particles labeled by the nodes of a unimodular Galton-Watson (UGW) tree, where the state of each node evolves like a d-dimensional diffusion whose drift coefficient depends on (the histories of) its own state and the states of neighboring nodes, and whose diffusion coefficient depends only on (the history of) its own state. Under suitable regularity assumptions on the coefficients, an autonomous characterization is obtained for the marginal distribution of the dynamics of the neighborhood of a typical node in terms of a certain local equation, which is a new kind of SDE that is nonlinear in the sense of McKean. This equation describes a finite-dimensional non-Markovian stochastic process whose evolution at any time depends not only on the structure and current state of the neighborhood, but also on the conditional law of the current state given the past of the states of neighborhing nodes. Such marginal distributions are of interest because they arise as weak limits of both marginal distributions and empirical measures of interacting diffusions on many sequences of sparse random graphs, including the configuration model and Erdos-Renyi graphs whose average degrees converge to a finite non-zero limit. The results obtained complement classical results in the mean-field regime, which characterize the limiting dynamics of homogeneous interacting diffusions on complete graphs, as the number of nodes goes to infinity, in terms of a corresponding nonlinear Markov process. However, in the sparse graph setting, the topology of the graph strongly influences the dynamics, and the analysis requires a completely different approach. The proofs of existence and uniqueness of the local equation rely on delicate new conditional independence and symmetry properties of particle trajectories on UGW trees, as well as judicious use of changes of measure. △ Less

Submitted 15 July, 2021; v1 submitted 23 September, 2020; originally announced September 2020.

Comments: 59 pages, 1 figure. arXiv admin note: text overlap with arXiv:1904.02585

MSC Class: 60K35; 60J60; 60J8 (Primary); 60F17; 82C22

Parameter Estimation for Undirected Graphical Models with Hard Constraints

Authors: Bhaswar B. Bhattacharya, Kavita Ramanan

Abstract: The hardcore model on a graph $G$ with parameter $λ>0$ is a probability measure on the collection of all independent sets of $G$, that assigns to each independent set $I$ a probability proportional to $λ^{|I|}$. In this paper we consider the problem of estimating the parameter $λ$ given a single sample from the hardcore model on a graph $G$. To bypass the computational intractability of the maximu… ▽ More The hardcore model on a graph $G$ with parameter $λ>0$ is a probability measure on the collection of all independent sets of $G$, that assigns to each independent set $I$ a probability proportional to $λ^{|I|}$. In this paper we consider the problem of estimating the parameter $λ$ given a single sample from the hardcore model on a graph $G$. To bypass the computational intractability of the maximum likelihood method, we use the maximum pseudo-likelihood (MPL) estimator, which for the hardcore model has a surprisingly simple closed form expression. We show that for any sequence of graphs $\{G_N\}_{N\geq 1}$, where $G_N$ is a graph on $N$ vertices, the MPL estimate of $λ$ is $\sqrt N$-consistent, whenever the graph sequence has uniformly bounded average degree. We then derive sufficient conditions under which the MPL estimate of the activity parameters is $\sqrt N$-consistent given a single sample from a general $H$-coloring model, in which restrictions between adjacent colors are encoded by a constraint graph $H$. We verify the sufficient conditions for models where there is at least one unconstrained color as long as the graph sequence has uniformly bounded average degree. This applies to many $H$-coloring examples such as the Widom-Rowlinson and multi-state hard-core models. On the other hand, for the $q$-coloring model, which falls outside this class, we show that consistent estimation may be impossible even for graphs with bounded average degree. Nevertheless, we show that the MPL estimate is $\sqrt N$-consistent in the $q$-coloring model when $\{G_N\}_{N\geq 1}$ has bounded average double neighborhood. The presence of hard constraints, as opposed to soft constraints, leads to new challenges, and our proofs entail applications of the method of exchangeable pairs as well as combinatorial arguments that employ the probabilistic method. △ Less

Submitted 23 June, 2021; v1 submitted 22 August, 2020; originally announced August 2020.

Comments: Introduction reorganized. 34 pages, 3 figures

Invariant states of hydrodynamic limits of randomized load balancing networks

Authors: Pooja Agarwal, Kavita Ramanan

Abstract: Randomized load-balancing algorithms play an important role in improving performance in large-scale networks at relatively low computational cost. A common model of such a system is a network of $N$ parallel queues in which incoming jobs with independent and identically distributed service times are routed on arrival using the join-the-shortest-of-$d$-queues routing algorithm. Under fairly general… ▽ More Randomized load-balancing algorithms play an important role in improving performance in large-scale networks at relatively low computational cost. A common model of such a system is a network of $N$ parallel queues in which incoming jobs with independent and identically distributed service times are routed on arrival using the join-the-shortest-of-$d$-queues routing algorithm. Under fairly general conditions, it was shown by Aghajani and Ramanan that as $N\rightarrow\infty$, the state dynamics converges to the unique solution of a countable system of coupled deterministic measure-valued equations called the hydrodynamic equations. In this article, a characterization of invariant states of these hydrodynamic equations is obtained and, when $d=2$, used to construct a numerical algorithm to compute the queue length distribution and mean virtual waiting time in the invariant state. Additionally, it is also shown that under a suitable tail condition on the service distribution, the queue length distribution of the invariant state exhibits a doubly exponential tail decay, thus demonstrating a vast improvement in performance over the case $d=1$, which corresponds to random routing, when the tail decay could even be polynomial. Furthermore, numerical evidence is provided to support the conjecture that the invariant state is the limit of the steady-state distributions of the $N$-server models. The proof methodology, which entails analysis of a coupled system of measure-valued equations, can potentially be applied to other many-server systems with general service distributions, where measure-valued representations are useful. △ Less

Submitted 19 August, 2020; originally announced August 2020.

Comments: 40 pages, 6 figures

MSC Class: 60K25; 60K35; 90B15

On $r$-to-$p$ norms of random matrices with nonnegative entries: Asymptotic normality and $\ell_\infty$-bounds for the maximizer

Authors: Souvik Dhara, Debankur Mukherjee, Kavita Ramanan

Abstract: For an $n\times n$ matrix $A_n$, the $r\to p$ operator norm is defined as $$\|A_n\|_{r\to p}:= \sup_{\mathbf{x}\in\mathbb{R}^n:\|\mathbf{x} \|_r\leq 1 } \|A_n\mathbf{x} \|_p\quad\text{for}\quad r,p\geq 1.$$ For different choices of $r$ and $p$, this norm corresponds to key quantities that arise in diverse applications including matrix condition number estimation, clustering of data, and constructi… ▽ More For an $n\times n$ matrix $A_n$, the $r\to p$ operator norm is defined as $$\|A_n\|_{r\to p}:= \sup_{\mathbf{x}\in\mathbb{R}^n:\|\mathbf{x} \|_r\leq 1 } \|A_n\mathbf{x} \|_p\quad\text{for}\quad r,p\geq 1.$$ For different choices of $r$ and $p$, this norm corresponds to key quantities that arise in diverse applications including matrix condition number estimation, clustering of data, and construction of oblivious routing schemes in transportation networks. This article considers $r\to p$ norms of symmetric random matrices with nonnegative entries, including adjacency matrices of Erdős-Rényi random graphs, matrices with positive sub-Gaussian entries, and certain sparse matrices. For $1<p\leq r<\infty$, the asymptotic normality, as $n\to\infty$, of the appropriately centered and scaled norm $\|A_n\|_{r\to p}$ is established. When $p \geq 2$, this is shown to imply asymptotic normality of the solution to the $\ell_p$ quadratic maximization problem, also known as the $\ell_p$ Grothendieck problem. Furthermore, a sharp $\ell_\infty$-approximation bound for the unique maximizing vector in the definition of $\|A_n\|_{r\to p}$ is obtained, and may be viewed as an $\ell_\infty$-stability result of the maximizer under random perturbations of the matrix with mean entries. This result is in fact shown to hold for a broad class of deterministic sequences of matrices having certain asymptotic expansion properties. The results obtained can be viewed as a generalization of the seminal results of Füredi and Komlós (1981) on asymptotic normality of the largest singular value of a class of symmetric random matrices. In the general case with $1<p\leq r< \infty$, spectral methods are no longer applicable, and so a new approach is developed involving a refined convergence analysis of a nonlinear power method and a perturbation bound on the maximizing vector, which may be of independent interest. △ Less

Submitted 15 March, 2024; v1 submitted 28 May, 2020; originally announced May 2020.

Comments: To appear in Ann. Appl. Probab

MSC Class: Primary: 60B20; 15B52; Secondary: 15A60; 15A18

Geometric sharp large deviations for random projections of $\ell_p^n$ spheres and balls

Authors: Yin-Ting Liao, Kavita Ramanan

Abstract: Accurate estimation of tail probabilities of projections of high-dimensional probability measures is of relevance in high-dimensional statistics and asymptotic geometric analysis. Whereas large deviation principles identify the asymptotic exponential decay rate of probabilities, sharp large deviation estimates also provide the "prefactor" in front of the exponentially decaying term. For fixed… ▽ More Accurate estimation of tail probabilities of projections of high-dimensional probability measures is of relevance in high-dimensional statistics and asymptotic geometric analysis. Whereas large deviation principles identify the asymptotic exponential decay rate of probabilities, sharp large deviation estimates also provide the "prefactor" in front of the exponentially decaying term. For fixed $p \in (1,\infty)$, consider independent sequences $(X^{(n,p)})_{n \in \mathbb{N}}$ and $(Θ^n)_{n \in \mathbb{N}}$ of random vectors with $Θ^n$ distributed according to the normalized cone measure on the unit $\ell_2^n$ sphere, and $X^{(n,p)}$ distributed according to the normalized cone measure on the unit $\ell_p^n$ sphere. For almost every realization $(θ^n)_{n\in\mathbb{N}}$ of $(Θ^n)_{n\in\mathbb{N}}$, (quenched) sharp large deviation estimates are established for suitably normalized (scalar) projections of $X^{(n,p)}$ onto $θ^n$, that are asymptotically exact (as the dimension $n$ tends to infinity). Furthermore, the case when $(X^{(n,p)})_{n \in \mathbb{N}}$ is replaced with $(\mathscr{X}^{(n,p)})_{n \in \mathbb{N}}$, where $\mathscr{X}^{(n,p)}$ is distributed according to the uniform (or normalized volume) measure on the unit $\ell_p^n$ ball, is also considered. In both cases, in contrast to the (quenched) large deviation rate function, the prefactor exhibits a dependence on the projection directions $(θ^n)_{n \in\mathbb{N}}$ that encodes additional geometric information that enables one to distinguish between projections of balls and spheres. Moreover, comparison with numerical estimates obtained by direct computation and importance sampling shows that the obtained analytical expressions for tail probabilities provide good approximations even for moderate values of $n$. △ Less

Submitted 22 April, 2023; v1 submitted 12 January, 2020; originally announced January 2020.

Comments: 55 pages. This version of the paper is a slightly modified version of v1, with more details added to the proofs of Proposition 5.4 for greater clarity. The analysis of $\ell^n_p$ balls, which was removed in v2, is now added to this version

MSC Class: 60F10; 52A23 (Primary) 46B06; 41A60 (Secondary)

An asymptotic thin shell condition and large deviations for random multidimensional projections

Authors: Steven Soojin Kim, Yin-Ting Liao, Kavita Ramanan

Abstract: Consider the projection of an $n$-dimensional random vector onto a random $k_n$-dimensional basis, $k_n \leq n$, drawn uniformly from the Haar measure on the Stiefel manifold of orthonormal $k_n$-frames in $\mathbb{R}^n$, in three different asymptotic regimes as $n \rightarrow \infty$: "constant" ($k_n=k$), "sublinear" ($k_n \rightarrow \infty$ but $k_n/n \rightarrow 0$) and "linear"… ▽ More Consider the projection of an $n$-dimensional random vector onto a random $k_n$-dimensional basis, $k_n \leq n$, drawn uniformly from the Haar measure on the Stiefel manifold of orthonormal $k_n$-frames in $\mathbb{R}^n$, in three different asymptotic regimes as $n \rightarrow \infty$: "constant" ($k_n=k$), "sublinear" ($k_n \rightarrow \infty$ but $k_n/n \rightarrow 0$) and "linear" $k_n/n \rightarrow λ$ with $0 < λ\le 1$). When the sequence of random vectors satisfies a certain "asymptotic thin shell condition", we establish annealed large deviation principles (LDPs) for the corresponding sequence of random projections in the constant regime, and for the sequence of empirical measures of the coordinates of the random projections in the sublinear and linear regimes. We also establish LDPs for certain scaled $\ell_q$ norms of the random projections in these different regimes. Moreover, we verify our assumptions for various sequences of random vectors of interest, including those distributed according to Gibbs measures with superquadratic interaction potential, or the uniform measure on suitably scaled $\ell_p^n$ balls, for $p \in [1,\infty)$, and generalized Orlicz balls defined via a superquadratic function. Our results complement the central limit theorem for convex sets and related results which are known to hold under a "thin shell" condition. These results also substantially extend existing large deviation results for random projections, which are first, restricted to the setting of measures on $\ell_p^n$ balls, and secondly, limited to univariate LDPs (i.e., in $\mathbb{R}$) involving either the norm of a $k_n$-dimensional projection or the projection of $X^{(n)}$ onto a random one-dimensional subspace. Random projections of high-dimensional random vectors are of interest in a range of fields including asymptotic convex geometry and high-dimensional statistics. △ Less

Submitted 27 October, 2021; v1 submitted 31 December, 2019; originally announced December 2019.

Comments: 51 pages. The original version introduces LDPs under Assumption A* (verified for product measures, $\ell_p^n$ balls with $p > 2$, and Gibbs measures). This update verifies Assumption A* for a class of Orlicz balls, establishes general conditions Assumptions A, B, and C (which are verified for $\ell_p^n$ balls with $p \in [1, 2)$), and introduces LDPs for norms in the sublinear regime

MSC Class: 60F10; 52A23; 46B06

Locally interacting diffusions as space-time Markov random fields

Authors: Daniel Lacker, Kavita Ramanan, Ruoyu Wu

Abstract: We consider a countable system of interacting (possibly non-Markovian) stochastic differential equations driven by independent Brownian motions and indexed by the vertices of a locally finite graph $G = (V,E)$. The drift of the process at each vertex is influenced by the states of that vertex and its neighbors, and the diffusion coefficient depends on the state of only that vertex. Such processes… ▽ More We consider a countable system of interacting (possibly non-Markovian) stochastic differential equations driven by independent Brownian motions and indexed by the vertices of a locally finite graph $G = (V,E)$. The drift of the process at each vertex is influenced by the states of that vertex and its neighbors, and the diffusion coefficient depends on the state of only that vertex. Such processes arise in a variety of applications including statistical physics, neuroscience, engineering and math finance. Under general conditions on the coefficients, we show that if the initial conditions form a second-order Markov random field on $d$-dimensional Euclidean space, then at any positive time, the collection of histories of the processes at different vertices forms a second-order Markov random field on path space. We also establish a bijection between (second-order) Gibbs measures on $(\R^d)^V$ (with finite second moments) and a set of space-time (second-order) Gibbs measures on path space, corresponding respectively to the initial law and the law of the solution to the stochastic differential equation. As a corollary, we establish a Gibbs uniqueness property that shows that for infinite graphs the joint distribution of the paths is completely determined by the initial condition and the specifications, namely the family of conditional distributions on finite vertex sets given the configuration on the complement. Along the way, we establish various approximation and projection results for Markov random fields on locally finite graphs that may be of independent interest. △ Less

Submitted 25 September, 2020; v1 submitted 4 November, 2019; originally announced November 2019.

Sensitivity analysis for the stationary distribution of reflected Brownian motion in a convex polyhedral cone

Authors: David Lipshutz, Kavita Ramanan

Abstract: Reflected Brownian motion (RBM) in a convex polyhedral cone arises in a variety of applications ranging from the theory of stochastic networks to math finance, and under general stability conditions, it has a unique stationary distribution. In such applications, to implement a stochastic optimization algorithm or quantify robustness of a model, it is useful to characterize the dependence of statio… ▽ More Reflected Brownian motion (RBM) in a convex polyhedral cone arises in a variety of applications ranging from the theory of stochastic networks to math finance, and under general stability conditions, it has a unique stationary distribution. In such applications, to implement a stochastic optimization algorithm or quantify robustness of a model, it is useful to characterize the dependence of stationary performance measures on model parameters. In this work we characterize parametric sensitivities of the stationary distribution of an RBM in a simple convex polyhedral cone; that is, sensitivities to perturbations of the parameters that define the RBM --- namely, the covariance matrix, drift vector and directions of reflection along the boundary of the polyhedral cone. In order to characterize these sensitivities we study the long time behavior of the joint process consisting of an RBM along with its so-called derivative process, which characterizes pathwise derivatives of RBMs on finite time intervals. We show that the joint process is positive recurrent, has a unique stationary distribution, and parametric sensitivities of the stationary distribution of an RBM can be expressed in terms of the stationary distribution of the joint process. This can be thought of as establishing an interchange of the differential operator and the limit in time. The analysis of ergodicity of the joint process is significantly more complicated than that of the RBM due to its degeneracy and the fact that the derivative process exhibits jumps that are modulated by the RBM. The proofs of our results rely on path properties of coupled RBMs and contraction properties related to the geometry of the polyhedral cone and directions of reflection along the boundary. Our results are potentially useful for developing efficient numerical algorithms for computing sensitivities of functionals of stationary RBMs. △ Less

Submitted 11 November, 2019; v1 submitted 30 June, 2019; originally announced July 2019.

Comments: 38 pages; this version is identical to the June 30 version except for the addition of a funding acknowledgment

MSC Class: 60G17; 90C31; 93B35; 60H10; 65C30

Local weak convergence for sparse networks of interacting processes

Authors: Daniel Lacker, Kavita Ramanan, Ruoyu Wu

Abstract: We study the limiting behavior of interacting particle systems indexed by large sparse graphs, which evolve either according to a discrete time Markov chain or a diffusion, in which particles interact directly only with their nearest neighbors in the graph. To encode sparsity we work in the framework of local weak convergence of marked (random) graphs. We show that the joint law of the particle sy… ▽ More We study the limiting behavior of interacting particle systems indexed by large sparse graphs, which evolve either according to a discrete time Markov chain or a diffusion, in which particles interact directly only with their nearest neighbors in the graph. To encode sparsity we work in the framework of local weak convergence of marked (random) graphs. We show that the joint law of the particle system varies continuously with respect to local weak convergence of the underlying graph marked with the initial conditions. In addition, we show that the global empirical measure converges to a non-random limit for a large class of graph sequences including sparse Erdös-Rényi graphs and configuration models, whereas the empirical measure of the connected component of a uniformly random vertex converges to a random limit. Along the way, we develop some related results on the time-propagation of ergodicity and empirical field convergence, as well as some general results on local weak convergence of Gibbs measures in the uniqueness regime which appear to be new. The results obtained here are also useful for obtaining autonomous descriptions of marginal dynamics of interacting diffusions and Markov chains on sparse graphs. While limits of interacting particle systems on dense graphs have been extensively studied, there are relatively few works that have studied the sparse regime in generality. △ Less

Submitted 16 May, 2022; v1 submitted 4 April, 2019; originally announced April 2019.

Comments: 45 pages, 1 figure. Accepted by AAP. Version v3/v2 of the paper significantly extend the convergence results for diffusions in v1, and include new results on propagation of ergodicity and discrete-time models. The complementary results in v1 on autonomous characterization of marginal dynamics of diffusions on trees and generalizations thereof are now presented in a separate paper arXiv:2009.11667

MSC Class: Primary: 60K35; 60J05; 60J60; 60J80; Secondary: 60F17; 60B10; 82C22

Exit Time Risk-Sensitive Control for Systems of Cooperative Agents

Authors: Paul Dupuis, Vaios Laschos, Kavita Ramanan

Abstract: We study sequences, parametrized by the number of agents, of many agent exit time stochastic control problems with risk-sensitive cost structure. We identify a fully characterizing assumption, under which each of such control problem corresponds to a risk-neutral stochastic control problem with additive cost, and sequentially to a risk-neutral stochastic control problem on the simplex, where the s… ▽ More We study sequences, parametrized by the number of agents, of many agent exit time stochastic control problems with risk-sensitive cost structure. We identify a fully characterizing assumption, under which each of such control problem corresponds to a risk-neutral stochastic control problem with additive cost, and sequentially to a risk-neutral stochastic control problem on the simplex, where the specific information about the state of each agent can be discarded. We also prove that, under some additional assumptions, the sequence of value functions converges to the value function of a deterministic control problem, which can be used for the design of nearly optimal controls for the original problem, when the number of agents is sufficiently large. △ Less

Submitted 22 August, 2018; v1 submitted 17 July, 2018; originally announced July 2018.

MSC Class: 49K45

From the master equation to mean field game limit theory: Large deviations and concentration of measure

Authors: Francois Delarue, Daniel Lacker, Kavita Ramanan

Abstract: We study a sequence of symmetric $n$-player stochastic differential games driven by both idiosyncratic and common sources of noise, in which players interact with each other through their empirical distribution. The unique Nash equilibrium empirical measure of the $n$-player game is known to converge, as $n$ goes to infinity, to the unique equilibrium of an associated mean field game. Under suitab… ▽ More We study a sequence of symmetric $n$-player stochastic differential games driven by both idiosyncratic and common sources of noise, in which players interact with each other through their empirical distribution. The unique Nash equilibrium empirical measure of the $n$-player game is known to converge, as $n$ goes to infinity, to the unique equilibrium of an associated mean field game. Under suitable regularity conditions, in the absence of common noise, we complement this law of large numbers result with non-asymptotic concentration bounds for the Wasserstein distance between the $n$-player Nash equilibrium empirical measure and the mean field equilibrium. We also show that the sequence of Nash equilibrium empirical measures satisfies a weak large deviation principle, which can be strengthened to a full large deviation principle only in the absence of common noise. For both sets of results, we first use the master equation, an infinite-dimensional partial differential equation that characterizes the value function of the mean field game, to construct an associated McKean-Vlasov interacting $n$-particle system that is exponentially close to the Nash equilibrium dynamics of the $n$-player game for large $n$, by refining estimates obtained in our companion paper. Then we establish a weak large deviation principle for McKean-Vlasov systems in the presence of common noise. In the absence of common noise, we upgrade this to a full large deviation principle and obtain new concentration estimates for McKean-Vlasov systems. Finally, in two specific examples that do not satisfy the assumptions of our main theorems, we show how to adapt our methodology to establish large deviations and concentration results. △ Less

Submitted 23 April, 2018; originally announced April 2018.

From the master equation to mean field game limit theory: A central limit theorem

Authors: Francois Delarue, Daniel Lacker, Kavita Ramanan

Abstract: Mean field games (MFGs) describe the limit, as $n$ tends to infinity, of stochastic differential games with $n$ players interacting with one another through their common empirical distribution. Under suitable smoothness assumptions that guarantee uniqueness of the MFG equilibrium, a form of law of large of numbers (LLN), also known as propagation of chaos, has been established to show that the MFG… ▽ More Mean field games (MFGs) describe the limit, as $n$ tends to infinity, of stochastic differential games with $n$ players interacting with one another through their common empirical distribution. Under suitable smoothness assumptions that guarantee uniqueness of the MFG equilibrium, a form of law of large of numbers (LLN), also known as propagation of chaos, has been established to show that the MFG equilibrium arises as the limit of the sequence of empirical measures of the $n$-player game Nash equilibria, including the case when player dynamics are driven by both idiosyncratic and common sources of noise. The proof of convergence relies on the so-called master equation for the value function of the MFG, a partial differential equation on the space of probability measures. In this work, under additional assumptions, we establish a functional central limit theorem (CLT) that characterizes the limiting fluctuations around the LLN limit as the unique solution of a linear stochastic PDE. The key idea is to use the solution to the master equation to construct an associated McKean-Vlasov interacting $n$-particle system that is sufficiently close to the Nash equilibrium dynamics of the $n$-player game for large $n$. We then derive the CLT for the latter from the CLT for the former. Along the way, we obtain a new multidimensional CLT for McKean-Vlasov systems. We also illustrate the broader applicability of our methodology by applying it to establish a CLT for a specific linear-quadratic example that does not satisfy our main assumptions, and we explicitly solve the resulting stochastic PDE in this case. △ Less

Submitted 23 April, 2018; originally announced April 2018.

A Monte Carlo method for estimating sensitivities of reflected diffusions in convex polyhedral domains

Authors: David Lipshutz, Kavita Ramanan

Abstract: In this work we develop an effective Monte Carlo method for estimating sensitivities, or gradients of expectations of sufficiently smooth functionals, of a reflected diffusion in a convex polyhedral domain with respect to its defining parameters --- namely, its initial condition, drift and diffusion coefficients, and directions of reflection. Our method, which falls into the class of infinitesimal… ▽ More In this work we develop an effective Monte Carlo method for estimating sensitivities, or gradients of expectations of sufficiently smooth functionals, of a reflected diffusion in a convex polyhedral domain with respect to its defining parameters --- namely, its initial condition, drift and diffusion coefficients, and directions of reflection. Our method, which falls into the class of infinitesimal perturbation analysis (IPA) methods, uses a probabilistic representation for such sensitivities as the expectation of a functional of the reflected diffusion and its associated derivative process. The latter process is the unique solution to a constrained linear stochastic differential equation with jumps whose coefficients, domain and directions of reflection are modulated by the reflected diffusion. We propose an asymptotically unbiased estimator for such sensitivities using an Euler approximation of the reflected diffusion and its associated derivative process. Proving that the Euler approximation converges is challenging because the derivative process jumps whenever the reflected diffusion hits the boundary (of the domain). A key step in the proof is establishing a continuity property of the related derivative map, which is of independent interest. We compare the performance of our IPA estimator to a standard likelihood ratio estimator (whenever the latter is applicable), and provide numerical evidence that the variance of the former is substantially smaller than that of the latter. We illustrate our method with an example of a rank-based interacting diffusion model of equity markets. Interestingly, we show that estimating certain sensitivities of the rank-based interacting diffusion model using our method for a reflected Brownian motion description of the model outperforms a finite difference method for a stochastic differential equation description of the model. △ Less

Submitted 30 November, 2017; originally announced November 2017.

Comments: 43 pages, 4 figures, 1 table

MSC Class: 65C05; 65C30; 90C31 (Primary); 60G17; 60H10 (Secondary)

Uniqueness of Gibbs Measures for Continuous Hardcore Models

Authors: David Gamarnik, Kavita Ramanan

Abstract: We formulate a continuous version of the well known discrete hardcore (or independent set) model on a locally finite graph, parameterized by the so-called activity parameter $λ> 0$. In this version, the state or "spin value" $x_u$ of any node $u$ of the graph lies in the interval $[0,1]$, the hardcore constraint $x_u + x_v \leq 1$ is satisfied for every edge $(u,v)$ of the graph, and the space of… ▽ More We formulate a continuous version of the well known discrete hardcore (or independent set) model on a locally finite graph, parameterized by the so-called activity parameter $λ> 0$. In this version, the state or "spin value" $x_u$ of any node $u$ of the graph lies in the interval $[0,1]$, the hardcore constraint $x_u + x_v \leq 1$ is satisfied for every edge $(u,v)$ of the graph, and the space of feasible configurations is given by a convex polytope. When the graph is a regular tree, we show that there is a unique Gibbs measure associated to each activity parameter $λ>0$. Our result shows that, in contrast to the standard discrete hardcore model, the continuous hardcore model does not exhibit a phase transition on the infinite regular tree. We also consider a family of continuous models that interpolate between the discrete and continuous hardcore models on a regular tree when $λ= 1$ and show that each member of the family has a unique Gibbs measure, even when the discrete model does not. In each case, the proof entails the analysis of an associated Hamiltonian dynamical system that describes a certain limit of the marginal distribution at a node. Furthermore, given any sequence of regular graphs with fixed degree and girth diverging to infinity, we apply our results to compute the asymptotic limit of suitably normalized volumes of the corresponding sequence of convex polytopes of feasible configurations. In particular, this yields an approximation for the partition function of the continuous hard core model on a regular graph with large girth in the case $λ= 1$. △ Less

Submitted 14 August, 2017; originally announced August 2017.

Comments: 34 pages, 1 figure

MSC Class: 60K35; 82B20; 82B27; 68W25

The hydrodynamic limit of a randomized load balancing network

Authors: Reza Aghajani, Kavita Ramanan

Abstract: Randomized load balancing networks arise in a variety of applications, and allow for efficient sharing of resources, while being relatively easy to implement. We consider a network of parallel queues in which incoming jobs with independent and identically distributed service times are assigned to the shortest queue among a randomly chosen subset of $d$ queues, and leave the network on completion o… ▽ More Randomized load balancing networks arise in a variety of applications, and allow for efficient sharing of resources, while being relatively easy to implement. We consider a network of parallel queues in which incoming jobs with independent and identically distributed service times are assigned to the shortest queue among a randomly chosen subset of $d$ queues, and leave the network on completion of service. Prior work on dynamical properties of this model has focused on the case of exponential service distributions. In this work, we analyze the more realistic case of general service distributions. We first introduce a novel particle representation of the state of the network, and characterize the state dynamics via a sequence of interacting measure-valued stochastic processes. Under mild assumptions, we show that the sequence of scaled state processes converges, as the number of servers goes to infinity, to a hydrodynamic limit that is characterized as the unique solution to a countable system of coupled deterministic measure-valued equations. We also establish a propagation of chaos result that shows that finite collections of queues are asymptotically independent. The general framework developed here is potentially useful for analyzing a larger class of models arising in diverse fields including biology and materials science. △ Less

Submitted 11 October, 2017; v1 submitted 6 July, 2017; originally announced July 2017.

Comments: 71 pages, Extended version

MSC Class: 60F17; 60K25; 60K35 (Primary); 60G57 (Secondary)

Pathwise differentiability of reflected diffusions in convex polyhedral domains

Authors: David Lipshutz, Kavita Ramanan

Abstract: Reflected diffusions in convex polyhedral domains arise in a variety of applications, including interacting particle systems, queueing networks, biochemical reaction networks and mathematical finance. Under suitable conditions on the data, we establish pathwise differentiability of such a reflected diffusion with respect to its defining parameters --- namely, its initial condition, drift and diffu… ▽ More Reflected diffusions in convex polyhedral domains arise in a variety of applications, including interacting particle systems, queueing networks, biochemical reaction networks and mathematical finance. Under suitable conditions on the data, we establish pathwise differentiability of such a reflected diffusion with respect to its defining parameters --- namely, its initial condition, drift and diffusion coefficients, and (oblique) directions of reflection along the boundary of the domain. We characterize the right-continuous regularization of a pathwise derivative of the reflected diffusion as the pathwise unique solution to a constrained linear stochastic differential equation with jumps whose drift and diffusion coefficients, domain and directions of reflection depend on the state of the reflected diffusion. The proof of this result relies on properties of directional derivatives of the associated (extended) Skorokhod reflection map and their characterization in terms of a so-called derivative problem, and also involves establishing certain path properties of the reflected diffusion at nonsmooth parts of the boundary of the polyhedral domain, which may be of independent interest. As a corollary, we obtain a probabilistic representation for derivatives of expectations of functionals of reflected diffusions, which is useful for sensitivity analysis of reflected diffusions. △ Less

Submitted 5 May, 2017; originally announced May 2017.

Comments: 37 pages

MSC Class: Primary: 60G17; 90C31; 93B35. Secondary: 60H07; 60H10; 65C30

Rare Nash Equilibria and the Price of Anarchy in Large Static Games

Authors: Daniel Lacker, Kavita Ramanan

Abstract: We study a static game played by a finite number of agents, in which agents are assigned independent and identically distributed random types and each agent minimizes its objective function by choosing from a set of admissible actions that depends on its type. The game is anonymous in the sense that the objective function of each agent depends on the actions of other agents only through the empiri… ▽ More We study a static game played by a finite number of agents, in which agents are assigned independent and identically distributed random types and each agent minimizes its objective function by choosing from a set of admissible actions that depends on its type. The game is anonymous in the sense that the objective function of each agent depends on the actions of other agents only through the empirical distribution of their type-action pairs. We study the asymptotic behavior of Nash equilibria, as the number of agents tends to infinity, first by deriving laws of large numbers characterizes almost sure limit points of Nash equilibria in terms of so-called Cournot-Nash equilibria of an associated nonatomic game. Our main results are large deviation principles that characterize the probability of rare Nash equilibria and associated conditional limit theorems describing the behavior of equilibria conditioned on a rare event. The results cover situations when neither the finite-player game nor the associated nonatomic game has a unique equilibrium. In addition, we study the asymptotic behavior of the price of anarchy, complementing existing worst-case bounds with new probabilistic bounds in the context of congestion games, which are used to model traffic routing in networks. △ Less

Submitted 7 February, 2017; originally announced February 2017.

The Limit of Stationary Distributions of Many-Server Queues in the Halfin-Whitt Regime

Authors: Reza Aghajani, Kavita Ramanan

Abstract: We consider the so-called GI/GI/N queue, in which a stream of jobs with independent and identically distributed service times arrive as a renewal process to a common queue that is served by $N$ identical parallel servers in a first-come-first-serve manner. We introduce a new representation for the state of the system and, under suitable conditions on the service and interarrival distributions, est… ▽ More We consider the so-called GI/GI/N queue, in which a stream of jobs with independent and identically distributed service times arrive as a renewal process to a common queue that is served by $N$ identical parallel servers in a first-come-first-serve manner. We introduce a new representation for the state of the system and, under suitable conditions on the service and interarrival distributions, establish convergence of the corresponding sequence of centered and scaled stationary distributions in the so-called Halfin-Whitt asymptotic regime. In particular, this resolves an open question posed by Halfin and Whitt in 1981. We also characterize the limit as the stationary distribution of an infinite-dimensional two-component Markov process that is the unique solution to a certain stochastic partial differential equation. Previous results were essentially restricted to exponential service distributions or service distributions with finite support, for which the corresponding limit process admits a reduced finite-dimensional Markovian representation. We develop a different approach to deal with the general case when the Markovian representation of the limit is truly infinite-dimensional. This approach is more broadly applicable to a larger class of networks. △ Less

Submitted 4 December, 2017; v1 submitted 4 October, 2016; originally announced October 2016.

MSC Class: Primary 60K25; 60J70; secondary 90B22; 90B15; 68M20

Intertwinings of beta-Dyson Brownian motions of different dimensions

Authors: Kavita Ramanan, Mykhaylo Shkolnikov

Abstract: We show that for all positive beta the semigroups of beta-Dyson Brownian motions of different dimensions are intertwined. The proof relates beta-Dyson Brownian motions directly to Jack symmetric polynomials and omits an approximation of the former by discrete space Markov chains, thereby disposing of the technical assumption beta>1 in [GS]. The corresponding results for beta-Dyson Ornstein-Uhlenbe… ▽ More We show that for all positive beta the semigroups of beta-Dyson Brownian motions of different dimensions are intertwined. The proof relates beta-Dyson Brownian motions directly to Jack symmetric polynomials and omits an approximation of the former by discrete space Markov chains, thereby disposing of the technical assumption beta>1 in [GS]. The corresponding results for beta-Dyson Ornstein-Uhlenbeck processes are also presented. △ Less

Submitted 4 August, 2016; originally announced August 2016.

Comments: 13 pages

MSC Class: 60H10; 33D52; 82C22

Bounds on Lifting Continuous Markov Chains to Speed Up Mixing

Authors: Kavita Ramanan, Aaron Smith

Abstract: It is often possible to speed up the mixing of a Markov chain $\{ X_{t} \}_{t \in \mathbb{N}}$ on a state space $Ω$ by \textit{lifting}, that is, running a more efficient Markov chain $\{ \hat{X}_{t} \}_{t \in \mathbb{N}}$ on a larger state space $\hatΩ \supset Ω$ that projects to $\{ X_{t} \}_{t \in \mathbb{N}}$ in a certain sense. In [CLP99], Chen, Lov{á}sz and Pak prove that for Markov chains o… ▽ More It is often possible to speed up the mixing of a Markov chain $\{ X_{t} \}_{t \in \mathbb{N}}$ on a state space $Ω$ by \textit{lifting}, that is, running a more efficient Markov chain $\{ \hat{X}_{t} \}_{t \in \mathbb{N}}$ on a larger state space $\hatΩ \supset Ω$ that projects to $\{ X_{t} \}_{t \in \mathbb{N}}$ in a certain sense. In [CLP99], Chen, Lov{á}sz and Pak prove that for Markov chains on finite state spaces, the mixing time of any lift of a Markov chain is at least the square root of the mixing time of the original chain, up to a factor that depends on the stationary measure. Unfortunately, this extra factor makes the bound in [CLP99] very loose for Markov chains on large state spaces and useless for Markov chains on continuous state spaces. In this paper, we develop an extension of the evolving set method that allows us to refine this extra factor and find bounds for Markov chains on continuous state spaces that are analogous to the bounds in [CLP99]. These bounds also allow us to improve on the bounds in [CLP99] for some chains on finite state spaces. △ Less

Submitted 27 February, 2017; v1 submitted 9 June, 2016; originally announced June 2016.

Comments: 25 pages

MSC Class: 60J05

A Skorokhod Map on Measure-Valued Paths with Applications to Priority Queues

Authors: Rami Atar, Anup Biswas, Haya Kaspi, Kavita Ramanan

Abstract: The Skorokhod map on the half-line has proved to be a useful tool for studying processes with non-negativity constraints. In this work we introduce a measure-valued analog of this map that transforms each element $ζ$ of a certain class of càdlàg paths that take values in the space of signed measures on the half-line to a càdlàg path that takes values in the space of non-negative measures on… ▽ More The Skorokhod map on the half-line has proved to be a useful tool for studying processes with non-negativity constraints. In this work we introduce a measure-valued analog of this map that transforms each element $ζ$ of a certain class of càdlàg paths that take values in the space of signed measures on the half-line to a càdlàg path that takes values in the space of non-negative measures on $[0,\infty)$ in such a way that for each $x > 0$, the path $t \mapsto ζ_t[0,x]$ is transformed via a Skorokhod map on the half-line, and the regulating functions for different $x > 0$ are coupled. We establish regularity properties of this map and show that the map provides a convenient tool for studying queueing systems in which tasks are prioritized according to a continuous parameter. Three such well known models are the earliest-deadline-first, the shortest-job-first and the shortest-remaining-processing-time scheduling policies. For these applications, we show how the map provides a unified framework within which to form fluid model equations, prove uniqueness of solutions to these equations and establish convergence of scaled state processes to the fluid model. In particular, for these models, we obtain new convergence results in time-inhomogeneous settings, which appear to fall outside the purview of existing approaches. △ Less

Submitted 17 April, 2016; originally announced April 2016.

Comments: 51 pages, 1 figure

MSC Class: 60K25; 60G57; 68M20

On directional derivatives of Skorokhod maps in convex polyhedral domains

Authors: David Lipshutz, Kavita Ramanan

Abstract: The study of both sensitivity analysis and differentiability of the stochastic flow of a reflected process in a convex polyhedral domain is challenging because the dynamics are discontinuous at the boundary of the domain and the boundary of the domain is not smooth. These difficulties can be addressed by studying directional derivatives of an associated extended Skorokhod map, which is a determini… ▽ More The study of both sensitivity analysis and differentiability of the stochastic flow of a reflected process in a convex polyhedral domain is challenging because the dynamics are discontinuous at the boundary of the domain and the boundary of the domain is not smooth. These difficulties can be addressed by studying directional derivatives of an associated extended Skorokhod map, which is a deterministic mapping that takes an unconstrained path to a suitably reflected version. In this work we develop an axiomatic framework for the analysis of directional derivatives of a large class of Lipschitz continuous extended Skorokhod maps in convex polyhedral domains with oblique directions of reflection. We establish existence of directional derivatives at a path whose reflected version satisfies a certain boundary jitter property, and also show that the right-continuous regularization of such a directional derivative can be characterized as the unique solution to a Skorokhod-type problem, where both the domain and directions of reflection vary (discontinuously) with time. A key ingredient in the proof is establishing certain contraction properties for a family of (oblique) derivative projection operators. As an application, we establish pathwise differentiability of reflected Brownian motion in the nonnegative quadrant with respect to the initial condition, drift vector, dispersion matrix and directions of reflection. The results of this paper are also used in subsequent work to establish pathwise differentiability of a much larger class of reflected diffusions in convex polyhedral domains. △ Less

Submitted 4 February, 2016; originally announced February 2016.

Comments: 58 pages, 3 figures

MSC Class: 60G17; 90C31; 93B35 (Primary); 90B15 (Secondary)

Large Deviation Principle For Finite-State Mean Field Interacting Particle Systems

Authors: Paul Dupuis, Kavita Ramanan, Wei Wu

Abstract: We establish a large deviation principle for the empirical measure process associated with a general class of finite-state mean field interacting particle systems with Lipschitz continuous transition rates that satisfy a certain ergodicity condition. The approach is based on a variational representation for functionals of a Poisson random measure. Under an appropriate strengthening of the ergodici… ▽ More We establish a large deviation principle for the empirical measure process associated with a general class of finite-state mean field interacting particle systems with Lipschitz continuous transition rates that satisfy a certain ergodicity condition. The approach is based on a variational representation for functionals of a Poisson random measure. Under an appropriate strengthening of the ergodicity condition, we also prove a locally uniform large deviation principle. The main novelty is that more than one particle is allowed to change its state simultaneously, and so a standard approach to the proof based on a change of measure with respect to a system of independent particles is not possible. The result is shown to be applicable to a wide range of models arising from statistical physics, queueing systems and communication networks. Along the way, we establish a large deviation principle for a class of jump Markov processes on the simplex, whose rates decay to zero as they approach the boundary of the domain. This result may be of independent interest. △ Less

Submitted 22 January, 2016; originally announced January 2016.

Comments: 62 pages

MSC Class: 60F10; 60K35

Mean-field Dynamics of Load-Balancing Networks with General Service Distributions

Authors: Reza Aghajani, Xingjie Li, Kavita Ramanan

Abstract: We introduce a general framework for the mean-field analysis of large-scale load-balancing networks with general service distributions. Specifically, we consider a parallel server network that consists of N queues and operates under the $SQ(d)$ load balancing policy, wherein jobs have independent and identical service requirements and each incoming job is routed on arrival to the shortest of $d$ q… ▽ More We introduce a general framework for the mean-field analysis of large-scale load-balancing networks with general service distributions. Specifically, we consider a parallel server network that consists of N queues and operates under the $SQ(d)$ load balancing policy, wherein jobs have independent and identical service requirements and each incoming job is routed on arrival to the shortest of $d$ queues that are sampled uniformly at random from $N$ queues. We introduce a novel state representation and, for a large class of arrival processes, including renewal and time-inhomogeneous Poisson arrivals, and mild assumptions on the service distribution, show that the mean-field limit, as $N \rightarrow \infty$, of the state can be characterized as the unique solution of a sequence of coupled partial integro-differential equations, which we refer to as the hydrodynamic PDE. We use a numerical scheme to solve the PDE to obtain approximations to the dynamics of large networks and demonstrate the efficacy of these approximations using Monte Carlo simulations. We also illustrate how the PDE can be used to gain insight into network performance. △ Less

Submitted 22 December, 2015; v1 submitted 16 December, 2015; originally announced December 2015.

Comments: Minor change, adding acknowledgments

Large deviations for random projections of $\ell^p$ balls

Authors: Nina Gantert, Steven Soojin Kim, Kavita Ramanan

Abstract: Let $p\in[1,\infty]$. Consider the projection of a uniform random vector from a suitably normalized $\ell^p$ ball in $\mathbb{R}^n$ onto an independent random vector from the unit sphere. We show that sequences of such random projections, when suitably normalized, satisfy a large deviation principle (LDP) as the dimension $n$ goes to $\infty$, which can be viewed as an annealed LDP. We also establ… ▽ More Let $p\in[1,\infty]$. Consider the projection of a uniform random vector from a suitably normalized $\ell^p$ ball in $\mathbb{R}^n$ onto an independent random vector from the unit sphere. We show that sequences of such random projections, when suitably normalized, satisfy a large deviation principle (LDP) as the dimension $n$ goes to $\infty$, which can be viewed as an annealed LDP. We also establish a quenched LDP (conditioned on a fixed sequence of projection directions) and show that for $p\in(1,\infty]$ (but not for $p=1$), the corresponding rate function is "universal", in the sense that it coincides for "almost every" sequence of projection directions. We also analyze some exceptional sequences of directions in the "measure zero" set, including the directions corresponding to the classical Cramér's theorem, and show that those directions yield LDPs with rate functions that are distinct from the universal rate function of the quenched LDP. Lastly, we identify a variational formula that relates the annealed and quenched LDPs, and analyze the minimizer of this variational formula. These large deviation results complement the central limit theorem for convex sets, specialized to the case of sequences of $\ell^p$ balls. △ Less

Submitted 15 December, 2015; originally announced December 2015.

Comments: 48 pages, 3 figures

MSC Class: 60F10; 52A23 (Primary); 52A20; 60K37; 60D05 (Secondary)

Ergodicity of an SPDE Associated with a Many-Server Queue

Authors: Reza Aghajani, Kavita Ramanan

Abstract: We consider the so-called GI/GI/N queueing network in which a stream of jobs with independent and identically distributed service times arrive according to a renewal process to a common queue served by $N$ identical servers in a First-Come-First-Serve manner. We introduce a two-component infinite-dimensional Markov process that serves as a diffusion model for this network, in the regime where the… ▽ More We consider the so-called GI/GI/N queueing network in which a stream of jobs with independent and identically distributed service times arrive according to a renewal process to a common queue served by $N$ identical servers in a First-Come-First-Serve manner. We introduce a two-component infinite-dimensional Markov process that serves as a diffusion model for this network, in the regime where the number of servers goes to infinity and the load on the network scales as $1 - βN^{-1/2}+ o(N^{-1/2})$ for some $β> 0$. Under suitable assumptions, we characterize this process as the unique solution to a pair of stochastic evolution equations comprised of a real-valued Itô equation and a stochastic partial differential equation on the positive half line, which are coupled together by a nonlinear boundary condition. We construct an asymptotic (equivalent) coupling to show that this Markov process has a unique invariant distribution. This invariant distribution is shown in a companion paper [1] to be the limit of the sequence of suitably scaled and centered stationary distributions of the GI/GI/N network, thus resolving (for a large class service distributions) an open problem raised by Halfin and Whitt in 1981. The methods introduced here are more generally applicable for the analysis of a broader class of networks. △ Less

Submitted 4 December, 2017; v1 submitted 9 December, 2015; originally announced December 2015.

MSC Class: Primary: 60H15; 60G10; 60K25. Secondary 90B22

Obliquely reflected Brownian motion in non-smooth planar domains

Authors: Krzysztof Burdzy, Zhen-Qing Chen, Donald Marshall, Kavita Ramanan

Abstract: We construct obliquely reflected Brownian motions in all bounded simply connected planar domains, including non-smooth domains, with general reflection vector fields on the boundary. Conformal mappings and excursion theory are our main technical tools. A key intermediate step, which may be of independent interest, is an alternative characterization of reflected Brownian motions in smooth bounded p… ▽ More We construct obliquely reflected Brownian motions in all bounded simply connected planar domains, including non-smooth domains, with general reflection vector fields on the boundary. Conformal mappings and excursion theory are our main technical tools. A key intermediate step, which may be of independent interest, is an alternative characterization of reflected Brownian motions in smooth bounded planar domains with a given field of angles of oblique reflection on the boundary in terms of a pair of quantities, namely an integrable positive harmonic function, which represents the stationary distribution of the process, and a real number that represents, in a suitable sense, the asymptotic rate of rotation of the process around a reference point in the domain. Furthermore, we also show that any obliquely reflected Brownian motion in a simply connected Jordan domain can be obtained as a suitable limit of obliquely reflected Brownian motions in smooth domains. △ Less

Submitted 7 December, 2015; originally announced December 2015.

Large deviations for configurations generated by Gibbs distributions with energy functionals consisting of singular interaction and weakly confining potentials

Authors: Paul Dupuis, Vaios Laschos, Kavita Ramanan

Abstract: We establish large deviation principles (LDPs) for empirical measures associated with a sequence of Gibbs distributions on $n$-particle configurations, each of which is defined in terms of an inverse temperature $% β_n$ and an energy functional consisting of a (possibly singular) interaction potential and a (possibly weakly) confining potential. Under fairly general assumptions on the potentials,… ▽ More We establish large deviation principles (LDPs) for empirical measures associated with a sequence of Gibbs distributions on $n$-particle configurations, each of which is defined in terms of an inverse temperature $% β_n$ and an energy functional consisting of a (possibly singular) interaction potential and a (possibly weakly) confining potential. Under fairly general assumptions on the potentials, we use a common framework to establish LDPs both with speeds $β_n/n \rightarrow \infty$, in which case the rate function is expressed in terms of a functional involving the potentials, and with speed $β_n =n$, when the rate function contains an additional entropic term. Such LDPs are motivated by questions arising in random matrix theory, sampling, simulated annealing and asymptotic convex geometry. Our approach, which uses the weak convergence method developed by Dupuis and Ellis, establishes LDPs with respect to stronger Wasserstein-type topologies. Our results address several interesting examples not covered by previous works, including the case of a weakly confining potential, which allows for rate functions with minimizers that do not have compact support, thus resolving several open questions raised in a work of Chafaï et al. △ Less

Submitted 5 January, 2020; v1 submitted 21 November, 2015; originally announced November 2015.

A conditional limit theorem for high-dimensional $\ell^{p}$ spheres

Authors: Steven Soojin Kim, Kavita Ramanan

Abstract: The study of high-dimensional distributions is of interest in probability theory, statistics and asymptotic convex geometry, where the object of interest is the uniform distribution on a convex set in high dimensions. The $\ell^p$ spaces and norms are of particular interest in this setting. In this paper, we establish a limit theorem for distributions on $\ell^p$ spheres, conditioned on a rare eve… ▽ More The study of high-dimensional distributions is of interest in probability theory, statistics and asymptotic convex geometry, where the object of interest is the uniform distribution on a convex set in high dimensions. The $\ell^p$ spaces and norms are of particular interest in this setting. In this paper, we establish a limit theorem for distributions on $\ell^p$ spheres, conditioned on a rare event, in a high-dimensional geometric setting. As part of our proof, we establish a certain large deviation principle that is also relevant to the study of the tail behavior of random projections of $\ell^p$ balls in a high-dimensional Euclidean space. △ Less

Submitted 20 June, 2018; v1 submitted 17 September, 2015; originally announced September 2015.

Comments: 17 pages; formerly titled "A Sanov-type theorem for empirical measures associated with the surface and cone measures on $\ell^{p}$ spheres"

MSC Class: 60F10; 52A20 (Primary); 52A23; 60D05 (Secondary)

Cramér's theorem is atypical

Authors: Nina Gantert, Steven Soojin Kim, Kavita Ramanan

Abstract: The empirical mean of $n$ independent and identically distributed (i.i.d.) random variables $(X_1,\dots,X_n)$ can be viewed as a suitably normalized scalar projection of the $n$-dimensional random vector $X^{(n)}\doteq(X_1,\dots,X_n)$ in the direction of the unit vector $n^{-1/2}(1,1,\dots,1) \in \mathbb{S}^{n-1}$. The large deviation principle (LDP) for such projections as $n\rightarrow\infty$ is… ▽ More The empirical mean of $n$ independent and identically distributed (i.i.d.) random variables $(X_1,\dots,X_n)$ can be viewed as a suitably normalized scalar projection of the $n$-dimensional random vector $X^{(n)}\doteq(X_1,\dots,X_n)$ in the direction of the unit vector $n^{-1/2}(1,1,\dots,1) \in \mathbb{S}^{n-1}$. The large deviation principle (LDP) for such projections as $n\rightarrow\infty$ is given by the classical Cramér's theorem. We prove an LDP for the sequence of normalized scalar projections of $X^{(n)}$ in the direction of a generic unit vector $θ^{(n)} \in \mathbb{S}^{n-1}$, as $n\rightarrow\infty$. This LDP holds under fairly general conditions on the distribution of $X_1$, and for "almost every" sequence of directions $(θ^{(n)})_{n\in\mathbb{N}}$. The associated rate function is "universal" in the sense that it does not depend on the particular sequence of directions. Moreover, under mild additional conditions on the law of $X_1$, we show that the universal rate function differs from the Cramér rate function, thus showing that the sequence of directions $n^{-1/2}(1,1,\dots,1) \in \mathbb{S}^{n-1},$ $n \in \mathbb{N}$, corresponding to Cramér's theorem is atypical. △ Less

Submitted 5 October, 2015; v1 submitted 18 August, 2015; originally announced August 2015.

Comments: 16 pages, simplified proof of Theorem 2.4, result slightly strengthened, added references, corrected typos, clarified some language

MSC Class: 60F10 (Primary); 60D05 (Secondary)

Local stability of Kolmogorov forward equations for finite state nonlinear Markov processes

Authors: Amarjit Budhiraja, Paul Dupuis, Markus Fischer, Kavita Ramanan

Abstract: The focus of this work is on local stability of a class of nonlinear ordinary differential equations (ODE) that describe limits of empirical measures associated with finite-state weakly interacting N-particle systems. Local Lyapunov functions are identified for several classes of such ODE, including those associated with systems with slow adaptation and Gibbs systems. Using results from [5] and la… ▽ More The focus of this work is on local stability of a class of nonlinear ordinary differential equations (ODE) that describe limits of empirical measures associated with finite-state weakly interacting N-particle systems. Local Lyapunov functions are identified for several classes of such ODE, including those associated with systems with slow adaptation and Gibbs systems. Using results from [5] and large deviations heuristics, a partial differential equation (PDE) associated with the nonlinear ODE is introduced and it is shown that positive definite subsolutions of this PDE serve as local Lyapunov functions for the ODE. This PDE characterization is used to construct explicit Lyapunov functions for a broad class of models called locally Gibbs systems. This class of models is significantly larger than the family of Gibbs systems and several examples of such systems are presented, including models with nearest neighbor jumps and models with simultaneous jumps that arise in applications. △ Less

Submitted 12 February, 2015; v1 submitted 17 December, 2014; originally announced December 2014.

Comments: Updated to include Acknowledgements

Limits of relative entropies associated with weakly interacting particle systems

Authors: Amarjit Budhiraja, Paul Dupuis, Markus Fischer, Kavita Ramanan

Abstract: The limits of scaled relative entropies between probability distributions associated with N-particle weakly interacting Markov processes are considered. The convergence of such scaled relative entropies is established in various settings. The analysis is motivated by the role relative entropy plays as a Lyapunov function for the (linear) Kolmogorov forward equation associated with an ergodic Marko… ▽ More The limits of scaled relative entropies between probability distributions associated with N-particle weakly interacting Markov processes are considered. The convergence of such scaled relative entropies is established in various settings. The analysis is motivated by the role relative entropy plays as a Lyapunov function for the (linear) Kolmogorov forward equation associated with an ergodic Markov process, and Lyapunov function properties of these scaling limits with respect to nonlinear finite-state Markov processes are studied in the companion paper [6]. △ Less

Submitted 12 February, 2015; v1 submitted 17 December, 2014; originally announced December 2014.

On the submartingale problem for reflected diffusions in domains with piecewise smooth boundaries

Authors: Weining Kang, Kavita Ramanan

Abstract: Two frameworks that have been used to characterize reflected diffusions include stochastic differential equations with reflection and the so-called submartingale problem. We introduce a general formulation of the submartingale problem for (obliquely) reflected diffusions in domains with piecewise C^2 boundaries and piecewise continuous reflection vector fields. Under suitable assumptions, we show… ▽ More Two frameworks that have been used to characterize reflected diffusions include stochastic differential equations with reflection and the so-called submartingale problem. We introduce a general formulation of the submartingale problem for (obliquely) reflected diffusions in domains with piecewise C^2 boundaries and piecewise continuous reflection vector fields. Under suitable assumptions, we show that well-posedness of the submartingale problem is equivalent to existence and uniqueness in law of weak solutions to the corresponding stochastic differential equation with reflection. Our result generalizes to the case of reflecting diffusions a classical result due to Stroock and Varadhan on the equivalence of well-posedness of martingale problems and well-posedness of weak solutions of stochastic differential equations in d-dimensional Euclidean space. The analysis in the case of reflected diffusions in domains with non-smooth boundaries is considerably more subtle and requires a careful analysis of the behavior of the reflected diffusion on the boundary of the domain. In particular, the equivalence can fail to hold when our assumptions are not satisfied. The equivalence we establish allows one to transfer results on reflected diffusions characterized by one approach to reflected diffusions analyzed by the other approach. As an application, we provide a characterization of stationary distributions of a large class of reflected diffusions in convex polyhedral domains. △ Less

Submitted 1 December, 2014; originally announced December 2014.

Comments: 49 pages

MSC Class: Primary: 60H10; 60J60; 58J65; Secondary: 60H30; 90B15

Large Deviations for Weighted Sums of Stretched Exponential Random Variables

Authors: Nina Gantert, Kavita Ramanan, Franz Rembart

Abstract: We consider the probability that a weighted sum of $n$ i.i.d. random variables $X_j$, $j = 1, . . ., n$, with stretched exponential tails is larger than its expectation and determine the rate of its decay, under suitable conditions on the weights. We show that the decay is subexponential, and identify the rate function in terms of the tails of $X_j$ and the weights. Our result generalizes the larg… ▽ More We consider the probability that a weighted sum of $n$ i.i.d. random variables $X_j$, $j = 1, . . ., n$, with stretched exponential tails is larger than its expectation and determine the rate of its decay, under suitable conditions on the weights. We show that the decay is subexponential, and identify the rate function in terms of the tails of $X_j$ and the weights. Our result generalizes the large deviation principle given by Kiesel and Stadtmüller [8] as well as the tail asymptotics for sums of i.i.d. random variables provided by Nagaev [10, 11]. As an application of our result, motivated by random projections of high-dimensional vectors, we consider the case of random, self-normalized weights that are independent of the sequence $\{X_j\}_{j \in \mathbb N}$, identify the decay rate for both the quenched and annealed large deviations in this case, and show that they coincide. As another example we consider weights derived from kernel functions that arise in non-parametric regression. △ Less

Submitted 24 December, 2014; v1 submitted 18 January, 2014; originally announced January 2014.

MSC Class: 60F10; 62G32

Journal ref: Electronic Communications in Probability 19 (2014), 41, 1-14

Characterization of stationary distributions of reflected diffusions

Authors: Weining Kang, Kavita Ramanan

Abstract: Given a domain G, a reflection vector field d(.) on the boundary of G, and drift and dispersion coefficients b(.) and σ(.), let L be the usual second-order elliptic operator associated with b(.) and σ(.). Under suitable assumptions that, in particular, ensure that the associated submartingale problem is well posed, it is shown that a probability measure $π$ on \bar{G} is a stationary distribution… ▽ More Given a domain G, a reflection vector field d(.) on the boundary of G, and drift and dispersion coefficients b(.) and σ(.), let L be the usual second-order elliptic operator associated with b(.) and σ(.). Under suitable assumptions that, in particular, ensure that the associated submartingale problem is well posed, it is shown that a probability measure $π$ on \bar{G} is a stationary distribution for the corresponding reflected diffusion if and only if $π(\partial G) = 0$ and $\int_{\bar{G}} L f (x) π(dx) \leq 0$ for every f in a certain class of test functions. Moreover, the assumptions are shown to be satisfied by a large class of reflected diffusions in piecewise smooth multi-dimensional domains with possibly oblique reflection. △ Less

Submitted 23 April, 2012; originally announced April 2012.

Comments: 48 pages

MSC Class: 60H10; 60J60; 60J65 (Primary) 90B15; 90B22 (Secondary)