Skip to main content

Showing 1–19 of 19 results for author: Majka, M B

Searching in archive math. Search in all archives.
.
  1. arXiv:2505.22760  [pdf, ps, other

    math.OC cs.LG math.PR

    Non-convex entropic mean-field optimization via Best Response flow

    Authors: Razvan-Andrei Lascu, Mateusz B. Majka

    Abstract: We study the problem of minimizing non-convex functionals on the space of probability measures, regularized by the relative entropy (KL divergence) with respect to a fixed reference measure, as well as the corresponding problem of solving entropy-regularized non-convex-non-concave min-max problems. We utilize the Best Response flow (also known in the literature as the fictitious play flow) and stu… ▽ More

    Submitted 28 May, 2025; originally announced May 2025.

    Comments: 40 pages

  2. arXiv:2412.19377  [pdf, ps, other

    math.PR

    Geometric ergodicity of modified Euler schemes for SDEs with super-linearity

    Authors: Jianhai Bao, Mateusz B. Majka, Jian Wang

    Abstract: As a well-known fact, the classical Euler scheme works merely for SDEs with coefficients of linear growth. In this paper, we study a general framework of modified Euler schemes, which is applicable to SDEs with super-linear drifts and encompasses numerical methods such as the tamed Euler scheme and the truncated Euler scheme. On the one hand, by exploiting an approach based on the refined basic co… ▽ More

    Submitted 26 December, 2024; originally announced December 2024.

    Comments: 29 pages

  3. arXiv:2411.15067  [pdf, ps, other

    math.OC cs.LG math.PR

    Linear convergence of proximal descent schemes on the Wasserstein space

    Authors: Razvan-Andrei Lascu, Mateusz B. Majka, David Šiška, Łukasz Szpruch

    Abstract: We investigate proximal descent methods, inspired by the minimizing movement scheme introduced by Jordan, Kinderlehrer and Otto, for optimizing entropy-regularized functionals on the Wasserstein space. We establish linear convergence under flat convexity assumptions, thereby relaxing the common reliance on geodesic convexity. Our analysis circumvents the need for discrete-time adaptations of the E… ▽ More

    Submitted 22 November, 2024; originally announced November 2024.

    Comments: 28 pages

  4. arXiv:2405.15834  [pdf, ps, other

    math.OC cs.LG math.PR

    A Fisher-Rao gradient flow for entropic mean-field min-max games

    Authors: Razvan-Andrei Lascu, Mateusz B. Majka, Łukasz Szpruch

    Abstract: Gradient flows play a substantial role in addressing many machine learning problems. We examine the convergence in continuous-time of a \textit{Fisher-Rao} (Mean-Field Birth-Death) gradient flow in the context of solving convex-concave min-max games with entropy regularization. We propose appropriate Lyapunov functions to demonstrate convergence with explicit rates to the unique mixed Nash equilib… ▽ More

    Submitted 18 September, 2024; v1 submitted 24 May, 2024; originally announced May 2024.

    Comments: 24 pages. arXiv admin note: text overlap with arXiv:2306.03033

    Journal ref: Transactions on Machine Learning Research (2024)

  5. arXiv:2402.08106  [pdf, ps, other

    math.OC cs.LG math.PR

    Mirror Descent-Ascent for mean-field min-max problems

    Authors: Razvan-Andrei Lascu, Mateusz B. Majka, Łukasz Szpruch

    Abstract: We study two variants of the mirror descent-ascent algorithm for solving min-max problems on the space of measures: simultaneous and sequential. We work under assumptions of convexity-concavity and relative smoothness of the payoff function with respect to a suitable Bregman divergence, defined on the space of measures via flat derivatives. We show that the convergence rates to mixed Nash equilibr… ▽ More

    Submitted 28 May, 2024; v1 submitted 12 February, 2024; originally announced February 2024.

    Comments: 33 pages; updated introduction

  6. arXiv:2310.15897  [pdf, ps, other

    math.PR

    $L^2$-Wasserstein contraction for Euler schemes of elliptic diffusions and interacting particle systems

    Authors: Linshan Liu, Mateusz B. Majka, Pierre Monmarché

    Abstract: We show the $L^2$-Wasserstein contraction for the transition kernel of a discretised diffusion process, under a contractivity at infinity condition on the drift and a sufficiently high diffusivity requirement. This extends recent results that, under similar assumptions on the drift but without the diffusivity restrictions, showed the $L^1$-Wasserstein contraction, or $L^p$-Wasserstein bounds for… ▽ More

    Submitted 24 October, 2023; originally announced October 2023.

    Comments: 28 pages

  7. Entropic mean-field min-max problems via Best Response flow

    Authors: Razvan-Andrei Lascu, Mateusz B. Majka, Łukasz Szpruch

    Abstract: We investigate the convergence properties of a continuous-time optimization method, the \textit{Mean-Field Best Response} flow, for solving convex-concave min-max games with entropy regularization. We introduce suitable Lyapunov functions to establish exponential convergence to the unique mixed Nash equilibrium. Additionally, we demonstrate the convergence of the fictitious play flow as a by-produ… ▽ More

    Submitted 9 March, 2025; v1 submitted 5 June, 2023; originally announced June 2023.

    Comments: 34 pages, revised version, accepted for publication in Applied Mathematics & Optimization. The final manuscript is available at Springer via https://link.springer.com/article/10.1007/s00245-025-10246-6#article-info

  8. arXiv:2210.11251  [pdf, other

    math.PR

    Optimal Markovian coupling for finite activity Lévy processes

    Authors: Wilfrid S. Kendall, Mateusz B. Majka, Aleksandar Mijatović

    Abstract: We study optimal Markovian couplings of Markov processes, where the optimality is understood in terms of minimization of concave transport costs between the time-marginal distributions of the coupled processes. We provide explicit constructions of such optimal couplings for one-dimensional finite-activity Lévy processes (continuous-time random walks) whose jump distributions are unimodal but not n… ▽ More

    Submitted 20 October, 2022; originally announced October 2022.

    Comments: 23 pages, 2 figures

  9. Polyak-Łojasiewicz inequality on the space of measures and convergence of mean-field birth-death processes

    Authors: Linshan Liu, Mateusz B. Majka, Łukasz Szpruch

    Abstract: The Polyak-Lojasiewicz inequality (PLI) in $\mathbb{R}^d$ is a natural condition for proving convergence of gradient descent algorithms. In the present paper, we study an analogue of PLI on the space of probability measures $\mathcal{P}(\mathbb{R}^d)$ and show that it is a natural condition for showing exponential convergence of a class of birth-death processes related to certain mean-field optimi… ▽ More

    Submitted 5 June, 2023; v1 submitted 6 June, 2022; originally announced June 2022.

    Comments: 21 pages, revised version, accepted for publication in Applied Mathematics & Optimization. The final manuscript is available at Springer via https://doi.org/10.1007/s00245-022-09962-0

  10. arXiv:2109.00694  [pdf, ps, other

    math.PR

    Strict Kantorovich contractions for Markov chains and Euler schemes with general noise

    Authors: Lu-Jing Huang, Mateusz B. Majka, Jian Wang

    Abstract: We study contractions of Markov chains on general metric spaces with respect to some carefully designed distance-like functions, which are comparable to the total variation and the standard $L^p$-Wasserstein distances for $p \ge 1$. We present explicit lower bounds of the corresponding contraction rates. By employing the refined basic coupling and the coupling by reflection, the results are applie… ▽ More

    Submitted 1 September, 2021; originally announced September 2021.

    Comments: 24 pages

  11. arXiv:2007.02212  [pdf, ps, other

    math.PR

    Approximation of heavy-tailed distributions via stable-driven SDEs

    Authors: Lu-Jing Huang, Mateusz B. Majka, Jian Wang

    Abstract: Constructions of numerous approximate sampling algorithms are based on the well-known fact that certain Gibbs measures are stationary distributions of ergodic stochastic differential equations (SDEs) driven by the Brownian motion. However, for some heavy-tailed distributions it can be shown that the associated SDE is not exponentially ergodic and that related sampling algorithms may perform poorly… ▽ More

    Submitted 4 July, 2020; originally announced July 2020.

    Comments: 21 pages

  12. arXiv:2006.06102  [pdf, other

    stat.ML cs.LG math.PR math.ST stat.CO

    Multi-index Antithetic Stochastic Gradient Algorithm

    Authors: Mateusz B. Majka, Marc Sabate-Vidales, Łukasz Szpruch

    Abstract: Stochastic Gradient Algorithms (SGAs) are ubiquitous in computational statistics, machine learning and optimisation. Recent years have brought an influx of interest in SGAs, and the non-asymptotic analysis of their bias is by now well-developed. However, relatively little is known about the optimal choice of the random approximation (e.g mini-batching) of the gradient in SGAs as this relies on the… ▽ More

    Submitted 30 September, 2021; v1 submitted 10 June, 2020; originally announced June 2020.

    Comments: 51 pages, 8 figures. Revised version: an improved introduction, a completely new numerical section including experiments in non-convex settings, a new appendix discussing the dependence of the variance of SGLD on the mini-batch size

  13. arXiv:1901.11125  [pdf, ps, other

    math.PR

    Exponential ergodicity for SDEs and McKean-Vlasov processes with Lévy noise

    Authors: Mingjie Liang, Mateusz B. Majka, Jian Wang

    Abstract: We study stochastic differential equations (SDEs) of McKean-Vlasov type with distribution dependent drifts and driven by pure jump Lévy processes. We prove a uniform in time propagation of chaos result, providing quantitative bounds on convergence rate of interacting particle systems with Lévy noise to the corresponding McKean-Vlasov SDE. By applying techniques that combine couplings, appropriatel… ▽ More

    Submitted 8 November, 2020; v1 submitted 30 January, 2019; originally announced January 2019.

    Comments: 44 pages

  14. arXiv:1808.07105  [pdf, ps, other

    math.PR math.ST stat.ML

    Non-asymptotic bounds for sampling algorithms without log-concavity

    Authors: Mateusz B. Majka, Aleksandar Mijatović, Lukasz Szpruch

    Abstract: Discrete time analogues of ergodic stochastic differential equations (SDEs) are one of the most popular and flexible tools for sampling high-dimensional probability measures. Non-asymptotic analysis in the $L^2$ Wasserstein distance of sampling algorithms based on Euler discretisations of SDEs has been recently developed by several authors for log-concave probability distributions. In this work we… ▽ More

    Submitted 10 October, 2019; v1 submitted 21 August, 2018; originally announced August 2018.

    Comments: 48 pages, revised version, accepted for publication in The Annals of Applied Probability

    MSC Class: 65C05; 65C30; 65C40; 60J22; 62H12; 60H10

  15. arXiv:1808.07033  [pdf, ps, other

    math.PR

    Quantitative contraction rates for Markov chains on general state spaces

    Authors: Andreas Eberle, Mateusz B. Majka

    Abstract: We investigate the problem of quantifying contraction coefficients of Markov transition kernels in Kantorovich ($L^1$ Wasserstein) distances. For diffusion processes, relatively precise quantitative bounds on contraction rates have recently been derived by combining appropriate couplings with carefully designed Kantorovich distances. In this paper, we partially carry over this approach from diffus… ▽ More

    Submitted 21 August, 2018; originally announced August 2018.

    Comments: 39 pages

    MSC Class: 60J05; 60J22; 65C05; 65C30; 65C40

  16. arXiv:1612.03824  [pdf, ps, other

    math.PR

    A note on existence of global solutions and invariant measures for jump SDEs with locally one-sided Lipschitz drift

    Authors: Mateusz B. Majka

    Abstract: We extend some methods developed by Albeverio, Brzeźniak and Wu and we show how to apply them in order to prove existence of global strong solutions of stochastic differential equations with jumps, under a local one-sided Lipschitz condition on the drift (also known as a monotonicity condition) and a local Lipschitz condition on the diffusion and jump coefficients, while an additional global one-s… ▽ More

    Submitted 12 December, 2016; originally announced December 2016.

    Comments: 15 pages

  17. Transportation inequalities for non-globally dissipative SDEs with jumps via Malliavin calculus and coupling

    Authors: Mateusz B. Majka

    Abstract: By using the mirror coupling for solutions of SDEs driven by pure jump Lévy processes, we extend some transportation and concentration inequalities, which were previously known only in the case where the coefficients in the equation satisfy a global dissipativity condition. Furthermore, by using the mirror coupling for the jump part and the coupling by reflection for the Brownian part, we extend a… ▽ More

    Submitted 11 November, 2019; v1 submitted 21 October, 2016; originally announced October 2016.

    Comments: 40 pages, revised version, accepted for publication in Annales de l'Institut Henri Poincaré Probabilités et Statistiques. The final manuscript is available at Project Euclid via https://projecteuclid.org/euclid.aihp/1573203622

    Journal ref: Ann. Inst. H. Poincare Probab. Statist., Volume 55, Number 4 (2019), 2019-2057

  18. arXiv:1605.01384  [pdf, other

    math.NA stat.ME stat.ML

    Multilevel Monte Carlo methods for the approximation of invariant measures of stochastic differential equations

    Authors: Michael B. Giles, Mateusz B. Majka, Lukasz Szpruch, Sebastian Vollmer, Konstantinos Zygalakis

    Abstract: We develop a framework that allows the use of the multi-level Monte Carlo (MLMC) methodology (Giles2015) to calculate expectations with respect to the invariant measure of an ergodic SDE. In that context, we study the (over-damped) Langevin equations with a strongly concave potential. We show that, when appropriate contracting couplings for the numerical integrators are available, one can obtain a… ▽ More

    Submitted 12 August, 2019; v1 submitted 4 May, 2016; originally announced May 2016.

    Comments: 25 pages, 8 figures

  19. Coupling and exponential ergodicity for stochastic differential equations driven by Lévy processes

    Authors: Mateusz B. Majka

    Abstract: We present a novel idea for a coupling of solutions of stochastic differential equations driven by Lévy noise, inspired by some results from the optimal transportation theory. Then we use this coupling to obtain exponential contractivity of the semigroups associated with these solutions with respect to an appropriately chosen Kantorovich distance. As a corollary, we obtain exponential convergence… ▽ More

    Submitted 29 April, 2017; v1 submitted 29 September, 2015; originally announced September 2015.

    Comments: 40 pages, revised version, accepted for publication in Stochastic Processes and their Applications. The final manuscript is available at Elsevier via https://doi.org/10.1016/j.spa.2017.03.020

    MSC Class: 60G51; 60H10