-
On an efficient line smoother for the p-multigrid γ-cycle
Authors:
José Pablo Lucero Lorca,
Duane Rosenberg,
Isidora Jankov,
Conor McCoid,
Martin Jakob Gander
Abstract:
As part of the development of a Poisson solver for the spectral element discretization used in the GeoFluid Object Workbench (GeoFLOW) code, we propose a solver for the linear system arising from a Gauss-Legendre-Lobatto global spectral method. We precondition using a p-multigrid γ-cycle with highly-vectorizable smoothers, that we refer to as line smoothers. Our smoothers are restrictions of spect…
▽ More
As part of the development of a Poisson solver for the spectral element discretization used in the GeoFluid Object Workbench (GeoFLOW) code, we propose a solver for the linear system arising from a Gauss-Legendre-Lobatto global spectral method. We precondition using a p-multigrid γ-cycle with highly-vectorizable smoothers, that we refer to as line smoothers. Our smoothers are restrictions of spectral and finite element discretizations to low-order one-dimensional problems along lines, that are solved by a reformulation of cyclic reduction as a direct multigrid method. We illustrate our method with numerical experiments showing the apparent boundedness of the iteration count for a fixed residual reduction over a range of moderately deformed domains, right hand sides and Dirichlet boundary conditions.
△ Less
Submitted 31 May, 2025; v1 submitted 14 April, 2025;
originally announced April 2025.
-
Online Nonconvex Bilevel Optimization with Bregman Divergences
Authors:
Jason Bohne,
David Rosenberg,
Gary Kazantsev,
Pawel Polak
Abstract:
Bilevel optimization methods are increasingly relevant within machine learning, especially for tasks such as hyperparameter optimization and meta-learning. Compared to the offline setting, online bilevel optimization (OBO) offers a more dynamic framework by accommodating time-varying functions and sequentially arriving data. This study addresses the online nonconvex-strongly convex bilevel optimiz…
▽ More
Bilevel optimization methods are increasingly relevant within machine learning, especially for tasks such as hyperparameter optimization and meta-learning. Compared to the offline setting, online bilevel optimization (OBO) offers a more dynamic framework by accommodating time-varying functions and sequentially arriving data. This study addresses the online nonconvex-strongly convex bilevel optimization problem. In deterministic settings, we introduce a novel online Bregman bilevel optimizer (OBBO) that utilizes adaptive Bregman divergences. We demonstrate that OBBO enhances the known sublinear rates for bilevel local regret through a novel hypergradient error decomposition that adapts to the underlying geometry of the problem. In stochastic contexts, we introduce the first stochastic online bilevel optimizer (SOBBO), which employs a window averaging method for updating outer-level variables using a weighted average of recent stochastic approximations of hypergradients. This approach not only achieves sublinear rates of bilevel local regret but also serves as an effective variance reduction strategy, obviating the need for additional stochastic gradient samples at each timestep. Experiments on online hyperparameter optimization and online meta-learning highlight the superior performance, efficiency, and adaptability of our Bregman-based algorithms compared to established online and offline bilevel benchmarks.
△ Less
Submitted 16 September, 2024;
originally announced September 2024.
-
Resilience of Rademacher chaos of low degree
Authors:
Elad Aigner-Horev,
Daniel Rosenberg,
Roi Weiss
Abstract:
The resilience of a Rademacher chaos is the maximum number of adversarial sign-flips that the chaos can sustain without having its largest atom probability significantly altered. Inspired by probabilistic lower-bound guarantees for the resilience of linear Rademacher chaos, obtained by Bandeira, Ferber, and Kwan (Advances in Mathematics, Vol. $319$, $2017$), we provide probabilistic lower-bound gu…
▽ More
The resilience of a Rademacher chaos is the maximum number of adversarial sign-flips that the chaos can sustain without having its largest atom probability significantly altered. Inspired by probabilistic lower-bound guarantees for the resilience of linear Rademacher chaos, obtained by Bandeira, Ferber, and Kwan (Advances in Mathematics, Vol. $319$, $2017$), we provide probabilistic lower-bound guarantees for the resilience of Rademacher chaos of arbitrary yet sufficiently low degree.
Our main results distinguish between Rademacher chaos of order two and those of higher order. In that, our first main result pertains to the resilience of decoupled bilinear Rademacher forms where different asymptotic behaviour is observed for sparse and dense matrices. For our second main result, we bootstrap our first result in order to provide resilience guarantees for quadratic Rademacher chaos. Our third main result, generalises the first and handles the resilience of decoupled Rademacher chaos of arbitrary yet sufficiently low order.
Our results for decoupled Rademacher chaos of order two and that of higher order whilst are established through the same conceptual framework, differ substantially. A difference incurred due to the implementation of the same conceptual argument. The order two result is established using Dudley's maximal inequality for sub-Gaussian processes, the Hanson-Wright inequality, as well as the Kolmogorov-Rogozin inequality. To handle higher order chaos, appeals to Dudley's inequality as well as the Hanson-Wright inequality are replaced with tools suited for random tensors. Appeals to the Hanson-Wright inequality are replaced with appeals to a concentration result for random tensors put forth by Adamczak and Wolff.
Our results are instance-dependent and thus allow for the efficient computation of resilience guarantees provided the order of the chaos is constant.
△ Less
Submitted 9 June, 2025; v1 submitted 16 February, 2024;
originally announced February 2024.
-
Markov games with frequent actions and incomplete information
Authors:
Pierre Cardaliaguet,
Catherine Rainer,
Dinah Rosenberg,
Nicolas Vieille
Abstract:
We study a two-player, zero-sum, stochastic game with incomplete information on one side in which the players are allowed to play more and more frequently. The informed player observes the realization of a Markov chain on which the payoffs depend, while the non-informed player only observes his opponent's actions. We show the existence of a limit value as the time span between two consecutive stag…
▽ More
We study a two-player, zero-sum, stochastic game with incomplete information on one side in which the players are allowed to play more and more frequently. The informed player observes the realization of a Markov chain on which the payoffs depend, while the non-informed player only observes his opponent's actions. We show the existence of a limit value as the time span between two consecutive stages vanishes; this value is characterized through an auxiliary optimization problem and as the solution of an Hamilton-Jacobi equation.
△ Less
Submitted 12 July, 2013;
originally announced July 2013.
-
Strategic Information Exchange
Authors:
Dinah Rosenberg,
Eilon Solan,
Nicolas Vieille
Abstract:
We study a class of two-player repeated games with incomplete information and informational externalities. In these games, two states are chosen at the outset, and players get private information on the pair, before engaging in repeated play. The payoff of each player only depends on his `own' state and on his own action. We study to what extent, and how, information can be exchanged in equilibriu…
▽ More
We study a class of two-player repeated games with incomplete information and informational externalities. In these games, two states are chosen at the outset, and players get private information on the pair, before engaging in repeated play. The payoff of each player only depends on his `own' state and on his own action. We study to what extent, and how, information can be exchanged in equilibrium. We prove that provided the private information of each player is valuable for the other player, the set of sequential equilibrium payoffs converges to the set of feasible and individually rational payoffs as players become patient.
△ Less
Submitted 26 July, 2010;
originally announced July 2010.
-
On the Optimal Amount of Experimentation in Sequential Decision Problems
Authors:
Dinah Rosenberg,
Eilon Solan,
Nicolas Vieille
Abstract:
We provide a tight bound on the amount of experimentation under the optimal strategy in sequential decision problems. We show the applicability of the result by providing a bound on the cut-off in a one-arm bandit problem.
We provide a tight bound on the amount of experimentation under the optimal strategy in sequential decision problems. We show the applicability of the result by providing a bound on the cut-off in a one-arm bandit problem.
△ Less
Submitted 12 July, 2009;
originally announced July 2009.
-
Optimized Schwarz preconditioning for SEM based magnetohydrodynamics
Authors:
Amik St-Cyr,
Duane Rosenberg,
Sang Dong Kim
Abstract:
A recent theoretical result on optimized Schwarz algorithms demonstrated at the algebraic level enables the modification of an existing Schwarz procedure to its optimized counterpart. In this work, it is shown how to modify a bilinear FEM based Schwarz preconditioning strategy originally presented in [Fischer, JCP 133:84 1997] to its optimized version. The latter is employed to precondition the…
▽ More
A recent theoretical result on optimized Schwarz algorithms demonstrated at the algebraic level enables the modification of an existing Schwarz procedure to its optimized counterpart. In this work, it is shown how to modify a bilinear FEM based Schwarz preconditioning strategy originally presented in [Fischer, JCP 133:84 1997] to its optimized version. The latter is employed to precondition the pseudo--Laplacian operator arising from the spectral element discretization of the magnetohydrodynamic equations in Elsasser form.
△ Less
Submitted 30 April, 2008;
originally announced May 2008.
-
Approximating a sequence of observations by a simple process
Authors:
Dinah Rosenberg,
Eilon Solan,
Nicolas Vieille
Abstract:
Given an arbitrary long but finite sequence of observations from a finite set, we construct a simple process that approximates the sequence, in the sense that with high probability the empirical frequency, as well as the empirical one-step transitions along a realization from the approximating process, are close to that of the given sequence. We generalize the result to the case where the one-st…
▽ More
Given an arbitrary long but finite sequence of observations from a finite set, we construct a simple process that approximates the sequence, in the sense that with high probability the empirical frequency, as well as the empirical one-step transitions along a realization from the approximating process, are close to that of the given sequence. We generalize the result to the case where the one-step transitions are required to be in given polyhedra.
△ Less
Submitted 30 August, 2005;
originally announced August 2005.
-
Geophysical-astrophysical spectral-element adaptive refinement (GASpAR): Object-oriented h-adaptive code for geophysical fluid dynamics simulation
Authors:
Duane Rosenberg,
Aime' Fournier,
Paul Fischer,
Annick Pouquet
Abstract:
We present an object-oriented geophysical and astrophysical spectral-element adaptive refinement (GASpAR) code for application to turbulent flows. Like most spectral-element codes, GASpAR combines finite-element efficiency with spectral-method accuracy. It is also designed to be flexible enough for a range of geophysics and astrophysics applications where turbulence or other complex multiscale p…
▽ More
We present an object-oriented geophysical and astrophysical spectral-element adaptive refinement (GASpAR) code for application to turbulent flows. Like most spectral-element codes, GASpAR combines finite-element efficiency with spectral-method accuracy. It is also designed to be flexible enough for a range of geophysics and astrophysics applications where turbulence or other complex multiscale problems arise. For extensibility and flexibilty the code is designed in an object-oriented manner. The computational core is based on spectral-element operators, which are represented as objects. The formalism accommodates both conforming and nonconforming elements and their associated data structures for handling interelement communications in a parallel environment. Many aspects of this code are a synthesis of existing methods; however, we focus on a new formulation of dynamic adaptive refinement (DARe) of nonconforming h-type. This paper presents the code and its algorithms; we do not consider parallel efficiency metrics or performance. As a demonstration of the code we offer several two-dimensional test cases that we propose as standard test problems for comparable DARe codes. The suitability of these test problems for turbulent flow simulation is considered.
△ Less
Submitted 19 July, 2005;
originally announced July 2005.
