Showing 1–4 of 4 results for author: Hait, S

Comparator-Adaptive $Φ$-Regret: Improved Bounds, Simpler Algorithms, and Applications to Games

Authors: Soumita Hait, Ping Li, Haipeng Luo, Mengxiao Zhang

Abstract: In the classic expert problem, $Φ$-regret measures the gap between the learner's total loss and that achieved by applying the best action transformation $φ\in Φ$. A recent work by Lu et al., [2025] introduces an adaptive algorithm whose regret against a comparator $φ$ depends on a certain sparsity-based complexity measure of $φ$, (almost) recovering and interpolating optimal bounds for standard re… ▽ More In the classic expert problem, $Φ$-regret measures the gap between the learner's total loss and that achieved by applying the best action transformation $φ\in Φ$. A recent work by Lu et al., [2025] introduces an adaptive algorithm whose regret against a comparator $φ$ depends on a certain sparsity-based complexity measure of $φ$, (almost) recovering and interpolating optimal bounds for standard regret notions such as external, internal, and swap regret. In this work, we propose a general idea to achieve an even better comparator-adaptive $Φ$-regret bound via much simpler algorithms compared to Lu et al., [2025]. Specifically, we discover a prior distribution over all possible binary transformations and show that it suffices to achieve prior-dependent regret against these transformations. Then, we propose two concrete and efficient algorithms to achieve so, where the first one learns over multiple copies of a prior-aware variant of the Kernelized MWU algorithm of Farina et al., [2022], and the second one learns over multiple copies of a prior-aware variant of the BM-reduction [Blum and Mansour, 2007]. To further showcase the power of our methods and the advantages over Lu et al., [2025] besides the simplicity and better regret bounds, we also show that our second approach can be extended to the game setting to achieve accelerated and adaptive convergence rate to $Φ$-equilibria for a class of general-sum games. When specified to the special case of correlated equilibria, our bound improves over the existing ones from Anagnostides et al., [2022a,b] △ Less

Submitted 22 May, 2025; originally announced May 2025.

Alternating Regret for Online Convex Optimization

Authors: Soumita Hait, Ping Li, Haipeng Luo, Mengxiao Zhang

Abstract: Motivated by alternating learning dynamics in two-player games, a recent work by Cevher et al.(2024) shows that $o(\sqrt{T})$ alternating regret is possible for any $T$-round adversarial Online Linear Optimization (OLO) problem, and left as an open question whether the same is true for general Online Convex Optimization (OCO). We answer this question in the affirmative by showing that the continuo… ▽ More Motivated by alternating learning dynamics in two-player games, a recent work by Cevher et al.(2024) shows that $o(\sqrt{T})$ alternating regret is possible for any $T$-round adversarial Online Linear Optimization (OLO) problem, and left as an open question whether the same is true for general Online Convex Optimization (OCO). We answer this question in the affirmative by showing that the continuous Hedge algorithm achieves $\tilde{\mathcal{O}}(d^{\frac{2}{3}}T^{\frac{1}{3}})$ alternating regret for any adversarial $d$-dimensional OCO problems. We show that this implies an alternating learning dynamic that finds a Nash equilibrium for any convex-concave zero-sum games or a coarse correlated equilibrium for any convex two-player general-sum games at a rate of $\tilde{\mathcal{O}}(d^{\frac{2}{3}}/T^{\frac{2}{3}})$. To further improve the time complexity and/or the dimension dependence, we propose another simple algorithm, Follow-the-Regularized-Leader with a regularizer whose convex conjugate is 3rd-order smooth, for OCO with smooth and self-concordant loss functions (such as linear or quadratic losses). We instantiate our algorithm with different regularizers and show that, for example, when the decision set is the $\ell_2$ ball, our algorithm achieves $\tilde{\mathcal{O}}(T^{\frac{2}{5}})$ alternating regret with no dimension dependence (and a better $\tilde{\mathcal{O}}(T^{\frac{1}{3}})$ bound for quadratic losses). We complement our results by showing some algorithm-specific alternating regret lower bounds, including a somewhat surprising $Ω(\sqrt{T})$ lower bound for a Regret Matching variant that is widely used in alternating learning dynamics. △ Less

Submitted 18 June, 2025; v1 submitted 17 February, 2025; originally announced February 2025.

Efficient Algorithms for Euclidean Steiner Minimal Tree on Near-Convex Terminal Sets

Authors: Anubhav Dhar, Soumita Hait, Sudeshna Kolay

Abstract: The Euclidean Steiner Minimal Tree problem takes as input a set $\mathcal P$ of points in the Euclidean plane and finds the minimum length network interconnecting all the points of $\mathcal P$. In this paper, in continuation to the works of Du et al. and Weng et al., we study Euclidean Steiner Minimal Tree when $\mathcal P$ is formed by the vertices of a pair of regular, concentric and parallel… ▽ More The Euclidean Steiner Minimal Tree problem takes as input a set $\mathcal P$ of points in the Euclidean plane and finds the minimum length network interconnecting all the points of $\mathcal P$. In this paper, in continuation to the works of Du et al. and Weng et al., we study Euclidean Steiner Minimal Tree when $\mathcal P$ is formed by the vertices of a pair of regular, concentric and parallel $n$-gons. We restrict our attention to the cases where the two polygons are not very close to each other. In such cases, we show that Euclidean Steiner Minimal Tree is polynomial-time solvable, and we describe an explicit structure of a Euclidean Steiner minimal tree for $\mathcal P$. We also consider point sets $\mathcal P$ of size $n$ where the number of input points not on the convex hull of $\mathcal P$ is $f(n) \leq n$. We give an exact algorithm with running time $2^{\mathcal{O}(f(n)\log n)}$ for such input point sets $\mathcal P$. Note that when $f(n) = \mathcal{O}(\frac{n}{\log n})$, our algorithm runs in single-exponential time, and when $f(n) = o(n)$ the running time is $2^{o(n\log n)}$ which is better than the known algorithm stated in Hwang et al. We know that no FPTAS exists for Euclidean Steiner Minimal Tree unless P=NP, as shown by Garey et al. On the other hand FPTASes exist for Euclidean Steiner Minimal Tree on convex point sets, as given by Scott Provan. In this paper, we show that if the number of input points in $\mathcal P$ not belonging to the convex hull of $\mathcal P$ is $\mathcal{O}(\log n)$, then an FPTAS exists for Euclidean Steiner Minimal Tree. In contrast, we show that for any $ε\in (0,1]$, when there are $Ω(n^ε)$ points not belonging to the convex hull of the input set, then no FPTAS can exist for Euclidean Steiner Minimal Tree unless P=NP. △ Less

Submitted 1 July, 2023; originally announced July 2023.

On finding short reconfiguration sequences between independent sets

Authors: Akanksha Agrawal, Soumita Hait, Amer E. Mouawad

Abstract: Assume we are given a graph $G$, two independent sets $S$ and $T$ in $G$ of size $k \geq 1$, and a positive integer $\ell \geq 1$. The goal is to decide whether there exists a sequence $\langle I_0, I_1, ..., I_\ell \rangle$ of independent sets such that for all $j \in \{0,\ldots,\ell-1\}$ the set $I_j$ is an independent set of size $k$, $I_0 = S$, $I_\ell = T$, and $I_{j+1}$ is obtained from… ▽ More Assume we are given a graph $G$, two independent sets $S$ and $T$ in $G$ of size $k \geq 1$, and a positive integer $\ell \geq 1$. The goal is to decide whether there exists a sequence $\langle I_0, I_1, ..., I_\ell \rangle$ of independent sets such that for all $j \in \{0,\ldots,\ell-1\}$ the set $I_j$ is an independent set of size $k$, $I_0 = S$, $I_\ell = T$, and $I_{j+1}$ is obtained from $I_j$ by a predetermined reconfiguration rule. We consider two reconfiguration rules. Intuitively, we view each independent set as a collection of tokens placed on the vertices of the graph. Then, the Token Sliding Optimization (TSO) problem asks whether there exists a sequence of at most $\ell$ steps that transforms $S$ into $T$, where at each step we are allowed to slide one token from a vertex to an unoccupied neighboring vertex. In the Token Jumping Optimization (TJO) problem, at each step, we are allowed to jump one token from a vertex to any other unoccupied vertex of the graph. Both TSO and TJO are known to be fixed-parameter tractable when parameterized by $\ell$ on nowhere dense classes of graphs. In this work, we show that both problems are fixed-parameter tractable for parameter $k + \ell + d$ on $d$-degenerate graphs as well as for parameter $|M| + \ell + Δ$ on graphs having a modulator $M$ whose deletion leaves a graph of maximum degree $Δ$. We complement these result by showing that for parameter $\ell$ alone both problems become W[1]-hard already on $2$-degenerate graphs. Our positive result makes use of the notion of independence covering families introduced by Lokshtanov et al. Finally, we show that using such families one can obtain a simpler and unified algorithm for the standard Token Jumping Reachability problem parameterized by $k$ on both degenerate and nowhere dense classes of graphs. △ Less

Submitted 12 September, 2022; originally announced September 2022.