-
Computing High-dimensional Confidence Sets for Arbitrary Distributions
Authors:
Chao Gao,
Liren Shan,
Vaidehi Srinivas,
Aravindan Vijayaraghavan
Abstract:
We study the problem of learning a high-density region of an arbitrary distribution over $\mathbb{R}^d$. Given a target coverage parameter $δ$, and sample access to an arbitrary distribution $D$, we want to output a confidence set $S \subset \mathbb{R}^d$ such that $S$ achieves $δ$ coverage of $D$, i.e., $\mathbb{P}_{y \sim D} \left[ y \in S \right] \ge δ$, and the volume of $S$ is as small as pos…
▽ More
We study the problem of learning a high-density region of an arbitrary distribution over $\mathbb{R}^d$. Given a target coverage parameter $δ$, and sample access to an arbitrary distribution $D$, we want to output a confidence set $S \subset \mathbb{R}^d$ such that $S$ achieves $δ$ coverage of $D$, i.e., $\mathbb{P}_{y \sim D} \left[ y \in S \right] \ge δ$, and the volume of $S$ is as small as possible. This is a central problem in high-dimensional statistics with applications in finding confidence sets, uncertainty quantification, and support estimation.
In the most general setting, this problem is statistically intractable, so we restrict our attention to competing with sets from a concept class $C$ with bounded VC-dimension. An algorithm is competitive with class $C$ if, given samples from an arbitrary distribution $D$, it outputs in polynomial time a set that achieves $δ$ coverage of $D$, and whose volume is competitive with the smallest set in $C$ with the required coverage $δ$. This problem is computationally challenging even in the basic setting when $C$ is the set of all Euclidean balls. Existing algorithms based on coresets find in polynomial time a ball whose volume is $\exp(\tilde{O}( d/ \log d))$-factor competitive with the volume of the best ball.
Our main result is an algorithm that finds a confidence set whose volume is $\exp(\tilde{O}(d^{1/2}))$ factor competitive with the optimal ball having the desired coverage. The algorithm is improper (it outputs an ellipsoid). Combined with our computational intractability result for proper learning balls within an $\exp(\tilde{O}(d^{1-o(1)}))$ approximation factor in volume, our results provide an interesting separation between proper and (improper) learning of confidence sets.
△ Less
Submitted 12 May, 2025; v1 submitted 3 April, 2025;
originally announced April 2025.
-
On the Oscillations in Cournot Games with Best Response Strategies
Authors:
Zhengyang Liu,
Haolin Lu,
Liang Shan,
Zihe Wang
Abstract:
In this paper, we consider the dynamic oscillation in the Cournot oligopoly model, which involves multiple firms producing homogeneous products. To explore the oscillation under the updates of best response strategies, we focus on the linear price functions. In this setting, we establish the existence of oscillations. In particular, we show that for the scenario of different costs among firms, the…
▽ More
In this paper, we consider the dynamic oscillation in the Cournot oligopoly model, which involves multiple firms producing homogeneous products. To explore the oscillation under the updates of best response strategies, we focus on the linear price functions. In this setting, we establish the existence of oscillations. In particular, we show that for the scenario of different costs among firms, the best response converges to either a unique equilibrium or a two-period oscillation. We further characterize the oscillations and propose linear-time algorithms for finding all types of two-period oscillations. To the best of our knowledge, our work is the first step toward fully analyzing the periodic oscillation in the Cournot oligopoly model.
△ Less
Submitted 6 May, 2025; v1 submitted 12 October, 2024;
originally announced October 2024.
-
Connection-Aware P2P Trading: Simultaneous Trading and Peer Selection
Authors:
Cheng Feng,
Kedi Zheng,
Lanqing Shan,
Hani Alers,
Qixin Chen,
Lampros Stergioulas,
Hongye Guo
Abstract:
Peer-to-peer (P2P) trading is seen as a viable solution to handle the growing number of distributed energy resources in distribution networks. However, when dealing with large-scale consumers, there are several challenges that must be addressed. One of these challenges is limited communication capabilities. Additionally, prosumers may have specific preferences when it comes to trading. Both can re…
▽ More
Peer-to-peer (P2P) trading is seen as a viable solution to handle the growing number of distributed energy resources in distribution networks. However, when dealing with large-scale consumers, there are several challenges that must be addressed. One of these challenges is limited communication capabilities. Additionally, prosumers may have specific preferences when it comes to trading. Both can result in serious asynchrony in peer-to-peer trading, potentially impacting the effectiveness of negotiations and hindering convergence before the market closes. This paper introduces a connection-aware P2P trading algorithm designed for extensive prosumer trading. The algorithm facilitates asynchronous trading while respecting prosumer's autonomy in trading peer selection, an often overlooked aspect in traditional models. In addition, to optimize the use of limited connection opportunities, a smart trading peer connection selection strategy is developed to guide consumers to communicate strategically to accelerate convergence. A theoretical convergence guarantee is provided for the connection-aware P2P trading algorithm, which further details how smart selection strategies enhance convergence efficiency. Numerical studies are carried out to validate the effectiveness of the connection-aware algorithm and the performance of smart selection strategies in reducing the overall convergence time.
△ Less
Submitted 28 October, 2024; v1 submitted 18 February, 2024;
originally announced February 2024.
-
Dynamic Curing and Network Design in SIS Epidemic Processes
Authors:
Yuhao Yi,
Liren Shan,
Shijie Wang,
Philip E. Paré,
Karl H. Johansson
Abstract:
This paper studies efficient algorithms for dynamic curing policies and the corresponding network design problems to guarantee the fast extinction of epidemic spread in a susceptible-infected-susceptible (SIS) model. We consider a Markov process-based SIS epidemic model. We provide a computationally efficient curing algorithm based on the curing policy proposed by Drakopoulos, Ozdaglar, and Tsitsi…
▽ More
This paper studies efficient algorithms for dynamic curing policies and the corresponding network design problems to guarantee the fast extinction of epidemic spread in a susceptible-infected-susceptible (SIS) model. We consider a Markov process-based SIS epidemic model. We provide a computationally efficient curing algorithm based on the curing policy proposed by Drakopoulos, Ozdaglar, and Tsitsiklis (2014). Since the corresponding optimization problem is NP-hard, finding optimal policies is intractable for large graphs. We provide approximation guarantees on the curing budget of the proposed dynamic curing algorithm. We also present a curing algorithm fair to demographic groups.
When the total infection rate is high, the original curing policy includes a waiting period in which no measure is taken to mitigate the spread until the rate slows down. To avoid the waiting period, we study network design problems to reduce the total infection rate by deleting edges or reducing the weight of edges. Then the curing processes become continuous since the total infection rate is restricted by network design. We provide algorithms with provable guarantees for the considered network design problems. In summary, the proposed curing and network design algorithms together provide an effective and computationally efficient approach that mitigates SIS epidemic spread in networks.
△ Less
Submitted 14 August, 2024; v1 submitted 11 November, 2022;
originally announced November 2022.
-
Automatic Sequences in Negative Bases and Proofs of Some Conjectures of Shevelev
Authors:
Jeffrey Shallit,
Sonja Linghui Shan,
Kai Hsiang Yang
Abstract:
We discuss the use of negative bases in automatic sequences. Recently the theorem-prover Walnut has been extended to allow the use of base (-k) to express variables, thus permitting quantification over Z instead of N. This enables us to prove results about two-sided (bi-infinite) automatic sequences. We first explain the theory behind negative bases in Walnut. Next, we use this new version of Waln…
▽ More
We discuss the use of negative bases in automatic sequences. Recently the theorem-prover Walnut has been extended to allow the use of base (-k) to express variables, thus permitting quantification over Z instead of N. This enables us to prove results about two-sided (bi-infinite) automatic sequences. We first explain the theory behind negative bases in Walnut. Next, we use this new version of Walnut to give a very simple proof of a strengthened version of a theorem of Shevelev. We use our ideas to resolve two open problems of Shevelev from 2017. We also reprove a 2000 result of Shur involving bi-infinite binary words.
△ Less
Submitted 11 August, 2022;
originally announced August 2022.
-
Pseudoperiodic Words and a Question of Shevelev
Authors:
Joseph Meleshko,
Pascal Ochem,
Jeffrey Shallit,
Sonja Linghui Shan
Abstract:
We generalize the familiar notion of periodicity in sequences to a new kind of pseudoperiodicity, and we prove some basic results about it. We revisit the results of a 2012 paper of Shevelev and reprove his results in a simpler and more unified manner, and provide a complete answer to one of his previously unresolved questions. We consider finding words with specific pseudoperiod and having the sm…
▽ More
We generalize the familiar notion of periodicity in sequences to a new kind of pseudoperiodicity, and we prove some basic results about it. We revisit the results of a 2012 paper of Shevelev and reprove his results in a simpler and more unified manner, and provide a complete answer to one of his previously unresolved questions. We consider finding words with specific pseudoperiod and having the smallest possible critical exponent. Finally, we consider the problem of determining whether a finite word is pseudoperiodic of a given size, and show that it is NP-complete.
△ Less
Submitted 12 October, 2023; v1 submitted 20 July, 2022;
originally announced July 2022.
-
Edge Deletion Algorithms for Minimizing Spread in SIR Epidemic Models
Authors:
Yuhao Yi,
Liren Shan,
Philip E. Paré,
Karl H. Johansson
Abstract:
This paper studies algorithmic strategies to effectively reduce the number of infections in susceptible-infected-recovered (SIR) epidemic models. We consider a Markov chain SIR model and its two instantiations in the deterministic SIR (D-SIR) model and the independent cascade SIR (IC-SIR) model. We investigate the problem of minimizing the number of infections by restricting contacts under realist…
▽ More
This paper studies algorithmic strategies to effectively reduce the number of infections in susceptible-infected-recovered (SIR) epidemic models. We consider a Markov chain SIR model and its two instantiations in the deterministic SIR (D-SIR) model and the independent cascade SIR (IC-SIR) model. We investigate the problem of minimizing the number of infections by restricting contacts under realistic constraints. Under moderate assumptions on the reproduction number, we prove that the infection numbers are bounded by supermodular functions in the D-SIR model and the IC-SIR model for large classes of random networks. We propose efficient algorithms with approximation guarantees to minimize infections. The theoretical results are illustrated by numerical simulations.
△ Less
Submitted 22 November, 2020;
originally announced November 2020.
-
On the existence and non-existence of improper homomorphisms of oriented and $2$-edge-coloured graphs to reflexive targets
Authors:
Christopher Duffy,
Sonja Linghui Shan
Abstract:
We consider non-trivial homomorphisms to reflexive oriented graphs in which some pair of adjacent vertices have the same image. Using a notion of convexity for oriented graphs, we study those oriented graphs that do not admit such homomorphisms. We fully classify those oriented graphs with tree-width $2$ that do not admit such homomorphisms and show that it is NP-complete to decide if a graph admi…
▽ More
We consider non-trivial homomorphisms to reflexive oriented graphs in which some pair of adjacent vertices have the same image. Using a notion of convexity for oriented graphs, we study those oriented graphs that do not admit such homomorphisms. We fully classify those oriented graphs with tree-width $2$ that do not admit such homomorphisms and show that it is NP-complete to decide if a graph admits an orientation that does not admit such homomorphisms. We prove analogous results for $2$-edge-coloured graphs. We apply our results on oriented graphs to provide a new tool in the study of chromatic number of orientations of planar graphs -- a long-standing open problem.
△ Less
Submitted 18 March, 2021; v1 submitted 18 April, 2020;
originally announced April 2020.
-
The Coarse Geometric $\ell^p$-Novikov Conjecture for Subspaces of Non-positively Curved Manifolds
Authors:
Lin Shan,
Qin Wang
Abstract:
In this paper, we prove the coarse geometric $\ell^p$-Novikov Conjecture for metric spaces with bounded geometry which admit a coarse embedding into a simply connected complete Riemannian manifold of nonpositive sectional curvature.
In this paper, we prove the coarse geometric $\ell^p$-Novikov Conjecture for metric spaces with bounded geometry which admit a coarse embedding into a simply connected complete Riemannian manifold of nonpositive sectional curvature.
△ Less
Submitted 17 December, 2020; v1 submitted 3 October, 2019;
originally announced October 2019.