-
Bilevel Programming for Pebbling Numbers of Lemke Graph Products
Authors:
Jonad Pulaj,
Kenan Wood,
Carl Yerger
Abstract:
Given a configuration of indistinguishable pebbles on the vertices of a graph, a pebbling move consists of removing two pebbles from one vertex and placing one pebble on an adjacent vertex. The pebbling number of a graph is the least integer such that any configuration with that many pebbles and any target vertex, some sequence of pebbling moves can place a pebble on the target. Graham's conjectur…
▽ More
Given a configuration of indistinguishable pebbles on the vertices of a graph, a pebbling move consists of removing two pebbles from one vertex and placing one pebble on an adjacent vertex. The pebbling number of a graph is the least integer such that any configuration with that many pebbles and any target vertex, some sequence of pebbling moves can place a pebble on the target. Graham's conjecture asserts that the pebbling number of the cartesian product of two graphs is at most the product of the two graphs' pebbling numbers. Products of so-called Lemke graphs are widely thought to be the most likely counterexamples to Graham's conjecture, provided one exists.
In this paper, we introduce a novel framework for computing pebbling numbers using bilevel optimization. We use this approach to algorithmically show that the pebbling numbers of all products of 8-vertex Lemke graphs are consistent with Graham's conjecture, with the added assumption that pebbles can only be placed on a set of at most four vertices.
△ Less
Submitted 28 November, 2024;
originally announced November 2024.
-
Optimal Multilevel Slashing for Blockchains
Authors:
Kenan Wood,
Hammurabi Mendes,
Jonad Pulaj
Abstract:
We present the notion of multilevel slashing, where proof-of-stake blockchain validators can obtain gradual levels of assurance that a certain block is bound to be finalized in a global consensus procedure, unless an increasing and optimally large number of Byzantine processes have their staked assets slashed -- that is, deducted -- due to provably incorrect behavior. Our construction is a highly…
▽ More
We present the notion of multilevel slashing, where proof-of-stake blockchain validators can obtain gradual levels of assurance that a certain block is bound to be finalized in a global consensus procedure, unless an increasing and optimally large number of Byzantine processes have their staked assets slashed -- that is, deducted -- due to provably incorrect behavior. Our construction is a highly parameterized generalization of combinatorial intersection systems based on finite projective spaces, with asymptotic high availability and optimal slashing properties. Even under weak conditions, we show that our construction has asymptotically optimal slashing properties with respect to message complexity and validator load; this result also illustrates a fundamental trade off between message complexity, load, and slashing. In addition, we show that any intersection system whose ground elements are disjoint subsets of nodes (e.g. "committees" in committee-based consensus protocols) has asymptotic high availability under similarly weak conditions. Finally, our multilevel construction gives the flexibility to blockchain validators to decide how many "levels" of finalization assurance they wish to obtain. This functionality can be seen either as (i) a form of an early, slashing-based block finalization; or (ii) a service to support reorg tolerance.
△ Less
Submitted 29 October, 2024; v1 submitted 13 May, 2024;
originally announced May 2024.
-
Solving Decision-Dependent Games by Learning from Feedback
Authors:
Killian Wood,
Ahmed Zamzam,
Emiliano Dall'Anese
Abstract:
This paper tackles the problem of solving stochastic optimization problems with a decision-dependent distribution in the setting of stochastic strongly-monotone games and when the distributional dependence is unknown. A two-stage approach is proposed, which initially involves estimating the distributional dependence on decision variables, and subsequently optimizing over the estimated distribution…
▽ More
This paper tackles the problem of solving stochastic optimization problems with a decision-dependent distribution in the setting of stochastic strongly-monotone games and when the distributional dependence is unknown. A two-stage approach is proposed, which initially involves estimating the distributional dependence on decision variables, and subsequently optimizing over the estimated distributional map. The paper presents guarantees for the approximation of the cost of each agent. Furthermore, a stochastic gradient-based algorithm is developed and analyzed for finding the Nash equilibrium in a distributed fashion. Numerical simulations are provided for a novel electric vehicle charging market formulation using real-world data.
△ Less
Submitted 19 April, 2024; v1 submitted 28 December, 2023;
originally announced December 2023.
-
Local Configurations in Union-Closed Families
Authors:
Jonad Pulaj,
Kenan Wood
Abstract:
The Frankl or Union-Closed Sets conjecture states that for any finite union-closed family of sets $\mathcal{F}$ containing some nonempty set, there is some element $i$ in the ground set $U(\mathcal F) := \bigcup_{S \in \mathcal{F}} S$ of $\mathcal{F}$ such that $i$ is in at least half of the sets in $\mathcal{F}$. In this work, we find new values and bounds for the least integer $FC(k, n)$ such th…
▽ More
The Frankl or Union-Closed Sets conjecture states that for any finite union-closed family of sets $\mathcal{F}$ containing some nonempty set, there is some element $i$ in the ground set $U(\mathcal F) := \bigcup_{S \in \mathcal{F}} S$ of $\mathcal{F}$ such that $i$ is in at least half of the sets in $\mathcal{F}$. In this work, we find new values and bounds for the least integer $FC(k, n)$ such that any union-closed family containing $FC(k, n)$ distinct $k$-sets of an $n$-set $X$ satisfies Frankl's conjecture with an element of $X$. Additionally, we answer an older question of Vaughan regarding symmetry in union-closed families and we give a proof of a recent question posed by Ellis, Ivan and Leader. Finally, we introduce novel local configuration criteria through a generalization of Poonen's Theorem to prove the conjecture for many, previously unknown classes of families.
△ Less
Submitted 14 October, 2024; v1 submitted 3 January, 2023;
originally announced January 2023.
-
Online Saddle Point Tracking with Decision-Dependent Data
Authors:
Killian Wood,
Emiliano Dall'Anese
Abstract:
In this work, we consider a time-varying stochastic saddle point problem in which the objective is revealed sequentially, and the data distribution depends on the decision variables. Problems of this type express the distributional dependence via a distributional map, and are known to have two distinct types of solutions--saddle points and equilibrium points. We demonstrate that, under suitable co…
▽ More
In this work, we consider a time-varying stochastic saddle point problem in which the objective is revealed sequentially, and the data distribution depends on the decision variables. Problems of this type express the distributional dependence via a distributional map, and are known to have two distinct types of solutions--saddle points and equilibrium points. We demonstrate that, under suitable conditions, online primal-dual type algorithms are capable of tracking equilibrium points. In contrast, since computing closed-form gradient of the objective requires knowledge of the distributional map, we offer an online stochastic primal-dual algorithm for tracking equilibrium trajectories. We provide bounds in expectation and in high probability, with the latter leveraging a sub-Weibull model for the gradient error. We illustrate our results on an electric vehicle charging problem where responsiveness to prices follows a location-scale family based distributional map.
△ Less
Submitted 5 December, 2022;
originally announced December 2022.
-
Scalable Gaussian Process Hyperparameter Optimization via Coverage Regularization
Authors:
Killian Wood,
Alec M. Dunton,
Amanda Muyskens,
Benjamin W. Priest
Abstract:
Gaussian processes (GPs) are Bayesian non-parametric models popular in a variety of applications due to their accuracy and native uncertainty quantification (UQ). Tuning GP hyperparameters is critical to ensure the validity of prediction accuracy and uncertainty; uniquely estimating multiple hyperparameters in, e.g. the Matern kernel can also be a significant challenge. Moreover, training GPs on l…
▽ More
Gaussian processes (GPs) are Bayesian non-parametric models popular in a variety of applications due to their accuracy and native uncertainty quantification (UQ). Tuning GP hyperparameters is critical to ensure the validity of prediction accuracy and uncertainty; uniquely estimating multiple hyperparameters in, e.g. the Matern kernel can also be a significant challenge. Moreover, training GPs on large-scale datasets is a highly active area of research: traditional maximum likelihood hyperparameter training requires quadratic memory to form the covariance matrix and has cubic training complexity. To address the scalable hyperparameter tuning problem, we present a novel algorithm which estimates the smoothness and length-scale parameters in the Matern kernel in order to improve robustness of the resulting prediction uncertainties. Using novel loss functions similar to those in conformal prediction algorithms in the computational framework provided by the hyperparameter estimation algorithm MuyGPs, we achieve improved UQ over leave-one-out likelihood maximization while maintaining a high degree of scalability as demonstrated in numerical experiments.
△ Less
Submitted 2 November, 2022; v1 submitted 22 September, 2022;
originally announced September 2022.
-
Stochastic Saddle Point Problems with Decision-Dependent Distributions
Authors:
Killian Wood,
Emiliano Dall'Anese
Abstract:
This paper focuses on stochastic saddle point problems with decision-dependent distributions. These are problems whose objective is the expected value of a stochastic payoff function and whose data distribution drifts in response to decision variables--a phenomenon represented by a distributional map. A common approach to accommodating distributional shift is to retrain optimal decisions once a ne…
▽ More
This paper focuses on stochastic saddle point problems with decision-dependent distributions. These are problems whose objective is the expected value of a stochastic payoff function and whose data distribution drifts in response to decision variables--a phenomenon represented by a distributional map. A common approach to accommodating distributional shift is to retrain optimal decisions once a new distribution is revealed, or repeated retraining. We introduce the notion of equilibrium points, which are the fixed points of this repeated retraining procedure, and provide sufficient conditions for their existence and uniqueness. To find equilibrium points, we develop deterministic and stochastic primal-dual algorithms and demonstrate their convergence with constant step-size in the former and polynomial decay step-size schedule in the latter. By modeling errors emerging from a stochastic gradient estimator as sub-Weibull random variables, we provide error bounds in expectation and in high probability that hold for each iteration. Without additional knowledge of the distributional map, computing saddle points is intractable. Thus we propose a condition on the distributional map--which we call opposing mixture dominance--that ensures that the objective is strongly-convex-strongly-concave. Finally, we demonstrate that derivative-free algorithms with a single function evaluation are capable of approximating saddle points
△ Less
Submitted 11 November, 2022; v1 submitted 6 January, 2022;
originally announced January 2022.
-
Online Projected Gradient Descent for Stochastic Optimization with Decision-Dependent Distributions
Authors:
Killian Wood,
Gianluca Bianchin,
Emiliano Dall'Anese
Abstract:
This paper investigates the problem of tracking solutions of stochastic optimization problems with time-varying costs that depend on random variables with decision-dependent distributions. In this context, we propose the use of an online stochastic gradient descent method to solve the optimization, and we provide explicit bounds in expectation and in high probability for the distance between the o…
▽ More
This paper investigates the problem of tracking solutions of stochastic optimization problems with time-varying costs that depend on random variables with decision-dependent distributions. In this context, we propose the use of an online stochastic gradient descent method to solve the optimization, and we provide explicit bounds in expectation and in high probability for the distance between the optimizers and the points generated by the algorithm. In particular, we show that when the gradient error due to sampling is modeled as a sub-Weibull random variable, then the tracking error is ultimately bounded in expectation and in high probability. The theoretical findings are validated via numerical simulations in the context of charging optimization of a fleet of electric vehicles.
△ Less
Submitted 27 October, 2021; v1 submitted 20 July, 2021;
originally announced July 2021.
-
Admission predictors for success in a mathematics graduate program
Authors:
Timmy Ma,
Karen E. Wood,
Di Xu,
Patrick Guidotti,
Alessandra Pantano,
Natalia L. Komarova
Abstract:
There are many factors that can influence the outcome for students in a mathematics PhD program: bachelor's GPA (BGPA), bachelor's major, GRE scores, gender, Under-Represented Minority (URM) status, institution tier, etc. Are these variables equally important predictors of a student's likelihood of succeeding in a math PhD program? In this paper, we present and analyze admission data of students f…
▽ More
There are many factors that can influence the outcome for students in a mathematics PhD program: bachelor's GPA (BGPA), bachelor's major, GRE scores, gender, Under-Represented Minority (URM) status, institution tier, etc. Are these variables equally important predictors of a student's likelihood of succeeding in a math PhD program? In this paper, we present and analyze admission data of students from different groups entering a math PhD program at a southern California university. We observe that some factors correlate with success in the PhD program (defined as obtaining a PhD degree within a time-limit). According to our analysis, GRE scores correlate with success, but interestingly, the verbal part of the GRE score has a higher predictive power compared to the quantitative part. Further, we observe that undergraduate student GPA does not correlate with success (there is even a slight negative slope in the relationship between GPA and the probability of success). This counterintuitive observation is explained once undergraduate institutions are separated by tiers: students from "higher tiers" have undergone a more rigorous training program; they on average have a slightly lower GPA but run a slightly higher probability to succeed. Finally, a gender gap is observed in the probability to succeed with female students having a lower probability to finish with a PhD despite the same undergraduate performance, compared to males. This gap is reversed if we only consider foreign graduate students. It is our hope that this study will encourage other universities to perform similar analyses, in order to design better admission and retention strategies for Math PhD programs.
△ Less
Submitted 1 March, 2018;
originally announced March 2018.
