-
Distributionally robust optimization through the lens of submodularity
Authors:
Karthik Natarajan,
Divya Padmanabhan,
Arjun Ramachandra
Abstract:
Distributionally robust optimization is used to tackle decision making problems under uncertainty where the distribution of the uncertain data is ambiguous. Many ambiguity sets have been proposed for continuous uncertainty that build on convexity and for which the resulting formulations scale polynomially in the number of random variables. However fewer ambiguity sets have been proposed for discre…
▽ More
Distributionally robust optimization is used to tackle decision making problems under uncertainty where the distribution of the uncertain data is ambiguous. Many ambiguity sets have been proposed for continuous uncertainty that build on convexity and for which the resulting formulations scale polynomially in the number of random variables. However fewer ambiguity sets have been proposed for discrete uncertainty where the exact formulations scale polynomially in the number of random variables. Towards this, we define a submodular ambiguity set and showcase its expressive power in modeling both discrete and continuous uncertainty. With discrete uncertainty, we show that a class of distributionally robust optimization problems is solvable in polynomial time by viewing it through the lens of submodularity. With continuous uncertainty, we show that it is solvable approximately up to an additive error in pseudo-polynomial time. We then focus on a specific class of submodular ambiguity sets where univariate marginal information and bivariate dependence information on the random vector is specified and provide an exact reformulation as a polynomial sized linear program when the uncertainty is discrete and as a polynomial sized semidefinite program when the uncertainty is continuous. We provide numerical evidence of the modeling flexibility and expressive power of the submodular ambiguity set and demonstrate its applicability in two examples: project networks and multi-newsvendor problems. The paper highlights that the submodular ambiguity set is the natural discrete counterpart of the convex ambiguity set and supplements it for continuous uncertainty, both in modeling and computation.
△ Less
Submitted 27 May, 2025; v1 submitted 8 December, 2023;
originally announced December 2023.
-
Probability bounds for $n$ random events under $(n-1)$-wise independence
Authors:
Karthik Natarajan,
Arjun Kodagehalli Ramachandra,
Colin Tan
Abstract:
A collection of $n$ random events is said to be $(n - 1)$-wise independent if any $n - 1$ events among them are mutually independent. We characterise all probability measures with respect to which $n$ random events are $(n - 1)$-wise independent. We provide sharp upper and lower bounds on the probability that at least $k$ out of $n$ events with given marginal probabilities occur over these probabi…
▽ More
A collection of $n$ random events is said to be $(n - 1)$-wise independent if any $n - 1$ events among them are mutually independent. We characterise all probability measures with respect to which $n$ random events are $(n - 1)$-wise independent. We provide sharp upper and lower bounds on the probability that at least $k$ out of $n$ events with given marginal probabilities occur over these probability measures. The bounds are shown to be computable in polynomial time.
△ Less
Submitted 3 November, 2022;
originally announced November 2022.
-
Pairwise independent correlation gap
Authors:
Arjun Ramachandra,
Karthik Natarajan
Abstract:
In this paper, we introduce the notion of a ``pairwise independent correlation gap'' for set functions with random elements. The pairwise independent correlation gap is defined as the ratio of the maximum expected value of a set function with arbitrary dependence among the elements with fixed marginal probabilities to the maximum expected value with pairwise independent elements with the same marg…
▽ More
In this paper, we introduce the notion of a ``pairwise independent correlation gap'' for set functions with random elements. The pairwise independent correlation gap is defined as the ratio of the maximum expected value of a set function with arbitrary dependence among the elements with fixed marginal probabilities to the maximum expected value with pairwise independent elements with the same marginal probabilities. We show that for any nonnegative monotone submodular set function defined on $n$ elements, this ratio is upper bounded by $4/3$ in the following two cases: (a) $n = 3$ for all marginal probabilities and (b) all $n$ for small marginal probabilities (and similarly large marginal probabilities). This differs from the bound on the ``correlation gap'' which holds with mutual independence and showcases the fundamental difference between pairwise independence and mutual independence. We discuss the implication of the results with two examples and end the paper with a conjecture.
△ Less
Submitted 26 February, 2025; v1 submitted 18 September, 2022;
originally announced September 2022.
-
Extremal Probability Bounds in Combinatorial Optimization
Authors:
Divya Padmanabhan,
Selin Damla Ahipasaoglu,
Arjun Ramachandra,
Karthik Natarajan
Abstract:
In this paper, we compute the tightest possible bounds on the probability that the optimal value of a combinatorial optimization problem in maximization form with a random objective exceeds a given number, assuming only knowledge of the marginal distributions of the objective coefficient vector. The bounds are ``extremal'' since they are valid across all joint distributions with the given marginal…
▽ More
In this paper, we compute the tightest possible bounds on the probability that the optimal value of a combinatorial optimization problem in maximization form with a random objective exceeds a given number, assuming only knowledge of the marginal distributions of the objective coefficient vector. The bounds are ``extremal'' since they are valid across all joint distributions with the given marginals. We analyze the complexity of computing the bounds assuming discrete marginals and identify instances when the bounds are computable in polynomial time. For compact 0/1 V-polytopes, we show that the tightest upper bound is weakly NP-hard to compute by providing a pseudopolynomial time algorithm. On the other hand, the tightest lower bound is shown to be strongly NP-hard to compute for compact 0/1 V-polytopes by restricting attention to Bernoulli random variables. For compact 0/1 H-polytopes, for the special case of PERT networks arising in project management, we show that the tightest upper bound is weakly NP-hard to compute by providing a pseudopolynomial time algorithm. The results in the paper complement existing results in the literature for computing the probability with independent random variables.
△ Less
Submitted 3 September, 2021;
originally announced September 2021.
-
Robust Conic Satisficing
Authors:
Arjun Ramachandra,
Napat Rujeerapaiboon,
Melvyn Sim
Abstract:
In practical optimization problems, we typically model uncertainty as a random variable though its true probability distribution is unobservable to the decision maker. Historical data provides some information of this distribution that we can use to approximately quantify the risk that depends on both the decision and the uncertainty. This empirical optimization approach is vulnerable to the issue…
▽ More
In practical optimization problems, we typically model uncertainty as a random variable though its true probability distribution is unobservable to the decision maker. Historical data provides some information of this distribution that we can use to approximately quantify the risk that depends on both the decision and the uncertainty. This empirical optimization approach is vulnerable to the issues of overfitting, which could be overcome by several data-driven robust optimization techniques. To tackle overfitting, Long et.al.(2022) propose a robust satisficing model, which is specified by a performance target and a penalty function that measures the deviation of the uncertainty from its nominal value, and yields solutions with superior out-of-sample performance. We generalize the robust satisficing framework to conic optimization problems with recourse, which has broad applications in predictive and prescriptive analytics. We derive an exact semidefinite optimization formulation for a biconvex quadratic evaluation function, with quadratic penalty and ellipsoidal support set. More importantly, under complete and bounded recourse, and a reasonably chosen polyhedral support set and penalty function, we propose safe approximations that are feasible for any reasonably chosen target. We then demonstrate that the assumption of complete and bounded recourse is not unimpeachable, and then introduce a novel perspective casting technique to derive an equivalent conic optimization problem satisfying the stated assumptions. Computationally, we showcase a study on data-driven portfolio optimization and demonstrate that the robust satisficing solutions can provide significant improvements over the solutions obtained by stochastic optimization models, including the celebrated Markowitz model, which is prone to overfitting.
△ Less
Submitted 27 January, 2025; v1 submitted 14 July, 2021;
originally announced July 2021.
-
Tight Probability Bounds with Pairwise Independence
Authors:
Arjun Ramachandra,
Karthik Natarajan
Abstract:
While useful probability bounds for $n$ pairwise independent Bernoulli random variables adding up to at least an integer $k$ have been proposed in the literature, none of these bounds are tight in general. In this paper, we provide several results in this direction. Firstly, when $k = 1$, the tightest upper bound on the probability of the union of $n$ pairwise independent events is provided in clo…
▽ More
While useful probability bounds for $n$ pairwise independent Bernoulli random variables adding up to at least an integer $k$ have been proposed in the literature, none of these bounds are tight in general. In this paper, we provide several results in this direction. Firstly, when $k = 1$, the tightest upper bound on the probability of the union of $n$ pairwise independent events is provided in closed-form for any input marginal probability vector $\mathbf{p} \in [0,1]^n$. To prove the result, we show the existence of a positively correlated Bernoulli random vector with transformed bivariate probabilities, which is of independent interest. Building on this, we show that the ratio of the Boole union bound and the tight pairwise independent bound is upper bounded by $4/3$ and that the ratio is attained. Applications of the result in correlation gap analysis and distributionally robust bottleneck optimization are discussed. The result is extended to find the tightest lower bound on the probability of the intersection of $n$ pairwise independent events. Secondly, for any $k \geq 2$ and input marginal probability vector $\mathbf{p} \in [0,1]^n$, new upper bounds are derived by exploiting ordering of probabilities. Numerical examples are provided to illustrate when the bounds provide improvement over existing bounds. Lastly, we identify specific instances when the existing and the new bounds are tight, for example, with identical marginal probabilities.
△ Less
Submitted 23 November, 2022; v1 submitted 31 May, 2020;
originally announced June 2020.
