Showing 1–12 of 12 results for author: Steele, J M

A central limit theorem for costs in Bulinskaya's inventory management problem when deliveries face delays

Authors: Alessandro Arlotto, J. Michael Steele

Abstract: It is common in inventory theory to consider policies that minimize the expected cost of ordering and holding goods or materials. Nevertheless, the realized cost is a random variable, and, as the Saint Petersburg Paradox reminds us, the expected value does not always capture the full economic reality of a decision problem. Here we take the classic inventory model of Bulinskaya (1964), and, by prov… ▽ More It is common in inventory theory to consider policies that minimize the expected cost of ordering and holding goods or materials. Nevertheless, the realized cost is a random variable, and, as the Saint Petersburg Paradox reminds us, the expected value does not always capture the full economic reality of a decision problem. Here we take the classic inventory model of Bulinskaya (1964), and, by proving an appropriate central limit theorem, we show in a reasonably rich (and practical) sense that the mean-optimal policies are economically appropriate. The motivation and the tools are applicable to a large class of Markov decision problems. △ Less

Submitted 28 September, 2016; originally announced September 2016.

Comments: 15 pages

MSC Class: Primary: 60C05; 90B05; Secondary: 60F05; 60J05; 90C39; 90C40

Journal ref: Methodology and Computing in Applied Probability, 2018, 20, 839-854

The Bruss-Robertson Inequality: Elaborations, Extensions, and Applications

Authors: J. Michael Steele

Abstract: The Bruss-Robertson inequality gives a bound on the maximal number of elements of a random sample whose sum is less than a specified value, and the extension of that inequality which is given here neither requires the independence of the summands nor requires the equality of their marginal distributions. A review is also given of the applications of the Bruss-Robertson inequality, especially the a… ▽ More The Bruss-Robertson inequality gives a bound on the maximal number of elements of a random sample whose sum is less than a specified value, and the extension of that inequality which is given here neither requires the independence of the summands nor requires the equality of their marginal distributions. A review is also given of the applications of the Bruss-Robertson inequality, especially the applications to problems of combinatorial optimization such as the sequential knapsack problem and the sequential monotone subsequence selection problem. △ Less

Submitted 3 October, 2015; originally announced October 2015.

MSC Class: Primary: 60C05; 60G40; 90C40; Secondary: 60F99; 90C27; 90C39

Sequential Selection of a Monotone Subsequence from a Random Permutation

Authors: Peichao Peng, J. Michael Steele

Abstract: We find a two term asymptotic expansion for the optimal expected value of a sequentially selected monotone subsequence from a random permutation of length n. A striking feature of this expansion is that tells us that the expected value of optimal selection from a random permutation is quantifiably larger than optimal sequential selection from an independent sequences of uniformly distributed rando… ▽ More We find a two term asymptotic expansion for the optimal expected value of a sequentially selected monotone subsequence from a random permutation of length n. A striking feature of this expansion is that tells us that the expected value of optimal selection from a random permutation is quantifiably larger than optimal sequential selection from an independent sequences of uniformly distributed random variables; specifically, it is larger by at least (1/6)log n +O(1). △ Less

Submitted 15 September, 2015; originally announced September 2015.

MSC Class: 60C05

A central limit theorem for temporally non-homogenous Markov chains with applications to dynamic programming

Authors: Alessandro Arlotto, J. Michael Steele

Abstract: We prove a central limit theorem for a class of additive processes that arise naturally in the theory of finite horizon Markov decision problems. The main theorem generalizes a classic result of Dobrushin (1956) for temporally non-homogeneous Markov chains, and the principal innovation is that here the summands are permitted to depend on both the current state and a bounded number of future states… ▽ More We prove a central limit theorem for a class of additive processes that arise naturally in the theory of finite horizon Markov decision problems. The main theorem generalizes a classic result of Dobrushin (1956) for temporally non-homogeneous Markov chains, and the principal innovation is that here the summands are permitted to depend on both the current state and a bounded number of future states of the chain. We show through several examples that this added flexibility gives one a direct path to asymptotic normality of the optimal total reward of finite horizon Markov decision problems. The same examples also explain why such results are not easily obtained by alternative Markovian techniques such as enlargement of the state space. △ Less

Submitted 6 December, 2015; v1 submitted 4 May, 2015; originally announced May 2015.

Comments: 27 pages, 1 figure

MSC Class: Primary: 60J05; 90C40; Secondary: 60C05; 60F05; 60G42; 90B05; 90C27; 90C39

Journal ref: Mathematics of Operations Research, 2016, 41, 1448-1468

Quickest Online Selection of an Increasing Subsequence of Specified Size

Authors: Alessandro Arlotto, Elchanan Mossel, J. Michael Steele

Abstract: Given a sequence of independent random variables with a common continuous distribution, we consider the online decision problem where one seeks to minimize the expected value of the time that is needed to complete the selection of a monotone increasing subsequence of a prespecified length $n$. This problem is dual to some online decision problems that have been considered earlier, and this dual pr… ▽ More Given a sequence of independent random variables with a common continuous distribution, we consider the online decision problem where one seeks to minimize the expected value of the time that is needed to complete the selection of a monotone increasing subsequence of a prespecified length $n$. This problem is dual to some online decision problems that have been considered earlier, and this dual problem has some notable advantages. In particular, the recursions and equations of optimality lead with relative ease to asymptotic formulas for mean and variance of the minimal selection time. △ Less

Submitted 9 August, 2015; v1 submitted 26 December, 2014; originally announced December 2014.

Comments: 17 pages

MSC Class: Primary: 60C05; 90C40; Secondary: 60G40; 90C27; 90C39

Journal ref: Random Structures & Algorithms 49 (2016) 235-252

Optimal Online Selection of a Monotone Subsequence: a Central Limit Theorem

Authors: Alessandro Arlotto, Vinh V. Nguyen, J. Michael Steele

Abstract: Consider a sequence of $n$ independent random variables with a common continuous distribution $F$, and consider the task of choosing an increasing subsequence where the observations are revealed sequentially and where an observation must be accepted or rejected when it is first revealed. There is a unique selection policy $π_n^*$ that is optimal in the sense that it maximizes the expected value of… ▽ More Consider a sequence of $n$ independent random variables with a common continuous distribution $F$, and consider the task of choosing an increasing subsequence where the observations are revealed sequentially and where an observation must be accepted or rejected when it is first revealed. There is a unique selection policy $π_n^*$ that is optimal in the sense that it maximizes the expected value of $L_n(π_n^*)$, the number of selected observations. We investigate the distribution of $L_n(π_n^*)$; in particular, we obtain a central limit theorem for $L_n(π_n^*)$ and a detailed understanding of its mean and variance for large $n$. Our results and methods are complementary to the work of Bruss and Delbaen (2004) where an analogous central limit theorem is found for monotone increasing selections from a finite sequence with cardinality $N$ where $N$ is a Poisson random variable that is independent of the sequence. △ Less

Submitted 29 March, 2015; v1 submitted 28 August, 2014; originally announced August 2014.

Comments: 26 pages

MSC Class: Primary: 60C05; 60G40; 90C40; Secondary: 60F05; 60G42; 90C27; 90C39

Journal ref: Stochastic Processes and their Applications, 2015, 125, 3596-3622

Beardwood-Halton-Hammersley Theorem for Stationary Ergodic Sequences: a Counterexample

Authors: Alessandro Arlotto, J. Michael Steele

Abstract: We construct a stationary ergodic process $X_1, X_2, \ldots $ such that each $X_t$ has the uniform distribution on the unit square and the length $L_n$ of the shortest path through the points $X_1, X_2, \ldots,X_n$ is not asymptotic to a constant times the square root of $n$. In other words, we show that the Beardwood, Halton and Hammersley theorem does not extend from the case of independent unif… ▽ More We construct a stationary ergodic process $X_1, X_2, \ldots $ such that each $X_t$ has the uniform distribution on the unit square and the length $L_n$ of the shortest path through the points $X_1, X_2, \ldots,X_n$ is not asymptotic to a constant times the square root of $n$. In other words, we show that the Beardwood, Halton and Hammersley theorem does not extend from the case of independent uniformly distributed random variables to the case of stationary ergodic sequences with uniform marginal distributions. △ Less

Submitted 24 August, 2015; v1 submitted 30 June, 2013; originally announced July 2013.

Comments: 24 pages, 1 figure

MSC Class: Primary 60D05; 90B15; Secondary 60F15; 60G10; 60G55; 90C27

Journal ref: The Annals of Applied Probability 26 (2016) 2141-2168

Optimal On-Line Selection of an Alternating Subsequence: A Central Limit Theorem

Authors: Alessandro Arlotto, J. Michael Steele

Abstract: We analyze the optimal policy for the sequential selection of an alternating subsequence from a sequence of $n$ independent observations from a continuous distribution $F$, and we prove a central limit theorem for the number of selections made by that policy. The proof exploits the backward recursion of dynamic programming and assembles a detailed understanding of the associated value functions an… ▽ More We analyze the optimal policy for the sequential selection of an alternating subsequence from a sequence of $n$ independent observations from a continuous distribution $F$, and we prove a central limit theorem for the number of selections made by that policy. The proof exploits the backward recursion of dynamic programming and assembles a detailed understanding of the associated value functions and selection rules. △ Less

Submitted 9 June, 2013; v1 submitted 6 December, 2012; originally announced December 2012.

Comments: 24 pages, 1 figure

MSC Class: Primary: 60C05; 60G40; 90C40; Secondary: 60F05; 90C27; 90C39

Journal ref: Advances in Applied Probability 46 (2014) 536-559

Twitter event networks and the Superstar model

Authors: Shankar Bhamidi, J. Michael Steele, Tauhid Zaman

Abstract: Condensation phenomenon is often observed in social networks such as Twitter where one "superstar" vertex gains a positive fraction of the edges, while the remaining empirical degree distribution still exhibits a power law tail. We formulate a mathematically tractable model for this phenomenon that provides a better fit to empirical data than the standard preferential attachment model across an ar… ▽ More Condensation phenomenon is often observed in social networks such as Twitter where one "superstar" vertex gains a positive fraction of the edges, while the remaining empirical degree distribution still exhibits a power law tail. We formulate a mathematically tractable model for this phenomenon that provides a better fit to empirical data than the standard preferential attachment model across an array of networks observed in Twitter. Using embeddings in an equivalent continuous time version of the process, and adapting techniques from the stable age-distribution theory of branching processes, we prove limit results for the proportion of edges that condense around the superstar, the degree distribution of the remaining vertices, maximal nonsuperstar degree asymptotics and height of these random trees in the large network limit. △ Less

Submitted 9 September, 2015; v1 submitted 13 November, 2012; originally announced November 2012.

Comments: Published at http://dx.doi.org/10.1214/14-AAP1053 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AAP-AAP1053

Journal ref: Annals of Applied Probability 2015, Vol. 25, No. 5, 2462-2502

A Systematic Martingale Construction with Applications to Permutation Inequalities

Authors: Vladimir Pozdnyakov, J. Michael Steele

Abstract: We illustrate a process that constructs martingales from raw material that arises naturally from the theory of sampling without replacement.The usefulness of the new martingales is illustrated by the development of maximal inequalities for permuted sequences of real numbers. Some of these inequalities are new and some are variations of classical inequalities like those introduced by A. Garsia in t… ▽ More We illustrate a process that constructs martingales from raw material that arises naturally from the theory of sampling without replacement.The usefulness of the new martingales is illustrated by the development of maximal inequalities for permuted sequences of real numbers. Some of these inequalities are new and some are variations of classical inequalities like those introduced by A. Garsia in the study of rearrangement of orthogonal series. △ Less

Submitted 28 October, 2012; originally announced October 2012.

MSC Class: 60G42

Optimal Sequential Selection of a Unimodal Subsequence of a Random Sequence

Authors: Alessandro Arlotto, J. Michael Steele

Abstract: We consider the problem of selecting sequentially a unimodal subsequence from a sequence of independent identically distributed random variables, and we find that a person doing optimal sequential selection does within a factor of the square root of two as well as a prophet who knows all of the random observations in advance of any selections. Our analysis applies in fact to selections of subseque… ▽ More We consider the problem of selecting sequentially a unimodal subsequence from a sequence of independent identically distributed random variables, and we find that a person doing optimal sequential selection does within a factor of the square root of two as well as a prophet who knows all of the random observations in advance of any selections. Our analysis applies in fact to selections of subsequences that have d+1 monotone blocks, and, by including the case d=0, our analysis also covers monotone subsequences. △ Less

Submitted 24 September, 2011; v1 submitted 12 August, 2011; originally announced August 2011.

MSC Class: Primary: 60C05; 90C40; Secondary: 60G42; 90C27; 90C39

Journal ref: Combinatorics, Probability and Computing (2011) 20, 799--814

On-Line Selection of Alternating Subsequences from a Random Sample

Authors: Alessandro Arlotto, Robert W. Chen, Lawrence A. Shepp, J. Michael Steele

Abstract: We consider sequential selection of an alternating subsequence from a sequence of independent, identically distributed, continuous random variables, and we determine the exact asymptotic behavior of an optimal sequentially selected subsequence. Moreover, we find (in a sense we make precise) that a person who is constrained to make sequential selections does only about 12% worse than a person who c… ▽ More We consider sequential selection of an alternating subsequence from a sequence of independent, identically distributed, continuous random variables, and we determine the exact asymptotic behavior of an optimal sequentially selected subsequence. Moreover, we find (in a sense we make precise) that a person who is constrained to make sequential selections does only about 12% worse than a person who can make selections with full knowledge of the random sequence. △ Less

Submitted 1 July, 2011; v1 submitted 8 May, 2011; originally announced May 2011.

MSC Class: Primary: 60C05; 90C40; Secondary: 90C27; 90C39

Journal ref: Journal of Applied Probability 48 (4), December 2011