Showing 1–12 of 12 results for author: Bassett, R

Coupled Adaptable Backward-Forward-Backward Resolvent Splitting Algorithm (CABRA): A Matrix-Parametrized Resolvent Splitting Method for the Sum of Maximal Monotone and Cocoercive Operators Composed with Linear Coupling Operators

Authors: Peter Barkley, Robert L. Bassett

Abstract: We present a novel matrix-parametrized frugal splitting algorithm which finds the zero of a sum of maximal monotone and cocoercive operators composed with linear selection operators. We also develop a semidefinite programming framework for selecting matrix parameters and demonstrate its use for designing matrix parameters which provide beneficial diagonal scaling, allow parallelization, and adhere… ▽ More We present a novel matrix-parametrized frugal splitting algorithm which finds the zero of a sum of maximal monotone and cocoercive operators composed with linear selection operators. We also develop a semidefinite programming framework for selecting matrix parameters and demonstrate its use for designing matrix parameters which provide beneficial diagonal scaling, allow parallelization, and adhere to a given communication structure. We show that taking advantage of the linear selection operators in this way accelerates convergence in numeric experiments, and show that even when the selection operators are the identity, we can accelerate convergence by using the matrix parameters to provide appropriately chosen diagonal scaling. We conclude by demonstrating the applicability of this algorithm to multi-stage stochastic programming, outlining a decentralized approach to the relaxed stochastic weapon target assignment problem which splits over the source nodes and has low data transfer and memory requirements. △ Less

Submitted 20 May, 2025; originally announced May 2025.

Comments: 32 pages, 5 figures

MSC Class: 49M37; 65K05

Decentralized Sensor Network Localization using Matrix-Parametrized Proximal Splittings

Authors: Peter Barkley, Robert L. Bassett

Abstract: We present a novel application of a recently-proposed matrix-parametrized proximal splitting method to sensor network localization, the problem of estimating the locations of a set of sensors using only noisy pairwise distance information between the sensors. The decentralized computation required by our approach respects the communication structure between sensors specified by the noisy SNL probl… ▽ More We present a novel application of a recently-proposed matrix-parametrized proximal splitting method to sensor network localization, the problem of estimating the locations of a set of sensors using only noisy pairwise distance information between the sensors. The decentralized computation required by our approach respects the communication structure between sensors specified by the noisy SNL problem, thereby allowing individual sensors to estimate their location using only local computations and communication with their neighbors. Our proposed method experimentally outperforms a competing method for decentralized computation -- the alternating direction method of multipliers (ADMM) -- with respect to convergence rate and memory use. As an independent methodological contribution, we propose using the Sinkhorn-Knopp algorithm in a completely decentralized manner to construct the matrices which parametrize our proposed splitting method. We show that parameters selected using this method perform similarly to those selected via existing parameter selection methods while requiring far less computation. Unlike centralized interior point solution methods, our first order splitting method allows for efficient warm starting, and we demonstrate improvements in convergence using rough estimates of sensor location to warm start our algorithm. We also find that early termination of the algorithm provides more accurate location estimates than the minimizer of the node-based SDP relaxation of the SNL. △ Less

Submitted 17 March, 2025; originally announced March 2025.

MSC Class: 65K10; 90C22; 49M27; 90B18

Optimal Design of Resolvent Splitting Algorithms

Authors: Robert L Bassett, Peter Barkley

Abstract: In this paper, we introduce a novel semidefinite programming framework for designing custom frugal resolvent splitting algorithms which find a zero in the sum of n monotone operators. This framework features a number of design choices which facilitate creating resolvent splitting algorithms with specific communication structure. We illustrate these design choices using a variety of constraint sets… ▽ More In this paper, we introduce a novel semidefinite programming framework for designing custom frugal resolvent splitting algorithms which find a zero in the sum of n monotone operators. This framework features a number of design choices which facilitate creating resolvent splitting algorithms with specific communication structure. We illustrate these design choices using a variety of constraint sets and objective functions, as well as the use of a mixed-integer SDP to minimize time per iteration or required number of communications between the resolvents which define the splitting. Using the Performance Estimation Problem (PEP) framework, we provide parameter selections, such as step size, which for high dimensional problems provide optimal contraction factors in the algorithms. Among the algorithm design choices we introduce, we provide a characterization of algorithm designs which provide minimal convergence time given structural properties of the monotone operators, resolvent computation times, and communication latencies. △ Less

Submitted 3 September, 2024; v1 submitted 22 July, 2024; originally announced July 2024.

MSC Class: 49M37; 65K05

Adversarial Perturbations of Physical Signals

Authors: Robert L. Bassett, Austin Van Dellen, Anthony P. Austin

Abstract: We investigate the vulnerability of computer-vision-based signal classifiers to adversarial perturbations of their inputs, where the signals and perturbations are subject to physical constraints. We consider a scenario in which a source and interferer emit signals that propagate as waves to a detector, which attempts to classify the source by analyzing the spectrogram of the signal it receives usi… ▽ More We investigate the vulnerability of computer-vision-based signal classifiers to adversarial perturbations of their inputs, where the signals and perturbations are subject to physical constraints. We consider a scenario in which a source and interferer emit signals that propagate as waves to a detector, which attempts to classify the source by analyzing the spectrogram of the signal it receives using a pre-trained neural network. By solving PDE-constrained optimization problems, we construct interfering signals that cause the detector to misclassify the source even though the perturbations to the spectrogram of the received signal are nearly imperceptible. Though such problems can have millions of decision variables, we introduce methods to solve them efficiently. Our experiments demonstrate that one can compute effective and physically realizable adversarial perturbations for a variety of machine learning models under various physical conditions. △ Less

Submitted 26 February, 2024; originally announced February 2024.

MSC Class: 65K05; 90C30; 65M60

Exponential Family Trend Filtering on Lattices

Authors: Veeranjaneyulu Sadhanala, Robert Bassett, James Sharpnack, Daniel J. McDonald

Abstract: Trend filtering is a modern approach to nonparametric regression that is more adaptive to local smoothness than splines or similar basis procedures. Existing analyses of trend filtering focus on estimating a function corrupted by homoskedastic Gaussian noise, but our work extends this technique to general exponential family distributions. This extension is motivated by the need to study massive, g… ▽ More Trend filtering is a modern approach to nonparametric regression that is more adaptive to local smoothness than splines or similar basis procedures. Existing analyses of trend filtering focus on estimating a function corrupted by homoskedastic Gaussian noise, but our work extends this technique to general exponential family distributions. This extension is motivated by the need to study massive, gridded climate data derived from polar-orbiting satellites. We present algorithms tailored to large problems, theoretical results for general exponential family likelihoods, and principled methods for tuning parameter selection without excess computation. △ Less

Submitted 19 September, 2022; originally announced September 2022.

Comments: 53 pages; 6 figures; 3 tables

Journal ref: Electron. J. Statist. 18(1): 1749-1814 (2024)

One-Step Estimation With Scaled Proximal Methods

Authors: Robert Bassett, Julio Deride

Abstract: We study statistical estimators computed using iterative optimization methods that are not run until completion. Classical results on maximum likelihood estimators (MLEs) assert that a one-step estimator (OSE), in which a single Newton-Raphson iteration is performed from a starting point with certain properties, is asymptotically equivalent to the MLE. We further develop these early-stopping resul… ▽ More We study statistical estimators computed using iterative optimization methods that are not run until completion. Classical results on maximum likelihood estimators (MLEs) assert that a one-step estimator (OSE), in which a single Newton-Raphson iteration is performed from a starting point with certain properties, is asymptotically equivalent to the MLE. We further develop these early-stopping results by deriving properties of one-step estimators defined by a single iteration of scaled proximal methods. Our main results show the asymptotic equivalence of the likelihood-based estimator and various one-step estimators defined by scaled proximal methods. By interpreting OSEs as the last of a sequence of iterates, our results provide insight on scaling numerical tolerance with sample size. Our setting contains scaled proximal gradient descent applied to certain composite models as a special case, making our results applicable to many problems of practical interest. Additionally, our results provide support for the utility of the scaled Moreau envelope as a statistical smoother by interpreting scaled proximal descent as a quasi-Newton method applied to the scaled Moreau envelope. △ Less

Submitted 24 June, 2021; v1 submitted 29 April, 2020; originally announced April 2020.

MSC Class: 62F12; 65K10; 90C53

How many ways to color the map of America?

Authors: Rebekah Bassett, Jennifer Canizales, Jasbir S. Chahal, Thomas Fackrell, Vanessa Rico

Abstract: Although the Four Color Conjecture originated in cartography, surprisingly, there is nothing in the literature on the number of ways to color an actual geographic map with four or fewer colors. In this paper, we compute these numbers, with exponentially increasing order of difficulty, for the maps of Canada, France, and the USA. Our attempts to compute the latter two lead to some new results on th… ▽ More Although the Four Color Conjecture originated in cartography, surprisingly, there is nothing in the literature on the number of ways to color an actual geographic map with four or fewer colors. In this paper, we compute these numbers, with exponentially increasing order of difficulty, for the maps of Canada, France, and the USA. Our attempts to compute the latter two lead to some new results on the chromatic polynomial of graphs. △ Less

Submitted 15 August, 2019; originally announced August 2019.

Fused Density Estimation: Theory and Methods

Authors: Robert Bassett, James Sharpnack

Abstract: In this paper we introduce a method for nonparametric density estimation on geometric networks. We define fused density estimators as solutions to a total variation regularized maximum-likelihood density estimation problem. We provide theoretical support for fused density estimation by proving that the squared Hellinger rate of convergence for the estimator achieves the minimax bound over univaria… ▽ More In this paper we introduce a method for nonparametric density estimation on geometric networks. We define fused density estimators as solutions to a total variation regularized maximum-likelihood density estimation problem. We provide theoretical support for fused density estimation by proving that the squared Hellinger rate of convergence for the estimator achieves the minimax bound over univariate densities of log-bounded variation. We reduce the original variational formulation in order to transform it into a tractable, finite-dimensional quadratic program. Because random variables on geometric networks are simple generalizations of the univariate case, this method also provides a useful tool for univariate density estimation. Lastly, we apply this method and assess its performance on examples in the univariate and geometric network setting. We compare the performance of different optimization techniques to solve the problem, and use these results to inform recommendations for the computation of fused density estimators. △ Less

Submitted 4 December, 2018; v1 submitted 8 May, 2018; originally announced May 2018.

MSC Class: 62G07; 62G20; 90C35; 49M37

Maximum a Posteriori Estimators as a Limit of Bayes Estimators

Authors: Robert Bassett, Julio Deride

Abstract: Maximum a posteriori and Bayes estimators are two common methods of point estimation in Bayesian Statistics. It is commonly accepted that maximum a posteriori estimators are a limiting case of Bayes estimators with 0-1 loss. In this paper, we provide a counterexample which shows that in general this claim is false. We then correct the claim that by providing a level-set condition for posterior den… ▽ More Maximum a posteriori and Bayes estimators are two common methods of point estimation in Bayesian Statistics. It is commonly accepted that maximum a posteriori estimators are a limiting case of Bayes estimators with 0-1 loss. In this paper, we provide a counterexample which shows that in general this claim is false. We then correct the claim that by providing a level-set condition for posterior densities such that the result holds. Since both estimators are defined in terms of optimization problems, the tools of variational analysis find a natural application to Bayesian point estimation. △ Less

Submitted 21 January, 2018; v1 submitted 17 November, 2016; originally announced November 2016.

MSC Class: 62C10; 62F10; 62F15; 65K10

Log-Concave Duality in Estimation and Control

Authors: Robert Bassett, Michael Casey, Roger J-B Wets

Abstract: In this paper we generalize the estimation-control duality that exists in the linear-quadratic-Gaussian setting. We extend this duality to maximum a posteriori estimation of the system's state, where the measurement and dynamical system noise are independent log-concave random variables. More generally, we show that a problem which induces a convex penalty on noise terms will have a dual control p… ▽ More In this paper we generalize the estimation-control duality that exists in the linear-quadratic-Gaussian setting. We extend this duality to maximum a posteriori estimation of the system's state, where the measurement and dynamical system noise are independent log-concave random variables. More generally, we show that a problem which induces a convex penalty on noise terms will have a dual control problem. We provide conditions for strong duality to hold, and then prove relaxed conditions for the piecewise linear-quadratic case. The results have applications in estimation problems with nonsmooth densities, such as log-concave maximum likelihood densities. We conclude with an example reconstructing optimal estimates from solutions to the dual control problem, which has implications for sharing solution methods between the two types of problems. △ Less

Submitted 8 July, 2016; originally announced July 2016.

Multistage Portfolio Optimization: A Duality Result in Conic Market Models

Authors: Robert Bassett, Khoa Le

Abstract: We prove a general duality result for multi-stage portfolio optimization problems in markets with proportional transaction costs. The financial market is described by Kabanov's model of foreign exchange markets over a finite probability space and finite-horizon discrete time steps. This framework allows us to compare vector-valued portfolios under a partial ordering, so that our model does not req… ▽ More We prove a general duality result for multi-stage portfolio optimization problems in markets with proportional transaction costs. The financial market is described by Kabanov's model of foreign exchange markets over a finite probability space and finite-horizon discrete time steps. This framework allows us to compare vector-valued portfolios under a partial ordering, so that our model does not require liquidation into some numeraire at terminal time. We embed the vector-valued portfolio problem into the set-optimization framework, and generate a problem dual to portfolio optimization. Using recent results in the development of set optimization, we then show that a strong duality relationship holds between the problems. △ Less

Submitted 22 January, 2016; v1 submitted 4 January, 2016; originally announced January 2016.

A Quantitative Doignon-Bell-Scarf Theorem

Authors: Iskander Aliev, Robert Bassett, Jesus A. De Loera, Quentin Louveaux

Abstract: The famous Doignon-Bell-Scarf Theorem is a Helly-type result about the existence of integer solutions on systems of linear inequalities. The purpose of this paper is to present the following quantitative generalization: Given an integer $k$, we prove that there exists a constant $c(n,k)$, depending only on the dimension $n$ and $k$, such that if a polyhedron ${x: Ax \leq b}$ contains exactly k int… ▽ More The famous Doignon-Bell-Scarf Theorem is a Helly-type result about the existence of integer solutions on systems of linear inequalities. The purpose of this paper is to present the following quantitative generalization: Given an integer $k$, we prove that there exists a constant $c(n,k)$, depending only on the dimension $n$ and $k$, such that if a polyhedron ${x: Ax \leq b}$ contains exactly k integer solutions, then there exists a subset of the rows, of cardinality no more than $c(n,k)$, defining a polyhedron that contains exactly the same $k$ integer points. In this case $c(n,0) = 2^n$ is the original case of Doignon-Bell-Scarf for infeasible systems of inequalities. We work on both upper and lower bounds for the constant $c(n,k)$ and discuss some consequences, including a Clarkson-style algorithm to find the $l$-th best solution of an integer program with respect to the ordering induced by the objective function. △ Less

Submitted 7 September, 2015; v1 submitted 10 May, 2014; originally announced May 2014.