-
Randomized Block Adaptive Linear System Solvers
Authors:
Vivak Patel,
Mohammad Jahangoshahi,
Daniel Adrian Maldonado
Abstract:
Randomized linear solvers randomly compress and solve a linear system with compelling theoretical convergence rates and computational complexities. However, such solvers suffer a substantial disconnect between their theoretical rates and actual efficiency in practice. Fortunately, these solvers are quite flexible and can be adapted to specific problems and computing environments to ensure high eff…
▽ More
Randomized linear solvers randomly compress and solve a linear system with compelling theoretical convergence rates and computational complexities. However, such solvers suffer a substantial disconnect between their theoretical rates and actual efficiency in practice. Fortunately, these solvers are quite flexible and can be adapted to specific problems and computing environments to ensure high efficiency in practice, even at the cost of lower effectiveness (i.e., having a slower theoretical rate of convergence). While highly efficient adapted solvers can be readily designed by application experts, will such solvers still converge and at what rate? To answer this, we distill three general criteria for randomized adaptive solvers, which, as we show, will guarantee a worst-case exponential rate of convergence of the solver applied to consistent and inconsistent linear systems irrespective of whether such systems are over-determined, under-determined or rank-deficient. As a result, we enable application experts to design randomized adaptive solvers that achieve efficiency and can be verified for effectiveness using our theory. We demonstrate our theory on twenty-six solvers, nine of which are novel or novel block extensions of existing methods to the best of our knowledge.
△ Less
Submitted 27 April, 2023; v1 submitted 4 April, 2022;
originally announced April 2022.
-
Convergence of Adaptive, Randomized, Iterative Linear Solvers
Authors:
Vivak Patel,
Mohammad Jahangoshahi,
Daniel Adrian Maldonado
Abstract:
Deterministic and randomized, row-action and column-action linear solvers have become increasingly popular owing to their simplicity, low computational and memory complexities, and ease of composition with other techniques. Moreover, in order to achieve high-performance, such solvers must often be adapted to the given problem structure and to the hardware platform on which the problem will be solv…
▽ More
Deterministic and randomized, row-action and column-action linear solvers have become increasingly popular owing to their simplicity, low computational and memory complexities, and ease of composition with other techniques. Moreover, in order to achieve high-performance, such solvers must often be adapted to the given problem structure and to the hardware platform on which the problem will be solved. Unfortunately, determining whether such adapted solvers will converge to a solution has required equally unique analyses. As a result, adapted, reliable solvers are slow to be developed and deployed. In this work, we provide a general set of assumptions under which such adapted solvers are guaranteed to converge with probability one, and provide worst case rates of convergence. As a result, we can provide practitioners with guidance on how to design highly adapted, randomized or deterministic, row-action or column-action linear solvers that are also guaranteed to converge.
△ Less
Submitted 26 April, 2021; v1 submitted 10 April, 2021;
originally announced April 2021.
-
An Implicit Representation and Iterative Solution of Randomly Sketched Linear Systems
Authors:
Vivak Patel,
Mohammad Jahangoshahi,
Daniel Adrian Maldonado
Abstract:
Randomized linear system solvers have become popular as they have the potential to reduce floating point complexity while still achieving desirable convergence rates. One particularly promising class of methods, random sketching solvers, has achieved the best known computational complexity bounds in theory, but is blunted by two practical considerations: there is no clear way of choosing the size…
▽ More
Randomized linear system solvers have become popular as they have the potential to reduce floating point complexity while still achieving desirable convergence rates. One particularly promising class of methods, random sketching solvers, has achieved the best known computational complexity bounds in theory, but is blunted by two practical considerations: there is no clear way of choosing the size of the sketching matrix apriori; and there is a nontrivial storage cost of the sketched system. In this work, we make progress towards addressing these issues by implicitly generating the sketched system and solving it simultaneously through an iterative procedure. As a result, we replace the question of the size of the sketching matrix with determining appropriate stopping criteria; we also avoid the costs of explicitly representing the sketched linear system; and our implicit representation also solves the system at the same time, which controls the per-iteration computational costs.
Additionally, our approach allows us to generate a connection between random sketching methods and randomized iterative solvers (e.g., randomized Kaczmarz method, randomized Gauss-Seidel). As a consequence, we exploit this connection to (1) produce a stronger, more precise convergence theory for such randomized iterative solvers under arbitrary sampling schemes (i.i.d., adaptive, permutation, dependent, etc.), and (2) improve the rates of convergence of randomized iterative solvers at the expense of a user-determined increases in per-iteration computational and storage costs. We demonstrate these concepts on numerical examples on forty-nine distinct linear systems.
△ Less
Submitted 22 December, 2020; v1 submitted 26 April, 2019;
originally announced April 2019.
-
Multiple-paths $SLE_κ$ in multiply connected domains
Authors:
Mohammad Jahangoshahi,
Gregory F. Lawler
Abstract:
We define multiple-paths Schramm-Loewner evolution ($SLE_κ$) in multiply connected domains when $κ\leq 4$ and prove that in annuli, the partition function is smooth. Moreover, we give up-to-constant estimates for the partition function of bi-chordal annulus $SLE_κ$ measure and we establish a connection between this measure and two-sided $SLE_κ$ in the unit disk.
We define multiple-paths Schramm-Loewner evolution ($SLE_κ$) in multiply connected domains when $κ\leq 4$ and prove that in annuli, the partition function is smooth. Moreover, we give up-to-constant estimates for the partition function of bi-chordal annulus $SLE_κ$ measure and we establish a connection between this measure and two-sided $SLE_κ$ in the unit disk.
△ Less
Submitted 12 November, 2018;
originally announced November 2018.
-
On the smoothness of the partition function for multiple Schramm-Loewner evolutions
Authors:
Mohammad Jahangoshahi,
Gregory F. Lawler
Abstract:
We consider the measure on multiple chordal Schramm-Loewner evolution ($SLE_κ$) curves. We establish a derivative estimate and use it to give a direct proof that the partition function is $C^2$ if $κ<4$.
We consider the measure on multiple chordal Schramm-Loewner evolution ($SLE_κ$) curves. We establish a derivative estimate and use it to give a direct proof that the partition function is $C^2$ if $κ<4$.
△ Less
Submitted 2 October, 2017;
originally announced October 2017.
-
GROTESQUE: Noisy Group Testing (Quick and Efficient)
Authors:
Sheng Cai,
Mohammad Jahangoshahi,
Mayank Bakshi,
Sidharth Jaggi
Abstract:
Group-testing refers to the problem of identifying (with high probability) a (small) subset of $D$ defectives from a (large) set of $N$ items via a "small" number of "pooled" tests. For ease of presentation in this work we focus on the regime when $D = \cO{N^{1-\gap}}$ for some $\gap > 0$. The tests may be noiseless or noisy, and the testing procedure may be adaptive (the pool defining a test may…
▽ More
Group-testing refers to the problem of identifying (with high probability) a (small) subset of $D$ defectives from a (large) set of $N$ items via a "small" number of "pooled" tests. For ease of presentation in this work we focus on the regime when $D = \cO{N^{1-\gap}}$ for some $\gap > 0$. The tests may be noiseless or noisy, and the testing procedure may be adaptive (the pool defining a test may depend on the outcome of a previous test), or non-adaptive (each test is performed independent of the outcome of other tests). A rich body of literature demonstrates that $Θ(D\log(N))$ tests are information-theoretically necessary and sufficient for the group-testing problem, and provides algorithms that achieve this performance. However, it is only recently that reconstruction algorithms with computational complexity that is sub-linear in $N$ have started being investigated (recent work by \cite{GurI:04,IndN:10, NgoP:11} gave some of the first such algorithms). In the scenario with adaptive tests with noisy outcomes, we present the first scheme that is simultaneously order-optimal (up to small constant factors) in both the number of tests and the decoding complexity ($\cO{D\log(N)}$ in both the performance metrics). The total number of stages of our adaptive algorithm is "small" ($\cO{\log(D)}$). Similarly, in the scenario with non-adaptive tests with noisy outcomes, we present the first scheme that is simultaneously near-optimal in both the number of tests and the decoding complexity (via an algorithm that requires $\cO{D\log(D)\log(N)}$ tests and has a decoding complexity of {${\cal O}(D(\log N+\log^{2}D))$}. Finally, we present an adaptive algorithm that only requires 2 stages, and for which both the number of tests and the decoding complexity scale as {${\cal O}(D(\log N+\log^{2}D))$}. For all three settings the probability of error of our algorithms scales as $\cO{1/(poly(D)}$.
△ Less
Submitted 10 July, 2013;
originally announced July 2013.
