Title:Hybrid CG-Tikhonov is a filtration of the CG Lanczos vectors

Abstract:We consider iterative methods for solving linear ill-posed problems with compact operator and right-hand side only available via noise-polluted measurements. Conjugate gradients (\cg) applied to the normal equations with an appropriate stopping rule and \cg applied to the system solving for a Tikhonov-regularized solution (\cgt) $(A^\ast A + c I_{\mathcal{X}}) x^{(\delta,c)} = A^\ast y^\delta$ are closely related regularization methods that build iterates from the same family of Krylov subspaces.
In this work, we show that the \cgt iterate can be expressed as $x^{(\delta,c)}_m = \sum_{i=1}^{m} \gamma^{(m)}_i(c) z_i^{(m)}v_i$, where $\braces{\gamma_i^{(m)}(c)}_{i=1}^m$ are functions of the Tikhonov parameter and $x^{(\delta)}_m = \sum_{i=1}^{m} z_i^{(m)}v_i$ is the $m$-th \cg iterate. We call these functions \emph{Lanczos filters}, and they can be shown to have decay properties as $c\rightarrow\infty$ with the speed of decay increasing with $i$. This has the effect of filtering out the contribution of the later terms of the \cg iterate. The filters can be constructed using quantities defined via recursions at each iteration.
We demonstrate with numerical experiments that good parameter choices correspond to appropriate damping of the Lanczos vectors. The filtration approach also provides a platform for further development of parameter choice rules, and similar representations may hold for other hybrid iterative schemes.