-
Classification of ill-posedness for bounded linear operators in Banach spaces
Authors:
Bernd Hofmann,
Stefan Kindermann
Abstract:
In this article, concepts of well- and ill-posedness for linear operators in Hilbert and Banach spaces are discussed. While these concepts are well understood in Hilbert spaces, this is not the case in Banach spaces, as there are several competing definitions, related to the occurrence of uncomplemented subspaces. We provide an overview of the various definitions and, based on this, discuss the cl…
▽ More
In this article, concepts of well- and ill-posedness for linear operators in Hilbert and Banach spaces are discussed. While these concepts are well understood in Hilbert spaces, this is not the case in Banach spaces, as there are several competing definitions, related to the occurrence of uncomplemented subspaces. We provide an overview of the various definitions and, based on this, discuss the classification of type I and type II ill-posedness in Banach spaces. Furthermore, a discussion of borderline (hybrid) cases in this classification is given together with several example instances of operators.
△ Less
Submitted 19 May, 2025;
originally announced May 2025.
-
Operator ordering by ill-posedness in Hilbert and Banach spaces
Authors:
Stefan Kindermann,
Bernd Hofmann
Abstract:
For operators representing ill-posed problems, an ordering by ill-posedness is proposed, where one operator is considered more ill-posed than another one if the former can be expressed as a cocatenation of bounded operators involving the latter. This definition is motivated by a recent one introduced by Mathé and Hofmann [Adv. Oper. Theory, 2025] that utilizes bounded and orthogonal operators, and…
▽ More
For operators representing ill-posed problems, an ordering by ill-posedness is proposed, where one operator is considered more ill-posed than another one if the former can be expressed as a cocatenation of bounded operators involving the latter. This definition is motivated by a recent one introduced by Mathé and Hofmann [Adv. Oper. Theory, 2025] that utilizes bounded and orthogonal operators, and we show the equivalence of our new definition with this one for the case of compact and non-compact linear operators in Hilbert spaces. We compare our ordering with other measures of ill-posedness such as the decay of the singular values, norm estimates, and range inclusions. Furthermore, as the new definition does not depend on the notion of orthogonal operators, it can be extended to the case of linear operators in Banach spaces, and it also provides ideas for applications to nonlinear problems in Hilbert spaces. In the latter context, certain nonlinearity conditions can be interpreted as ordering relations between a nonlinear operator and its linearization.
△ Less
Submitted 5 February, 2025;
originally announced February 2025.
-
Comparing the ill-posedness for linear operators in Hilbert spaces
Authors:
Peter Mathé,
Bernd Hofmann
Abstract:
The difficulty for solving ill-posed linear operator equations in Hilbert space is reflected by the strength of ill-posedness of the governing operator, and the inherent solution smoothness. In this study we focus on the ill-posedness of the operator, and we propose a partial ordering for the class of all bounded linear operators which lead to ill-posed operator equations. For compact linear opera…
▽ More
The difficulty for solving ill-posed linear operator equations in Hilbert space is reflected by the strength of ill-posedness of the governing operator, and the inherent solution smoothness. In this study we focus on the ill-posedness of the operator, and we propose a partial ordering for the class of all bounded linear operators which lead to ill-posed operator equations. For compact linear operators, there is a simple characterization in terms of the decay rates of the singular values. In the context of the validity of the spectral theorem the partial ordering can also be understood. We highlight that range inclusions yield partial ordering, and we discuss cases when compositions of compact and non-compact operators occur. Several examples complement the theoretical results.
△ Less
Submitted 23 January, 2025; v1 submitted 23 October, 2024;
originally announced October 2024.
-
A unified concept of the degree of ill-posedness for compact and non-compact linear operator equations in Hilbert spaces under the auspices of the spectral theorem
Authors:
Frank Werner,
Bernd Hofmann
Abstract:
Covering ill-posed problems with compact and non-compact operators regarding the degree of ill-posedness is a never ending story written by many authors in the inverse problems literature. This paper tries to add a new narrative and some new facets with respect to this story under the auspices of the spectral theorem. The latter states that any self-adjoint and bounded operator is unitarily equiva…
▽ More
Covering ill-posed problems with compact and non-compact operators regarding the degree of ill-posedness is a never ending story written by many authors in the inverse problems literature. This paper tries to add a new narrative and some new facets with respect to this story under the auspices of the spectral theorem. The latter states that any self-adjoint and bounded operator is unitarily equivalent to a multiplication operator on some (semi-finite) measure space. We will exploit this fact and derive a distribution function from the corresponding multiplier, the growth behavior of which at zero allows us to characterize the degree of ill-posedness. We prove that this new concept coincides with the well-known one for compact operators (by means of their singular values), and illustrate the implications along examples including the Hausdorff moment operator and convolutions.
△ Less
Submitted 26 November, 2024; v1 submitted 2 August, 2024;
originally announced August 2024.
-
Curious ill-posedness phenomena in the composition of non-compact linear operators in Hilbert spaces
Authors:
Stefan Kindermann,
Bernd Hofmann
Abstract:
We consider the composition of operators with non-closed range in Hilbert spaces and how the nature of ill-posedness is affected by their composition. Specifically, we study the \mbox{Hausdorff-,} Cesàro-, integration operator, and their adjoints, as well as some combinations of those. For the composition of the Hausdorff- and the Cesàro-operator, we give estimates of the decay of the correspondin…
▽ More
We consider the composition of operators with non-closed range in Hilbert spaces and how the nature of ill-posedness is affected by their composition. Specifically, we study the \mbox{Hausdorff-,} Cesàro-, integration operator, and their adjoints, as well as some combinations of those. For the composition of the Hausdorff- and the Cesàro-operator, we give estimates of the decay of the corresponding singular values. As a curiosity, this provides also an example of two practically relevant non-compact operators, for which their composition is compact. Furthermore, we characterize those operators for which a composition with a non-compact operator gives a compact one.
△ Less
Submitted 16 May, 2024; v1 submitted 26 January, 2024;
originally announced January 2024.
-
The degree of ill-posedness for some composition governed by the Cesaro operator
Authors:
Yu Deng,
Hans-Jürgen Fischer,
Bernd Hofmann
Abstract:
In this article, we consider the singular value asymptotics of compositions of compact linear operators mapping in the real Hilbert space of quadratically integrable functions over the unit interval. Specifically, the composition is given by the compact simple integration operator followed by the non-compact Ces`aro operator possessing a non-closed range. We show that the degree of ill-posedness o…
▽ More
In this article, we consider the singular value asymptotics of compositions of compact linear operators mapping in the real Hilbert space of quadratically integrable functions over the unit interval. Specifically, the composition is given by the compact simple integration operator followed by the non-compact Ces`aro operator possessing a non-closed range. We show that the degree of ill-posedness of that composition is two, which means that the Ces`aro operator increases the degree of illposedness by the amount of one compared to the simple integration operator.
△ Less
Submitted 21 January, 2024;
originally announced January 2024.
-
Tractability of linear ill-posed problems in Hilbert space
Authors:
Peter Mathé,
Bernd Hofmann
Abstract:
We introduce a notion of tractability for ill-posed operator equations in Hilbert space. For such operator equations the asymptotics of the best possible rate of reconstruction in terms of the underlying noise level is known in many cases. However, the relevant question is, which level of discretization, again driven by the noise level, is required in order to achieve this best possible accuracy.…
▽ More
We introduce a notion of tractability for ill-posed operator equations in Hilbert space. For such operator equations the asymptotics of the best possible rate of reconstruction in terms of the underlying noise level is known in many cases. However, the relevant question is, which level of discretization, again driven by the noise level, is required in order to achieve this best possible accuracy. The proposed concept adapts the one from Information-based Complexity.
Several examples indicate the relevance of this concept in the light of the curse of dimensionality.
△ Less
Submitted 6 May, 2024; v1 submitted 18 January, 2024;
originally announced January 2024.
-
New results for variational regularization with oversmoothing penalty term in Banach spaces
Authors:
Bernd Hofmann,
Chantal Klinkhammer,
Robert Plato
Abstract:
In this article on variational regularization for ill-posed nonlinear problems, we are once again discussing the consequences of an oversmoothing penalty term. This means in our model that the searched-for solution of the considered nonlinear operator equation does not belong to the domain of definition of the penalty functional. In the past years, such variational regularization has been investig…
▽ More
In this article on variational regularization for ill-posed nonlinear problems, we are once again discussing the consequences of an oversmoothing penalty term. This means in our model that the searched-for solution of the considered nonlinear operator equation does not belong to the domain of definition of the penalty functional. In the past years, such variational regularization has been investigated comprehensively in Hilbert scales, but rarely in a Banach space setting. Our present results try to establish a theoretical justification of oversmoothing regularization in Banach scales. This new study includes convergence rates results for a priori and a posteriori choices of the regularization parameter, both for Hölder-type smoothness and low order-type smoothness. An illustrative example is intended to indicate the specificity of occurring non-reflexive Banach spaces.
△ Less
Submitted 29 April, 2023;
originally announced May 2023.
-
A note on the degree of ill-posedness for mixed differentiation on the d-dimensional unit cube
Authors:
Bernd Hofmann,
Hans-Jürgen Fischer,
Robert Plato
Abstract:
Numerical differentiation of a function, contaminated with noise, over the unit interval $[0,1] \subset \mathbb{R}$ by inverting the simple integration operator $J:L^2([0,1]) \to L^2([0,1])$ defined as $[Jx](s):=\int_0^s x(t) dt$ is discussed extensively in the literature. The complete singular system of the compact operator $J$ is explicitly given with singular values $σ_n(J)$ asymptotically prop…
▽ More
Numerical differentiation of a function, contaminated with noise, over the unit interval $[0,1] \subset \mathbb{R}$ by inverting the simple integration operator $J:L^2([0,1]) \to L^2([0,1])$ defined as $[Jx](s):=\int_0^s x(t) dt$ is discussed extensively in the literature. The complete singular system of the compact operator $J$ is explicitly given with singular values $σ_n(J)$ asymptotically proportional to $1/n$, which indicates a degree {\sl one} of ill-posedness for this inverse problem. We recall the concept of the degree of ill-posedness for linear operator equations with compact forward operators in Hilbert spaces. In contrast to the one-dimensional case with operator $J$, there is little material available about the analysis of the d-dimensional case, where the compact integral operator $J_d:L^2([0,1]^d) \to L^2([0,1]^d)$ defined as $[J_d\,x](s_1,\ldots,s_d):=\int_0^{s_1}\ldots\int_0^{s_d} x(t_1,\ldots,t_d)\, dt_d\ldots dt_1$ over unit $d$-cube is to be inverted. This inverse problem of mixed differentiation $x(s_1,\ldots,s_d)=\frac{\partial^d}{\partial s_1 \ldots \partial s_d} y(s_1,\ldots ,s_d)$ is of practical interest, for example when in statistics copula densities have to be verified from empirical copulas over $[0,1]^d \subset \mathbb{R}^d$. In this note, we prove that the non-increasingly ordered singular values $σ_n(J_d)$ of the operator $J_d$ have an asymptotics of the form $\frac{(\log n)^{d-1}}{n}$, which shows that the degree of ill-posedness stays at one, even though an additional logarithmic factor occurs. Some more discussion refers to the special case $d=2$ for characterizing the range $\mathcal{R}(J_2)$ of the operator $J_2$.
△ Less
Submitted 23 May, 2023; v1 submitted 25 March, 2023;
originally announced March 2023.
-
Newton's methods for solving linear inverse problems with neural network coders
Authors:
Otmar Scherzer,
Bernd Hofmann,
Zuhair Nashed
Abstract:
Neural networks functions are supposed to be able to encode the desired solution of an inverse problem very efficiently. In this paper, we consider the problem of solving linear inverse problems with neural network coders. First we establish some correspondences of this formulation with existing concepts in regularization theory, in particular with state space regularization, operator decompositio…
▽ More
Neural networks functions are supposed to be able to encode the desired solution of an inverse problem very efficiently. In this paper, we consider the problem of solving linear inverse problems with neural network coders. First we establish some correspondences of this formulation with existing concepts in regularization theory, in particular with state space regularization, operator decomposition and iterative regularization methods. A Gauss-Newton's method is suitable for solving encoded linear inverse problems, which is supported by a local convergence result. The convergence studies, however, are not complete, and are based on a conjecture on linear independence of activation functions and its derivatives.
△ Less
Submitted 24 March, 2023;
originally announced March 2023.
-
On uniqueness and ill-posedness for the deautoconvolution problem in the multi-dimensional case
Authors:
Bernd Hofmann,
Frank Werner,
Yu Deng
Abstract:
This paper analyzes the inverse problem of deautoconvolution in the multi-dimensional case with respect to solution uniqueness and ill-posedness. Deautoconvolution means here the reconstruction of a real-valued $L^2$-function with support in the $n$-dimensional unit cube $[0,1]^n$ from observations of its autoconvolution either in the full data case (i.e. on $[0,2]^n$) or in the limited data case…
▽ More
This paper analyzes the inverse problem of deautoconvolution in the multi-dimensional case with respect to solution uniqueness and ill-posedness. Deautoconvolution means here the reconstruction of a real-valued $L^2$-function with support in the $n$-dimensional unit cube $[0,1]^n$ from observations of its autoconvolution either in the full data case (i.e. on $[0,2]^n$) or in the limited data case (i.e. on $[0,1]^n$). Based on multi-dimensional variants of the Titchmarsh convolution theorem due to Lions and Mikusiński, we prove in the full data case a twofoldness assertion, and in the limited data case uniqueness of non-negative solutions for which the origin belongs to the support. The latter assumption is also shown to be necessary for any uniqueness statement in the limited data case. A glimpse of rate results for regularized solutions completes the paper.
△ Less
Submitted 13 December, 2022;
originally announced December 2022.
-
Deautoconvolution in the two-dimensional case
Authors:
Yu Deng,
Bernd Hofmann,
Frank Werner
Abstract:
There is extensive mathematical literature on the inverse problem of deautoconvolution for a function with support in the unit interval $[0,1] \subset \mathbb R$, but little is known about the multidimensional situation. This article tries to fill this gap with analytical and numerical studies on the reconstruction of a real function of two real variables over the unit square from observations of…
▽ More
There is extensive mathematical literature on the inverse problem of deautoconvolution for a function with support in the unit interval $[0,1] \subset \mathbb R$, but little is known about the multidimensional situation. This article tries to fill this gap with analytical and numerical studies on the reconstruction of a real function of two real variables over the unit square from observations of its autoconvolution on $[0,2]^2 \subset \mathbb R^2$ (full data case) or on $[0,1]^2$ (limited data case). In an $L^2$-setting, twofoldness and uniqueness assertions are proven for the deautoconvolution problem in 2D. Moreover, its ill-posedness is characterized and illustrated. Extensive numerical case studies give an overview of the behaviour of stable approximate solutions to the two-dimensional deautoconvolution problem obtained by Tikhonov-type regularization with different penalties and the iteratively regularized Gauss-Newton method.
△ Less
Submitted 25 October, 2022;
originally announced October 2022.
-
Open questions asked to analysis and numerics concerning the Hausdorff moment problem
Authors:
Daniel Gerth,
Bernd Hofmann
Abstract:
We address facts and open questions concerning the degree of ill-posedness of the composite Hausdorff moment problem aimed at the recovery of a function $x \in L^2(0,1)$ from elements of the infinite dimensional sequence space $\ell^2$ that characterize moments applied to the antiderivative of $x$. This degree, unknown by now, results from the decay rate of the singular values of the associated co…
▽ More
We address facts and open questions concerning the degree of ill-posedness of the composite Hausdorff moment problem aimed at the recovery of a function $x \in L^2(0,1)$ from elements of the infinite dimensional sequence space $\ell^2$ that characterize moments applied to the antiderivative of $x$. This degree, unknown by now, results from the decay rate of the singular values of the associated compact forward operator $A$, which is the composition of the compact simple integration operator mapping in $L^2(0,1)$ and the non-compact Hausdorff moment operator $B^{(H)}$ mapping from $L^2(0,1)$ to $\ell^2$. There is a seeming contradiction between (a) numerical computations, which show (even for large $n$) an exponential decay of the singular values for $n$-dimensional matrices obtained by discretizing the operator $A$, and \linebreak (b) a strongly limited smoothness of the well-known kernel $k$ of the Hilbert-Schmidt operator $A^*A$. Fact (a) suggests severe ill-posedness of the infinite dimensional Hausdorff moment problem, whereas fact (b) lets us expect the opposite, because exponential ill-posedness occurs in common just for $C^\infty$-kernels $k$. We recall arguments for the possible occurrence of a polynomial decay of the singular values of $A$, even if the numerics seems to be against it, and discuss some issues in the numerical approximation of non-compact operators.
△ Less
Submitted 8 June, 2022;
originally announced June 2022.
-
Variational regularization with oversmoothing penalty term in Banach spaces
Authors:
Robert Plato,
Bernd Hofmann
Abstract:
In the present work, we discuss variational regularization for ill-posed nonlinear problems with focus on an oversmoothing penalty term. This means in our model that the searched-for solution of the considered nonlinear operator equation does not belong to the domain of definition of the penalty functional. In the past years, such variational regularization has been investigated comprehensively in…
▽ More
In the present work, we discuss variational regularization for ill-posed nonlinear problems with focus on an oversmoothing penalty term. This means in our model that the searched-for solution of the considered nonlinear operator equation does not belong to the domain of definition of the penalty functional. In the past years, such variational regularization has been investigated comprehensively in Hilbert scales. Our present study tries to continue and to extend those investigations to Banach scales. This new study includes convergence rates results for a priori choices of the regularization parameter, both for Hölder-type smoothness and low order-type smoothness. The necessary tools for low order smoothness in the Banach space setting are provided.
△ Less
Submitted 1 November, 2022; v1 submitted 4 June, 2022;
originally announced June 2022.
-
The degree of ill-posedness of composite linear ill-posed problems with focus on the impact of the non-compact Hausdorff moment operator
Authors:
Bernd Hofmann,
Peter Mathé
Abstract:
We consider compact composite linear operators in Hilbert space, where the composition is given by some compact operator followed by some non-compact one possessing a non-closed range.
Focus is on the impact of the non-compact factor on the overall behaviour of the decay rates of the singular values of the composition. Specifically, the composition of the compact integration operator with the no…
▽ More
We consider compact composite linear operators in Hilbert space, where the composition is given by some compact operator followed by some non-compact one possessing a non-closed range.
Focus is on the impact of the non-compact factor on the overall behaviour of the decay rates of the singular values of the composition. Specifically, the composition of the compact integration operator with the non-compact Hausdorff moment operator is considered. We show that the singular values of the composition decay faster than the ones of the integration operator, providing a first example of this kind. However, there is a gap between available lower bounds for the decay rate and the obtained result. Therefore we conclude with a discussion.
△ Less
Submitted 13 December, 2021; v1 submitted 1 November, 2021;
originally announced November 2021.
-
The Hausdorff Moment Problem in the light of ill-posedness of type I
Authors:
Daniel Gerth,
Bernd Hofmann,
Christopher Hofmann,
Stefan Kindermann
Abstract:
The Hausdorf moment problem (HMP) over the unit interval in an $L^2$-setting is a classical example of an ill-posed inverse problem. Since various applications can be rewritten in terms of the HMP, it has gathered significant attention in the literature. From the point of view of regularization it is of special interest because of the occurrence of a non-compact forward operator with non-closed ra…
▽ More
The Hausdorf moment problem (HMP) over the unit interval in an $L^2$-setting is a classical example of an ill-posed inverse problem. Since various applications can be rewritten in terms of the HMP, it has gathered significant attention in the literature. From the point of view of regularization it is of special interest because of the occurrence of a non-compact forward operator with non-closed range. Consequently, HMP constitutes one of few examples of a linear ill-posed problem of type~I in the sense of Nashed. In this paper we highlight this property and its consequences, for example, the existence of a infinite-dimensional subspace of stability. On the other hand, we show conditional stability estimates for the HMP in Sobolev spaces that indicate severe ill-posedness for the full recovery of a function from its moments, because Hölder-type stability can be excluded. However, the associated recovery %of the linear functional that characterizes of the function value at the rightmost point of the unit interval is stable of Hölder-type in an $H^1$-setting. We moreover discuss stability estimates for the truncated HMP, where the forward operator becomes compact. Some numerical case studies illustrate the theoretical results and complete the paper.
△ Less
Submitted 19 May, 2021; v1 submitted 13 April, 2021;
originally announced April 2021.
-
Nonlinear Tikhonov regularization in Hilbert scales with oversmoothing penalty: inspecting balancing principles
Authors:
Bernd Hofmann,
Christopher Hofmann,
Peter Mathé,
Robert Plato
Abstract:
The analysis of Tikhonov regularization for nonlinear ill-posed equations with smoothness promoting penalties is an important topic in inverse problem theory. With focus on Hilbert scale models, the case of oversmoothing penalties, i.e., when the penalty takes an infinite value at the true solution gained increasing interest. The considered nonlinearity structure is as in the study B. Hofmann and…
▽ More
The analysis of Tikhonov regularization for nonlinear ill-posed equations with smoothness promoting penalties is an important topic in inverse problem theory. With focus on Hilbert scale models, the case of oversmoothing penalties, i.e., when the penalty takes an infinite value at the true solution gained increasing interest. The considered nonlinearity structure is as in the study B. Hofmann and P. Mathé. Tikhonov regularization with oversmoothing penalty for non-linear ill-posed problems in Hilbert scales. Inverse Problems, 2018. Such analysis can address two fundamental questions. When is it possible to achieve order optimal reconstruction? How to select the regularization parameter? The present study complements previous ones by two main facets. First, an error decomposition into a smoothness dependent and a (smoothness independent) noise propagation term is derived, covering a large range of smoothness conditions. Secondly, parameter selection by balancing principles is presented. A detailed discussion, covering some history and variations of the parameter choice by balancing shows under which conditions such balancing principles yield order optimal reconstruction. A numerical case study, based on some exponential growth model, provides additional insights.
△ Less
Submitted 21 December, 2020;
originally announced December 2020.
-
Oversmoothing Tikhonov regularization in Banach spaces
Authors:
De-Han Chen,
Bernd Hofmann,
Irwin Yousept
Abstract:
This paper develops a Tikhonov regularization theory for nonlinear ill-posed operator equations in Banach spaces. As the main challenge, we consider the so-called oversmoothing state in the sense that the Tikhonov penalization is not able to capture the true solution regularity and leads to the infinite penalty value in the solution. We establish a vast extension of the Hilbertian convergence theo…
▽ More
This paper develops a Tikhonov regularization theory for nonlinear ill-posed operator equations in Banach spaces. As the main challenge, we consider the so-called oversmoothing state in the sense that the Tikhonov penalization is not able to capture the true solution regularity and leads to the infinite penalty value in the solution. We establish a vast extension of the Hilbertian convergence theory through the use of invertible sectorial operators from the holomorphic functional calculus and the prominent theory of interpolation scales in Banach spaces. Applications of the proposed theory involving $\ell^1$, Bessel potential spaces, and Besov spaces are discussed.
△ Less
Submitted 20 December, 2020; v1 submitted 17 August, 2020;
originally announced August 2020.
-
Two new non-negativity preserving iterative regularization methods for ill-posed inverse problems
Authors:
Ye Zhang,
Bernd Hofmann
Abstract:
Many inverse problems are concerned with the estimation of non-negative parameter functions. In this paper, in order to obtain non-negative stable approximate solutions to ill-posed linear operator equations in a Hilbert space setting, we develop two novel non-negativity preserving iterative regularization methods. They are based on fixed point iterations in combination with preconditioning ideas.…
▽ More
Many inverse problems are concerned with the estimation of non-negative parameter functions. In this paper, in order to obtain non-negative stable approximate solutions to ill-posed linear operator equations in a Hilbert space setting, we develop two novel non-negativity preserving iterative regularization methods. They are based on fixed point iterations in combination with preconditioning ideas. In contrast to the projected Landweber iteration, for which only weak convergence can be shown for the regularized solution when the noise level tends to zero, the introduced regularization methods exhibit strong convergence. There are presented convergence results, even for a combination of noisy right-hand side and imperfect forward operators, and for one of the approaches there are also convergence rates results. Specifically adapted discrepancy principles are used as a posteriori stopping rules of the established iterative regularization algorithms. For an application of the suggested new approaches, we consider a biosensor problem, which is modelled as a two dimensional linear Fredholm integral equation of the first kind. Several numerical examples, as well as a comparison with the projected Landweber method, are presented to show the accuracy and the acceleration effect of the novel methods. Case studies of a real data problem indicate that the developed methods can produce meaningful featured regularized solutions.
△ Less
Submitted 19 February, 2020; v1 submitted 11 February, 2020;
originally announced February 2020.
-
Convergence results and low order rates for nonlinear Tikhonov regularization with oversmoothing penalty term
Authors:
Bernd Hofmann,
Robert Plato
Abstract:
For the Tikhonov regularization of ill-posed nonlinear operator equations, convergence is studied in a Hilbert scale setting. We include the case of oversmoothing penalty terms, which means that the exact solution does not belong to the domain of definition of the considered penalty functional. In this case, we try to close a gap in the present theory, where Hölder-type convergence rates results h…
▽ More
For the Tikhonov regularization of ill-posed nonlinear operator equations, convergence is studied in a Hilbert scale setting. We include the case of oversmoothing penalty terms, which means that the exact solution does not belong to the domain of definition of the considered penalty functional. In this case, we try to close a gap in the present theory, where Hölder-type convergence rates results have been proven under corresponding source conditions, but assertions on norm convergence of regularized solutions without source conditions are completely missing. A result of the present work is to provide sufficient conditions for convergence under a priori and a posteriori regularization parameter choice strategies, without any additional smoothness assumption on the solution. The obtained error estimates moreover allow us to prove low order convergence rates under associated (for example logarithmic) source conditions. Some numerical illustrations are also given.
△ Less
Submitted 31 January, 2020; v1 submitted 2 November, 2019;
originally announced November 2019.
-
Regularization of linear ill-posed problems involving multiplication operators
Authors:
Peter Mathé,
M. Thamban Nair,
Bernd Hofmann
Abstract:
We study regularization of ill-posed equations involving multiplication operators when the multiplier function is positive almost everywhere and zero is an accumulation point of the range of this function. Such equations naturally arise from equations based on non-compact self-adjoint operators in Hilbert space, after applying unitary transformations arising out of the spectral theorem. For classi…
▽ More
We study regularization of ill-posed equations involving multiplication operators when the multiplier function is positive almost everywhere and zero is an accumulation point of the range of this function. Such equations naturally arise from equations based on non-compact self-adjoint operators in Hilbert space, after applying unitary transformations arising out of the spectral theorem. For classical regularization theory, when noisy observations are given and the noise is deterministic and bounded, then non-compactness of the ill-posed equations is a minor issue. However, for statistical ill-posed equations with non-compact operators less is known if the data are blurred by white noise. We develop a regularization theory with emphasis on this case. In this context, we highlight several aspects, in particular we discuss the intrinsic degree of ill-posedness in terms of rearrangements of the multiplier function. Moreover, we address the required modifications of classical regularization schemes in order to be used for non-compact statistical problems, and we also introduce the concept of the effective ill-posedness of the operator equation under white noise. This study is concluded with prototypical examples for such equations, as these are deconvolution equations and certain final value problems in evolution equations.
△ Less
Submitted 16 August, 2019;
originally announced August 2019.
-
Case studies and a pitfall for nonlinear variational regularization under conditional stability
Authors:
Daniel Gerth,
Bernd Hofmann,
Christopher Hofmann
Abstract:
Conditional stability estimates are a popular tool for the regularization of ill-posed problems. A drawback in particular under nonlinear operators is that additional regularization is needed for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this paper we consider Tikhonov regularization under conditional stability estimates for nonlinear…
▽ More
Conditional stability estimates are a popular tool for the regularization of ill-posed problems. A drawback in particular under nonlinear operators is that additional regularization is needed for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this paper we consider Tikhonov regularization under conditional stability estimates for nonlinear ill-posed operator equations in Hilbert scales. We summarize assertions on convergence and convergence rate in three cases describing the relative smoothness of the penalty in the Tikhonov functional and of the exact solution. For oversmoothing penalties, for which the rue solution no longer attains a finite value, we present a result with modified assumptions for a priori choices of the regularization parameter yielding convergence rates of optimal order for noisy data. We strongly highlight the local character of the conditional stability estimate and demonstrate that pitfalls may occur through incorrect stability estimates. Then convergence can completely fail and the stabilizing effect of conditional stability may be lost. Comprehensive numerical case studies for some nonlinear examples illustrate such effects.
△ Less
Submitted 28 May, 2019;
originally announced May 2019.
-
Convergence Analysis of (Statistical) Inverse Problems under Conditional Stability Estimates
Authors:
Frank Werner,
Bernd Hofmann
Abstract:
Conditional stability estimates require additional regularization for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this context, we consider ill-posed nonlinear inverse problems in Hilbert scales satisfying conditional stability estimates characterized by general concave index functions. For that case, we exploit Tikhonov regularization…
▽ More
Conditional stability estimates require additional regularization for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this context, we consider ill-posed nonlinear inverse problems in Hilbert scales satisfying conditional stability estimates characterized by general concave index functions. For that case, we exploit Tikhonov regularization and provide convergence and convergence rates of regularized solutions for both deterministic and stochastic noise. We further discuss a priori and a posteriori parameter choice rules and illustrate the validity of our assumptions in different model and real world situations.
△ Less
Submitted 29 August, 2019; v1 submitted 23 May, 2019;
originally announced May 2019.
-
A priori parameter choice in Tikhonov regularization with oversmoothing penalty for non-linear ill-posed problems
Authors:
Bernd Hofmann,
Peter Mathé
Abstract:
We study Tikhonov regularization for certain classes of non-linear ill-posed operator equations in Hilbert space. Emphasis is on the case where the solution smoothness fails to have a finite penalty value, as in the preceding study 'Tikhonov regularization with oversmoothing penalty for non-linear ill-posed problems in Hilbert scales'. Inverse Problems 34(1), 2018, by the same authors. Optimal ord…
▽ More
We study Tikhonov regularization for certain classes of non-linear ill-posed operator equations in Hilbert space. Emphasis is on the case where the solution smoothness fails to have a finite penalty value, as in the preceding study 'Tikhonov regularization with oversmoothing penalty for non-linear ill-posed problems in Hilbert scales'. Inverse Problems 34(1), 2018, by the same authors. Optimal order convergence rates are established for the specific a priori parameter choice, as used for the corresponding linear equations.
△ Less
Submitted 3 April, 2019;
originally announced April 2019.
-
A new class of accelerated regularization methods, with application to bioluminescence tomography
Authors:
Rongfang Gong,
B. Hofmann,
Ye Zhang
Abstract:
In this paper we propose a new class of iterative regularization methods for solving ill-posed linear operator equations. The prototype of these iterative regularization methods is in the form of second order evolution equation with a linear vanishing damping term, which can be viewed not only as an extension of the asymptotical regularization, but also as a continuous analog of the Nesterov's acc…
▽ More
In this paper we propose a new class of iterative regularization methods for solving ill-posed linear operator equations. The prototype of these iterative regularization methods is in the form of second order evolution equation with a linear vanishing damping term, which can be viewed not only as an extension of the asymptotical regularization, but also as a continuous analog of the Nesterov's acceleration scheme. New iterative regularization methods are derived from this continuous model in combination with damped symplectic numerical schemes. The regularization property as well as convergence rates and acceleration effects under the Hölder-type source conditions of both continuous and discretized methods are proven.
The second part of this paper is concerned with the application of the newly developed accelerated iterative regularization methods to the diffusion-based bioluminescence tomography, which is modeled as an inverse source problem in elliptic partial differential equations with both Dirichlet and Neumann boundary data. A relaxed mathematical formulation is proposed so that the discrepancy principle can be applied to the iterative scheme without the usage of Sobolev embedding constants. Several numerical examples, as well as a comparison with the state-of-the-art methods, are given to show the accuracy and the acceleration effect of the new methods.
△ Less
Submitted 25 March, 2020; v1 submitted 14 March, 2019;
originally announced March 2019.
-
On fractional asymptotical regularization of linear ill-posed problems in Hilbert spaces
Authors:
Ye Zhang,
Bernd Hofmann
Abstract:
In this paper, we study a fractional-order variant of the asymptotical regularization method, called {\it Fractional Asymptotical Regularization (FAR)}, for solving linear ill-posed operator equations in a Hilbert space setting. We assign the method to the general linear regularization schema and prove that under certain smoothness assumptions, FAR with fractional order in the range $(1,2)$ yields…
▽ More
In this paper, we study a fractional-order variant of the asymptotical regularization method, called {\it Fractional Asymptotical Regularization (FAR)}, for solving linear ill-posed operator equations in a Hilbert space setting. We assign the method to the general linear regularization schema and prove that under certain smoothness assumptions, FAR with fractional order in the range $(1,2)$ yields an acceleration with respect to comparable order optimal regularization methods. Based on the one-step Adams-Moulton method, a novel iterative regularization scheme is developed for the numerical realization of FAR. Two numerical examples are given to show the accuracy and the acceleration effect of FAR.
△ Less
Submitted 14 July, 2019; v1 submitted 23 December, 2018;
originally announced December 2018.
-
On the singular value decomposition of n-fold integration operators
Authors:
Ronny Ramlau,
Christoph Koutschan,
Bernd Hofmann
Abstract:
In theory and practice of inverse problems, linear operator equations $Tx=y$ with compact linear forward operators $T$ having a non-closed range $\mathcal{R}(T)$ and mapping between infinite dimensional Hilbert spaces plays some prominent role. As a consequence of the ill-posedness of such problems, regularization approaches are required, and due to its unlimited qualification spectral cut-off is…
▽ More
In theory and practice of inverse problems, linear operator equations $Tx=y$ with compact linear forward operators $T$ having a non-closed range $\mathcal{R}(T)$ and mapping between infinite dimensional Hilbert spaces plays some prominent role. As a consequence of the ill-posedness of such problems, regularization approaches are required, and due to its unlimited qualification spectral cut-off is an appropriate method for the stable approximate solution of corresponding inverse problems. For this method, however, the singular system $\{σ_i(T),u_i(T),v_i(T)\}_{i=1}^\infty$ of the compact operator $T$ is needed, at least for $i=1,2,...,N$, up to some stopping index $N$. In this note we consider $n$-fold integration operators $T=J^n\;(n=1,2,...)$ in $L^2([0,1])$ occurring in numerous applications, where the solution of the associated operator equation is characterized by the $n$-th generalized derivative $x=y^{(n)}$ of the Sobolev space function $y \in H^n([0,1])$. Almost all textbooks on linear inverse problems present the whole singular system $\{σ_i(J^1),u_i(J^1),v_i(J^1)\}_{i=1}^\infty$ in an explicit manner. However, they do not discuss the singular systems for $J^n,\;n \ge 2$. We will emphasize that this seems to be a consequence of the fact that for higher $n$ the eigenvalues $σ^2_i(J^n)$ of the associated ODE boundary value problems obey transcendental equations, the complexity of which is growing with $n$. We present the transcendental equations for $n=2,3,...$ and discuss and illustrate the associated eigenfunctions and some of their properties.
△ Less
Submitted 28 November, 2018;
originally announced November 2018.
-
Tikhonov regularization with l^0-term complementing a convex penalty: l^1 convergence under sparsity constraints
Authors:
Wei Wang,
Shuai Lu,
Bernd Hofmann,
Jin Cheng
Abstract:
Measuring the error by an l^1-norm, we analyze under sparsity assumptions an l^0-regularization approach, where the penalty in the Tikhonov functional is complemented by a general stabilizing convex functional. In this context, ill-posed operator equations Ax = y with an injective and bounded linear operator A mapping between l^2 and a Banach space Y are regularized. For sparse solutions, error es…
▽ More
Measuring the error by an l^1-norm, we analyze under sparsity assumptions an l^0-regularization approach, where the penalty in the Tikhonov functional is complemented by a general stabilizing convex functional. In this context, ill-posed operator equations Ax = y with an injective and bounded linear operator A mapping between l^2 and a Banach space Y are regularized. For sparse solutions, error estimates as well as linear and sublinear convergence rates are derived based on a variational inequality approach, where the regularization parameter can be chosen either a priori in an appropriate way or a posteriori by the sequential discrepancy principle. To further illustrate the balance between the l^0-term and the complementing convex penalty, the important special case of the l^2-norm square penalty is investigated showing explicit dependence between both terms. Finally, some numerical experiments verify and illustrate the sparsity promoting properties of corresponding regularized solutions.
△ Less
Submitted 20 October, 2018;
originally announced October 2018.
-
Tikhonov regularization in Hilbert scales under conditional stability assumptions
Authors:
Herbert Egger,
Bernd Hofmann
Abstract:
Conditional stability estimates allow us to characterize the degree of ill-posedness of many inverse problems, but without further assumptions they are not sufficient for the stable solution in the presence of data perturbations. We here consider the stable solution of nonlinear inverse problems satisfying a conditional stability estimate by Tikhonov regularization in Hilbert scales. Order optimal…
▽ More
Conditional stability estimates allow us to characterize the degree of ill-posedness of many inverse problems, but without further assumptions they are not sufficient for the stable solution in the presence of data perturbations. We here consider the stable solution of nonlinear inverse problems satisfying a conditional stability estimate by Tikhonov regularization in Hilbert scales. Order optimal convergence rates are established for a-priori and a-posteriori parameter choice strategies. The role of a hidden source condition is investigated and the relation to previous results for regularization in Hilbert scales is elaborated. The applicability of the results is discussed for some model problems, and the theoretical results are illustrated by numerical tests.
△ Less
Submitted 16 July, 2018;
originally announced July 2018.
-
Convergence rates of a penalized variational inequality method for nonlinear monotone ill-posed equations in Hilbert spaces
Authors:
Robert Plato,
Bernd Hofmann
Abstract:
We consider perturbed nonlinear ill-posed equations in Hilbert spaces, with operators that are monotone on a given closed convex subset. A simple stable approach is Lavrentiev regularization, but existence of solutions of the regularized equation on the given subset can be guaranteed only under additional assumptions that are not satisfied in some applications.
Lavrentiev regularization of the r…
▽ More
We consider perturbed nonlinear ill-posed equations in Hilbert spaces, with operators that are monotone on a given closed convex subset. A simple stable approach is Lavrentiev regularization, but existence of solutions of the regularized equation on the given subset can be guaranteed only under additional assumptions that are not satisfied in some applications.
Lavrentiev regularization of the related variational inequality seems to be a reasonable alternative then. For the latter approach, in this paper we present new error estimates for suitable a priori parameter choices, if the considered operator is cocoercive and if in addition the solution admits an adjoint source representation. Some numerical experiments are included.
△ Less
Submitted 3 June, 2018;
originally announced June 2018.
-
Penalty-based smoothness conditions in convex variational regularization
Authors:
Bernd Hofmann,
Stefan Kindermann,
Peter Mathé
Abstract:
The authors study Tikhonov regularization of linear ill-posed problems with a general convex penalty defined on a Banach space. It is well known that the error analysis requires smoothness assumptions. Here such assumptions are given in form of inequalities involving only the family of noise-free minimizers along the regularization parameter and the (unknown) penalty-minimizing solution. These ine…
▽ More
The authors study Tikhonov regularization of linear ill-posed problems with a general convex penalty defined on a Banach space. It is well known that the error analysis requires smoothness assumptions. Here such assumptions are given in form of inequalities involving only the family of noise-free minimizers along the regularization parameter and the (unknown) penalty-minimizing solution. These inequalities control, respectively, the defect of the penalty, or likewise, the defect of the whole Tikhonov functional. The main results provide error bounds for a Bregman distance, which split into two summands: the first smoothness-dependent term does not depend on the noise level, whereas the second term includes the noise level. This resembles the situation of standard quadratic Tikhonov regularization Hilbert spaces. It is shown that variational inequalities, as these were studied recently, imply the validity of the assumptions made here. Several examples highlight the results in specific applications.
△ Less
Submitted 3 May, 2018;
originally announced May 2018.
-
On the second order asymptotical regularization of linear ill-posed inverse problems
Authors:
Ye Zhang,
Bernd Hofmann
Abstract:
In this paper, we establish an initial theory regarding the Second Order Asymptotical Regularization (SOAR) method for the stable approximate solution of ill-posed linear operator equations in Hilbert spaces, which are models for linear inverse problems with applications in the natural sciences, imaging and engineering. We show the regularizing properties of the new method, as well as the correspo…
▽ More
In this paper, we establish an initial theory regarding the Second Order Asymptotical Regularization (SOAR) method for the stable approximate solution of ill-posed linear operator equations in Hilbert spaces, which are models for linear inverse problems with applications in the natural sciences, imaging and engineering. We show the regularizing properties of the new method, as well as the corresponding convergence rates. We prove that, under the appropriate source conditions and by using Morozov's conventional discrepancy principle, SOAR exhibits the same power-type convergence rate as the classical version of asymptotical regularization (Showalter's method). Moreover, we propose a new total energy discrepancy principle for choosing the terminating time of the dynamical solution from SOAR, which corresponds to the unique root of a monotonically non-increasing function and allows us to also show an order optimal convergence rate for SOAR. A damped symplectic iterative regularizing algorithm is developed for the realization of SOAR. Several numerical examples are given to show the accuracy and the acceleration affect of the proposed method. A comparison with other state-of-the-art methods are provided as well.
△ Less
Submitted 27 August, 2018; v1 submitted 18 April, 2018;
originally announced April 2018.
-
On $\ell^1$-regularization under continuity of the forward operator in weaker topologies
Authors:
Daniel Gerth,
Bernd Hofmann
Abstract:
Our focus is on the stable approximate solution of linear operator equations based on noisy data by using $\ell^1$-regularization as a sparsity-enforcing version of Tikhonov regularization. We summarize recent results on situations where the sparsity of the solution slightly fails. In particular, we show how the recently established theory for weak*-to-weak continuous linear forward operators can…
▽ More
Our focus is on the stable approximate solution of linear operator equations based on noisy data by using $\ell^1$-regularization as a sparsity-enforcing version of Tikhonov regularization. We summarize recent results on situations where the sparsity of the solution slightly fails. In particular, we show how the recently established theory for weak*-to-weak continuous linear forward operators can be extended to the case of weak*-to-weak* continuity. This might be of interest when the image space is non-reflexive. We discuss existence, stability and convergence of regularized solutions. For injective operators, we will formulate convergence rates by exploiting variational source conditions. The typical rate function obtained under an ill-posed operator is strictly concave and the degree of failure of the solution sparsity has an impact on its behavior. Linear convergence rates just occur in the two borderline cases of proper sparsity, where the solutions belong to $\ell^0$, and of well-posedness. For an exemplary operator, we demonstrate that the technical properties used in our theory can be verified in practice. In the last section, we briefly mention the difficult case of oversmoothing regularization where $x^†$ does not belong to $\ell^1$.
△ Less
Submitted 23 November, 2017;
originally announced November 2017.
-
On ill-posedness concepts, stable solvability and saturation
Authors:
Bernd Hofmann,
Robert Plato
Abstract:
We consider different concepts of well-posedness and ill-posedness and their relations for solving nonlinear and linear operator equations in Hilbert spaces. First, the concepts of Hadamard and Nashed are recalled which are appropriate for linear operator equations. For nonlinear operator equations, stable respective unstable solvability is considered, and the properties of local well-posedness an…
▽ More
We consider different concepts of well-posedness and ill-posedness and their relations for solving nonlinear and linear operator equations in Hilbert spaces. First, the concepts of Hadamard and Nashed are recalled which are appropriate for linear operator equations. For nonlinear operator equations, stable respective unstable solvability is considered, and the properties of local well-posedness and ill-posedness are investigated. Those two concepts consider stability in image space and solution space, respectively, and both seem to be appropriate concepts for nonlinear operators which are not onto and/or not, locally or globally, injective. Several example situations for nonlinear problems are considered, including the prominent autoconvolution problems and other quadratic equations in Hilbert spaces.
It turns out that for linear operator equations, well-posedness and ill-posedness are global properties valid for all possible solutions, respectively. The special role of the nullspace is pointed out in this case.
Finally, non-injectivity also causes differences in the saturation behavior of Tikhonov and Lavrentiev regularization of linear ill-posed equations. This is examined at the end of this study.
△ Less
Submitted 4 September, 2017;
originally announced September 2017.
-
Tikhonov regularization with oversmoothing penalty for non-linear ill-posed problems in Hilbert scales
Authors:
Bernd Hofmann,
Peter Mathé
Abstract:
We study the Tikhonov regularization for ill-posed non-linear operator equations in Hilbert scales. Our focus is on the interplay between the smoothness-promoting properties of the penalty and the smoothness inherent in the solution. The objective is to study the situation when the unknown solution fails to have a finite penalty value, hence when the penalty is oversmoothing. By now this case was…
▽ More
We study the Tikhonov regularization for ill-posed non-linear operator equations in Hilbert scales. Our focus is on the interplay between the smoothness-promoting properties of the penalty and the smoothness inherent in the solution. The objective is to study the situation when the unknown solution fails to have a finite penalty value, hence when the penalty is oversmoothing. By now this case was only studied for linear operator equations in Hilbert scales. We extend those results to certain classes of non-linear problems. The main result asserts that under appropriate assumptions order optimal reconstruction is still possible. In an appendix we highlight that the non-linearity assumption underlying the present analysis is met for specific applications.
△ Less
Submitted 15 November, 2017; v1 submitted 9 May, 2017;
originally announced May 2017.
-
A regularization approach for an inverse source problem in elliptic systems from single Cauchy data
Authors:
Michael Hinze,
Bernd Hofmann,
Tran Nhan Tam Quyen
Abstract:
In this paper we investigate the problem of identifying the source term in an elliptic system from a single noisy measurement couple of the Neumann and Dirichlet data. A variational method of Tikhonov-type regularization with specific misfit term of Kohn-Vogelius-type and quadratic stabilizing penalty term is suggested to tackle this linear inverse problem. The method also appears as a variant of…
▽ More
In this paper we investigate the problem of identifying the source term in an elliptic system from a single noisy measurement couple of the Neumann and Dirichlet data. A variational method of Tikhonov-type regularization with specific misfit term of Kohn-Vogelius-type and quadratic stabilizing penalty term is suggested to tackle this linear inverse problem. The method also appears as a variant of the Lavrentiev regularization. For the occurring linear inverse problem in infinite dimensional Hilbert spaces, convergence and rate results can be found from the general theory of classical Tikhonov and Lavrentiev regularization. Using the variational discretization concept, where the PDE is discretized with piecewise linear and continuous finite elements, we show the convergence of finite element approximations to solutions of the identification problem. Moreover, we derive an error bound and corresponding convergence rates provided a suitable range-type source condition is satisfied. For the numerical solution we propose a conjugate gradient method. To illustrate the theoretical results, a numerical case study is presented which supports our analytical findings.
△ Less
Submitted 14 March, 2019; v1 submitted 28 March, 2017;
originally announced March 2017.
-
Conditional stability versus ill-posedness for operator equations with monotone operators in Hilbert space
Authors:
Radu Ioan Bot,
Bernd Hofmann
Abstract:
In the literature on singular perturbation (Lavrentiev regularization) for the stable approximate solution of operator equations with monotone operators in the Hilbert space the phenomena of conditional stability and local well-posedness and ill-posedness are rarely investigated. Our goal is to present some studies which try to bridge this gap. So we discuss the impact of conditional stability on…
▽ More
In the literature on singular perturbation (Lavrentiev regularization) for the stable approximate solution of operator equations with monotone operators in the Hilbert space the phenomena of conditional stability and local well-posedness and ill-posedness are rarely investigated. Our goal is to present some studies which try to bridge this gap. So we discuss the impact of conditional stability on error estimates and convergence rates for the Lavrentiev regularization and distinguish for linear problems well-posedness and ill-posedness in a specific manner motivated by a saturation result. The role of the regularization error in the noise-free case, called bias, is a crucial point in the paper for nonlinear and linear problems. In particular, for linear operator equations general convergence rates, including logarithmic rates, are derived by means of the method of approximate source conditions. This allows us to extend well-known convergence rates results for the Lavrentiev regularization that were based on general source conditions to the case of non-selfadjoint linear monotone forward operators for which general source conditions fail. Examples presenting the self-adjoint multiplication operator as well as the non-selfadjoint fractional integral operator and Cesàro operator illustrate the theoretical results. Extensions to the nonlinear case under specific conditions on the nonlinearity structure complete the paper.
△ Less
Submitted 19 July, 2016;
originally announced July 2016.
-
Elastic-net regularization versus $\ell^1$-regularization for linear inverse problems with quasi-sparse solutions
Authors:
De-Han Chen,
Bernd Hofmann,
Jun Zou
Abstract:
We consider the ill-posed operator equation $Ax=y$ with an injective and bounded linear operator $A$ mapping between $\ell^2$ and a Hilbert space $Y$, possessing the unique solution \linebreak $x^†=\{x^†_k\}_{k=1}^\infty$. For the cases that sparsity $x^†\in \ell^0$ is expected but often slightly violated in practice, we investigate in comparison with the $\ell^1$-regularization the elastic-net re…
▽ More
We consider the ill-posed operator equation $Ax=y$ with an injective and bounded linear operator $A$ mapping between $\ell^2$ and a Hilbert space $Y$, possessing the unique solution \linebreak $x^†=\{x^†_k\}_{k=1}^\infty$. For the cases that sparsity $x^†\in \ell^0$ is expected but often slightly violated in practice, we investigate in comparison with the $\ell^1$-regularization the elastic-net regularization, where the penalty is a weighted superposition of the $\ell^1$-norm and the $\ell^2$-norm square, under the assumption that $x^†\in \ell^1$. There occur two positive parameters in this approach, the weight parameter $η$ and the regularization parameter as the multiplier of the whole penalty in the Tikhonov functional, whereas only one regularization parameter arises in $\ell^1$-regularization. Based on the variational inequality approach for the description of the solution smoothness with respect to the forward operator $A$ and exploiting the method of approximate source conditions, we present some results to estimate the rate of convergence for the elastic-net regularization. The occurring rate function contains the rate of the decay $x^†_k \to 0$ for $k \to \infty$ and the classical smoothness properties of $x^†$ as an element in $\ell^2$.
△ Less
Submitted 8 November, 2016; v1 submitted 12 April, 2016;
originally announced April 2016.
-
Variational regularization of complex deautoconvolution and phase retrieval in ultrashort laser pulse characterization
Authors:
Stephan W. Anzengruber,
Steven Buerger,
Bernd Hofmann,
Guenter Steinmeyer
Abstract:
The SD-SPIDER method for the characterization of ultrashort laser pulses requires the solution of a nonlinear integral equation of autoconvolution type with a device-based kernel function. Taking into account the analytical background of a variational regularization approach for solving the corresponding ill-posed operator equation formulated in complex-valued $L^2$-spaces over finite real interva…
▽ More
The SD-SPIDER method for the characterization of ultrashort laser pulses requires the solution of a nonlinear integral equation of autoconvolution type with a device-based kernel function. Taking into account the analytical background of a variational regularization approach for solving the corresponding ill-posed operator equation formulated in complex-valued $L^2$-spaces over finite real intervals, we suggest and evaluate numerical procedures using NURBS and the TIGRA method for calculating the regularized solutions in a stable manner. In this context, besides the complex deautoconvolution problem with noisy but full data, a phase retrieval problem is introduced which adapts to the experimental state of the art in laser optics. For the treatment of this problem facet, which is formulated as a tensor product operator equation, we derive well-posedness of variational regularization methods. Case studies with synthetic and real optical data show the capability of the implemented approach as well as its limitation due to measurement deficits.
△ Less
Submitted 4 August, 2015;
originally announced August 2015.
-
Lavrentiev's regularization method in Hilbert spaces revisited
Authors:
Bernd Hofmann,
Barbara Kaltenbacher,
Elena Resmerita
Abstract:
In this paper, we deal with nonlinear ill-posed problems involving monotone operators and consider Lavrentiev's regularization method. This approach, in contrast to Tikhonov's regularization method, does not make use of the adjoint of the derivative. There are plenty of qualitative and quantitative convergence results in the literature, both in Hilbert and Banach spaces. Our aim here is mainly to…
▽ More
In this paper, we deal with nonlinear ill-posed problems involving monotone operators and consider Lavrentiev's regularization method. This approach, in contrast to Tikhonov's regularization method, does not make use of the adjoint of the derivative. There are plenty of qualitative and quantitative convergence results in the literature, both in Hilbert and Banach spaces. Our aim here is mainly to contribute to convergence rates results in Hilbert spaces based on some types of error estimates derived under various source conditions and to interpret them in some settings. In particular, we propose and investigate new variational source conditions adapted to these Lavrentiev-type techniques. Another focus of this paper is to exploit the concept of approximate source conditions.
△ Less
Submitted 19 April, 2016; v1 submitted 5 June, 2015;
originally announced June 2015.
-
A unified approach to convergence rates for $\ell^1$-regularization and lacking sparsity
Authors:
Jens Flemming,
Bernd Hofmann,
Ivan Veselic
Abstract:
In $\ell^1$-regularization, which is an important tool in signal and image processing, one usually is concerned with signals and images having a sparse representation in some suitable basis, e.g. in a wavelet basis. Many results on convergence and convergence rates of sparse approximate solutions to linear ill-posed problems are known, but rate results for the $\ell^1$-regularization in case of la…
▽ More
In $\ell^1$-regularization, which is an important tool in signal and image processing, one usually is concerned with signals and images having a sparse representation in some suitable basis, e.g. in a wavelet basis. Many results on convergence and convergence rates of sparse approximate solutions to linear ill-posed problems are known, but rate results for the $\ell^1$-regularization in case of lacking sparsity had not been published until 2013. In the last two years, however, two articles appeared providing sufficient conditions for convergence rates in case of non-sparse but almost sparse solutions. In the present paper, we suggest a third sufficient condition, which unifies the existing two and, by the way, also incorporates the well-known restricted isometry property.
△ Less
Submitted 4 June, 2015;
originally announced June 2015.
-
On $\ell^1$-regularization in light of Nashed's ill-posedness concept
Authors:
Jens Flemming,
Bernd Hofmann,
Ivan Veselic
Abstract:
Based on the powerful tool of variational inequalities, in recent papers convergence rates results on $\ell^1$-regularization for ill-posed inverse problems have been formulated in infinite dimensional spaces under the condition that the sparsity assumption slightly fails, but the solution is still in $\ell^1$. In the present paper we improve those convergence rates results and apply them to the C…
▽ More
Based on the powerful tool of variational inequalities, in recent papers convergence rates results on $\ell^1$-regularization for ill-posed inverse problems have been formulated in infinite dimensional spaces under the condition that the sparsity assumption slightly fails, but the solution is still in $\ell^1$. In the present paper we improve those convergence rates results and apply them to the Cesáro operator equation in $\ell^2$ and to specific denoising problems. Moreover, we formulate in this context relationships between Nashed's types of ill-posedness and mapping properties like compactness and strict singularity.
△ Less
Submitted 15 May, 2015; v1 submitted 29 January, 2015;
originally announced January 2015.
-
On the interplay of basis smoothness and specific range conditions occurring in sparsity regularization
Authors:
Stephan W. Anzengruber,
Bernd Hofmann,
Ronny Ramlau
Abstract:
The convergence rates results in $\ell^1$-regularization when the sparsity assumption is narrowly missed, presented by Burger et al. (2013 Inverse Problems 29 025013), are based on a crucial condition which requires that all basis elements belong to the range of the adjoint of the forward operator. Partly it was conjectured that such a condition is very restrictive. In this context, we study spars…
▽ More
The convergence rates results in $\ell^1$-regularization when the sparsity assumption is narrowly missed, presented by Burger et al. (2013 Inverse Problems 29 025013), are based on a crucial condition which requires that all basis elements belong to the range of the adjoint of the forward operator. Partly it was conjectured that such a condition is very restrictive. In this context, we study sparsity-promoting varieties of Tikhonov regularization for linear ill-posed problems with respect to an orthonormal basis in a separable Hilbert space using $\ell^1$ and sublinear penalty terms. In particular, we show that the corresponding range condition is always satisfied for all basis elements if the problems are well-posed in a certain weaker topology and the basis elements are chosen appropriately related to an associated Gelfand triple. The Radon transform, Symm's integral equation and linear integral operators of Volterra type are examples for such behaviour, which allows us to apply convergence rates results for non-sparse solutions, and we further extend these results also to the case of non-convex $\ell^q$-regularization with 0<q<1.
△ Less
Submitted 29 July, 2013;
originally announced July 2013.
-
Convergence rates in $\mathbf{\ell^1}$-regularization if the sparsity assumption fails
Authors:
Martin Burger,
Jens Flemming,
Bernd Hofmann
Abstract:
Variational sparsity regularization based on $\ell^1$-norms and other nonlinear functionals has gained enormous attention recently, both with respect to its applications and its mathematical analysis. A focus in regularization theory has been to develop error estimation in terms of regularization parameter and noise strength. For this sake specific error measures such as Bregman distances and spec…
▽ More
Variational sparsity regularization based on $\ell^1$-norms and other nonlinear functionals has gained enormous attention recently, both with respect to its applications and its mathematical analysis. A focus in regularization theory has been to develop error estimation in terms of regularization parameter and noise strength. For this sake specific error measures such as Bregman distances and specific conditions on the solution such as source conditions or variational inequalities have been developed and used.
In this paper we provide, for a certain class of ill-posed linear operator equations, a convergence analysis that works for solutions that are not completely sparse, but have a fast decaying nonzero part. This case is not covered by standard source conditions, but surprisingly can be treated with an appropriate variational inequality. As a consequence the paper also provides the first examples where the variational inequality approach, which was often believed to be equivalent to appropriate source conditions, can indeed go farther than the latter.
△ Less
Submitted 28 October, 2012; v1 submitted 25 September, 2012;
originally announced September 2012.
-
Errors of regularisation under range inclusions using variable Hilbert scales
Authors:
Markus Hegland,
Bernd Hofmann
Abstract:
Based on the variable Hilbert scale interpolation inequality bounds for the error of regularisation methods are derived under range inclusions. In this context, new formulae for the modulus of continuity of the inverse of bounded operators with non-closed range are given. Even if one can show the equivalence of this approach to the version used previously in the literature, the new formulae and co…
▽ More
Based on the variable Hilbert scale interpolation inequality bounds for the error of regularisation methods are derived under range inclusions. In this context, new formulae for the modulus of continuity of the inverse of bounded operators with non-closed range are given. Even if one can show the equivalence of this approach to the version used previously in the literature, the new formulae and corresponding conditions are simpler than the former ones. Several examples from image processing and spectral enhancement illustrate how the new error bounds can be applied.
△ Less
Submitted 21 May, 2010;
originally announced May 2010.
-
An extension of the variational inequality approach for nonlinear ill-posed problems
Authors:
Radu Ioan Bot,
Bernd Hofmann
Abstract:
Convergence rates results for Tikhonov regularization of nonlinear ill-posed operator equations in abstract function spaces require the handling of both smoothness conditions imposed on the solution and structural conditions expressing the character of nonlinearity. Recently, the distinguished role of variational inequalities holding on some level sets was outlined for obtaining convergence rate…
▽ More
Convergence rates results for Tikhonov regularization of nonlinear ill-posed operator equations in abstract function spaces require the handling of both smoothness conditions imposed on the solution and structural conditions expressing the character of nonlinearity. Recently, the distinguished role of variational inequalities holding on some level sets was outlined for obtaining convergence rates results. When lower rates are expected such inequalities combine the smoothness properties of solution and forward operator in a sophisticated manner. In this paper, using a Banach space setting we are going to extend the variational inequality approach from Hölder rates to more general rates including the case of logarithmic convergence rates.
△ Less
Submitted 28 September, 2009;
originally announced September 2009.
-
A new approach to source conditions in regularization with general residual term
Authors:
Jens Geissler,
Bernd Hofmann
Abstract:
This paper addresses Tikhonov like regularization methods with convex penalty functionals for solving nonlinear ill-posed operator equations formulated in Banach or, more general, topological spaces. We present an approach for proving convergence rates which combines advantages of approximate source conditions and variational inequalities. Precisely, our technique provides both a wide range of c…
▽ More
This paper addresses Tikhonov like regularization methods with convex penalty functionals for solving nonlinear ill-posed operator equations formulated in Banach or, more general, topological spaces. We present an approach for proving convergence rates which combines advantages of approximate source conditions and variational inequalities. Precisely, our technique provides both a wide range of convergence rates and the capability to handle general and not necessarily convex residual terms as well as nonsmooth operators. Initially formulated for topological spaces, the approach is extensively discussed for Banach and Hilbert space situations, showing that it generalizes some well-known convergence rates results.
△ Less
Submitted 18 June, 2009;
originally announced June 2009.
