1.. Introduction {#S0001}
================

Let *L*: *X* → *Y* be a bounded linear operator between two Hilbert spaces *X* and *Y*. We are interested in finding the minimum-norm solution *x* ^†^ ∈ *X* of the equation for some *y* ∈ ℛ(*L*), that is the element *x* ^†^ ∈ {*x* ∈ *X* \| *Lx* = *y*} with the property ‖*x* ^†^‖ = inf {‖*x*‖ \| *Lx* = *y*}. It is well-known that this minimal-norm solution exists and is unique, see for example \[[3](#CIT0003){ref-type="bib"}, Theorem 2.5\].

Since *y* is typically not exactly known and only an approximation with is given, we are looking for a family of approximative solutions so that for every sequence converging to *y*, we find a sequence (α~*k*~)~*k*∈ℕ~ of regularization parameters such that tends to the minimum-norm solution *x* ^†^.

A standard way to construct this family is by using Tikhonov regularization: where the minimiser can be explicitly calculated from the optimality condition and reads as follows:

More generally, we want to analyze regularized solutions of the form with some appropriately chosen function *r* ~α~, see for example \[[9](#CIT0009){ref-type="bib"}\].

The aim of this article is to characterize for a given regularization method, generated by a family (*r* ~α~)~α\>0~, the optimal convergence rate with which tends to the minimum-norm solution *x* ^†^. This convergence rate depends on the solution *x* ^†^, and we will give an explicit relation between the spectral projections of *x* ^†^ with respect to the operator *L*\**L* and the convergence rate; first in Section 2 for the convergence of *x* ~α~(*y*) with the exact data *y*, and then in Section 3 for with noisy data . This generalizes existing convergence rates results of \[[10](#CIT0010){ref-type="bib"}\] to general source conditions, such as logarithmic source conditions.

Afterwards, we show in Section 4 that these convergence rates can also be obtained from variational inequalities and establish the optimality of these general variational source conditions, extending the results of \[[1](#CIT0001){ref-type="bib"}\]. It is interesting to note that variational source conditions are equivalent to convergence rates of the regularized solutions, while the classical results in \[[5](#CIT0005){ref-type="bib"}\] are not.

Finally, we consider in Section 5 approximate source conditions that relate the convergence rates of the regularized solutions to the decay rate of a distance function, measuring how far away the minimum-norm solution is from the classical range condition, see \[[4](#CIT0004){ref-type="bib"}, [9](#CIT0009){ref-type="bib"}\]. We can show that these approximate source conditions are indeed equivalent to the convergence rates.

2.. Convergence rates for exact data {#S0002}
====================================

In the following, we analyze the convergence rate of the sequence (*x* ~α~(*y*))~α\>0~ with the exact data *y* ∈ ℛ(*L*) to the minimum-norm solution *x* ^†^ of *Lx* = *y*.

We investigate regularization methods of the form ([2](#M0002)), which are generated by functions satisfying the following properties.

We call a family (*r* ~α~)~α\>0~ of continuous functions *r* ~α~: \[0, ∞) → \[0, ∞) the generator of a regularization method if there exists a constant ρ ∈ (0, 1) such thatthe error function , defined by is decreasing.For fixed λ ≥0 the map is continuous and increasing, andthere exists a constant such that

These conditions do not yet enforce that *x* ~α~(*y*) → *x* ^†^. To ensure this, we could additionally impose that for every λ \> 0 as α → 0.

Let us now fix the notation for the rest of the article.

Let *L*: *X* → *Y* be a bounded linear operator between two real Hilbert spaces *X* and *Y*, *y* ∈ ℛ(*L*), and *x* ^†^ ∈ *X* be the minimum-norm solution of *Lx* = *y*.

We choose a generator (*r* ~α~)~α\>0~ of a regularization method, introduce the family of its error functions, and the corresponding family of regularized solutions shall be given by ([2](#M0002)).

We denote by *A* → *E* ~*A*~ and *A* → *F* ~*A*~ the spectral measures of the operators *L*\**L* and *LL*\*, respectively, on all Borel sets *A* ⊆ \[0, ∞).

Next, we define the right-continuous and increasing function

Moreover, if *f*: (0, ∞) → ℝ is a right-continuous, increasing, and bounded function, we write for the Lebesgue--Stieltjes integral of *f*, where μ~*f*~ denotes the unique non-negative Borel measure defined by μ~*f*~((λ~1~, λ~2~\]) = *f*(λ~2~) − *f*(λ~1~) and *g* ∈ *L* ^1^(μ).

In this setting, we can write the error according to spectral theory in the form

We want to point out here that it directly follows from the definition that the minimum-norm solution *x* ^†^ is in the orthogonal complement 𝒩(*L*)^⊥^ of the nullspace of *L*, and we therefore do not have to consider the point λ = 0 in the integrals in equation ([6](#M0006)).

We first want to establish a relation between the convergence rate of the regularized solution *x* ~α~(*y*) for exact data *y* to the minimum-norm solution *x* ^†^ and the behaviour of the spectral function ([4](#M0004)).

We use Notation 2.2 and assume that there exist an increasing function ϕ: (0, ∞) → (0, ∞) and constants μ ∈ (0, 1) and *A* \> 0 such that we have for every α \> 0 the inequality

Then, the following two statements are equivalent: There exists a constant *C* \> 0 withThere exists a constant with

According to Definition 2.1 (ii) the error function is decreasing, and thus it follows together with ([6](#M0006)) that for all α \> 0

Let first ([8](#M0008)) hold. Then, it follows from ([10](#M0010)) that for all α \> 0

Now, we use Definition 2.1 (i), which gives that

Using this estimate in ([11](#M0011)) yields ([9](#M0009)) with .

Conversely, let ([9](#M0009)) hold. Since ‖*x* ~α~(*y*) − *x* ^†^‖^2^ ≤ ‖*x* ^†^‖^2^ (which follows from ([6](#M0006)) with ), it is enough to check the condition ([8](#M0008)) for all α ∈ (0, ‖*L*‖^2^\].

We use ([6](#M0006)) and integrate the right hand side by parts, see for example \[[2](#CIT0002){ref-type="bib"}, Theorem 6.2.2\] regarding the integration by parts for Lebesgue--Stieltjes integrals, and obtain that

We split up the integral on the right hand side into two terms:

The first term is estimated by using that the function *e* is increasing and by utilising the assumption ([9](#M0009)):

The second integral term in ([13](#M0013)) is estimated by using the inequalities ([9](#M0009)) and ([7](#M0007)): where we used Definition 2.1 (iv) in the last step. Inserting the two estimates in ([13](#M0013)) and in ([12](#M0012)), we find with *e*(‖*L*‖^2^) = ‖*x* ^†^‖^2^ that

From ([7](#M0007)), we deduce further that since ϕ is increasing and μ \<1.

Thus, we get from ([14](#M0014)) that with

The condition ([7](#M0007)) with the choice was already used in \[[4](#CIT0004){ref-type="bib"}\], and such a function ϕ was called a qualification of the regularization method.

In the case of Tikhonov regularization, given by ([1](#M0001)), we have and therefore we get for the error function , defined by ([3](#M0003)), the expression . So, clearly, and all the conditions of Definition 2.1 are fulfilled.

To recover the classical equivalence results, see \[[10](#CIT0010){ref-type="bib"}, Theorem 2.1\], we set ϕ(α) = α^2ν^ for some ν ∈ (0, 1) and find that the condition ([7](#M0007)) with *A* = 1 is for every μ ≥ ν fulfilled, since we have for arbitrary α \> 0 and λ \> 0.Thus, Proposition 2.3 yields for every ν ∈ (0, 1) the equivalence of ‖*x* ~α~(*y*) − *x* ^†^‖^2^ = 𝒪(α^2ν^) and *e*(λ) = 𝒪(λ^2ν^).Similarly, we also get the equivalence in the case of logarithmic convergence rates. Let 0 \< ν \< μ \<1 and define for the function ϕ(α) = \|log α\|^−ν^ (for bigger values of α, we may simply set ). Then, we have for all . Thus, is decreasing on , which implies ([7](#M0007)) with *A* = 1.So, Proposition 2.3 tells us that ‖*x* ~α~(*y*) − *x* ^†^‖^2^ = 𝒪(\|log α\|^−ν^) if and only if *e*(λ) = 𝒪(\|log λ\|^−ν^).

3.. Convergence rates for noisy data {#S0003}
====================================

We now want to estimate the distance of the regularized solution to the minimum-norm solution *x* ^†^ if we do not have the exact data *y*, but only some approximation of it.

In this case, we consider the regularization parameter α as a function of the noisy data such that the distance between and *x* ^†^ is minimal. Thus, we are interested in the convergence rate of the expression to zero as the distance between and *y* tends to zero. We therefore want to find an upper bound for the expression , where denotes the closed ball with radius δ \> 0 around the data *y*.

Let us first consider the trivial case where ‖*x* ~α~(*y*) − *x* ^†^‖ = 0 for all α in a vicinity of 0.

We use Notation 2.2 and assume that there exists an ϵ \> 0 such that

Then, we have where ρ \> 0 is chosen as in Definition 2.1 (i).

Let be fixed. Then, using that *Lr* ~α~(*L*\**L*) = *r* ~α~(*LL*\*)*L*, it follows from Definition 2.1 (i) that

The right hand side is uniform for all . Thus, picking α = ϵ, we get which is ([15](#M0015)).

In the general case, we estimate the optimal regularization parameter α to be in the vicinity of the value α~δ~, which is chosen as the solution of the implicit equation ([17](#M0017)) and is therefore only depending on the distance δ between the correct data *y* and the noisy data .

We use again Notation 2.2 and consider the case where ‖*x* ~α~(*y*) − *x* ^†^‖ \> 0 for all α \> 0.

If we choose for every δ \> 0 the parameter α~δ~ \> 0 such that then there exists a constant *C* ~1~ \> 0 such that

Moreover, there exists a constant *C* ~0~ \> 0 such that for all δ \> 0 which fulfil that α~δ~ ∈ σ(*LL*\*), where σ(*LL*\*) ⊂ \[0, ∞) denotes the spectrum of the operator *LL*\*.

First, we remark that the function is, according to Definition 2.1 (iii) together with the assumption that ‖*x* ~α~(*y*) − *x* ^†^‖ \> 0 for all α \> 0, continuous and strictly increasing and satisfies lim ~α→0~ *A*(α) = 0 and lim ~α→∞~ *A*(α) = ∞. Therefore, we find for every δ \> 0 a unique value α~δ~ = *A* ^−1^(δ^2^).

Let . Then, as in the proof of Lemma 3.1, see ([16](#M0016)), we find that

From this estimate, we obtain with the triangular inequality and with the definition ([17](#M0017)) of α~δ~ that which is the upper bound ([18](#M0018)) with the constant *C* ~1~ = (1 + ρ)^2^.

For the lower bound ([19](#M0019)), we write similarly

Now, from the continuity of and Definition 2.1 (iv), we find that for every δ \> 0 there exists a parameter *a* ~δ~ ∈ (0, α~δ~) such that .

Then, the assumption α~δ~ ∈ σ(*LL*\*) implies that the spectral measure *F* of the operator *LL*\* fulfils *F* ~\[*a*~δ~,\ 2α~δ~\]~ ≠ 0.

Suppose now that

Then, choosing , equation ([20](#M0020)) becomes

Thus, we may drop the last term as it is non-negative, which gives us the lower bound

Since we get from Definition 2.1 (ii) the inequality we can estimate further

Now, since is for every λ \> 0 increasing, see Definition 2.1 (iii), the first term is increasing in α, see ([6](#M0006)), and the second term is decreasing in α. Thus, we can estimate the expression for α \< α~δ~ from below by the second term at α = α~δ~, and for α ≥ α~δ~ by the first term at α = α~δ~: which is ([19](#M0019)) with .

If *z* ~δ~, as defined by ([21](#M0021)), happens to vanish, the same argument works with an arbitrary non-zero element *z* ~δ~ ∈ ℛ(*F* ~\[*a*~δ~,\ 2α~δ~\]~) since the last term in ([20](#M0020)) is zero for .

From Lemma 3.1 and Lemma 3.2, we now get an equivalence relation between the noisy and the noise-free convergence rates.

We use Notation 2.2. Let further ϕ: \[0, ∞) → \[0, ∞) be a strictly increasing function satisfying ϕ(0) = 0 and for some increasing function *g*: (0, ∞) → (0, ∞).

Moreover, we assume that there exists a constant *C* \> 0 with and there is a constant such that

We define

Then, the following two statements are equivalent: There exists a constant *c* \> 0 such thatThere exists a constant such that

We first remark that ([22](#M0022)) implies that , and so by setting , and , we get

Thus, we have where .

In the case where ‖*x* ~α~(*y*) − *x* ^†^‖ = 0 for all α ∈ (0, ϵ\] for some ϵ \> 0, the inequality ([27](#M0027)) is trivially fulfilled for some . Moreover, we know from Lemma 3.1 that then the inequality ([15](#M0015)) holds, which implies the inequality ([26](#M0026)) for some constant *c* \> 0, since we have according to the definition of the function ψ that ψ(δ) ≥ *a*δ^2^ for all δ ∈ (0, δ~0~) for some constants *a* \> 0 and δ~0~ \> 0.

Thus, we may assume that ‖*x* ~α~(*y*) − *x* ^†^‖ \> 0 for all α \> 0.

Let ([27](#M0027)) hold. For arbitrary δ \> 0, we use the regularization parameter α~δ~ defined in ([17](#M0017)). Then, the inequality ([27](#M0027)) implies that

Consequently and therefore, using the inequality ([18](#M0018)) obtained in Lemma 3.2, we find with ([28](#M0028)) that which is the estimate ([26](#M0026)) with .

Conversely, if ([26](#M0026)) holds, we choose an arbitrary δ \> 0 such that α~δ~ defined by ([17](#M0017)) is in the spectrum σ(*LL*\*). Then, we can use the inequality ([19](#M0019)) of Lemma 3.2 to obtain from the condition ([26](#M0026)) that

Thus, by the definition of ψ, we have

So, finally, we get with ([22](#M0022)) that and since this holds for every δ such that α~δ~ ∈ σ(*LL*\*), we have with that

Finally, we consider some α ∉ σ(*LL*\*), α \< ‖*L*‖^2^, and set

Then, recalling that σ(*L*\**L*)∖{0} = σ(*LL*\*)∖{0}, see for example \[[6](#CIT0006){ref-type="bib"}, Problem 61\], we find for α~−~ \> 0 (for α~−~ = 0, the first term in the following calculation simply vanishes) that

Using the conditions ([23](#M0023)) and ([24](#M0024)), we have with ([29](#M0029)) that which is ([27](#M0027)) with .

If we consider Tikhonov regularization, then we can ignore the conditions ([23](#M0023)) and ([24](#M0024)) in Proposition 3.3 if we have a quadratic upper bound on the function *g* in ([22](#M0022)).

Indeed, let ϕ: \[0, ∞) → \[0, ∞) be an arbitrary increasing function fulfilling ([22](#M0022)) for some increasing function *g*: (0, ∞) → (0, ∞) which is bounded by for some constant *C* \> 0. Then, conditions ([23](#M0023)) and ([24](#M0024)) are fulfilled for the error function of Tikhonov regularization, given by .

To see this, we remark that for 0 \< α ≤ β, the ratio is decreasing in λ. Therefore, for λ ≥ β we get that which is ([23](#M0023)).

We similarly find for λ ≤ α that which is ([24](#M0024)) with .

We want to apply this theorem now to the two special cases discussed previously in Example 2.4.

In the case of Example 2.4 (i), where we considered Tikhonov regularization with a convergence rate given by ϕ(α) = α^2ν^ for some ν ∈ (0, 1), the condition ([22](#M0022)) in Proposition 3.3 is clearly fulfilled with *g*(γ) = γ^2ν^. In particular, *g* satisfies that *g*(γ) ≤1 + γ^2^, which is ([30](#M0030)) with *C* = 4, and thus the conditions ([23](#M0023)) and ([24](#M0024)) in Proposition 3.3 follow as in the remark above.So, we can apply Proposition 3.3 and it only remains to calculateThus, we recover the classical result, see \[[10](#CIT0010){ref-type="bib"}, Theorem 2.6\], that the convergence rate ‖*x* ~α~(*y*) − *x* ^†^‖^2^ = 𝒪(α^2ν^) for the correct data *y* is equivalent to the convergence rate for noisy data.Next, we look at Tikhonov regularization with the logarithmic convergence rate see Example 2.4 (ii). First, we remark that ϕ is concave. This is because ϕ is increasing, constant for α \> e^−(1+ν)^, and for 0 \< α \<e^−(1+ν)^ we have and because ϕ(0) = 0, we haveThus, using that ϕ is increasing, the requirement ([22](#M0022)) in Proposition 3.3 is fulfilled withIn particular, this function *g* satisfies the inequality ([30](#M0030)) with *C* = 4 and therefore, also the conditions ([23](#M0023)) and ([24](#M0024)) in Proposition 3.3 are fulfilled according to the previous remark.To get the corresponding function ψ, as defined in ([25](#M0025)), we have to solve the implicit equation , where is defined in ([25](#M0025)) and with the specific choice of ϕ(α) = \|log α\|^−ν^ for α \<e^−(1+ν)^ satisfies . This equation then reads as follows:By solving this equation for δ, we get which, in particular, shows that the function ψ is increasing and furthermore, because of lim ~δ↓0~ψ(δ) = 0, ψ(δ) \<1 for sufficiently small δ \> 0. Therefore, we find for small δ \> 0 thatMoreover, if we write ψ as for some function *f*, the implicit equation ([31](#M0031)) becomesSince , we find parameters ϵ ∈ (0, 1) and δ~0~ ∈ (0, 1) such that we have for all δ \< δ~0~ the inequality 0 ≤ log (\|log δ\|^ν^) ≤ ϵ\|log δ\|. Assuming that *f*(δ) ≥1 gives which is a contradiction to the assumption. Thus, *f*(δ) \<1.Since we know already from ([32](#M0032)) that *f*(δ) ≥2^−ν^, it therefore follows from Proposition 3.3 that the convergence rate ‖*x* ~α~(*y*) − *x* ^†^‖^2^ = 𝒪(\|log α\|^−ν^) is equivalent to .

4.. Relation to variational inequalities {#S0004}
========================================

Instead of characterizing the convergence rate of the regularized solution via the behavior of the spectral decomposition of the minimum-norm solution *x* ^†^, we may also check variational inequalities for the element *x* ^†^, see \[[7](#CIT0007){ref-type="bib"}, [8](#CIT0008){ref-type="bib"}, [11](#CIT0011){ref-type="bib"}, [12](#CIT0012){ref-type="bib"}\]. In \[[1](#CIT0001){ref-type="bib"}\], it was shown that for Tikhonov regularization and convergence rates of the order 𝒪(α^2ν^), ν ∈ (0, 1), such variational inequalities are equivalent to specific convergence rates.

In this section, we generalize this result to cover general regularization methods and convergence rates.

We consider again the setting of Notation 2.2. Moreover, let ϕ: \[0, ∞) → \[0, ∞) be an increasing, continuous function and ν ∈ (0, 1).

Then, the following two statements are equivalent: There exists a constant *C* \> 0 withThere exists a constant such that

Assume first that ([34](#M0034)) holds. Then, we have for all λ \> 0 which implies ([33](#M0033)) with .

On the other hand, if ([33](#M0033)) is fulfilled then we can estimate for arbitrary Λ \> 0 and every *x* ∈ *X*

Furthermore, we get with the bounded, invertible operator *T* = ϕ(*L*\**L*)\|~ℛ(*E*~\[Λ,\ ∞)~)~ that

Integrating by parts, we can rewrite the integral in the form

Using now ([33](#M0033)) and dropping all negative terms, we arrive at with the constant *c* \> 0 given by . Plugging this into ([36](#M0036)), we find that

We now pick and assume that Λ \> 0; otherwise \<*x* ^†^, *x* \> = 0 and ([34](#M0034)) is trivially fulfilled. Then, the right continuity of λ → \<*E* ~\[0,\ λ\]~ *x* ^†^, *x* \> implies that

Moreover, we have that for every λ ∈ (0, Λ). Therefore, the left continuity of λ → \<*E* ~\[λ,\ ∞)~ *x* ^†^, *x* \> implies that

Thus, we get with the estimates ([35](#M0035)) and ([37](#M0037)) that

We remark that the first part of this proof also works in the limit case ν = 1, which shows that ([34](#M0034)) implies ([33](#M0033)) for ν = 1 as well.

We use again Notation 2.2. Let further ϕ: \[0, ∞) → \[0, ∞) be an increasing, continuous function and ν ∈ (0, 1\].

Then, the standard source condition implies the variational inequality for some constant *C* \> 0.

Conversely, the variational inequality ([39](#M0039)) implies that for every continuous function ψ: \[0, ∞) → \[0, ∞) with ψ ≥*c*ϕ^μ^ for some constant *c* \> 0 and some μ ∈ (0, ν).

If *x* ^†^ fulfils ([38](#M0038)), then there exists an element ω ∈*X* with

Using the interpolation inequality, see for example \[[3](#CIT0003){ref-type="bib"}, Chapter 2.3\], we find which is ([39](#M0039)) with *C* = ‖ω‖.

If, on the other hand, ([39](#M0039)) holds, then, according to Proposition 4.1 there exists a constant such that . Now, similarly to the proof of Proposition 4.1 we get with *T* = ψ(*L*\**L*)\|~ℛ(*E*~(Λ,\ ∞)~)~ that and, using the lower bound on ψ, that for some constant . So which implies that *x* ^†^ ∈ ℛ(ψ(*L*\**L*)), see for example \[[11](#CIT0011){ref-type="bib"}, Lemma 8.21\].

In general, the inequality ([39](#M0039)) does not imply the standard source condition ([38](#M0038)). Let us for example consider the case where we have an increasing, continuous function ϕ: \[0, ∞) → \[0, ∞) with ϕ(0) = 0, ϕ(λ) \> 0 for all λ \> 0, and for some constants 0 \< *c* ≤ *C*.

Now, the standard source condition ([38](#M0038)) would imply that we can find a ξ ∈ 𝒩(*L*)^⊥^ with *x* ^†^ = ϕ^ν^(*L*\**L*)ξ. Thus, we would get with *T* = ϕ^ν^(*L*\**L*)\|~ℛ(*E*~(Λ,\ ∞)~)~ that

However, in the limit Λ → 0, we have that which is a contradiction to the existence of such a point ξ.

5.. Connection to approximate source conditions {#S0005}
===============================================

Another approach to weakening the standard source condition ([38](#M0038)) in order to obtain a condition which is equivalent to the convergence rate was introduced in \[[9](#CIT0009){ref-type="bib"}\], see also \[[4](#CIT0004){ref-type="bib"}\]. The idea was that for the argument ([40](#M0040)), which shows that the standard source condition ([38](#M0038)) implies the variational inequality ([39](#M0039)), it would have been enough to be able to approximate the minimum-norm solution *x* ^†^ by a bounded sequence in ℛ(ϕ^ν^(*L*\**L*)). And, the smaller the bound on the sequence, the smaller the constant *C* in the variational inequality ([39](#M0039)) will be. Therefore, the distance between *x* ^†^ and as a function of the radius *R* of the closed ball should be directly related to the convergence rate.

In the setting of Notation 2.2, we define the distance function *d* ~ϕ~ of a continuous function ϕ: \[0, ∞) → \[0, ∞) by

Indeed, this distance function gives us directly an upper bound on the error between the regularized solution *x* ~α~(*y*) and the minimum-norm solution *x* ^†^, see \[[9](#CIT0009){ref-type="bib"}, Theorem 5.5\] or \[[4](#CIT0004){ref-type="bib"}, Proposition 2\]. For convenience, we repeat the argument here.

We use Notation 2.2 and assume that ϕ: \[0, ∞) → \[0, ∞) is an increasing, continuous function with ϕ(0) = 0 so that there exists a constant *A* \> 0 such that the inequality holds for every α \> 0.

Then, we have for every ξ ∈*X* that

For every vector ξ ∈*X*, we find from ([5](#M0005)) with the definition ([3](#M0003)) of the error function that

Now, since , we have that . Moreover, with *e* ~ξ~(λ) = ‖*E* ~(0,\ λ\]~ξ‖^2^, we get from the inequality ([42](#M0042)) that

So, putting the two inequalities together, we obtain ([43](#M0043)).

Thus, taking the infimum over all in ([43](#M0043)), the error ‖*x* ~α~(*y*) − *x* ^†^‖ can be bound by a combination of *d* ~ϕ~(*R*) and ϕ(α)*R*. By balancing these terms, we obtain from a given distance function *d* ~ϕ~ the corresponding convergence rate.

Conversely, we can also show that an upper bound on the spectral projections of the minimum-norm solution gives us an upper bound on the distance function, which then yields another equivalent characterisation for the convergence rate of the regularization method.

We use Notation 2.2 and assume that ϕ: \[0, ∞) → \[0, ∞) is an increasing, continuous function with ϕ(0) = 0 so that there exists a constant *A* \> 0 with

Moreover, let *d* ~ϕ~ be the distance function of ϕ, and let ν ∈ (0, 1) be arbitrary.

Then, the following statements are equivalent: There exists a constant *C* \> 0 so thatThere exists a constant so that

Assume first that ([46](#M0046)) holds. Then, from Lemma 5.2, we get by taking the infimum of ([43](#M0043)) over all for an arbitrary *R* \> 0 that

Since the first term is decreasing and the second term is increasing in *R*, we pick for *R* the value *R*(α) given by

Thus, we end up with

Applying Proposition 2.3 with the function ϕ, therein replaced by ϕ^2ν^ (we remark that the condition ([7](#M0007)) is then fulfilled with μ = ν, since ([44](#M0044)) implies ) we find that there exists a constant *C* \> 0 so that ([45](#M0045)) holds.

Conversely, if we have the relation ([45](#M0045)), then we define for arbitrary α \> 0 with the operator *T* = ϕ(*L*\**L*)\|~ℛ(*E*~(α,\ ∞)~)~ the element

Now, the distance of ϕ(*L*\**L*)ξ~α~ to the minimum-norm solution *x* ^†^ can be estimated according to ([45](#M0045)) by

Moreover, we can get an upper bound on the norm of ξ~α~ by

Using assumption ([45](#M0045)), evaluating the integral, and dropping the resulting two negative terms, we find that with .

So, combining ([47](#M0047)) and ([48](#M0048)), we have by definition ([41](#M0041)) of the distance function *d* ~ϕ~ with *R* = *c*ϕ^−(1−ν)^(α) that and thus it follows by switching to the variable *R* that where .

6.. Conclusion {#S0006}
==============

In this article, we have proven optimal convergence rates results for regularization methods for solving linear ill-posed operator equations in Hilbert spaces. The result generalizes existing convergence rates results on optimality of \[[10](#CIT0010){ref-type="bib"}\] to general source conditions, such as logarithmic source conditions. The results state that convergence rates results of regularised solution require a certain decay of the solution in terms of the spectral decomposition. Moreover, we also provide optimality results under variational source conditions, extending the results of \[[1](#CIT0001){ref-type="bib"}\]. It is interesting to note that variational source conditions are equivalent to convergence rates of the regularized solutions, while the classical results are not. Moreover, we also show that rates of the distance function developed in \[[4](#CIT0004){ref-type="bib"}, [9](#CIT0009){ref-type="bib"}\] are equivalent to convergence rates of the regularized solutions.
