\{{\underline\gamma},\gamma_c/(1+\kappa), \gamma_c(1-{\eta})/(2\kappa), 3\gamma_c(1-\eta)/L\right\}
\equiv {\gamma_{\min}},$$ meaning that  holds with $k$ replaced by $k+1$ as claimed.

$\gamma_k
\leq \min\left\{1/(1+\kappa), (1-{\eta})/(2\kappa), 3(1-\eta)/L\right\}$. We must consider two subcases. First, suppose that $k\in\Kcal_g$. It follows from the definition of $\rho_k$, Lemma \[lem-difference\], and Lemma \[lem-achievable\] that $$\begin{aligned}
| \rho_k - 1 |
&= \frac{|\,f(x_k+s_k) - m_k(s_k)|}{m_k(0) - m_k(s_k)} 
\leq \frac{2\kappa \gamma_k^2 \|g_k\|^2}{\min\big\{(1+\kappa)^{-1},\gamma_k\big\} \|g_k\|^2}
= 2\kappa\gamma_k
\leq 1-\eta,\end{aligned}$$ which implies that $\rho_k \geq {\eta}$, i.e., that $k\in\Scal$. Second, suppose that $k\in\Kcal_H$. It follows from Lemma \[lem-difference\] and Lemma \[lem-achievable\] that $$\begin{aligned}
| \rho_k - 1 |
&= \frac{|\,f(x_k+s_k) - m_k(s_k)|}{m_k(0) - m_k(s_k)} 
\leq \frac{L\gamma_k^3|(\lambda_k)_-|^3}{3\gamma_k^2|(\lambda_k)_-|^3}
= \frac{L\gamma_k}{3}
\leq 1-\eta,\end{aligned}$$ which implies $\rho_k \geq {\eta}$, i.e., that $k\in\Scal$. In either subcase, it follows that $k\in\Scal$. Using $k\in\Scal$, we have from Algorithm \[alg
\{{\underline\gamma},\gamma_c/(1+\kappa), \gamma_c(1-{\eta})/(2\kappa), 3\gamma_c(1-\eta)/L\right\ } 
 \equiv { \gamma_{\min}},$$ meaning that    holds with $ k$ replaced by $ k+1 $ as claimed. 

 $ \gamma_k 
 \leq \min\left\{1/(1+\kappa), (1-{\eta})/(2\kappa), 3(1-\eta)/L\right\}$. We must think two subcases. foremost, suppose that $ k\in\Kcal_g$. It follows from the definition of $ \rho_k$, Lemma   \[lem - difference\ ], and Lemma   \[lem - achievable\ ] that $ $ \begin{aligned } 
 | \rho_k - 1 | 
 & = \frac{|\,f(x_k+s_k) - m_k(s_k)|}{m_k(0) - m_k(s_k) } 
 \leq \frac{2\kappa \gamma_k^2 \|g_k\|^2}{\min\big\{(1+\kappa)^{-1},\gamma_k\big\ } \|g_k\|^2 } 
 = 2\kappa\gamma_k 
 \leq 1-\eta,\end{aligned}$$ which entail that $ \rho_k \geq { \eta}$, i.e., that $ k\in\Scal$. Second, speculate that $ k\in\Kcal_H$. It follows from Lemma   \[lem - difference\ ] and Lemma   \[lem - achievable\ ] that $ $ \begin{aligned } 
 | \rho_k - 1 | 
 & = \frac{|\,f(x_k+s_k) - m_k(s_k)|}{m_k(0) - m_k(s_k) } 
 \leq \frac{L\gamma_k^3|(\lambda_k)_-|^3}{3\gamma_k^2|(\lambda_k)_-|^3 } 
 = \frac{L\gamma_k}{3 } 
 \leq 1-\eta,\end{aligned}$$ which implies $ \rho_k \geq { \eta}$, i.e., that $ k\in\Scal$. In either subcase, it surveil that $ k\in\Scal$. Using $ k\in\Scal$, we have from Algorithm   \[alg
\{{\undfrline\gamma},\gamma_c/(1+\kappa), \gxmma_c(1-{\eta})/(2\kappa), 3\gcnma_c(1-\ete)/L\right\}
\squiv {\gaoma_{\min}},$$ meaning that  holds wivh $k$ replqced by $k+1$ as claimed.

$\gaoma_k
\leq \mpn\left\{1/(1+\kappa), (1-{\eua})/(2\kappa), 3(1-\eta)/L\right\}$. We must consiscr twm subcases. Firsj, suppose thdt $k\in\Kcal_g$. It fulpows from the definition of $\rho_k$, Leima \[lem-dofverence\], and Leima \[ltm-ashiebable\] that $$\begin{aligned}
| \rho_k - 1 |
&= \frzc{|\,f(x_k+s_k) - m_k(s_k)|}{m_k(0) - m_k(s_l)} 
\leq \frac{2\kappa \gamma_k^2 \|g_k\|^2}{\mln\bih\{(1+\kappa)^{-1},\gamma_k\big\} \|g_k\|^2}
= 2\kappa\gamma_j
\leq 1-\wta,\end{alignea}$$ which imklnes that $\rhk_k \geq {\eta}$, i.e., that $k\in\Scal$. Secovd, su'pose that $j\ib\Kcwn_H$. It folloxs froi Lemma \[lem-dingerenca\] and Lrmma \[lem-achievanle\] tiat $$\vegin{aligned}
| \rho_k - 1 |
&= \hrac{|\,f(x_k+s_k) - m_k(s_k)|}{m_k(0) - m_h(s_k)} 
\leq \fsae{L\gamma_k^3|(\lambda_k)_-|^3}{3\gamma_k^2|(\oanbda_k)_-|^3}
= \fraw{L\gaona_k}{3}
\ueq 1-\eva,\ehd{aligjed}$$ which impmies $\rho_k \gwq {\eta}$, i.e., that $k\in\Svaj$. In either sugcase, yt follows that $k\in\Scal$. Using $k\in\Scal$, we vavs from Algorithm \[alg
\{{\underline\gamma},\gamma_c/(1+\kappa), \gamma_c(1-{\eta})/(2\kappa), 3\gamma_c(1-\eta)/L\right\} \equiv {\gamma_{\min}},$$ meaning that $k$ by $k+1$ claimed. $\gamma_k \leq consider subcases. First, suppose $k\in\Kcal_g$. It follows the definition of $\rho_k$, Lemma \[lem-difference\], Lemma \[lem-achievable\] that $$\begin{aligned} | \rho_k - 1 | &= \frac{|\,f(x_k+s_k) - m_k(s_k)|}{m_k(0) m_k(s_k)} \leq \frac{2\kappa \gamma_k^2 \|g_k\|^2}{\min\big\{(1+\kappa)^{-1},\gamma_k\big\} \|g_k\|^2} = 2\kappa\gamma_k \leq 1-\eta,\end{aligned}$$ which implies that \geq i.e., $k\in\Scal$. suppose that $k\in\Kcal_H$. It follows from Lemma \[lem-difference\] and Lemma \[lem-achievable\] that $$\begin{aligned} | \rho_k - | &= \frac{|\,f(x_k+s_k) - m_k(s_k)|}{m_k(0) - m_k(s_k)} \leq = \frac{L\gamma_k}{3} \leq 1-\eta,\end{aligned}$$ implies $\rho_k \geq {\eta}$, i.e., $k\in\Scal$. either subcase, follows $k\in\Scal$. $k\in\Scal$, we have Algorithm \[alg
\{{\underline\gamma},\gamma_c/(1+\kappa), \Gamma_c(1-{\eta})/(2\kAppa), 3\gAmmA_c(1-\eTa)/l\rigHt\}
\eqUiv {\gamma_{\min}},$$ meaNIng tHat  holds with $k$ replaced bY $k+1$ as cLaIMed.

$\gAMmA_k
\leq \Min\left\{1/(1+\KApPA), (1-{\Eta})/(2\KaPpA), 3(1-\etA)/L\RIgHt\}$. We mUst ConsideR two subcasEs. FIrSt, suppose thaT $K\iN\Kcal_g$. It foLloWs from the defIniTion of $\RhO_k$, LEMma \[leM-diFfereNce\], and lEmma \[leM-achievabLe\] THat $$\begIN{aligneD}
| \RHo_K - 1 |
&= \fraC{|\,f(x_k+s_k) - m_k(s_k)|}{m_k(0) - m_k(s_k)} 
\lEQ \fRAc{2\kappa \gamma_k^2 \|g_K\|^2}{\min\biG\{(1+\kAPpA)^{-1},\GAmmA_k\bIg\} \|g_k\|^2}
= 2\kappa\gAmMa_k
\leQ 1-\Eta,\end{aLIgNED}$$ WhiCH implies that $\rHo_k \geq {\eta}$, i.e., THat $K\in\ScaL$. SEcoND, suppoSe thaT $k\IN\KcAl_H$. It followS froM Lemma \[lem-DifferENce\] and LEMma \[lem-aChievaBle\] ThaT $$\begIN{aLiGneD}
| \rHO_k - 1 |
&= \fRAc{|\,F(x_k+S_K) - m_k(S_k)|}{m_k(0) - m_k(s_k)} 
\LeQ \fRac{L\gAmma_K^3|(\LAMBda_k)_-|^3}{3\GamMa_k^2|(\lAmbda_K)_-|^3}
= \frac{L\gamma_k}{3}
\lEq 1-\eTa,\enD{AliGned}$$ wHich iMpliEs $\Rho_k \gEq {\eta}$, i.E., that $K\iN\Scal$. In either suBcasE, it followS thAt $K\in\scAl$. UsiNG $k\in\ScAl$, wE haVe from ALgorithM \[Alg
\{{\underline\gamma},\gamm a_c/(1+\ka ppa),  \g amm a_ c(1- {\et a})/(2\kappa), 3\ga mma_c(1-\eta)/L\right\ }
\eq ui v  {\g a mm a_{\m in}},$$ me a n ing  t ha t ho l ds  with  $k $ repla ced by $k+ 1$as  claimed.

$ \ ga mma_k
\leq  \m in\left\{1/( 1+\ kappa) ,(1- { \eta} )/( 2\kap pa), 3 ( 1-\eta )/L\right \} $ . We m u st cons i d er  two  subcases. First, su p pose that $k\i n\Kcal _g $ .I t  fo llo ws from th edefin i tion of $\ r h o _k$ ,  Lemma \[lem- difference\ ] , a nd Lem ma  \[ l em-ach ievab le \ ] t hat $$\begi n{al igned}
|\rho_k - 1 |
& =  \frac{ |\,f(x _k+ s_k ) -m _k (s _k) |} { m_k ( 0)  -m _k( s_k)} 
\ le q\frac {2\k a p p a  \ga mma _k^2  \|g_ k\|^2}{\min\b ig\ {(1+ \ kap pa)^{ -1},\ gamm a_ k\big \} \|g _k\|^ 2} 
= 2\kappa\gamm a_k\leq 1-\e ta, \e nd{ al igned } $$ whi chimp lies th at $\rh o _k\g e q {\ eta}$, i.e., that$k \ i n\ Scal$. S econd, su pp o se that$k \in \Kca l _ H$. I t fo l lo ws fromLemma\ [l em -differ en ce\] a nd  Le mma  \[le m -ach ievabl e\] that  $$\b e gin{aligned}
| \rho_k - 1 |& =\ f ra c {|\, f(x _k+s_k) - m _k(s _ k)|} {m_k ( 0)  -m _k(s_ k)} \l e q\ frac{L\gamma_k^3|(\ la mbda_k )_-|^ 3}{3\gamma_k^ 2|(\lambda _ k ) _-|^3}
=  \fr a c{ L \gamma_k}{3}
\ leq 1 -\eta,\end { aligned} $$ wh ich impl ies $\rho _ k  \geq {\ eta }$,  i. e., t ha t $k\in\Scal$ . In e it her sub cas e, it f oll ows  th at$k \in\Scal$ . Using$k \i n\ Sc al$ , weh ave from  A lgo ri thm  \[al g 
\{{\underline\gamma},\gamma_c/(1+\kappa), \gamma_c(1-{\eta})/(2\kappa),_3\gamma_c(1-\eta)/L\right\}
\equiv {\gamma_{\min}},$$_meaning that  holds with_$k$ replaced_by_$k+1$ as_claimed.

$\gamma_k
\leq_\min\left\{1/(1+\kappa), (1-{\eta})/(2\kappa), 3(1-\eta)/L\right\}$._We must consider_two subcases. First, suppose_that $k\in\Kcal_g$. It_follows_from the definition of $\rho_k$, Lemma \[lem-difference\], and Lemma \[lem-achievable\] that $$\begin{aligned}
| \rho_k - 1 |
&=_\frac{|\,f(x_k+s_k)_- m_k(s_k)|}{m_k(0)_-_m_k(s_k)}_
\leq \frac{2\kappa \gamma_k^2 \|g_k\|^2}{\min\big\{(1+\kappa)^{-1},\gamma_k\big\} \|g_k\|^2}
=_2\kappa\gamma_k
\leq 1-\eta,\end{aligned}$$ which implies that_$\rho_k \geq_{\eta}$, i.e., that $k\in\Scal$. Second, suppose that $k\in\Kcal_H$._It_follows from Lemma \[lem-difference\]_and Lemma \[lem-achievable\] that $$\begin{aligned}
| \rho_k - 1 |
&= \frac{|\,f(x_k+s_k)_- m_k(s_k)|}{m_k(0) - m_k(s_k)} 
\leq \frac{L\gamma_k^3|(\lambda_k)_-|^3}{3\gamma_k^2|(\lambda_k)_-|^3}
=_\frac{L\gamma_k}{3}
\leq 1-\eta,\end{aligned}$$ which_implies_$\rho_k_\geq {\eta}$, i.e., that_$k\in\Scal$. In either subcase, it follows_that $k\in\Scal$. Using $k\in\Scal$, we have_from Algorithm \[alg