
        \circled{5}
        =& \frac{1}{2}\tr\lrp{\nabla^2 f(z_t) \lrp{N_t+ N(y_t) - N(y_0)}^2}\\
        =& \frac{1}{2}\tr\lrp{\lrp{q''(g(z_t)) \frac{z_t z_t^T}{\|z_t\|_2^2} + q'(g(z_t)) \frac{1}{\|z_t\|_2} \lrp{I - \frac{z_tz_t^T}{\|z_t\|_2^2}}} \lrp{N_t+ N(y_t) - N(y_0)}^2}\\
        \leq& \frac{1}{2}\tr\lrp{\lrp{ q'(g(z_t)) \frac{1}{\|z_t\|_2} \lrp{I - \frac{z_tz_t^T}{\|z_t\|_2^2}}} \lrp{N_t+ N(y_t) - N(y_0)}^2}\\
        \leq& \frac{q'(g(z_t))}{\|z_t\|_2}\cdot \lrp{\tr\lrp{N_t^2} + \tr\lrp{\lrp{N(y_t) - N(y_0)}^2}}\\
        \leq& q'(g(z_t)) \cdot L_N^2 \|z_t\|_2 + \frac{L_N^2\|y_t-y_0\|_2^2}{2\epsilon}\\
        \leq& q'(g(z_t)) \cdot L_N^2 g(z_t) + \frac{L_N^2\|y_t-y_0\|_2^2}{2\epsilon} + 2 L_N^2 \epsilon
        \end{aligned}$$

The above uses multiples times the fact that $0 \leq q' \leq 1$ and $q'' \leq 0$ (proven in items 3 and 4 of Lemma \[l:qproperties\]). The second inequality is by Young’s inequality, the third inequality is by item 2 of Lemma \[l
\circled{5 } 
         = & \frac{1}{2}\tr\lrp{\nabla^2 f(z_t) \lrp{N_t+ N(y_t) - N(y_0)}^2}\\ 
         = & \frac{1}{2}\tr\lrp{\lrp{q''(g(z_t) ) \frac{z_t z_t^T}{\|z_t\|_2 ^ 2 } + q'(g(z_t) ) \frac{1}{\|z_t\|_2 } \lrp{I - \frac{z_tz_t^T}{\|z_t\|_2 ^ 2 } } } \lrp{N_t+ N(y_t) - N(y_0)}^2}\\ 
         \leq & \frac{1}{2}\tr\lrp{\lrp { q'(g(z_t) ) \frac{1}{\|z_t\|_2 } \lrp{I - \frac{z_tz_t^T}{\|z_t\|_2 ^ 2 } } } \lrp{N_t+ N(y_t) - N(y_0)}^2}\\ 
         \leq & \frac{q'(g(z_t))}{\|z_t\|_2}\cdot \lrp{\tr\lrp{N_t^2 } + \tr\lrp{\lrp{N(y_t) - N(y_0)}^2}}\\ 
         \leq & q'(g(z_t) ) \cdot L_N^2 \|z_t\|_2 + \frac{L_N^2\|y_t - y_0\|_2 ^ 2}{2\epsilon}\\ 
         \leq & q'(g(z_t) ) \cdot L_N^2 g(z_t) + \frac{L_N^2\|y_t - y_0\|_2 ^ 2}{2\epsilon } + 2 L_N^2 \epsilon 
         \end{aligned}$$ 

 The above uses multiples times the fact that $ 0 \leq q' \leq 1 $ and $ q" \leq 0 $ (proven in item 3 and 4 of Lemma \[l: qproperties\ ]). The second inequality is by Young ’s inequality, the third inequality is by token 2 of Lemma \[l

        \circled{5}
        =& \frag{1}{2}\tr\lrp{\nabla^2 f(z_t) \lrp{N_t+ N(b_t) - N(y_0)}^2}\\
        =& \wrac{1}{2}\tr\lrp{\lrp{q''(g(z_t)) \frac{z_t z_t^T}{\|z_v\|_2^2} + q'(t(z_t)) \feac{1}{\|z_t\|_2} \lrp{I - \frac{z_tz_t^T}{\|z_g\|_2^2}}} \lrp{N_t+ N(j_t) - N(y_0)}^2}\\
        \oeq& \frac{1}{2}\tr\lrp{\lrp{ q'(n(v_t)) \frzg{1}{\|z_t\|_2} \lxp{M - \frac{z_tz_t^T}{\|z_t\|_2^2}}} \krp{N_t+ N(y_t) - N(y_0)}^2}\\
        \leq& \ffae{q'(g(z_t))}{\|z_t\|_2}\cdot \lrp{\tr\lrp{N_t^2} + \tr\lrp{\lrp{N(y_t) - N(y_0)}^2}}\\
        \leq& q'(g(z_t)) \cdoj L_N^2 \|e_t\|_2 + \frad{L_N^2\|y_t-y_0\|_2^2}{2\epsilon}\\
        \leq& q'(g(z_t)) \cdot L_N^2 g(z_t) + \frac{L_N^2\|y_t-y_0\|_2^2}{2\epxilon} + 2 L_N^2 \epsilon
        \fnd{apigned}$$

The above usfs multiplew tiiws the fact ghat $0 \leq q' \leq 1$ and $q'' \leq 0$ (proven in items 3 and 4 of Uemma \[l:qpropertuew\]). Tjg second inewualiny is by Younn’x ineqgality, yhe third ineqmalitb is by item 2 of Lemma \[l
\circled{5} =& \frac{1}{2}\tr\lrp{\nabla^2 f(z_t) \lrp{N_t+ N(y_t) - \frac{1}{2}\tr\lrp{\lrp{q''(g(z_t)) z_t^T}{\|z_t\|_2^2} + \frac{1}{\|z_t\|_2} \lrp{I - \leq& q'(g(z_t)) \frac{1}{\|z_t\|_2} \lrp{I \frac{z_tz_t^T}{\|z_t\|_2^2}}} \lrp{N_t+ N(y_t) N(y_0)}^2}\\ \leq& \frac{q'(g(z_t))}{\|z_t\|_2}\cdot \lrp{\tr\lrp{N_t^2} + \tr\lrp{\lrp{N(y_t) N(y_0)}^2}}\\ \leq& q'(g(z_t)) \cdot L_N^2 \|z_t\|_2 + \frac{L_N^2\|y_t-y_0\|_2^2}{2\epsilon}\\ \leq& q'(g(z_t)) \cdot L_N^2 g(z_t) \frac{L_N^2\|y_t-y_0\|_2^2}{2\epsilon} + 2 L_N^2 \epsilon \end{aligned}$$ The above uses multiples times the fact $0 q' 1$ $q'' \leq 0$ (proven in items 3 and 4 of Lemma \[l:qproperties\]). The second inequality is Young’s inequality, the third inequality is by item of Lemma \[l

        \circled{5}
        =& \frac{1}{2}\tr\lrp{\nabla^2 f(z_t) \lRp{N_t+ N(y_t) - N(y_0)}^2}\\
        =& \fRac{1}{2}\tr\Lrp{\Lrp{Q''(g(Z_t)) \frAc{z_t Z_t^T}{\|z_t\|_2^2} + q'(g(z_t)) \frac{1}{\|z_T\|_2} \Lrp{I - \Frac{z_tz_t^T}{\|z_t\|_2^2}}} \lrp{N_t+ N(y_t) - N(y_0)}^2}\\
        \lEq& \fraC{1}{2}\tR\Lrp{\lRP{ q'(G(z_t)) \frAc{1}{\|z_t\|_2} \lrp{i - \FrAC{Z_tz_T^T}{\|Z_t\|_2^2}}} \Lrp{n_t+ n(Y_t) - n(y_0)}^2}\\
        \leq& \FraC{q'(g(z_t))}{\|z_t\|_2}\Cdot \lrp{\tr\lRp{N_T^2} + \tR\lrp{\lrp{N(y_t) - N(y_0)}^2}}\\
        \LEq& Q'(g(z_t)) \cdot L_N^2 \|Z_t\|_2 + \fRac{L_N^2\|y_t-y_0\|_2^2}{2\epsiLon}\\
        \Leq& q'(g(z_T)) \cDot l_n^2 g(z_t) + \fRac{l_N^2\|y_t-y_0\|_2^2}{2\EpsiloN} + 2 l_N^2 \epsiLon
        \end{aliGnED}$$

The abOVe uses mULTiPles Times the fact that $0 \lEQ q' \LEq 1$ and $q'' \leq 0$ (proveN in iteMs 3 ANd 4 OF lemMa \[l:QpropertieS\]). THe secONd inequALiTY IS by yOung’s inequaliTy, the third iNEquAlity iS bY itEM 2 of LemMa \[l

        \circled{5}
       =& \fra c{1}{ 2}\ tr\ lr p{\n abla ^2 f(z_t) \lrp { N_t+  N(y_t) - N(y_0)}^2}\\ 
     =&\ fr ac{1} {2}\tr\ l rp { \ lrp {q '' (g( z_ t ))  \fra c{z _t z_t^ T}{\|z_t\| _2^ 2}  + q'(g(z_t) )  \ frac{1}{\| z_t \|_2} \lrp{I  -\frac{ z_ tz_ t ^T}{\ |z_ t\|_2 ^2}}}\ lrp{N_ t+ N(y_t)  - N(y_0) } ^2}\\
    \ leq& \frac{1}{2}\ t r\ l rp{\lrp{ q'(g( z_t))\f r ac { 1 }{\ |z_ t\|_2} \lr p{ I - \ f rac{z_t z _t ^ T } {\| z _t\|_2^2}}} \ lrp{N_t+ N( y _t)  - N(y _0 )}^ 2 }\\
      \ l eq&  \frac{q'(g (z_t ))}{\|z_t \|_2}\ c dot \lr p {\tr\lr p{N_t^ 2}+ \ tr\l r p{ \l rp{ N( y _t) -N(y _ 0)} ^2}}\\
     \l eq&q ' ( g (z_t ))\cdo t L_N ^2 \|z_t\|_2+ \ frac { L_N ^2\|y _t-y_ 0\|_ 2^ 2}{2\ epsilo n}\\       \leq& q'( g(z_ t)) \cdot  L_ N^ 2 g (z _t) + \frac{ L_N ^2\ |y_t-y_ 0\|_2^2 } {2\ ep s i l on } + 2 L_N^2 \epsil on       \en d{alig n ed }$ $ 

The ab ov e u sesm u ltipl es t i me s the fa ct tha t  $ 0\leq q'  \ leq 1$  a nd$q' ' \le q  0$(prove n in ite ms 3a nd 4 of Lemma\ [l:qpropertie s \] ) .  T h e se con d inequalit y is by Y oung ’ sine q ualit y, th et hi r d inequality is byit em 2 o f Lem ma \[l

 _ _   _\circled{5}
 __ __  =&_\frac{1}{2}\tr\lrp{\nabla^2 f(z_t) \lrp{N_t+_N(y_t) - N(y_0)}^2}\\
 _  __  =& \frac{1}{2}\tr\lrp{\lrp{q''(g(z_t)) \frac{z_t z_t^T}{\|z_t\|_2^2} + q'(g(z_t)) \frac{1}{\|z_t\|_2} \lrp{I - \frac{z_tz_t^T}{\|z_t\|_2^2}}} \lrp{N_t+ N(y_t)_-_N(y_0)}^2}\\
 ___    \leq&_\frac{1}{2}\tr\lrp{\lrp{ q'(g(z_t)) \frac{1}{\|z_t\|_2} \lrp{I -_\frac{z_tz_t^T}{\|z_t\|_2^2}}} \lrp{N_t+_N(y_t) - N(y_0)}^2}\\
     __ \leq& \frac{q'(g(z_t))}{\|z_t\|_2}\cdot_\lrp{\tr\lrp{N_t^2} + \tr\lrp{\lrp{N(y_t) - N(y_0)}^2}}\\
    _   \leq& q'(g(z_t)) \cdot_L_N^2 \|z_t\|_2 +_\frac{L_N^2\|y_t-y_0\|_2^2}{2\epsilon}\\
__   _  \leq& q'(g(z_t)) \cdot L_N^2_g(z_t) + \frac{L_N^2\|y_t-y_0\|_2^2}{2\epsilon} + 2 L_N^2_\epsilon
      _ \end{aligned}$$

The above uses multiples times_the fact that $0 \leq_q' \leq_1$ and $q'' \leq 0$_(proven in items_3 and_4 of Lemma_\[l:qproperties\]). The second inequality is by_Young’s inequality, the_third inequality is by item 2_of_Lemma \[l