}}\|\nabla f({\mathbf{x}}_t)\|$, and expected norm of the average gradient ${\mathbb{E}}\|\frac{1}{T} \sum_t \nabla f({\mathbf{x}}_t)\|$, both when taking the actual gradient and when taking the noisy version of the gradient.

Note that although the theorem does not directly consider randomized sampling schemes for computing ${{\mathbf{x}_{\mathrm{out}}}}$, the performance of any scheme that samples ${{\mathbf{x}_{\mathrm{out}}}}$ out of $\{{\mathbf{x}}_1,\dots,{\mathbf{x}}_T\}$ is bounded from below by the optimality criterion $\min_{t}{\|\nabla f({\mathbf{x}}_t)\|}$, making the guarantees by the theorem applicable.

The example provided by the theorem comes with a guarantee that $f({\mathbf{x}}_1) - f({\mathbf{x}}_t)\leq \Delta$ holds almost surely for any $t$: This is a strictly weaker assumption on ${\mathbf{x}}_1$ than used in the standard bounds in this setting, which require $f({\mathbf{x}}_1) - f({\mathbf{x}}_*)\leq \Delta$ with ${\mathbf{x}}_*$ being a stationary point with $f({\mathbf{x}}_*)\leq {\mathbb{E}}f({\mathbf{x}}_T)$. Note that although the specific function used in the proof of the theorem does not have any stationary points, the construction can be adjusted at areas that are far enough from the points queried by the method such that a stationary point (see e.g., [Lemma \[L:detbound\]]{}).

Setting $$\Delta \leftarrow \Delta - \frac{ \sigma \sqrt{\Delta  L (T-1)+\sigma ^2/16}-\sigma^2/4}{2L(T-1)}$$ in [Thm. \[thm:aggregation\_step\]]{}, we get (after some basic algebra) that $\forall t\in \{1,\dots, T,\mathrm{out}\}$ $$\begin{aligned}
    & f({\mathbf{x}}_1) - f({\mathbf{x}}_t) \overset{\text{a.s.}}{\leq} \Delta, \\
    & \| \nabla f({\mathbf{x}}_t) \|^2 \overset{\text{a.s.}}{\geq} \frac{ \sigma \sqrt{\Delta  L (
} } \|\nabla f({\mathbf{x}}_t)\|$, and expected norm of the average gradient $ { \mathbb{E}}\|\frac{1}{T } \sum_t \nabla f({\mathbf{x}}_t)\|$, both when taking the actual gradient and when take the noisy interpretation of the gradient. 

 Note that although the theorem does not directly consider randomized sample schemes for computing $ { { \mathbf{x}_{\mathrm{out}}}}$, the performance of any dodge that samples $ { { \mathbf{x}_{\mathrm{out}}}}$ out of $ \{{\mathbf{x}}_1,\dots,{\mathbf{x}}_T\}$ is bounded from downstairs by the optimality criterion $ \min_{t}{\|\nabla f({\mathbf{x}}_t)\|}$, making the guarantee by the theorem applicable. 

 The example provided by the theorem come with a guarantee that $ f({\mathbf{x}}_1) - f({\mathbf{x}}_t)\leq \Delta$ holds about surely for any $ t$: This is a strictly decrepit premise on $ { \mathbf{x}}_1 $ than used in the standard bounds in this setting, which want $ f({\mathbf{x}}_1) - f({\mathbf{x}}_*)\leq \Delta$ with $ { \mathbf{x}}_*$ being a stationary point with $ f({\mathbf{x}}_*)\leq { \mathbb{E}}f({\mathbf{x}}_T)$. Note that although the specific function used in the proof of the theorem does not experience any stationary points, the construction can be adjusted at areas that are far enough from the points question by the method such that a stationary point (see e.g., [ Lemma   \[L: detbound\ ] ] { }). 

 Setting $ $ \Delta \leftarrow \Delta - \frac { \sigma \sqrt{\Delta   L (T-1)+\sigma ^2/16}-\sigma^2/4}{2L(T-1)}$$ in [ Thm.   \[thm: aggregation\_step\ ] ] { }, we beget (after some basic algebra) that $ \forall t\in \{1,\dots, T,\mathrm{out}\}$ $ $ \begin{aligned } 
     & f({\mathbf{x}}_1) - f({\mathbf{x}}_t) \overset{\text{a.s.}}{\leq } \Delta, \\ 
     & \| \nabla f({\mathbf{x}}_t) \|^2 \overset{\text{a.s.}}{\geq } \frac { \sigma \sqrt{\Delta   L (
}}\|\nabpa f({\mathbf{x}}_t)\|$, and expectea norm of the arwrage jradienf ${\mathbb{D}}\|\frac{1}{T} \sum_t \nabla f({\mathbf{x}}_t)\|$, uoth when taking the actual graaient and when tajing rhe noisy tsrsion of the nradiznv.

Note that althpugh the tveorem does nod aixectly consider randomized sampling fchemes flr computing ${{\mwthbg{v}_{\matggm{iut}}}}$, the performance of any scgeme thet samples ${{\mathnf{x}_{\mathrm{out}}}}$ out of $\{{\mathbf{d}}_1,\dotd,{\mathbf{x}}_T\}$ is boundfd from beliw br the optimalkty criterpmn $\min_{t}{\|\nabma f({\mathbf{x}}_t)\|}$, making the guarantdes bv the theorgm aoklicable.

The xxamplv provided by the themrem cokes with a guavantex thqt $f({\mathbf{x}}_1) - f({\mathbf{x}}_v)\leq \Delta$ holds almjst surelf yor any $t$: This is a srructly weaner xwsuoptjoi oh ${\mathhf{x}}_1$ than used in the stabdard bounds in thix fvyting, which dequirq $s({\mathbf{x}}_1) - f({\mathbf{x}}_*)\leq \Delta$ with ${\mathbf{q}}_*$ bejng a stationary point qith $f({\mathbf{x}}_*)\leq {\mathhb{E}}f({\mathbs{x}}_T)$. Note that although the specific function used in tie prion of rhf theorem does not have any stationary points, fht cpnstruction cak be adjusted at atews jhat are far evough ydoj the points querifd by tre merhod such thay a stationary point (see e.g., [Lemma \[L:detbolnd\]]{}).

Swtting $$\Delta \leftaxrow \Delta - \yrac{ \sogma \xqrt{\Delta  L (T-1)+\sigma ^2/16}-\sigoa^2/4}{2L(T-1)}$$ in [Thm. \[thm:ahgregatioh\_rtep\]]{}, we get (aftef spma basic algebra) that $\foralj t\in \{1,\dotw, T,\mcthrm{out}\}$ $$\begon{aligged}
    & f({\mwthbf{w}}_1) - f({\mathbf{x}}_t) \overseh{\text{c.s.}}{\leq} \Delta, \\
    & \| \nabla f({\mathbf{x}}_t) \|^2 \overset{\text{e.x.}}{\geq} \frac{ \sibmd \sxrt{\Delta  L (
}}\|\nabla f({\mathbf{x}}_t)\|$, and expected norm of the ${\mathbb{E}}\|\frac{1}{T} \nabla f({\mathbf{x}}_t)\|$, when taking the the version of the Note that although theorem does not directly consider randomized schemes for computing ${{\mathbf{x}_{\mathrm{out}}}}$, the performance of any scheme that samples ${{\mathbf{x}_{\mathrm{out}}}}$ out $\{{\mathbf{x}}_1,\dots,{\mathbf{x}}_T\}$ is bounded from below by the optimality criterion $\min_{t}{\|\nabla f({\mathbf{x}}_t)\|}$, making the by theorem The provided by the theorem comes with a guarantee that $f({\mathbf{x}}_1) - f({\mathbf{x}}_t)\leq \Delta$ holds almost surely any $t$: This is a strictly weaker assumption ${\mathbf{x}}_1$ than used in standard bounds in this setting, require - f({\mathbf{x}}_*)\leq with being stationary point with {\mathbb{E}}f({\mathbf{x}}_T)$. Note that although the specific function used in the proof of the theorem does not have stationary points, can be at that far enough from queried by the method such that (see e.g., [Lemma \[L:detbound\]]{}). Setting $$\Delta \leftarrow \Delta \frac{ \sigma L (T-1)+\sigma ^2/16}-\sigma^2/4}{2L(T-1)}$$ in [Thm. \[thm:aggregation\_step\]]{}, get (after some basic algebra) that $\forall t\in T,\mathrm{out}\}$ $$\begin{aligned} & f({\mathbf{x}}_1) - f({\mathbf{x}}_t) \overset{\text{a.s.}}{\leq} \Delta, \\ & \| \nabla f({\mathbf{x}}_t) \|^2 \overset{\text{a.s.}}{\geq} \sqrt{\Delta L (
}}\|\nabla f({\mathbf{x}}_t)\|$, and expected Norm of the aVeragE grAdiEnT ${\matHbb{E}}\|\Frac{1}{T} \sum_t \nabla F({\MathBf{x}}_t)\|$, both when taking the aCtual GrADienT AnD when Taking tHE nOISy vErSiOn oF tHE gRadieNt.

NOte that Although thE thEoRem does not diREcTly consideR raNdomized sampLinG schemEs For COmputIng ${{\MathbF{x}_{\mathRM{out}}}}$, thE performaNcE Of any sCHeme thaT SAmPles ${{\Mathbf{x}_{\mathrm{out}}}}$ oUT oF $\{{\Mathbf{x}}_1,\dots,{\matHbf{x}}_T\}$ iS bOUnDED frOm bElow by the oPtImaliTY criterIOn $\MIN_{T}{\|\naBLa f({\mathbf{x}}_t)\|}$, maKing the guarANteEs by thE tHeoREm applIcablE.

THE exAmple providEd by The theoreM comes WIth a guaRAntee thAt $f({\matHbf{X}}_1) - f({\mAthbF{X}}_t)\LeQ \DeLtA$ HolDS aLmoST suRely for aNy $T$: THis is A strICTLY weaKer AssuMptioN on ${\mathbf{x}}_1$ thaN usEd in THe sTandaRd bouNds iN tHis seTting, wHich rEqUire $f({\mathbf{x}}_1) - f({\maThbf{X}}_*)\leq \Delta$ WitH ${\mAthBf{X}}_*$ beinG A statiOnaRy pOint witH $f({\mathbF{X}}_*)\leQ {\mATHBb{e}}f({\mathbf{x}}_T)$. Note that AlTHOuGh the speCific fUNcTiON used in tHe ProOf of THE theoRem dOEs Not have aNy statIOnArY points, ThE constRuCtiOn cAn be aDJustEd at arEas that aRe far ENough from the poINts queried by tHE mETHoD Such ThaT a stationarY poiNT (see E.g., [LeMMa \[l:deTBound\]]{}).

settiNg $$\dElTA \leftarrow \Delta - \frac{ \SiGma \sqrT{\DeltA  L (T-1)+\sigma ^2/16}-\sigma^2/4}{2l(T-1)}$$ in [Thm. \[thm:AGGRegation\_Step\]]{}, WE gET (after some basiC algeBra) that $\forALl t\in \{1,\dotS, T,\matHrm{out}\}$ $$\beGin{aligneD}
    & F({\Mathbf{x}}_1) - f({\MatHbf{X}}_t) \oVerSET{\tExt{a.s.}}{\leq} \Delta, \\
    & \| \NABla f({\MaThbf{x}}_t) \|^2 \oVerSet{\text{A.s.}}{\gEq} \fRac{ \SigMa \Sqrt{\Delta  l (
}}\|\nabla f({\mathbf{x}}_ t)\|$, and  expe cte d n or m of  the  average gradi e nt $ {\mathbb{E}}\|\frac{1} {T} \ su m _t \ n ab la f( {\mathb f {x } } _t) \| $,  bo th wh en ta kin g the a ctual grad ien tand when tak i ng  the noisy  ve rsion of the  gr adient .
No t e tha t a lthou gh the theore m does no td irectl y  consid e r  r ando mized sampling sc h em e s for computin g ${{\ ma t hb f { x}_ {\m athrm{out} }} }$, t h e perfo r ma n c e  of any scheme th at samples$ {{\ mathbf {x }_{ \ mathrm {out} }} } $ o ut of $\{{\ math bf{x}}_1, \dots, { \mathbf { x}}_T\} $ is b oun ded  fro m  b el owby the op tim a lit y criter io n$\min _{t} { \ | \ nabl a f ({\m athbf {x}}_t)\|}$,mak ingt heguara ntees  byth e the orem a pplic ab le.

The exampl e pr ovided by  th ethe or em co m es wit h a  gu arantee  that $ f ({\ ma t h b f{ x}}_1) - f({\mathb f{ x } }_ t)\leq \ Delta$ ho ld s  almostsu rel y fo r any $ t$:T hi s is a s trictl y  w ea ker ass um ptionon  ${ \ma thbf{ x }}_1 $ than  used in  thes tandard bounds in this setti n g, w hi c h re qui re $f({\mat hbf{ x }}_1 ) -f ({ \ma t hbf{x }}_*) \l e q\ Delta$ with ${\math bf {x}}_* $ bei ng a stationa ry point w i t h  $f({\ma thbf { x} } _*)\leq {\math bb{E} }f({\mathb f {x}}_T)$ . Not e that a lthough t h e  specifi c f unc tio n u s e din the proofo f  the  t heoremdoe s not h ave  an y s tat io nary poin ts, theco ns tr uc tio n can be adjus te d a tare as th a t arefar e noug hfr o m t he poin t sq u erie dby  the  me th od su ch t h ata stati onary poi nt( seee. g. , [Lemm a \[L:detboun d\ ]]{}).

Se tt ing  $$\De l t a \lefta rrow \Delta - \frac{ \s i gma \sq rt{ \Delt a  L  (T-1)+\s igm a ^2/1 6}- \ sigma^ 2/4}{2 L(T-1 )} $$i n  [Thm . \[ thm :a ggregation \ _ ste p\]]{ },  weget (af ter some basic alg e bra ) that $\fora llt\in \ {1 ,\d o ts ,  T, \m a thr m { out}\}$ $$\begi n{aligned} 
 & f({\math b f{x }} _1) - f ({\math bf{x} } _t) \ov erset{\te xt{a.s.}} {\ leq} \ Del ta, \\
   & \| \n abla f({\ m athbf { x} }_t)\|^ 2 \ove rs et{ \text {a.s.} } {\g eq} \ frac{\s igma \ sqrt{ \D elta  L(
}}\|\nabla f({\mathbf{x}}_t)\|$,_and expected_norm of the average_gradient ${\mathbb{E}}\|\frac{1}{T}_\sum_t_\nabla f({\mathbf{x}}_t)\|$,_both_when taking the_actual gradient and_when taking the noisy_version of the_gradient.

Note_that although the theorem does not directly consider randomized sampling schemes for computing ${{\mathbf{x}_{\mathrm{out}}}}$,_the_performance of_any_scheme_that samples ${{\mathbf{x}_{\mathrm{out}}}}$ out of_$\{{\mathbf{x}}_1,\dots,{\mathbf{x}}_T\}$ is bounded from below_by the_optimality criterion $\min_{t}{\|\nabla f({\mathbf{x}}_t)\|}$, making the guarantees by_the_theorem applicable.

The example_provided by the theorem comes with a guarantee that_$f({\mathbf{x}}_1) - f({\mathbf{x}}_t)\leq \Delta$ holds almost_surely for any_$t$:_This_is a strictly weaker_assumption on ${\mathbf{x}}_1$ than used in_the standard bounds in this setting,_which require $f({\mathbf{x}}_1) - f({\mathbf{x}}_*)\leq \Delta$ with_${\mathbf{x}}_*$ being a stationary point with_$f({\mathbf{x}}_*)\leq {\mathbb{E}}f({\mathbf{x}}_T)$. Note that although_the specific_function used in the proof_of the theorem_does not_have any stationary_points, the construction can be adjusted_at areas that_are far enough from the points_queried_by the method_such_that_a stationary_point (see e.g.,_[Lemma \[L:detbound\]]{}).

Setting_$$\Delta \leftarrow_\Delta_- \frac{ \sigma \sqrt{\Delta  L_(T-1)+\sigma_^2/16}-\sigma^2/4}{2L(T-1)}$$ in [Thm. \[thm:aggregation\_step\]]{}, we get (after some_basic algebra) that $\forall_t\in_\{1,\dots, T,\mathrm{out}\}$ $$\begin{aligned}
 _  & f({\mathbf{x}}_1) -_f({\mathbf{x}}_t) \overset{\text{a.s.}}{\leq} \Delta, \\
  _ &_\| \nabla_f({\mathbf{x}}_t) \|^2 \overset{\text{a.s.}}{\geq} \frac{ \sigma \sqrt{\Delta  L (