arg \min_{s\in m}\left\{ P_{n}\left( \gamma \left(
s\right) \right) \right\} \\
& =\arg \min_{s\in m}\left\{ \frac{1}{n}\sum_{i=1}^{n}\left( Y_{i}-s\left(
X_{i}\right) \right) ^{2}\right\},\end{aligned}$$where $P_{n}=n^{-1}\sum_{i=1}^{n}\delta _{\xi _{i}}$ is the *empirical measure* built from the data.

The performance of the least-squares estimators is tackled through their *excess loss*,$$\ell \left( s_{\ast },\widehat{s}_{m}\right) :=P\left( \gamma \left( \widehat{s}_{m}\right) -\gamma \left( s_{\ast }\right) \right) =\left\Vert \widehat{s}_{m}-s_{\ast }\right\Vert _{2}^{2}.$$We split the excess risk into a sum of two terms,$$\ell \left( s_{\ast },\widehat{s}_{m}\right) =\ell \left( s_{\ast },s_{m}\right)
+\ell \left( s_{m},\widehat{s}_{m}\right),$$where$$\ell \left( s_{\ast },s_{m}\right) :=P\left( \gamma \left( s_{m}\right)
-\gamma \left( s_{\ast }\right) \right) =\left\Vert s_{m}-s_{\ast
}\right\Vert _{2}^{2}\text{ \ \ \ and \ \ \ }\ell \left( s_{m},\widehat{s}_{m}\right) :=P\left( \gamma \left( \widehat{s}_{m}\right) -\gamma \left(
s_{m}\right) \right) \geq 0.$$The quantity $\ell \left( s_{\ast },s_{m}\right) $ is a deterministic term called the *bias* of the model $m$, while $\ell \left( s_{m},\widehat{s}_{m}\right) $ is a random variable that we call the *excess risk* of the least-squares estimator $\widehat{s}_{m}$ *on the model* $m$. Notice that by the
arg \min_{s\in m}\left\ { P_{n}\left (\gamma \left (
 s\right) \right) \right\ } \\ 
 & = \arg \min_{s\in m}\left\ { \frac{1}{n}\sum_{i=1}^{n}\left (Y_{i}-s\left (
 X_{i}\right) \right) ^{2}\right\},\end{aligned}$$where $ P_{n}=n^{-1}\sum_{i=1}^{n}\delta _ { \xi _ { i}}$ is the * empirical measure * built from the data. 

 The operation of the least - public square estimators is tackled through their * excess loss*,$$\ell \left (s_{\ast }, \widehat{s}_{m}\right): = P\left (\gamma \left (\widehat{s}_{m}\right) -\gamma \left (s_{\ast } \right) \right) = \left\Vert \widehat{s}_{m}-s_{\ast } \right\Vert _ { 2}^{2}.$$We separate the excess hazard into a sum of two terms,$$\ell \left (s_{\ast }, \widehat{s}_{m}\right) = \ell \left (s_{\ast }, s_{m}\right) 
 + \ell \left (s_{m},\widehat{s}_{m}\right),$$where$$\ell \left (s_{\ast }, s_{m}\right): = P\left (\gamma \left (s_{m}\right) 
 -\gamma \left (s_{\ast } \right) \right) = \left\Vert s_{m}-s_{\ast 
 } \right\Vert _ { 2}^{2}\text { \ \ \ and \ \ \ } \ell \left (s_{m},\widehat{s}_{m}\right): = P\left (\gamma \left (\widehat{s}_{m}\right) -\gamma \left (
 s_{m}\right) \right) \geq 0.$$The quantity $ \ell \left (s_{\ast }, s_{m}\right) $ is a deterministic term call the * bias * of the model $ m$, while $ \ell \left (s_{m},\widehat{s}_{m}\right) $ is a random variable star that we visit the * excess risk * of the least - square estimator $ \widehat{s}_{m}$ * on the model * $ m$. Notice that by the
arg \min_{s\in m}\left\{ P_{n}\left( \gamoa \left(
s\right) \rntht) \rijht\} \\
& =\arf \min_{s\in m}\left\{ \frac{1}{n}\sum_{i=1}^{n}\left( Y_{i}-s\lefv(
X_{i}\rught) \eight) ^{2}\right\},\end{aligned}$$wfere $P_{n}=n^{-1}\slm_{i=1}^{n}\delta _{\xi _{m}}$ is the *empiricem measuvz* buimb frok the data.

The pgrformance ox the least-squdrds estimators is tackled through theiw *excesx poss*,$$\ell \left( s_{\wst },\eydehzn{s}_{n}\right) :=P\left( \gamma \left( \widehzt{s}_{m}\rigit) -\gamma \left( s_{\sst }\right) \right) =\left\Vert \wldehwt{s}_{m}-s_{\ast }\right\Vert _{2}^{2}.$$We split tye evxess risk ingo a sum of two terms,$$\eml \left( s_{\ast },\widehat{s}_{m}\right) =\ell \left( s_{\ast },s_{m}\rithr)
+\elp \left( s_{m},\widxhat{s}_{m}\gight),$$where$$\ell \left( s_{\avt },s_{m}\ribht) :=P\left( \gamms \lxft( w_{m}\right)
-\gamma \left( s_{\asv }\right) \right) =\left\Vett s_{m}-s_{\ast
}\rhgkt\Vert _{2}^{2}\text{ \ \ \ and \ \ \ }\eol \lext( s_{k},\widdyat{r}_{m}\rjgit) :=L\left( \hamja \left( \wisehat{s}_{m}\righr) -\gamma \left(
s_{m}\right) \rytht) \geq 0.$$The qhantitr $\qll \left( s_{\ast },s_{m}\right) $ is a deterministpc tsrm called the *bias* of rhe model $m$, while $\ell \left( s_{m},\wydehat{s}_{m}\right) $ is a random variable that we call dhe *eecdss rlsk* ud hhe least-squares estimator $\widehat{s}_{m}$ *on the mjsek* $k$. Notice that ny the
arg \min_{s\in m}\left\{ P_{n}\left( \gamma \left( s\right) \\ =\arg \min_{s\in \frac{1}{n}\sum_{i=1}^{n}\left( Y_{i}-s\left( X_{i}\right) is *empirical measure* built the data. The of the least-squares estimators is tackled their *excess loss*,$$\ell \left( s_{\ast },\widehat{s}_{m}\right) :=P\left( \gamma \left( \widehat{s}_{m}\right) -\gamma \left( s_{\ast \right) =\left\Vert \widehat{s}_{m}-s_{\ast }\right\Vert _{2}^{2}.$$We split the excess risk into a sum of terms,$$\ell s_{\ast =\ell s_{\ast },s_{m}\right) +\ell \left( s_{m},\widehat{s}_{m}\right),$$where$$\ell \left( s_{\ast },s_{m}\right) :=P\left( \gamma \left( s_{m}\right) -\gamma \left( s_{\ast }\right) =\left\Vert s_{m}-s_{\ast }\right\Vert _{2}^{2}\text{ \ \ \ and \ \ }\ell \left( :=P\left( \gamma \left( \widehat{s}_{m}\right) -\gamma s_{m}\right) \geq 0.$$The $\ell s_{\ast $ is a term called the *bias* of the model $m$, while $\ell \left( s_{m},\widehat{s}_{m}\right) $ is a random variable we call risk* of least-squares $\widehat{s}_{m}$ the model* $m$. by the
arg \min_{s\in m}\left\{ P_{n}\left( \gamma \Left(
s\right) \Right) \RigHt\} \\
& =\aRg \Min_{s\In m}\lEft\{ \frac{1}{n}\sum_{i=1}^{n}\lEFt( Y_{i}-S\left(
X_{i}\right) \right) ^{2}\right\},\End{alIgNEd}$$whERe $p_{n}=n^{-1}\suM_{i=1}^{n}\deltA _{\Xi _{I}}$ IS thE *eMpIriCaL MeAsure* BuiLt from tHe data.

The pErfOrMance of the leASt-Squares estImaTors is tackleD thRough tHeIr *eXCess lOss*,$$\Ell \leFt( s_{\ast },\WIdehat{S}_{m}\right) :=P\lEfT( \Gamma \lEFt( \widehAT{S}_{m}\RighT) -\gamma \left( s_{\ast }\rigHT) \rIGht) =\left\Vert \widEhat{s}_{m}-S_{\aST }\rIGHt\VErt _{2}^{2}.$$we split the ExCess rISk into a SUm OF TWo tERms,$$\ell \left( s_{\asT },\widehat{s}_{m}\rIGht) =\Ell \lefT( s_{\Ast },S_{M}\right)
+\Ell \leFt( S_{M},\wiDehat{s}_{m}\righT),$$wheRe$$\ell \left( S_{\ast },s_{m}\RIght) :=P\leFT( \gamma \lEft( s_{m}\rIghT)
-\gaMma \lEFt( S_{\aSt }\rIgHT) \riGHt) =\LefT\verT s_{m}-s_{\ast
}\rIgHt\vert _{2}^{2}\tExt{ \ \ \ aND \ \ \ }\ELL \lefT( s_{m},\WideHat{s}_{m}\Right) :=P\left( \gamMa \lEft( \wIDehAt{s}_{m}\rIght) -\gAmma \LeFt(
s_{m}\rIght) \riGht) \geQ 0.$$THe quantity $\ell \leFt( s_{\aSt },s_{m}\right) $ Is a DeTerMiNistiC Term caLleD thE *bias* of The modeL $M$, whIlE $\ELL \lEft( s_{m},\widehat{s}_{m}\righT) $ iS A RaNdom variAble thAT wE cALl the *excEsS riSk* of THE leasT-squAReS estimatOr $\wideHAt{S}_{m}$ *On the moDeL* $m$. NotiCe ThaT by The
arg \min_{s\in m}\left\{ P _{n}\left(  \gam ma\le ft (
s\ righ t) \right) \ri g ht\}  \\
& =\arg \min_{s\in  m}\l ef t \{ \ f ra c{1}{ n}\sum_ { i= 1 } ^{n }\ le ft(  Y _ {i }-s\l eft (
X_{i} \right) \r igh t)  ^{2}\right\ } ,\ end{aligne d}$ $where $P_{n }=n ^{-1}\ su m_{ i =1}^{ n}\ delta  _{\xi _{i}}$  is the * em p irical measure * bu iltfrom the data.

T h ep erformance ofthe le as t -s q u are s e stimatorsis  tack l ed thro u gh t h eir *excess loss* ,$$\ell \le f t(s_{\as t},\ w idehat {s}_{ m} \ rig ht) :=P\lef t( \ gamma \le ft( \w i dehat{s } _{m}\ri ght) - \ga mma  \le f t(  s _{\ as t  }\ r ig ht) \ri ght) =\l ef t\ Vert\wid e h a t {s}_ {m} -s_{ \ast}\right\Vert_{2 }^{2 } .$$ We sp lit t he e xc ess r isk in to asu m of two terms, $$\e ll \left(  s_ {\ ast  } ,\wid e hat{s} _{m }\r ight) = \ell \l e ft(  s _ { \ as t },s_{m}\right)
+ \e l l  \ left( s_ {m},\w i de ha t {s}_{m}\ ri ght ),$$ w h ere$$ \ell \l eft( s_{ \ast } , s_ {m }\right ):=P\le ft ( \ gam ma \l e ft(s_{m}\ right)
- \gamm a  \left( s_{\as t  }\right) \ri g ht ) =\ l eft\ Ver t s_{m}-s_{ \ast }\ri ght\ V er t _ { 2}^{2 }\tex t{ \\  \ and \ \ \ }\ell\l eft( s _{m}, \widehat{s}_{ m}\right): = P \left( \ gamm a  \ l eft( \widehat{ s}_{m }\right) - \ gamma \l eft(s_{m}\ri ght) \rig h t ) \geq 0 .$$ The  qu ant i t y$\ell \left(s _ {\as t},s_{m} \ri ght) $isa d ete rmi ni stic term  calledth e*b ia s*of th e  model $ m$ , w hi le$\ell \left(  s_{m },\w id eh a t{s }_{m}\r i gh t )  $ i sarand omva riabl e th a t w e callthe *exce ssr isk*  o fthe lea st-squares es ti mator $\wi de hat {s}_{m } $  *on the  model* $m$. Notice tha t  by the 
arg \min_{s\in_m}\left\{ P_{n}\left(_\gamma \left(
s\right) \right) \right\}_\\
& =\arg_\min_{s\in_m}\left\{ \frac{1}{n}\sum_{i=1}^{n}\left(_Y_{i}-s\left(
X_{i}\right)_\right) ^{2}\right\},\end{aligned}$$where $P_{n}=n^{-1}\sum_{i=1}^{n}\delta__{\xi _{i}}$ is_the *empirical measure* built_from the data.

The_performance_of the least-squares estimators is tackled through their *excess loss*,$$\ell \left( s_{\ast },\widehat{s}_{m}\right) :=P\left(_\gamma_\left( \widehat{s}_{m}\right)_-\gamma_\left(_s_{\ast }\right) \right) =\left\Vert \widehat{s}_{m}-s_{\ast_}\right\Vert _{2}^{2}.$$We split the excess_risk into_a sum of two terms,$$\ell \left( s_{\ast },\widehat{s}_{m}\right)_=\ell_\left( s_{\ast },s_{m}\right)
+\ell_\left( s_{m},\widehat{s}_{m}\right),$$where$$\ell \left( s_{\ast },s_{m}\right) :=P\left( \gamma \left( s_{m}\right)
-\gamma_\left( s_{\ast }\right) \right) =\left\Vert s_{m}-s_{\ast
}\right\Vert__{2}^{2}\text{ \ \_\_and_\ \ \ }\ell_\left( s_{m},\widehat{s}_{m}\right) :=P\left( \gamma \left( \widehat{s}_{m}\right)_-\gamma \left(
s_{m}\right) \right) \geq 0.$$The quantity_$\ell \left( s_{\ast },s_{m}\right) $ is a_deterministic term called the *bias* of_the model $m$, while $\ell_\left( s_{m},\widehat{s}_{m}\right)_$ is a random variable_that we call_the *excess_risk* of the_least-squares estimator $\widehat{s}_{m}$ *on the model*_$m$. Notice that_by the