-write $\hat{\beta}_{{\widehat{S}}} -
\beta_{{\widehat{S}}}$ as a linear transformation of $\hat{\psi} - \psi$ given by the Jacobian of $g$ at $\psi$, plus a stochastic reminder term. Since $\hat{\psi} - \psi$ is an average, such approximation is simpler to analyze that the original quantity $\hat{\beta}_{{\widehat{S}}} -
\beta_{{\widehat{S}}}$ and, provided that the reminder term of the Taylor expansion be small, also sufficiently accurate. This program is carried out in detail and greater generality in a later Section \[section::berry\], where we derive finite sample Berry-Esseen bounds for non-linear statistics of sums of independent random vectors. The results in this section are direct, albeit non-trivial, applications of those bounds.

### Concentration of $\hat{\beta}_{{\widehat{S}}}$ {#concentration-of-hatbeta_widehats.unnumbered}

We begin by deriving high probability concentration bonds for $\hat{\beta}_{{\widehat{S}}}$ around $\beta_{{\widehat{S}}}$. When there is no model selection nor sample splitting – so that ${\widehat{S}}$ is deterministic and equal to $\{1,\ldots,d$) – our results yield consistency rates for the ordinary least squares estimator of the projection parameters, under increasing dimensions and a misspecified model. An analogous result was established in [@hsu14], where the approximation error $\mu(x) - x^\top \beta$ is accounted for explicitly.

\[thm:beta.accuracy2\] Let $$B_n  = 
    \frac{ k}{u^2}
    \sqrt{ U \frac{ \log k +
    \log n}{n}}$$ and assume that $\max\{ B_n, u B_n \} \rightarrow 0$ as $n \rightarrow \infty$. Then, there exists a constant $C>0$, dependent on $A$ and $\eta$ only, such that, for all $n$ large enough, $$\label{eq::beta2}
\sup_{w_n \in \mathcal{W}_n} \sup_{P \in \mathcal{P}_n^{\mathrm{OLS}}} \|\hat\beta_{{\widehat{S}}} - \beta_{{\widehat{S}}} \| \leq C
B_n,$$ with probability at last $1 - \frac{2}{n}$.

[**
-write $ \hat{\beta}_{{\widehat{S } } } - 
 \beta_{{\widehat{S}}}$ as a linear transformation of $ \hat{\psi } - \psi$ given by the Jacobian of $ g$ at $ \psi$, plus a stochastic reminder term. Since $ \hat{\psi } - \psi$ is an modal, such estimate is simpler to analyze that the original quantity $ \hat{\beta}_{{\widehat{S } } } - 
 \beta_{{\widehat{S}}}$ and, provide that the admonisher term of the Taylor expansion be small, besides sufficiently accurate. This course of study is carried out in contingent and great generality in a late Section \[section::berry\ ], where we derive finite sample Berry - Esseen bounds for non - analogue statistics of sums of independent random vectors. The results in this section are direct, albeit non - fiddling, applications of those bounds. 

 # # # Concentration of $ \hat{\beta}_{{\widehat{S}}}$ { # concentration-of-hatbeta_widehats.unnumbered } 

 We get down by deriving high probability assiduity bonds for $ \hat{\beta}_{{\widehat{S}}}$ around $ \beta_{{\widehat{S}}}$. When there be no model selection nor sample splitting – so that $ { \widehat{S}}$ is deterministic and equal to $ \{1,\ldots, d$) – our results succumb consistency rates for the ordinary least squares estimator of the projection parameters, under increasing dimensions and a misspecified model. An analogous result was established in [ @hsu14 ], where the approximation error $ \mu(x) - x^\top \beta$ is accounted for explicitly. 

 \[thm: beta.accuracy2\ ] Let $ $ B_n   = 
     \frac { k}{u^2 } 
     \sqrt { U \frac { \log k + 
     \log n}{n}}$$ and assume that $ \max\ { B_n, u B_n \ } \rightarrow 0 $ as $ n \rightarrow \infty$. Then, there exist a constant $ C>0 $, dependent on $ A$ and $ \eta$ entirely, such that, for all $ n$ big enough, $ $ \label{eq::beta2 } 
 \sup_{w_n \in \mathcal{W}_n } \sup_{P \in \mathcal{P}_n^{\mathrm{OLS } } } \|\hat\beta_{{\widehat{S } } } - \beta_{{\widehat{S } } } \| \leq C 
 B_n,$$ with probability at last $ 1 - \frac{2}{n}$. 

 [ * *
-wrihe $\hat{\beta}_{{\widehat{S}}} -
\beta_{{\wldehat{S}}}$ as a lingae tranvformafion of $\fat{\psi} - \psi$ given by the Jaclbuan od $g$ at $\psi$, plus a stocfastic relinder twrm. Wunce $\hat{\psm} - \psi$ is an abcrage, wuch approximajion is simpner to analyze tfac the original quantity $\hat{\beta}_{{\widehwt{S}}} -
\bets_{{\wldehat{S}}}$ and, prjvidtd ehat nht reminder term of the Taylor expznsion ue small, also sifficiently accurate. This oroggam is carried out in detail qnd deeater generxlity in a later Sectikn \[section::berry\], where we derive finice sample Bgxey-Edveen bounds for gon-linear statistics of sumx of independekt raidom vectors. The results mn this section are qirect, altent non-trivial, applicariins ox thmse ciunas.

### Doicehtratiln kf $\hat{\beta}_{{\sidehat{S}}}$ {#cobcentration-of-hatbets_wyeehats.unnumbeded}

We fedin by deriving high probability concenuratikn bonds for $\hat{\beta}_{{\widwhat{S}}}$ around $\beta_{{\widejat{S}}}$. When there is no model selection nor sample splitting – so vhxt ${\clqdyah{S}}$ is deterministic and equal to $\{1,\ldots,d$) – our wssilns yield consistekcy rates for the prfimwry least squxres estijator of the projeftion pwramerers, undew invreasing dimensions and a musspecified iidel. An analogous xesult was ertabkishec in [@hsu14], where the appruximztion error $\mu(x) - x^\tol \beta$ is accountdd nor expliciuuy.

\[thm:beta.accuracy2\] Let $$B_n  = 
    \frac{ k}{j^2}
    \sqrt{ T \frac{ \log k +
    \log n}{n}}$$ and assume that $\mdx\{ B_n, u B_n \} \rightarrow 0$ as $n \rightarrow \iihty$. Then, therg efisns a conscant $C>0$, dependent on $A$ and $\eta$ onli, such thct, for all $n$ larfe enoujh, $$\label{eq::beea2}
\sup_{w_n \in \madjcal{W}_n} \sup_{P \mn \mathcaj{P}_n^{\mqthrn{OLS}}} \|\hag\ceta_{{\widehat{S}}} - \neta_{{\widehcu{S}}} \| \leq C
B_b,$$ with probability at mast $1 - \frac{2}{n}$.

[**
-write $\hat{\beta}_{{\widehat{S}}} - \beta_{{\widehat{S}}}$ as a linear $\hat{\psi} \psi$ given the Jacobian of stochastic term. Since $\hat{\psi} \psi$ is an such approximation is simpler to analyze the original quantity $\hat{\beta}_{{\widehat{S}}} - \beta_{{\widehat{S}}}$ and, provided that the reminder term of Taylor expansion be small, also sufficiently accurate. This program is carried out in and generality a Section \[section::berry\], where we derive finite sample Berry-Esseen bounds for non-linear statistics of sums of independent vectors. The results in this section are direct, non-trivial, applications of those ### Concentration of $\hat{\beta}_{{\widehat{S}}}$ {#concentration-of-hatbeta_widehats.unnumbered} begin deriving high concentration for around $\beta_{{\widehat{S}}}$. When is no model selection nor sample splitting – so that ${\widehat{S}}$ is deterministic and equal to $\{1,\ldots,d$) our results rates for ordinary squares of the projection increasing dimensions and a misspecified model. was established in [@hsu14], where the approximation error - x^\top is accounted for explicitly. \[thm:beta.accuracy2\] Let = \frac{ k}{u^2} \sqrt{ U \frac{ \log k \log n}{n}}$$ and assume that $\max\{ B_n, u B_n \} \rightarrow 0$ as $n \rightarrow there exists a constant dependent on $A$ $\eta$ such for $n$ large $$\label{eq::beta2} \sup_{w_n \in \mathcal{W}_n} \sup_{P \in \mathcal{P}_n^{\mathrm{OLS}}} \|\hat\beta_{{\widehat{S}}} - \beta_{{\widehat{S}}} \| C B_n,$$ with probability at last $1 - \frac{2}{n}$. [**
-write $\hat{\beta}_{{\widehat{S}}} -
\beta_{{\wIdehat{S}}}$ as a LineaR trAnsFoRmatIon oF $\hat{\psi} - \psi$ giveN By thE Jacobian of $g$ at $\psi$, plus a StochAsTIc reMInDer teRm. Since $\HAt{\PSI} - \psI$ iS aN avErAGe, Such aPprOximatiOn is simpleR to AnAlyze that the ORiGinal quantIty $\Hat{\beta}_{{\widehAt{S}}} -
\Beta_{{\wiDeHat{s}}}$ And, prOviDed thAt the rEMinder Term of the taYLor expANsion be SMAlL, alsO sufficiently accuRAtE. this program is cArried OuT In DETaiL anD greater geNeRalitY In a lateR seCTIOn \[sECtion::berry\], wheRe we derive fINitE samplE BErrY-esseen BoundS fOR noN-linear statIstiCs of sums oF indepENdent raNDom vectOrs. The ResUltS in tHIs SeCtiOn ARe dIReCt, aLBeiT non-trivIaL, aPplicAtioNS OF ThosE boUnds.

### conceNtration of $\hat{\BetA}_{{\widEHat{s}}}$ {#concEntraTion-Of-HatbeTa_wideHats.uNnUmbered}

We begin bY derIving high ProBaBilItY concENtratiOn bOndS for $\hat{\Beta}_{{\widEHat{s}}}$ aROUNd $\Beta_{{\widehat{S}}}$. When thErE IS nO model seLectioN NoR sAMple spliTtIng – So thAT ${\WidehAt{S}}$ iS DeTerminisTic and EQuAl To $\{1,\ldots,D$) – oUr resuLtS yiEld ConsiSTencY rates For the orDinarY Least squares esTImator of the prOJeCTIoN ParaMetErs, under incReasINg diMensIOnS anD A missPecifIeD MoDEl. An analogous result WaS estabLisheD in [@hsu14], where thE approximaTION error $\mu(X) - x^\toP \BeTA$ is accounted foR explIcitly.

\[thm:bETa.accuraCy2\] Let $$b_n  = 
    \frac{ k}{u^2}
    \Sqrt{ U \frac{ \LOG k +
    \log n}{n}}$$ aNd aSsuMe tHat $\MAX\{ B_N, u B_n \} \rightarroW 0$ AS $n \riGhTarrow \iNftY$. Then, thEre ExiSts A coNsTant $C>0$, depeNdent on $A$ AnD $\eTa$ OnLy, sUch thAT, for all $n$ LaRge EnOugH, $$\labeL{Eq::beta2}
\Sup_{w_n \In \maThCaL{w}_n} \sUp_{P \in \maTHcAL{p}_n^{\maThRm{oLS}}} \|\hAt\bEtA_{{\wideHat{S}}} - \BEta_{{\Widehat{s}}} \| \leq C
B_n,$$ wiTh pRObabIlItY at last $1 - \Frac{2}{n}$.

[**
-write $\hat{\beta}_{{\wid ehat{S}}}-
\be ta_ {{\ wi deha t{S} }}$ as a linea r  tra nsformation of $\hat{\ psi}-\ psi$ gi ven b y the J a co b i anof  $ g$at $\ psi$,  pl us a st ochastic r emi nd er term. Sin c e$\hat{\psi } -  \psi$ is an  av erage,  s uch appro xim ation  is si m pler t o analyze  t h at the origina l qu anti ty $\hat{\beta}_{ { \w i dehat{S}}} -
\ beta_{ {\ w id e h at{ S}} }$ and, pr ov idedt hat the re m i n der term of the T aylor expan s ion  be sm al l,a lso su ffici en t lyaccurate. T hisprogram i s carr i ed outi n detai l andgre ate r ge n er al ity  i n  al at erS ect ion \[se ct io n::be rry\ ] , w here  we  der ive f inite sampleBer ry-E s see n bou nds f or n on -line ar sta tisti cs  of sums of ind epen dent rand omve cto rs . The result s i n t his sec tion ar e  di re c t ,  a lbeit non-trivial,  a p p li cationsof tho s ebo u nds.

## #Con cent r a tionof $ \ ha t{\beta} _{{\wi d eh at {S}}}${# concen tr ati on- of-ha t beta _wideh ats.unnu mbere d }

We begin by deriving high pr o b ab i lity  co ncentration  bon d s fo r $\ h at {\b e ta}_{ {\wid eh a t{ S }}}$ around $\beta_ {{ \wideh at{S} }}$. When the re is no m o d e l select ionn or sample splitti ng –so that ${ \ widehat{ S}}$is deter ministica n d equalto$\{ 1,\ ldo t s ,d $) – our resu l t s yi el d consi ste ncy rat esfor  th e o rd inary lea st squar es  e st im ato r oft he proje ct ion  p ara meter s , unde r inc reas in gd ime nsionsa nd a  mis sp ec ifie d m od el. A n an a log ous res ult was e sta b lish ed  i n [@hsu 14], where th eapproximat io n e rror $ \ m u(x) - x ^\top \beta$ is account e d for e xpl icitl y.
\[thm:bet a.a ccurac y2\ ]  Let $ $B_n = 
  \fr a c { k}{ u ^ 2} 
  \sqrt{ U \ f r ac{  \log  k  +
   \log  n}{n}}$$ and assu m e t hat $\max\{ B _n,  u B _ n  \ } \ r ig h tar ro w  0$ a s $n \rightarro w \infty$.  T h en , there ex i sts  a  consta nt $C>0 $, de p endenton $A$ an d $\eta$on ly,s u chthat, forall $n$large eno u gh, $ $ \l abel{ eq: :beta2 }\su p_{w_ n \in\ mat hcal{ W}_n}\s up_{P\in \ ma thcal{P} _n^{\mathrm{OLS}}} \|\h at\bet a_{{\ wid ehat{S}}}  -\ bet a_{{\wide hat{ S}}} \| \l eqC
B _n,$$  wi t h pro babi l it y a t  last  $1-  \frac{2} { n} $.[ ** 
-write $\hat{\beta}_{{\widehat{S}}}_-
\beta_{{\widehat{S}}}$ as_a linear transformation of_$\hat{\psi} -_\psi$_given by_the_Jacobian of $g$_at $\psi$, plus_a stochastic reminder term._Since $\hat{\psi} -_\psi$_is an average, such approximation is simpler to analyze that the original quantity $\hat{\beta}_{{\widehat{S}}}_-
\beta_{{\widehat{S}}}$_and, provided_that_the_reminder term of the Taylor_expansion be small, also sufficiently_accurate. This_program is carried out in detail and greater_generality_in a later_Section \[section::berry\], where we derive finite sample Berry-Esseen bounds_for non-linear statistics of sums of_independent random vectors._The_results_in this section are_direct, albeit non-trivial, applications of those_bounds.

### Concentration of $\hat{\beta}_{{\widehat{S}}}$ {#concentration-of-hatbeta_widehats.unnumbered}

We begin_by deriving high probability concentration bonds for_$\hat{\beta}_{{\widehat{S}}}$ around $\beta_{{\widehat{S}}}$. When there is_no model selection nor sample_splitting –_so that ${\widehat{S}}$ is deterministic_and equal to_$\{1,\ldots,d$) –_our results yield_consistency rates for the ordinary least_squares estimator of_the projection parameters, under increasing dimensions_and_a misspecified model._An_analogous_result was_established in [@hsu14],_where_the approximation_error_$\mu(x) - x^\top \beta$ is accounted_for_explicitly.

\[thm:beta.accuracy2\] Let $$B_n  = 
 _  \frac{ k}{u^2}
__  \sqrt{ U_\frac{ \log k +
 _  \log n}{n}}$$ and assume_that $\max\{_B_n, u_B_n \} \rightarrow 0$ as $n \rightarrow \infty$. Then, there exists_a constant $C>0$, dependent on $A$_and $\eta$ only, such_that, for_all_$n$ large enough,_$$\label{eq::beta2}
\sup_{w_n_\in \mathcal{W}_n}_\sup_{P \in \mathcal{P}_n^{\mathrm{OLS}}} \|\hat\beta_{{\widehat{S}}} - \beta_{{\widehat{S}}} \|_\leq C
B_n,$$_with probability at last $1 -_\frac{2}{n}$.

[**