 entries in $\hat{\Gamma}_{{\widehat{S}}}$. Below we show that the paired bootstrap can be deployed to construct analogous confidence sets, centered at $\hat{\beta}_{{\widehat{S}}}$, without knowledge of $\hat{\Gamma}_{{\widehat{S}}}$.

Throughout, by the bootstrap distribution we mean the empirical probability measure associated to the sub-sample $\mathcal{D}_{2,n}$ and conditionally on $\mathcal{D}_{1,n}$ and the outcome of the sample splitting procedure.

We let $\hat{\beta}^*_{{\widehat{S}}}$ denote the estimator of the projection parameters $\beta_{{\widehat{S}}}$ of the form and arising from an i.i.d. sample of size $n$ drawn from the bootstrap distribution. It is important to point out that $\hat{\beta}^*_{{\widehat{S}}}$ is well-defined only provided that the bootstrap realization of the covariates $(X_1^*,\ldots,X_n^*)$ is such that the corresponding $k$-dimensional empirical covariance matrix $$\frac{1}{n} \sum_{i \in \mathcal{I}_{2,n}} X_i^*({\widehat{S}}) (X_i^*({\widehat{S}}))^\top$$ is invertible. Since the data distribution is assumed to have a $d$-dimensional Lebesgue density, this occurs almost surely with respect to the distribution of the full sample $\mathcal{D}_n$ if the bootstrap sample contains more than $k$ distinct values. Thus, the bootstrap guarantees given below only holds on such event. Luckily, this is a matter of little consequence, since under our assumptions the probability that such event does not occur is exponentially small in $n$ (see below).

For a given $\alpha \in (0,1)$, let $\hat{t}^*_\alpha$ be the smallest positive number such that $$\mathbb{P}\left( \sqrt{n} \| \hat{\beta}^*_{{\widehat{S}}} - \hat{\beta}_{{\widehat{S}}}\|
    \leq \hat{t}^*_\alpha \Big| \mathcal{D}_{2,n} \right) \geq 1 - \alpha.$$ Next, let $(\tilde{t}^*_j, j \in {\widehat{S}})$ be such that $$\mathbb{P}\left( \sqrt{n} | \hat{\beta}^*_{{\widehat{S}}}(j) - \hat{\beta}_{{\widehat{S}}}
    (j
entries in $ \hat{\Gamma}_{{\widehat{S}}}$. Below we show that the paired bootstrap can be deployed to manufacture analogous assurance sets, centered at $ \hat{\beta}_{{\widehat{S}}}$, without cognition of $ \hat{\Gamma}_{{\widehat{S}}}$. 

 Throughout, by the bootstrap distribution we intend the empirical probability measuring stick associated to the sub - sample distribution $ \mathcal{D}_{2,n}$ and conditionally on $ \mathcal{D}_{1,n}$ and the result of the sample splitting routine. 

 We let $ \hat{\beta}^*_{{\widehat{S}}}$ denote the calculator of the projection parameters $ \beta_{{\widehat{S}}}$ of the form and arising from an i.i.d. sample of size $ n$ drawn from the bootstrap distribution. It is important to indicate out that $ \hat{\beta}^*_{{\widehat{S}}}$ is well - defined only provided that the bootstrap realization of the covariates $ (X_1^*,\ldots, X_n^*)$ is such that the represent $ k$-dimensional empirical covariance matrix $ $ \frac{1}{n } \sum_{i \in \mathcal{I}_{2,n } } X_i^*({\widehat{S } }) (X_i^*({\widehat{S}}))^\top$$ is invertible. Since the data distribution is assumed to have a $ d$-dimensional Lebesgue concentration, this occurs about surely with respect to the distribution of the full sample $ \mathcal{D}_n$ if the bootstrap sample hold more than $ k$ distinct values. Thus, the bootstrap guarantees given below merely holds on such event. Luckily, this is a matter of little consequence, since under our assumptions the probability that such event does not occur is exponentially small in $ n$ (see downstairs). 

 For a given $ \alpha \in (0,1)$, let $ \hat{t}^*_\alpha$ be the small incontrovertible number such that $ $ \mathbb{P}\left (\sqrt{n } \| \hat{\beta}^*_{{\widehat{S } } } - \hat{\beta}_{{\widehat{S}}}\| 
     \leq \hat{t}^*_\alpha \Big| \mathcal{D}_{2,n } \right) \geq 1 - \alpha.$$ Next, let $ (\tilde{t}^*_j, j \in { \widehat{S}})$ be such that $ $ \mathbb{P}\left (\sqrt{n } | \hat{\beta}^*_{{\widehat{S}}}(j) - \hat{\beta}_{{\widehat{S } } } 
     (j
 enhries in $\hat{\Gamma}_{{\widehat{R}}}$. Below we show that tie pairsd bootsgrap can be deployed to consvrucr anaoogous confidence sets, centered at $\hat{\bwta}_{{\wmdehat{S}}}$, without knowledgc of $\gwt{\Gakna}_{{\widehat{S}}}$.

Throoghout, by tha bootstrap divtfiyution we mean the empirical probabijity messkre associated to uhe sub-aample $\mathcal{D}_{2,n}$ and conditionally on $\matical{D}_{1,n}$ and the putcome of the sample splihtinh procedure.

We let $\jat{\beta}^*_{{\wideyat{S}}}$ eenote the ertimator of the projecjion parameters $\beta_{{\widehat{S}}}$ of ghe fprm and arusung xrom an i.i.d. sampje of size $n$ drawn fsom the bootstrap disbribuvion. It is important to pmint out that $\hat{\bgta}^*_{{\widehat{V}}}$ ns well-defined only peocided thad thd boutsura' rsalizahioi of the cobariates $(X_1^*,\leots,X_n^*)$ is such that trv correspondihg $k$-diiegsional empirical covariance matrix $$\frab{1}{n} \shm_{i \in \mathcal{I}_{2,n}} X_i^*({\wideyat{S}}) (X_i^*({\widehat{S}}))^\top$$ is invertibje. Since the data distribution is assumed to have a $d$-dmmdnsninal Uwbfsgue density, this occurs almost surely with wsskecn to the distribubion of the full ssmolr $\mathcal{D}_n$ if the bootatrap sample contalns morg than $k$ distinst vslues. Thus, the bootstrap guqrantees givvn bwlow only holds on such event. Luclily, yhis is a matter of litcle cohsequence, slnce unded our assumptions thv prmbability that such event qoes not iccux is expunenjially fmall in $n$ (see nalow).

For a given $\aloha \iu (0,1)$, led $\hat{t}^*_\alphw$ be the smallest positive numbxc such that $$\mstvbb{I}\left( \sqrc{n} \| \hab{\beta}^*_{{\widehat{S}}} - \rat{\beta}_{{\widehat{X}}}\|
    \lez \hat{g}^*_\alpha \Big| \mathcan{D}_{2,n} \right) \gqq 1 - \alpha.$$ Nefj, let $(\tilde{t}^*_j, j \in {\wiqehar{S}})$ bw such gfat $$\mathbb{P}\lefy( \sqrt{n} | \kct{\beta}^*_{{\widwhat{S}}}(j) - \hat{\beta}_{{\widchat{S}}}
    (j
entries in $\hat{\Gamma}_{{\widehat{S}}}$. Below we show that bootstrap be deployed construct analogous confidence knowledge $\hat{\Gamma}_{{\widehat{S}}}$. Throughout, by bootstrap distribution we the empirical probability measure associated to sub-sample $\mathcal{D}_{2,n}$ and conditionally on $\mathcal{D}_{1,n}$ and the outcome of the sample splitting We let $\hat{\beta}^*_{{\widehat{S}}}$ denote the estimator of the projection parameters $\beta_{{\widehat{S}}}$ of the and from i.i.d. of size $n$ drawn from the bootstrap distribution. It is important to point out that $\hat{\beta}^*_{{\widehat{S}}}$ well-defined only provided that the bootstrap realization of covariates $(X_1^*,\ldots,X_n^*)$ is such the corresponding $k$-dimensional empirical covariance $$\frac{1}{n} \in \mathcal{I}_{2,n}} (X_i^*({\widehat{S}}))^\top$$ invertible. the data distribution assumed to have a $d$-dimensional Lebesgue density, this occurs almost surely with respect to the distribution of full sample the bootstrap contains than distinct values. Thus, guarantees given below only holds on this is a matter of little consequence, since our assumptions probability that such event does not is exponentially small in $n$ (see below). For given $\alpha \in (0,1)$, let $\hat{t}^*_\alpha$ be the smallest positive number such that $$\mathbb{P}\left( \sqrt{n} - \hat{\beta}_{{\widehat{S}}}\| \leq \hat{t}^*_\alpha \mathcal{D}_{2,n} \right) \geq - Next, $(\tilde{t}^*_j, \in {\widehat{S}})$ such that $$\mathbb{P}\left( \sqrt{n} | \hat{\beta}^*_{{\widehat{S}}}(j) - \hat{\beta}_{{\widehat{S}}} (j
 entries in $\hat{\Gamma}_{{\widehat{S}}}$. below we shoW that The PaiReD booTstrAp can be deployeD To coNstruct analogous confidEnce sEtS, CentEReD at $\haT{\beta}_{{\wiDEhAT{s}}}$, wiThOuT knOwLEdGe of $\hAt{\GAmma}_{{\widEhat{S}}}$.

ThrouGhoUt, By the bootstrAP dIstributioN we Mean the empirIcaL probaBiLitY MeasuRe aSsociAted to THe sub-sAmple $\mathCaL{d}_{2,n}$ and cONditionALLy On $\maThcal{D}_{1,n}$ and the outcOMe OF the sample spliTting pRoCEdURE.

We Let $\Hat{\beta}^*_{{\widEhAt{S}}}$ deNOte the eSTiMATOr oF The projection Parameters $\bETa_{{\wIdehat{s}}}$ oF thE Form anD arisInG FroM an i.i.d. samplE of sIze $n$ drawn From thE BootstrAP distriBution. it iS imPortANt To PoiNt OUt tHAt $\Hat{\BEta}^*_{{\Widehat{S}}}$ Is WeLl-defIned ONLY ProvIdeD thaT the bOotstrap realiZatIon oF The CovarIates $(x_1^*,\ldoTs,x_n^*)$ is sUch thaT the cOrResponding $k$-dimeNsioNal empiriCal CoVarIaNce maTRix $$\fraC{1}{n} \sUm_{i \In \mathcAl{I}_{2,n}} X_i^*({\wIDehAt{s}}) (x_I^*({\WiDehat{S}}))^\top$$ is invertiBlE. sInCe the datA distrIBuTiON is assumEd To hAve a $D$-DImensIonaL leBesgue deNsity, tHIs OcCurs almOsT surelY wIth ResPect tO The dIstribUtion of tHe fulL Sample $\mathcal{D}_N$ If the bootstraP SaMPLe COntaIns More than $k$ diStinCT valUes. THUs, The BOotstRap guArANtEEs given below only holDs On such Event. luckily, this is A matter of lITTLe conseqUencE, SiNCe under our assuMptioNs the probaBIlity thaT such Event doeS not occur IS ExponentIalLy sMalL in $N$ (SEe Below).

For a giveN $\ALpha \In (0,1)$, Let $\hat{t}^*_\AlpHa$ be the SmaLleSt pOsiTiVe number sUch that $$\mAtHbB{P}\LeFt( \sQrt{n} \| \hAT{\beta}^*_{{\widEhAt{S}}} - \HaT{\beTa}_{{\widEHat{S}}}\|
    \leQ \hat{t}^*_\AlphA \BIg| \MAthCal{D}_{2,n} \riGHt) \GEQ 1 - \alpHa.$$ neXt, leT $(\tiLdE{t}^*_j, j \iN {\widEHat{s}})$ be such That $$\mathbB{P}\lEFt( \sqRt{N} | \hAt{\beta}^*_{{\wIdehat{S}}}(j) - \hat{\beTa}_{{\Widehat{S}}}
    (j
 entries in $\hat{\Gamma}_ {{\widehat {S}}} $.Bel ow  weshow  that the pair e d bo otstrap can be deploye d toco n stru c tanalo gous co n fi d e nce  s et s,ce n te red a t $ \hat{\b eta}_{{\wi deh at {S}}}$, with o ut  knowledge  of  $\hat{\Gamm a}_ {{\wid eh at{ S }}}$. 

T hroug hout,b y thebootstrap  d i stribu t ion wem e an  the  empirical probab i li t y measure asso ciated  t o  t h e  su b-s ample $\ma th cal{D } _{2,n}$ an d c ond i tionally on $ \mathcal{D} _ {1, n}$ an dthe outcom e ofth e  sa mple splitt ingprocedure .

Wel et $\ha t {\beta} ^*_{{\ wid eha t{S} } }$  d eno te the es tim a tor  of thepr oj ectio n pa r a m e ters  $\ beta _{{\w idehat{S}}}$ofthef orm  andarisi ng f ro m ani.i.d.  samp le  of size $n$ dr awnfrom theboo ts tra pdistr i bution . I t i s impor tant to poi nt o u tthat $\hat{\beta}^ *_ { { \w idehat{S }}}$ i s  w el l -defined  o nly  pro v i ded t hatt he  bootstr ap rea l iz at ion ofth e cova ri ate s $ (X_1^ * ,\ld ots,X_ n^*)$ is  such that the corre s ponding $k$-d i me n s io n al e mpi rical covar ianc e  mat rix$ $\ fra c {1}{n } \su m_ { i\ in \mathcal{I}_{2,n }}  X_i^* ({\wi dehat{S}}) (X _i^*({\wid e h a t{S}}))^ \top $ $i s invertible.Since  the datad istribut ion i s assume d to have a  $d$-dim ens ion alLeb e s gu e density, th i s  occ ur s almos t s urely w ith  re spe ctto  the dist ribution  o fth eful l sam p le $\mat hc al{ D} _n$  if t h e boot strap  sam pl ec ont ains mo r et h an $ k$  d isti nct  v alues . Th u s,the boo tstrap gu ara n tees  g iv en belo w only holdson  such even t.  Lu ckily, t his is a  matter of little conse q uence,sin ce un derour assum pti ons th e p r obabil ity th at su ch  ev e n t doe s no t o cc ur is expo n e nti allysm allin $n$(see below).

Fora  gi ven $\alpha \ in(0,1 ) $ ,let $\ h at{ t} ^ *_\ a l pha$ be the sma llest posi ti v enumber suc h  th at  $$\mat hbb{P}\ left( \sqrt{n } \| \hat {\beta}^* _{ {\wi d e hat {S}}} - \h at{\beta }_{{\wide h at{S} } }\ |
   \l eq \ha t{ t}^ *_\al pha \B i g|\math cal{D} _{ 2,n} \ right )\geq 1 -  \alpha.$$ Next, let $( \tilde {t}^* _j,  j \in {\ wid e hat {S}})$ be  suc h that $$\ mat hbb {P}\l eft (  \sqr t{n} |\ha t {\bet a}^* _ {{\wideha t {S }}} ( j )- \hat{\bet a } _ {{\ wideh at{ S }}}
   (j 
 entries_in $\hat{\Gamma}_{{\widehat{S}}}$._Below we show that_the paired_bootstrap_can be_deployed_to construct analogous_confidence sets, centered_at $\hat{\beta}_{{\widehat{S}}}$, without knowledge_of $\hat{\Gamma}_{{\widehat{S}}}$.

Throughout, by_the_bootstrap distribution we mean the empirical probability measure associated to the sub-sample $\mathcal{D}_{2,n}$ and_conditionally_on $\mathcal{D}_{1,n}$_and_the_outcome of the sample splitting_procedure.

We let $\hat{\beta}^*_{{\widehat{S}}}$ denote the_estimator of_the projection parameters $\beta_{{\widehat{S}}}$ of the form and_arising_from an i.i.d._sample of size $n$ drawn from the bootstrap distribution._It is important to point out_that $\hat{\beta}^*_{{\widehat{S}}}$ is_well-defined_only_provided that the bootstrap_realization of the covariates $(X_1^*,\ldots,X_n^*)$ is_such that the corresponding $k$-dimensional empirical_covariance matrix $$\frac{1}{n} \sum_{i \in \mathcal{I}_{2,n}} X_i^*({\widehat{S}})_(X_i^*({\widehat{S}}))^\top$$ is invertible. Since the data_distribution is assumed to have_a $d$-dimensional_Lebesgue density, this occurs almost_surely with respect_to the_distribution of the_full sample $\mathcal{D}_n$ if the bootstrap_sample contains more_than $k$ distinct values. Thus, the_bootstrap_guarantees given below_only_holds_on such_event. Luckily, this_is_a matter_of_little consequence, since under our assumptions_the_probability that such event does not occur_is exponentially small in_$n$_(see below).

For a given_$\alpha \in (0,1)$, let $\hat{t}^*_\alpha$_be the smallest positive number such_that $$\mathbb{P}\left(_\sqrt{n} \|_\hat{\beta}^*_{{\widehat{S}}} - \hat{\beta}_{{\widehat{S}}}\|
    \leq \hat{t}^*_\alpha \Big| \mathcal{D}_{2,n} \right)_\geq 1 - \alpha.$$ Next, let_$(\tilde{t}^*_j, j \in {\widehat{S}})$_be such_that_$$\mathbb{P}\left( \sqrt{n} |_\hat{\beta}^*_{{\widehat{S}}}(j)_- \hat{\beta}_{{\widehat{S}}}
_   (j