] and model averaging interpretations [@hjort2003frequentist]; the impossibility results of [@leeb2008can], [@buja2015models] on random $X$ and model misspecification; methods based on resampling or sample splitting [@CL:11; @CL:13; @Efron:14; @wasserman2009high; @meinshausen2009pvalues]; stability selection [@meinshausen2010stability; @shah2013variable]; the conformal inference approach of [@lei2016distribution]; goodness-of-fit tests of [@shah2018goodness]; moment-constraint-based uniform confidence sets [@andrews2009hybrid]; [@meinshausen2015group] on inference about groups of variables under general designs; [@belloni2011inference] in the instrumental variable setting; [@belloni2015uniform] on post-selection inference for $Z$-estimators, and the knockoffs approach of [@barber2015controlling] and later [@candes2016panning]. Although they are not directed at linear models,[@wager2014confidence] and [@JMLR:v17:14-168] address similar problems for random forests.

  Method             Parameter      Assumptions   Accuracy                                Computation   Robust
  ------------------ -------------- ------------- --------------------------------------- ------------- --------
  Debiasing          True $\beta$   Very Strong   $1/\sqrt{n}$                            Easy          No
  Conditional        Projection     Strong        Not known                               Easy          No
  Uniform            Projection     Strong        $\sqrt{k/n}$                            NP hard       Yes
  Sample Splitting   Projection     Weak          $\sqrt{k^{5/2}\log k\sqrt{\log n}/n}$   Easy          Yes
  Sample Splitting   LOCO           None          $\sqrt{\log (kn)/n}$                    Easy          Yes

  : *Different inferential methods. ‘accuracy’ refers to the size of sides of the confidence set. ‘robust’ refers to robustness to model assumptions. The term ‘Very Strong’ means that the linear model is assumed to be correct and that there are incoherence assumptions on the design matrix. ‘Strong’ means constant variance and Normality are assumed. ‘Weak’ means only iid and invertible covariance matrix (for the selected variables). ‘None’ means only iid or iid plus a moment assumption.*[]{data-label="table::
] and model averaging interpretations [ @hjort2003frequentist ]; the impossibility results of [ @leeb2008can ], [ @buja2015models ] on random $ X$ and model misspecification; method free-base on resampling or sample splitting [ @CL:11; @CL:13; @Efron:14; @wasserman2009high; @meinshausen2009pvalues ]; stability selection [ @meinshausen2010stability; @shah2013variable ]; the conformal inference approach path of [ @lei2016distribution ]; goodness - of - fit tests of [ @shah2018goodness ]; consequence - restraint - based uniform confidence sets [ @andrews2009hybrid ]; [ @meinshausen2015group ] on inference about groups of variable under general designs; [ @belloni2011inference ] in the implemental variable setting; [ @belloni2015uniform ] on post - selection inference for $ Z$-estimators, and the knockoffs approach of [ @barber2015controlling ] and later [ @candes2016panning ]. Although they are not directed at linear models,[@wager2014confidence ] and [ @JMLR: v17:14 - 168 ] address alike problems for random forests. 

   Method              Parameter       Assumptions    Accuracy                                 Computation    Robust 
   ------------------ -------------- ------------- --------------------------------------- ------------- -------- 
   Debiasing           True $ \beta$    Very solid    $ 1/\sqrt{n}$                             Easy           No 
   Conditional         Projection      Strong         Not known                                Easy           No 
   Uniform             Projection      Strong         $ \sqrt{k / n}$                             NP hard        Yes 
   Sample Splitting    Projection      watery           $ \sqrt{k^{5/2}\log k\sqrt{\log n}/n}$    Easy           Yes 
   Sample Splitting    LOCO            None           $ \sqrt{\log (kn)/n}$                     Easy           Yes 

  : * Different inferential methods. ‘ accuracy ’ refers to the size of sides of the assurance set. ‘ robust ’ refers to robustness to model assumptions. The term ‘ Very solid ’ mean that the linear model is assumed to be correct and that there are incoherence assumptions on the invention matrix. ‘ potent ’ means constant discrepancy and Normality are assume. ‘ Weak ’ means merely iid and invertible covariance matrix (for the selected variables). ‘ None ’ means only iid or iid plus a here and now assumption.*[]{data - label="table::
] anf model averaging interpvetations [@hjort2003ftewuentivt]; the impossicility results of [@leeb2008can], [@buoa2015moeels] in random $X$ and model oisspecifpcation; mwthovs based on resampling ov samlpe s'lmtting [@CL:11; @CL:13; @Efton:14; @wassermat2009high; @meinshauvev2009pralues]; stability selection [@meinshausqn2010stabikihy; @shah2013variablg]; the sonfkgmcl inference approach of [@lei2016disfributimn]; goodness-of-git tests of [@shah2018goodness]; lomejt-constraint-based kniform condidegxe sets [@andrdws2009hybrid]; [@meinshausen2015gtoup] on inference about groups ow varnables undet fejgral designs; [@belljni2011inference] in the hnstrumrntal variable sevtint; [@belloni2015uniform] on pmst-selection infergnce for $Z$-ascimators, and the knocjodfs akproawh ow [@bafbed2015cpnfrollijg] end later [@czndes2016pannint]. Although they are njn directed at lineaw iodels,[@wager2014confidence] and [@JMLR:v17:14-168] address sijilar problems for randim forests.

  Method             Parameter      Assumptions   Accuracy                                Computation   Robust
  ------------------ -------------- ------------- --------------------------------------- ------------- --------
  Debiasing          True $\beta$   Very Stromg   $1/\fqrt{n}$                            Easy          Go
  Cinditionaj        Projection     Strong        Not kuowb                               Essy          No
  Uniform            Projectlon     Sffong        $\sqrt{y/n}$                            N[ hard       Ves
  Samole Xplittyng   Projfctiok     Weak          $\sqrt{n^{5/2}\lmg k\sqrt{\loh n}/n}$   Easy          Yes
  Samplx Splitting   LMCO           Noke          $\sqre{\log (kn)/n}$                    Easy          Yxs

  : *Differegt inferentian methods. ‘accnracy’ refqrs ro tye size uf sides of thr confideuee set. ‘rovust’ refers to robmstnera to model assunptuons. The term ‘Vrry Stwojg’ mqdns that the lindar kodel is assumed go br correct and that tvere are incoherence axsmmptions in the dqsign matrix. ‘Xtrong’ means constwnt veriancx and Moriality are assumed. ‘Weak’ means knly iid wnd invertible sovavianse matrix (yor the selected variables). ‘None’ means onoy iid or iid plus a moment assumptiou.*[]{dsta-label="tabke::
] and model averaging interpretations [@hjort2003frequentist]; the of [@buja2015models] on $X$ and model or splitting [@CL:11; @CL:13; @wasserman2009high; @meinshausen2009pvalues]; stability [@meinshausen2010stability; @shah2013variable]; the conformal inference approach [@lei2016distribution]; goodness-of-fit tests of [@shah2018goodness]; moment-constraint-based uniform confidence sets [@andrews2009hybrid]; [@meinshausen2015group] on inference groups of variables under general designs; [@belloni2011inference] in the instrumental variable setting; [@belloni2015uniform] post-selection for and knockoffs approach of [@barber2015controlling] and later [@candes2016panning]. Although they are not directed at linear models,[@wager2014confidence] and address similar problems for random forests. Method Parameter Accuracy Computation Robust ------------------ ------------- --------------------------------------- ------------- -------- Debiasing $\beta$ Strong $1/\sqrt{n}$ No Projection Not known Easy Uniform Projection Strong $\sqrt{k/n}$ NP hard Yes Sample Splitting Projection Weak $\sqrt{k^{5/2}\log k\sqrt{\log n}/n}$ Easy Yes Sample LOCO None Easy Yes *Different methods. refers to the sides of the confidence set. ‘robust’ to model assumptions. The term ‘Very Strong’ means the linear is assumed to be correct and there are incoherence assumptions on the design matrix. means constant variance and Normality are assumed. ‘Weak’ means only iid and invertible covariance matrix selected variables). ‘None’ means iid or iid a assumption.*[]{data-label="table::
] and model averaging interpreTations [@hjoRt2003freQueNtiSt]; The iMposSibility resultS Of [@leEb2008can], [@buja2015models] on randoM $X$ and MoDEl miSSpEcifiCation; mEThODS baSeD oN reSaMPlIng or SamPle spliTting [@CL:11; @CL:13; @EFroN:14; @wAsserman2009high; @MEiNshausen2009pvAluEs]; stability sEleCtion [@mEiNshAUsen2010sTabIlity; @Shah2013vaRIable]; tHe conformAl INferenCE approaCH Of [@Lei2016dIstribution]; goodneSS-oF-Fit tests of [@shah2018GoodneSs]; MOmENT-coNstRaint-based UnIform COnfidenCE sETS [@AndREws2009hybrid]; [@meinShausen2015grouP] On iNferenCe AboUT groupS of vaRiABleS under generAl deSigns; [@bellOni2011infERence] in THe instrUmentaL vaRiaBle sETtInG; [@beLlONi2015uNIfOrm] ON poSt-selectIoN iNfereNce fOR $z$-EStimAtoRs, anD the kNockoffs approAch Of [@baRBer2015ContrOllinG] and LaTer [@caNdes2016paNning]. alThough they are noT dirEcted at liNeaR mOdeLs,[@Wager2014COnfideNce] And [@jMLR:v17:14-168] adDress siMIlaR pROBLeMs for random forests.

  meTHOd             parameteR      AssumPTiOnS   accuracy                                coMpuTatiON   robusT
  ------------------ -------------- ------------- --------------------------------------- ------------- --------
  DebIAsIng          True $\bEta$   VerY stRoNg   $1/\sqrt{n}$                            eaSy          No
  CoNdItiOnaL        ProjECtioN     StronG        Not knowN                               Easy          nO
  Uniform            ProjecTIon     Strong        $\sqrt{K/N}$                            Np HArD       yes
  SAmpLe Splitting   projECtioN     WeaK          $\SqRt{k^{5/2}\LOg k\sqRt{\log N}/n}$   eAsY          yes
  Sample Splitting   LoCo           None          $\sQrt{\loG (kn)/n}$                    Easy          Yes

  : *DiFferent infERENtial metHods. ‘ACcURacy’ refers to thE size Of sides of tHE confideNce seT. ‘robust’ rEfers to roBUStness to ModEl aSsuMptIONs. the term ‘Very StRONg’ meAnS that thE liNear modEl iS asSumEd tO bE correct aNd that thErE aRe InCohErencE AssumptiOnS on ThE deSign mATrix. ‘StRong’ mEans CoNsTAnt VariancE AnD nOrmaLiTy Are aSsuMeD. ‘Weak’ MeanS OnlY iid and InvertiblE coVAriaNcE mAtrix (foR the selected vArIables). ‘None’ MeAns Only iiD OR iid plus A moment assumption.*[]{data-laBEl="table::
] and model averaging inte rpretation s [@h jor t20 03 freq uent ist]; the impo s sibi lity results of [@leeb 2008c an ] , [@ b uj a2015 models] on r and om  $ X$an d  m odelmis specifi cation; me tho ds  based on re s am pling or s amp le splitting  [@ CL:11;  @ CL: 1 3; @E fro n:14;  @wass e rman20 09high; @ me i nshaus e n2009pv a l ue s];stability selecti o n[ @meinshausen20 10stab il i ty ; @sh ah2 013variabl e] ; the conform a li n f ere n ce approach o f [@lei2016 d ist ributi on ];g oodnes s-of- fi t  te sts of [@sh ah20 18goodnes s]; mo m ent-con s traint- baseduni for m co n fi de nce  s e ts[ @a ndr e ws2 009hybri d] ;[@mei nsha u s e n 2015 gro up]on in ference about  gr oups ofvaria blesunde rgener al des igns;  [ @belloni2011inf eren ce] in th e i ns tru me ntalv ariabl e s ett ing; [@ belloni 2 015 un i f o rm ] on post-selectio ni n fe rence fo r $Z$- e st im a tors, an dthe  kno c k offsappr o ac h of [@b arber2 0 15 co ntrolli ng ] andla ter  [@ cande s 2016 pannin g]. Alth ought hey are not di r ected at line a rm o de l s,[@ wag er2014confi denc e ] an d [@ J ML R:v 1 7:14- 168]ad d re s s similar problemsfo r rand om fo rests.

  Met hod         Param eter    Assumptions  Acc uracy                           Comp u t ation  Rob ust 
 --- - - -- ----------- - - - ---- -- ----- - --- ------- ----- --- --- -- --------- -------- -- -- -- -- ---  ---- - --------  - --- -- --  Deb i asing       Tr ue $\b eta$  V er y Stro ng   $1/ \sq rt {n}$                     E asy       No 
  Conditiona l       Pro je cti on   S trong       Not known                         Easy        No 
 U niform           P roj e c tion Str on g        $ \ s qrt {k/n} $                         NP har d       Yes
 Sa mple S pl itt i ng   P ro j ect i o n     Weak         $\sqr t{ k ^{ 5/2}\log k \ sqr t{ \log n} /n}$  Easy       Yes
  Sa mple Spli tt ingLOC O          None         $ \ sqrt{ \ lo g (kn )/n }$               E asy          Y es 

  :*Diff er ent infe rential methods. ‘accur acy’ r efers  to  the size  of sid es of the  con fidence se t.‘ro bust’  re f ers t o ro b us tne s s tomode l  assumpti o ns . T h e  t erm ‘Very S t r o ng’  mean s t h at the  lin ear model is assu m ed to be corre ct a n d  th att here  a re incoherence  as su m p tions on  t he design m atrix. ‘ St r ong’meansconsta nt vari a n ce and No rmal ity  are assu med .‘ Weak’ m ea ns only i id a nd  inver tiblec ovar i a nce matrix (forthe s e l ected var iable s) . ‘None ’  mea ns only ii d or iid pl us a m omen t ass umption .* []{dat a-l ab el="table: : 
] and_model averaging_interpretations [@hjort2003frequentist]; the impossibility_results of_[@leeb2008can],_[@buja2015models] on_random_$X$ and model_misspecification; methods based_on resampling or sample_splitting [@CL:11; @CL:13;_@Efron:14;_@wasserman2009high; @meinshausen2009pvalues]; stability selection [@meinshausen2010stability; @shah2013variable]; the conformal inference approach of [@lei2016distribution]; goodness-of-fit tests_of_[@shah2018goodness]; moment-constraint-based_uniform_confidence_sets [@andrews2009hybrid]; [@meinshausen2015group] on inference_about groups of variables under_general designs;_[@belloni2011inference] in the instrumental variable setting; [@belloni2015uniform] on_post-selection_inference for $Z$-estimators,_and the knockoffs approach of [@barber2015controlling] and later [@candes2016panning]._Although they are not directed at_linear models,[@wager2014confidence] and_[@JMLR:v17:14-168]_address_similar problems for random_forests.

  Method   _     _   Parameter   _  Assumptions   Accuracy_    _ _    _  _ _  _     _  _  Computation   Robust
__------------------ -------------- -------------_---------------------------------------_-------------_--------
 _Debiasing  __ __   True $\beta$ __Very Strong   $1/\sqrt{n}$  _   __   _    _     _ _ _ Easy         _No
  Conditional   _   _Projection __  Strong__ _    Not known _ _     _   __     _     _    Easy___    _  No
  Uniform _  _      _Projection_    Strong __     $\sqrt{k/n}$___    _     _        _  _  NP hard ___   Yes
  Sample Splitting   Projection_ _  Weak_         $\sqrt{k^{5/2}\log_k\sqrt{\log n}/n}$   Easy  _       Yes
  Sample Splitting_  LOCO     _     None _   __   $\sqrt{\log (kn)/n}$  ____  _  _  _ _  _Easy _  __    Yes

  : *Different inferential methods. ‘accuracy’ refers to the size of sides of_the confidence set. ‘robust’ refers to_robustness to model assumptions. The_term_‘Very Strong’ means_that the linear model_is assumed to be correct and that there_are incoherence assumptions on the design matrix. ‘Strong’ means_constant_variance and_Normality are assumed. ‘Weak’_means only_iid and_invertible covariance matrix_(for the_selected variables)._‘None’ means_only iid or iid plus a moment_assumption.*[]{data-label="table::