1}{N}{{\mathbf{A}}}^{T}{\mathbf{A}}$ converges to a finite, positive-definite matrix: $$\lim_{N\rightarrow\infty} \frac{1}{N}{{\mathbf{A}}}^{T}{\mathbf{A}}= {\mathbf{D}}\succ 0.
     \label{eq.sing2}$$ This assumption is also known as [*Persistent Excitation*]{} (PE), see e.g. [@c6]. Note that our assumption in Eq. (\[eq.sing\]) covers a wider range of cases. For example, Eq. (\[eq.sing\]) does not require the singular values of $\frac{1}{\sqrt{N}}{{\mathbf{A}}}$ to converge, while only requires that they lie in $[c_1,c_2]$ when $N$ increases.

Classically, properties of the Least Square Estimate (LSE) under the model given in Eq. (1) are given by the Gauss-Markov theorem. It says that the Best Linear Unbiased Estimation (BLUE) of ${\mathbf{x}}^{0}$ is the LSE under certain assumptions on the noise term. For the Gauss-Markov theorem, please refer to [@c3]. However, the normal LSE does not utilize the ’sparse’ information of ${\mathbf{x}}^{0}$, which raises the question that whether it is possible to improve on the normal LSE by exploiting this information. In the literature, several approaches have been suggested, which can perform as if the true support set of ${\mathbf{x}}^{0}$ were known. Such property is termed as the ORACLE property in [@c7]. In [@c7], the SCAD (Smoothly Clipped Absolute Deviation) estimator is presented, which turns out to solve a non-convex optimization problem; later in [@c12], the ADALASSO (Adaptive Least Absolute Shrinkage and Selection Operator) estimator is presented. The ADALASSO estimator consists of two steps, which implements a normal LSE in the first step, and then solves a reweighed Lasso optimization problem, which is convex. Recently, in [@c1], two LASSO-based estimators, namely the ’A-SPARSEVA-AIC-RE’ method and the ’A-SPARSEVA-BIC-RE’ method, are suggested. Both methods need to do the LSE in the first step, then solve a Lasso
1}{N}{{\mathbf{A}}}^{T}{\mathbf{A}}$ converges to a finite, positive - definite matrix: $ $ \lim_{N\rightarrow\infty } \frac{1}{N}{{\mathbf{A}}}^{T}{\mathbf{A}}= { \mathbf{D}}\succ 0. 
      \label{eq.sing2}$$ This assumption is also known as [ * haunting Excitation * ] { } (PE), examine e.g. [ @c6 ]. Note that our assumption in Eq. (\[eq.sing\ ]) cover a wider range of case. For example, Eq. (\[eq.sing\ ]) does not require the singular values of $ \frac{1}{\sqrt{N}}{{\mathbf{A}}}$ to converge, while only want that they lie in $ [ c_1,c_2]$ when $ N$ increases. 

 Classically, place of the Least Square Estimate (LSE) under the model given in Eq. (1) are given by the Gauss - Markov theorem. It says that the Best Linear Unbiased Estimation (BLUE) of $ { \mathbf{x}}^{0}$ is the LSE under certain assumptions on the randomness term. For the Gauss - Markov theorem, please refer to [ @c3 ]. However, the normal LSE does not utilize the ’ sparse ’ data of $ { \mathbf{x}}^{0}$, which raises the question that whether it is possible to improve on the normal LSE by exploiting this data. In the literature, several approach path have been suggested, which can perform as if the true documentation set of $ { \mathbf{x}}^{0}$ were known. Such property is termed as the ORACLE property in [ @c7 ]. In [ @c7 ], the SCAD (Smoothly Clipped Absolute Deviation) estimator is presented, which turns out to solve a non - convex optimization problem; later in [ @c12 ], the ADALASSO (Adaptive Least Absolute Shrinkage and Selection Operator) estimator is presented. The ADALASSO estimator consists of two steps, which implements a normal LSE in the inaugural step, and then solves a reweighed Lasso optimization trouble, which is convex. Recently, in [ @c1 ], two LASSO - free-base calculator, namely the ’ A - SPARSEVA - AIC - RE ’ method and the ’ A - SPARSEVA - BIC - RE ’ method, are suggested. Both methods need to do the LSE in the inaugural step, then solve a Lasso
1}{N}{{\mahhbf{A}}}^{T}{\mathbf{A}}$ converges uo a finite, positnce-defiiite mafrix: $$\lim_{V\rightarrow\infty} \frac{1}{N}{{\mathbf{E}}}^{T}{\marhbf{A}}= {\mathbf{D}}\succ 0.
     \labeu{eq.sing2}$$ Tjis assunptiib is also known as [*Persiabent Zxritation*]{} (PE), see e.g. [@c6]. Note that our assukpgiln in Eq. (\[eq.sing\]) covers a wider rangq of caxed. For example, Gq. (\[eq.xyng\]) soes not require the singular valuss of $\fgac{1}{\sqrt{N}}{{\mathbf{A}}}$ tp converge, while only requlres that they lie in $[f_1,c_2]$ when $N$ ibcrewwes.

Classicaluy, propertpzs of the Lgast Square Estimate (LSE) under tfe mobel given ib Wq. (1) dre given bb the Dauss-Markov bneorem. It sayx that the Besb Linxar Ynbiased Estimation (BNUE) of ${\mathbf{x}}^{0}$ is jhe LSE ungex certain assumptions ob the noive tdem. Wor tie Fauss-Mwrkkv theorem, please refwr to [@c3]. However, the njgkal LSE does not ueijize the ’sparse’ information of ${\mathbf{x}}^{0}$, fhidh raises the question rhat whether it is podsible to improve on the normal LSE by exploiting this infmrmatmov. Iu the uutfrature, several approaches have been suggesteq, wnibh can perform as if the trur dulkort set of ${\majhbf{x}}^{0}$ wzde known. Such properhy is tgrmed qs the ORWCLE property in [@c7]. In [@c7], the SCAE (Smoothly Cjupped Absolute Devnation) estimctor ix prexented, which turns out co solbe a non-congex optimjxation problem; lxteg in [@c12], the ADALASSO (Adaptive Lqast Absooute Shrinkxge snd Sejection Opfratov) estimator is presfnted. Tve ADALASSL estimator consists of two ste'x, which implgmetts a normaj LSE in the first step, and then solves a redeighed Laaso optmmization prjblem, which iv convex. Receitly, in [@c1], two LASWO-based dstimators, namrly the ’A-SPARSEVA-AIX-RE’ method and the ’A-SKADSEVA-BIC-RE’ methid, qre suggested. Bpth meehldx gaed to do tha LSD iv the wirst suzp, bhev sokve a Lasso
1}{N}{{\mathbf{A}}}^{T}{\mathbf{A}}$ converges to a finite, positive-definite matrix: {\mathbf{D}}\succ \label{eq.sing2}$$ This is also known e.g. Note that our in Eq. (\[eq.sing\]) a wider range of cases. For Eq. (\[eq.sing\]) does not require the singular values of $\frac{1}{\sqrt{N}}{{\mathbf{A}}}$ to converge, while requires that they lie in $[c_1,c_2]$ when $N$ increases. Classically, properties of the Square (LSE) the given in Eq. (1) are given by the Gauss-Markov theorem. It says that the Best Linear Estimation (BLUE) of ${\mathbf{x}}^{0}$ is the LSE under assumptions on the noise For the Gauss-Markov theorem, please to However, the LSE not the ’sparse’ information ${\mathbf{x}}^{0}$, which raises the question that whether it is possible to improve on the normal LSE by this information. literature, several have suggested, can perform as true support set of ${\mathbf{x}}^{0}$ were is termed as the ORACLE property in [@c7]. [@c7], the (Smoothly Clipped Absolute Deviation) estimator is which turns out to solve a non-convex optimization later in [@c12], the ADALASSO (Adaptive Least Absolute Shrinkage and Selection Operator) estimator is presented. estimator consists of two which implements a LSE the step, then solves reweighed Lasso optimization problem, which is convex. Recently, in [@c1], two estimators, namely the ’A-SPARSEVA-AIC-RE’ method and the ’A-SPARSEVA-BIC-RE’ method, are methods to do the in the first step, solve Lasso
1}{N}{{\mathbf{A}}}^{T}{\mathbf{A}}$ converges To a finite, pOsitiVe-dEfiNiTe maTrix: $$\Lim_{N\rightarrow\INfty} \Frac{1}{N}{{\mathbf{A}}}^{T}{\mathbf{A}}= {\maThbf{D}}\SuCC 0.
     \labEL{eQ.sing2}$$ this assUMpTIOn iS aLsO knOwN As [*persiSteNt ExcitAtion*]{} (PE), see E.g. [@c6]. noTe that our assUMpTion in Eq. (\[eq.SinG\]) covers a wideR raNge of cAsEs. FOR examPle, eq. (\[eq.sIng\]) doeS Not reqUire the siNgULar valUEs of $\fraC{1}{\SQrT{N}}{{\maThbf{A}}}$ to converge, whILe ONly requires thaT they lIe IN $[c_1,C_2]$ WHen $n$ inCreases.

ClaSsIcallY, PropertIEs OF THe LEAst Square EstiMate (LSE) undeR The Model gIvEn iN eq. (1) are gIven bY tHE GaUss-Markov thEoreM. It says thAt the BESt LineaR unbiaseD EstimAtiOn (BlUE) oF ${\MaThBf{x}}^{0}$ Is THe Lse uNdeR CerTain assuMpTiOns on The nOISE Term. for The GAuss-MArkov theorem, pLeaSe reFEr tO [@c3]. HowEver, tHe noRmAl LSE Does noT utilIzE the ’sparse’ inforMatiOn of ${\mathbF{x}}^{0}$, wHiCh rAiSes thE QuestiOn tHat Whether It is posSIblE tO IMPrOve on the normal LSE bY eXPLoIting thiS inforMAtIoN. in the litErAtuRe, seVERal apProaCHeS have beeN suggeSTeD, wHich can PeRform aS iF thE trUe supPOrt sEt of ${\maThbf{x}}^{0}$ werE knowN. such property is TErmed as the ORAclE PROpERty iN [@c7]. IN [@c7], the SCAD (SmOothLY CliPped aBsOluTE DeviAtion) EsTImATor is presented, which TuRns out To solVe a non-convex oPtimizatioN PROblem; latEr in [@C12], ThE aDALASSO (AdaptiVe LeaSt Absolute sHrinkage And SeLection OPerator) esTIMator is pResEntEd. THe AdalAsSO estimator cONSistS oF two stePs, wHich impLemEntS a nOrmAl lSE in the fIrst step, AnD tHeN sOlvEs a reWEighed LaSsO opTiMizAtion PRoblem, Which Is coNvEx. rEceNtly, in [@c1], TWo lasSO-bAsEd EstiMatOrS, nameLy thE ’a-SPaRSEVA-AiC-RE’ methoD anD The ’A-sPaRsEVA-BIC-rE’ method, are suGgEsted. Both mEtHodS need tO DO the LSE iN the first step, then solve a lAsso
1}{N}{{\mathbf{A}}}^{T}{\m athbf{A}}$  conv erg esto  a f init e, positive-de f init e matrix: $$\lim_{N\ri ghtar ro w \inf t y}  \fra c{1}{N} { {\ m a thb f{ A} }}^ {T } {\ mathb f{A }}= {\m athbf{D}}\ suc c0.
     \lab e l{ eq.sing2}$ $ T his assumpti onis als okno w n as[*P ersis tent E x citati on*]{} (P E) ,  see e . g. [@c6 ] .  N otethat our assumpti o ni n Eq. (\[eq.si ng\])co v er s a w ide r range of  c ases. For exa m pl e , Eq. (\[eq.sing\])  does not r e qui re the  s ing u lar va luesof $\f rac{1}{\sqr t{N} }{{\mathb f{A}}} $  to con v erge, w hile o nly  re quir e sth atth e y l i ein$ [c_ 1,c_2]$wh en  $N$incr e a s e s.
Cla ssic ally,  properties o f t he L e ast  Squa re Es tima te  (LSE ) unde r the  m odel given in E q. ( 1) are gi ven  b y t he  Gaus s -Marko v t heo rem. It  says t h atth e B es t Linear UnbiasedEs t i ma tion (BL UE) of ${ \m a thbf{x}} ^{ 0}$  ist h e LSE  und e rcertainassump t io ns  on the  n oise t er m.For  theG auss -Marko v theore m, pl e ase refer to [ @ c3]. However, th e no r malLSE  does not u tili z e th e ’s p ar se’ infor matio no f$ {\mathbf{x}}^{0}$,wh ich ra isesthe questionthat wheth e r it is po ssib l et o improve on t he no rmal LSE b y  exploit ing t his info rmation.I n  the lit era tur e,sev e r al  approaches h a v e be en  sugges ted , which  ca n p erf orm  a s if thetrue sup po rt  s et  of  ${\m a thbf{x}} ^{ 0}$  w ere  know n . Such  prop erty  i st erm ed as t h eO R ACLE  p ro pert y i n[@c7] . In [@c 7], the  SCAD (Sm oot h ly C li pp ed Abso lute Deviatio n)  estimator  i s p resent e d , whichturns out to solve a no n -convex  op timiz atio n problem ; l ater i n [ @ c12],the AD ALASS O(Ad a p tiveL e as t A bs olute Shri n k age  andSe lect ion Ope rator) estimator i s  pr esented. TheADA LASS O es tim a to r  co ns i sts o f two steps, wh ich implem en t sa normal L S E i nthe fir st step , and then so lves a re weighed L as so o p t imi zation pro blem, wh ich is co n vex.R ec ently , i n [@c1 ],  tw o LAS SO-bas e d e stima tors,na mely t he ’A -S PARSEVA- AIC-RE’ method and the’A-SPA RSEVA -BI C-RE’ met hod ,  ar e suggest ed.Both metho dsnee d todot he LS E in th e f i rst s tep, then solv e  a  La s s o
1}{N}{{\mathbf{A}}}^{T}{\mathbf{A}}$ converges_to a_finite, positive-definite matrix: $$\lim_{N\rightarrow\infty}_\frac{1}{N}{{\mathbf{A}}}^{T}{\mathbf{A}}= {\mathbf{D}}\succ_0.
_ __ \label{eq.sing2}$$ This_assumption is also_known as [*Persistent Excitation*]{}_(PE), see e.g._[@c6]._Note that our assumption in Eq. (\[eq.sing\]) covers a wider range of cases. For_example,_Eq. (\[eq.sing\])_does_not_require the singular values of_$\frac{1}{\sqrt{N}}{{\mathbf{A}}}$ to converge, while only_requires that_they lie in $[c_1,c_2]$ when $N$ increases.

Classically, properties_of_the Least Square_Estimate (LSE) under the model given in Eq. (1)_are given by the Gauss-Markov theorem._It says that_the_Best_Linear Unbiased Estimation (BLUE)_of ${\mathbf{x}}^{0}$ is the LSE under_certain assumptions on the noise term._For the Gauss-Markov theorem, please refer to_[@c3]. However, the normal LSE does_not utilize the ’sparse’ information_of ${\mathbf{x}}^{0}$,_which raises the question that_whether it is_possible to_improve on the_normal LSE by exploiting this information._In the literature,_several approaches have been suggested, which_can_perform as if_the_true_support set_of ${\mathbf{x}}^{0}$ were_known._Such property_is_termed as the ORACLE property in_[@c7]._In [@c7], the SCAD (Smoothly Clipped Absolute_Deviation) estimator is presented,_which_turns out to solve_a non-convex optimization problem; later_in [@c12], the ADALASSO (Adaptive Least_Absolute Shrinkage_and Selection_Operator) estimator is presented. The ADALASSO estimator consists of two steps,_which implements a normal LSE in_the first step, and_then solves_a_reweighed Lasso optimization_problem,_which is_convex. Recently, in [@c1], two LASSO-based estimators,_namely the_’A-SPARSEVA-AIC-RE’ method and the ’A-SPARSEVA-BIC-RE’ method,_are suggested. Both methods_need_to do the LSE in the_first step, then solve a Lasso