hat{\Psi}_{\ell}a(x_{i}).$

Chernozhukov, Newey, and Robins (2018) introduce machine learning methods for choosing the functions to include in the vector $A(x)$. This method can be combined with machine learning methods for estimating $E[q_{i}|x_{i}]$ to construct a double machine learning estimator of average surplus, as shown in Chernozhukov, Hausman, and Newey (2018).

In parametric models moment functions like those in equation (\[lr series\]) are used to “partial out” nuisance parameters $\zeta.$ For maximum likelihood these moment functions are the basis of Neyman’s (1959) C-alpha test. Wooldridge (1991) generalized such moment conditions to nonlinear least squares and Lee (2005), Bera et al. (2010), and Chernozhukov et al. (2015) to GMM. What is novel here is their use in the construction of semiparametric estimators and the interpretation of the estimated LR moment functions $\psi(z_{i},\beta,\hat{\zeta}_{\ell},\hat{\Psi}_{\ell})$ as the sum of an original moment function $m(z_{i},\beta,\hat{\zeta}_{\ell})$ and an influence adjustment $\phi(z_{i},\beta,\hat{\zeta}_{\ell},\hat{\Psi}_{\ell})$.

Estimating the Influence Adjustment with First Step Smoothing
-------------------------------------------------------------

The adjustment term can be estimated in a general way that allows for kernel density, locally linear regression, and other kernel smoothing estimators for the first step. The idea is to differentiate with respect to the effect of the $i^{th}$ observation on sample moments. Newey (1994b) used a special case of this approach to estimate the asymptotic variance of a functional of a kernel based semiparametric or nonparametric estimator. Here we extend this method to a wider class of first step estimators, such as locally linear regression, and apply it to estimate the adjustment term for construction of LR moments.

We will describe this estimator for the case where $\gamma$ is a vector of functions of a vector of variables $x.$ Let $h(z,x,\gamma)$ be a vector of functions of a data observation $z$, $x$, and a possible realized value of $\gamma$ (i.e. a vector of real numbers $\gamma$). Also let $\hat{h}_{\ell
}(x,\
hat{\Psi}_{\ell}a(x_{i}).$ 

 Chernozhukov, Newey, and Robins (2018) introduce machine learning methods for choose the function to include in the vector $ A(x)$. This method can be combined with car learning methods for estimating $ E[q_{i}|x_{i}]$ to manufacture a double machine learn estimator of average excess, as shown in Chernozhukov, Hausman, and Newey (2018). 

 In parametric models moment functions like those in equality (\[lr series\ ]) are used to “ partial out ” nuisance argument $ \zeta.$ For maximum likelihood these moment function are the basis of Neyman ’s (1959) C - alpha test. Wooldridge (1991) generalized such consequence conditions to nonlinear least squares and Lee (2005), Bera et al. (2010), and Chernozhukov et al. (2015) to GMM. What is novel here is their use in the structure of semiparametric estimators and the rendition of the estimated LR moment functions $ \psi(z_{i},\beta,\hat{\zeta}_{\ell},\hat{\Psi}_{\ell})$ as the sum of an original consequence function $ m(z_{i},\beta,\hat{\zeta}_{\ell})$ and an influence adjustment $ \phi(z_{i},\beta,\hat{\zeta}_{\ell},\hat{\Psi}_{\ell})$. 

 Estimating the Influence Adjustment with First Step Smoothing 
 ------------------------------------------------------------- 

 The adjustment term can be estimate in a general way that allows for kernel density, locally linear regression, and other kernel smoothing estimators for the first measure. The idea is to differentiate with obedience to the impression of the $ i^{th}$ observation on sample moment. Newey (1994b) use a special case of this overture to estimate the asymptotic variance of a functional of a kernel based semiparametric or nonparametric estimator. Here we extend this method to a wider class of first step estimators, such as locally analogue regression, and give it to calculate the allowance term for construction of LR moments. 

 We will identify this estimator for the case where $ \gamma$ is a vector of functions of a vector of variable star $ x.$ Let $ h(z, x,\gamma)$ be a vector of functions of a data notice $ z$, $ x$, and a possible realized value of $ \gamma$ (i.e. a vector of real numbers $ \gamma$). Also permit $ \hat{h}_{\ell 
 } (x,\
hat{\Osi}_{\ell}a(x_{i}).$

Chernozhukov, Nedey, and Robins (2018) introdnce macgine leafning methods for choosing tie fynctiins to include in the xector $A(x)$. This merhod xan be comujned wibk macglne lzacning methods fpr estimathng $E[q_{i}|x_{i}]$ to cmnrtxuct a double machine learning estimwtor of agerage surplus, as xrown pn Chernozhukov, Hausman, and Newsy (2018).

In perametric modelx moment functions like thlse ln equation (\[lr serles\]) are usee to “partial out” vuisance parameters $\zeja.$ For maximum likelihood these oomenc functions aee hve basis of Neymwn’s (1959) C-alpha bvst. Woondridge (1991) generalized xuci monent conditions to noilinear least squaref and Lee (2005), Yera et al. (2010), and Chernizyukov et dl. (2015) gi GOM. Shet js novfl iere is thejr use in tye construction of xeiplarametric eatimatjrf and the interpretation of the estimattd LR moment functions $\psi(z_{i},\veta,\hat{\zeta}_{\ell},\hat{\Psi}_{\epl})$ as the sum of an original moment function $m(z_{i},\beta,\hat{\zetd}_{\ell})$ ena au infljwnfe adjustment $\phi(z_{i},\beta,\hat{\zeta}_{\ell},\hat{\Psi}_{\ell})$.

Estyjauinn the Influence Cdjustment with Gigsy Step Smoothivg
-------------------------------------------------------------

The csjhstment term can bf estimwted un a genewal eay that allows for kernel eensity, locajoy linear regressiln, and othex kerngl smopthing estimators for tke firat step. The idea is fu differentiate ditm raspect to the effect of thq $i^{th}$ obsxrvatnon on sxmplg momenes. Newey (1994b) used a special case of hhis cpprodch to estlmate the asymptotic variance oh a functionak mf d kernel basec semiparametwic or nonparaketric zstimagor. Here wv extend vhis method eo a wider cldds of first vtep estymatirs, wuch as uocally linear regression, and appoy it to estimate bhe aanustment term fir xonstruction of LR moiejtx.

Wq will descrite tfis rstimxtor for thc cxse ehere $\gamma$ is a vecdor kf functions of a fegtor of vqriables $x.$ Let $h(z,x,\gamka)$ be a vector of vunctmons oh a daya jbservation $z$, $x$, and a possible realized vajue of $\gamma$ (i.e. q vector of xeal numbers $\gamma$). Also let $\hat{h}_{\ell
}(x,\
hat{\Psi}_{\ell}a(x_{i}).$ Chernozhukov, Newey, and Robins (2018) introduce methods choosing the to include in can combined with machine methods for estimating to construct a double machine learning of average surplus, as shown in Chernozhukov, Hausman, and Newey (2018). In parametric moment functions like those in equation (\[lr series\]) are used to “partial out” parameters For likelihood moment functions are the basis of Neyman’s (1959) C-alpha test. Wooldridge (1991) generalized such moment conditions nonlinear least squares and Lee (2005), Bera et (2010), and Chernozhukov et (2015) to GMM. What is here their use the of estimators and the of the estimated LR moment functions $\psi(z_{i},\beta,\hat{\zeta}_{\ell},\hat{\Psi}_{\ell})$ as the sum of an original moment function $m(z_{i},\beta,\hat{\zeta}_{\ell})$ and influence adjustment the Influence with Step ------------------------------------------------------------- The adjustment be estimated in a general way kernel density, locally linear regression, and other kernel estimators for first step. The idea is to with respect to the effect of the $i^{th}$ on sample moments. Newey (1994b) used a special case of this approach to estimate the of a functional of kernel based semiparametric nonparametric Here extend method to wider class of first step estimators, such as locally linear regression, apply it to estimate the adjustment term for construction of We describe this estimator the case where $\gamma$ a of functions of a variables Let vector functions a data observation $z$, and a possible realized value $\gamma$ (i.e. a vector let $\hat{h}_{\ell }(x,\
hat{\Psi}_{\ell}a(x_{i}).$

Chernozhukov, NEwey, and RobIns (2018) inTroDucE mAchiNe leArning methods fOR choOsing the functions to incLude iN tHE vecTOr $a(x)$. ThiS method CAn BE ComBiNeD wiTh MAcHine lEarNing metHods for estImaTiNg $E[q_{i}|x_{i}]$ to conSTrUct a double MacHine learning EstImator Of AveRAge suRplUs, as sHown in cHernozHukov, HausMaN, And NewEY (2018).

In paraMETrIc moDels moment functioNS lIKe those in equatIon (\[lr sErIEs\]) ARE usEd tO “partial ouT” nUisanCE parameTErS $\ZETa.$ FOR maximum likelIhood these mOMenT functIoNs aRE the baSis of neYMan’S (1959) C-alpha test. woolDridge (1991) genEralizED such moMEnt condItions To nOnlIneaR LeAsT sqUaREs aND LEe (2005), BERa eT al. (2010), and ChErNoZhukoV et aL. (2015) TO gmM. WhAt iS novEl herE is their use in The ConsTRucTion oF semiParaMeTric eStimatOrs anD tHe interpretatioN of tHe estimatEd Lr mOmeNt FunctIOns $\psi(Z_{i},\bEta,\Hat{\zeta}_{\Ell},\hat{\PSI}_{\elL})$ aS THE sUm of an original momeNt FUNcTion $m(z_{i},\bEta,\hat{\ZEtA}_{\eLL})$ and an inFlUenCe adJUStmenT $\phi(Z_{I},\bEta,\hat{\zeTa}_{\ell},\hAT{\PSi}_{\Ell})$.

EstiMaTing thE INflUenCe AdjUStmeNt with first SteP SmooTHing
-------------------------------------------------------------

The adjustmENt term can be esTImATEd IN a geNerAl way that alLows FOr keRnel DEnSitY, LocalLy linEaR ReGRession, and other kernEl SmoothIng esTimators for thE first step. tHE Idea is to DiffEReNTiate with respeCt to tHe effect of THe $i^{th}$ obsErvatIon on samPle momentS. nEwey (1994b) useD a sPecIal CasE OF tHis approach to ESTimaTe The asymPtoTic variAncE of A fuNctIoNal of a kerNel based SeMiPaRaMetRic or NOnparameTrIc eStImaTor. HeRE we extEnd thIs meThOd TO a wIder claSS oF FIrst StEp EstiMatOrS, such As loCAllY linear RegressioN, anD ApplY iT tO estimaTe the adjustmeNt Term for conStRucTion of lr Moments.

WE will describe this estimaTOr for thE caSe wheRe $\gaMma$ is a vecTor Of funcTioNS of a veCtor of VariaBlEs $x.$ lET $h(z,x,\gAMMa)$ Be a VeCtor of funcTIOns Of a daTa ObseRvation $Z$, $x$, and a possible realIZed Value of $\gamma$ (i.E. a vEctoR OF rEal NUmBErs $\GaMMa$). ALSO let $\hat{h}_{\ell
}(x,\
hat{\Psi}_{\ell}a(x_{i}).$ 

Chernozh ukov,  Ne wey ,andRobi ns (2018) intr o duce  machine learning meth ods f or choo s in g the  functi o ns t o i nc lu dein th e vec tor  $A(x)$ . This met hod  c an be combin e dwith machi nelearning met hod s fores tim a ting$E[ q_{i} |x_{i} ] $ to c onstructad oublem achinel e ar ning  estimator of ave r ag e  surplus, as s hown i nC he r n ozh uko v, Hausman ,and N e wey (20 1 8) . Inp arametric mod els momentf unc tionsli ket hose i n equ at i on(\[lr serie s\])  are used  to “p a rtial o u t” nuis ance p ara met ers$ \z et a.$  F o r m a xi mum lik elihoodth es e mom entf u n c tion s a re t he ba sis of Neyman ’s(195 9 ) C -alph a tes t. W oo ldrid ge (19 91) g en eralized such m omen t conditi ons  t o n on linea r  least  sq uar es andLee (20 0 5),  B e r a  e t al. (2010), andCh e r no zhukov e t al.( 20 15 )  to GMM.  W hat  isn o vel h erei stheir us e in t h eco nstruct io n of s em ipa ram etric esti mators  and the  inte r pretation of t h e estimated L R  m o m en t  fun cti ons $\psi(z _{i} , \bet a,\h a t{ \ze t a}_{\ ell}, \h a t{ \ Psi}_{\ell})$ as th esum of  an o riginal momen t function $ m (z_{i},\ beta , \h a t{\zeta}_{\ell })$ a nd an infl u ence adj ustme nt $\phi (z_{i},\b e t a,\hat{\ zet a}_ {\e ll} , \ ha t{\Psi}_{\ell } ) $.
Es timatin g t he Infl uen ceAdj ust me nt with F irst Ste pSm oo th ing 
---- - -------- -- --- -- --- ----- - ------ ----- ---- -- -- - --- ------- - -T he a dj us tmen t t er m can  bee sti mated i n a gener alw ay t ha tallowsfor kernel de ns ity, local ly  li near r e g ression,  and other kernel smoot h ing est ima torsforthe first  st ep. Th e i d ea isto dif feren ti ate w ith r e s pe ctto  the effec t ofthe $ i^ {th} $ obser vation on sample m o men ts. Newey (19 94b ) us e d  a  sp e ci a l c as e  of t his approach to  estimateth e  a symptoticv ari an ce of a  functi onalo f a ker nel based  semipara me tric o r n onparametr ic estim ator. Her e  we e x te nd th ismethod  t o a  wide r clas s  of  firs t step  e stimat ors,su ch as lo cally linear regression , andapply  it  to estim ate the  adjustme nt t erm for co nst ruc tionofL R mom ents . 
Wew ill d escr i be this e s ti mat o r  f or the case w h ere  $\ga mma $  is avect or of functions o f  a vector of v aria b l es$x. $  Let  $ h(z,x,\gamma)$  be  a v ector of  f unctions of  a dataob s ervat ion $z $, $x$ , and a p os s ible r eali zed  value of  $\ ga m ma$ (i. e.  a vector  ofre al num bers $ \ gamm a $ ). Also let $\ha t{h}_ { \ ell
} ( x,\ 
hat{\Psi}_{\ell}a(x_{i}).$

Chernozhukov, Newey,_and Robins_(2018) introduce machine learning_methods for_choosing_the functions_to_include in the_vector $A(x)$. This_method can be combined_with machine learning_methods_for estimating $E[q_{i}|x_{i}]$ to construct a double machine learning estimator of average surplus, as_shown_in Chernozhukov,_Hausman,_and_Newey (2018).

In parametric models moment_functions like those in equation_(\[lr series\])_are used to “partial out” nuisance parameters $\zeta.$_For_maximum likelihood these_moment functions are the basis of Neyman’s (1959) C-alpha_test. Wooldridge (1991) generalized such moment_conditions to nonlinear_least_squares_and Lee (2005), Bera_et al. (2010), and Chernozhukov et_al. (2015) to GMM. What is_novel here is their use in the_construction of semiparametric estimators and the_interpretation of the estimated LR_moment functions_$\psi(z_{i},\beta,\hat{\zeta}_{\ell},\hat{\Psi}_{\ell})$ as the sum of_an original moment_function $m(z_{i},\beta,\hat{\zeta}_{\ell})$_and an influence_adjustment $\phi(z_{i},\beta,\hat{\zeta}_{\ell},\hat{\Psi}_{\ell})$.

Estimating the Influence Adjustment with_First Step Smoothing
-------------------------------------------------------------

The_adjustment term can be estimated in_a_general way that_allows_for_kernel density,_locally linear regression,_and_other kernel_smoothing_estimators for the first step. The_idea_is to differentiate with respect to the_effect of the $i^{th}$_observation_on sample moments. Newey_(1994b) used a special case_of this approach to estimate the_asymptotic variance_of a_functional of a kernel based semiparametric or nonparametric estimator. Here we_extend this method to a wider_class of first step_estimators, such_as_locally linear regression,_and_apply it_to estimate the adjustment term for construction_of LR_moments.

We will describe this estimator for_the case where $\gamma$_is_a vector of functions of a_vector of variables $x.$ Let $h(z,x,\gamma)$_be a vector of functions_of_a_data observation $z$, $x$, and_a possible realized value of $\gamma$_(i.e. a vector_of real numbers $\gamma$). Also let $\hat{h}_{\ell
}(x,\