 [@gordon:salmon:smith:1993], where particles are propagated from the model transition, more sophisticated filters can readily be used in the CPF procedure. For instance, performance gains can be obtained with auxiliary particle filters [@pitt1999filtering; @johansen2008note], as illustrated in Section \[sec:numerics:hiddenar\]. In presenting algorithms we focus on bootstrap particle filters for simplicity. When the transition density is tractable, extensions of the CPF include backward sampling [@whiteleycommentonpmcmc; @LindstenS:2013] and ancestor sampling [@LindstenJS:2014], which is beneficial in the proposed approach as illustrated in Section \[sec:numerics:hiddenar\]. The complexity of a standard CPF update is of order $NT$, and the memory requirements are of order $T + N\log N$ [@jacob2015path].

The proposed method relies on CPF kernels but is different from Markov chain Monte Carlo (MCMC) estimators: it involves independent copies of unbiased estimators of $\pi(h)$. Thus it will be amenable to parallel computation and confidence intervals will be constructed in a different way than with standard MCMC output [e.g. Chapter 7 in @gelman2010handbook]; see Section \[sec:comparison\] for a comparison with existing smoothers.

Debiasing Markov chains \[sec:debiasing\]
-----------------------------------------

We briefly recall the debiasing technique of @glynn2014exact, see also @McLeish:2011 [@Rhee:Glynn:2012; @vihola2015unbiased] and references therein. Denote by $(X^{(n)})_{n\geq 0}$ and $({\tilde{X}}^{(n)})_{n\geq 0}$ two Markov chains with invariant distribution $\pi$, initialized from a distribution $\pi_0$. Assume that, for all $n\geq 0$, $X^{(n)}$ and ${\tilde{X}}^{(n)}$ have the same marginal distribution, and that $\lim_{n\to\infty} \mathbb{E}[h(X^{(n)})] = \pi(h)$. Writing limit as a telescopic sum, and swapping infinite sum and expectation, which will be justified later on, we obtain $$\begin{aligned}
    \pi(h) 
    &= \mathbb{E}[h(X^{(0)})] + \sum_{n=1}^\infty \mathbb{E}[h(X^{(n)}) - h
[ @gordon: salmon: smith:1993 ], where particles are propagated from the model transition, more advanced filter can readily be used in the CPF operation. For example, performance gains can be obtain with auxiliary particle filter [ @pitt1999filtering; @johansen2008note ], as illustrated in Section \[sec: numerics: hiddenar\ ]. In presenting algorithm we focus on bootstrap particle filters for simplicity. When the passage density is tractable, extensions of the CPF include backward sampling [ @whiteleycommentonpmcmc; @LindstenS:2013 ] and ancestor sample [ @LindstenJS:2014 ], which is beneficial in the proposed approach as illustrated in Section \[sec: numerics: hiddenar\ ]. The complexity of a standard CPF update is of orderliness $ NT$, and the memory requirements are of order $ T + N\log N$ [ @jacob2015path ]. 

 The propose method trust on CPF kernels but is unlike from Markov chain Monte Carlo (MCMC) estimators: it involves independent copy of unbiased estimators of $ \pi(h)$. Thus it will be amenable to parallel computation and assurance time interval will be constructed in a different way than with standard MCMC output [ e.g. Chapter 7 in @gelman2010handbook ]; see Section \[sec: comparison\ ] for a comparison with existing smoothers. 

 Debiasing Markov chains \[sec: debiasing\ ] 
 ----------------------------------------- 

 We concisely remember the debiasing technique of @glynn2014exact, visit besides @McLeish:2011 [ @Rhee: Glynn:2012; @vihola2015unbiased ] and reference therein. Denote by $ (X^{(n)})_{n\geq 0}$ and $ ({ \tilde{X}}^{(n)})_{n\geq 0}$ two Markov chains with changeless distribution $ \pi$, initialized from a distribution $ \pi_0$. Assume that, for all $ n\geq 0 $, $ X^{(n)}$ and $ { \tilde{X}}^{(n)}$ have the like marginal distribution, and that $ \lim_{n\to\infty } \mathbb{E}[h(X^{(n) }) ] = \pi(h)$. Writing limit as a telescopic kernel, and swapping infinite sum and expectation, which will be justified later on, we obtain $ $ \begin{aligned } 
     \pi(h) 
     & = \mathbb{E}[h(X^{(0) }) ] + \sum_{n=1}^\infty \mathbb{E}[h(X^{(n) }) - h
 [@gogdon:salmon:smith:1993], where pavticles are propctated hrom ths model gransition, more sophisticatev fioters can readily be used iv the CPF proceduee. Fie instance, performance gzlns ccn be obtained wlth auxiliasy particle fintdrd [@pitt1999filtering; @johansen2008note], as illtstratec ln Section \[sec:gumegiss:hisdenar\]. In presenting algorithms we focus mn bootstrap larticle filters for simpllcitj. When the transitlon density is eeactable, extdnsions of the CPF incmude backward sampling [@whiteleyzommeutonpmcmc; @LunestftS:2013] and ancewtor fampling [@LindstenJS:2014], fhich ix beneficial ik the priposed approach as ilnustrated in Sectijn \[sec:numarncs:hiddenar\]. The complwxuty ox a vtanaqrd CPR npdzte is of order $NT$, znd the memiry requirements art os order $T + N\lof N$ [@jasof2015path].

The proposed method relies on CPF nerhels but is different feom Markov chain Montg Carlo (MCIC) estimators: it involves independent copies of utbiasxd esuinatorr ov $\pi(h)$. Thus it will be amenable to parallel coiluuatpon and confidencc intervals will br fomftructed in a diffexsnf way than with stwndard ICMC iutput [e.g. Chalter 7 in @gelman2010handbook]; see Section \[sec:bompqrison\] for a compaxison with eristinb smopthers.

Debiasing Markov ehains \[sec:debiasijg\]
-----------------------------------------

We brieruy recall the deciaxitg technique of @glynn2014exact, see also @McLzish:2011 [@Rhed:Glymn:2012; @vihjla2015unbiasef] and references therein. Denoje by $(F^{(n)})_{n\geq 0}$ anf $({\tilde{X}}^{(n)})_{n\geq 0}$ two Markov chains with invariamt divtributijn $\pi$, initialized srom a distribotion $\pi_0$. Cssume that, for zll $n\gex 0$, $X^{(n)}$ and ${\tylde{X}}^{(n)}$ have tvg same marginel distrifutiin, abd that $\uim_{n\to\infty} \mayhbb{E}[h(X^{(n)})] = \pi(h)$. Writibg limit as a telexcokid sum, and swappnug infinite sum amd dxpqcnatmon, wrhch will be bustkfidc latdr on, wt ontakn $$\brgin{aligned}
    \pi(h) 
    &= \jathbb{E}[h(X^{(0)})] + \sum_{n=1}^\infyy \mathbb{E}[y(X^{(n)}) - h
[@gordon:salmon:smith:1993], where particles are propagated from the more filters can be used in performance can be obtained auxiliary particle filters @johansen2008note], as illustrated in Section \[sec:numerics:hiddenar\]. presenting algorithms we focus on bootstrap particle filters for simplicity. When the transition is tractable, extensions of the CPF include backward sampling [@whiteleycommentonpmcmc; @LindstenS:2013] and ancestor [@LindstenJS:2014], is in proposed approach as illustrated in Section \[sec:numerics:hiddenar\]. The complexity of a standard CPF update is of $NT$, and the memory requirements are of order + N\log N$ [@jacob2015path]. proposed method relies on CPF but different from chain Carlo estimators: it involves copies of unbiased estimators of $\pi(h)$. Thus it will be amenable to parallel computation and confidence intervals be constructed different way with MCMC [e.g. Chapter 7 see Section \[sec:comparison\] for a comparison Debiasing Markov chains \[sec:debiasing\] ----------------------------------------- We briefly recall debiasing technique @glynn2014exact, see also @McLeish:2011 [@Rhee:Glynn:2012; @vihola2015unbiased] references therein. Denote by $(X^{(n)})_{n\geq 0}$ and $({\tilde{X}}^{(n)})_{n\geq two Markov chains with invariant distribution $\pi$, initialized from a distribution $\pi_0$. Assume that, for 0$, $X^{(n)}$ and ${\tilde{X}}^{(n)}$ the same marginal and $\lim_{n\to\infty} = Writing limit a telescopic sum, and swapping infinite sum and expectation, which will justified later on, we obtain $$\begin{aligned} \pi(h) &= \mathbb{E}[h(X^{(0)})] + -
 [@gordon:salmon:smith:1993], where parTicles are pRopagAteD frOm The mOdel Transition, more SOphiSticated filters can readIly be UsED in tHE CpF proCedure. FOR iNSTanCe, PeRfoRmANcE gainS caN be obtaIned with auXilIaRy particle fiLTeRs [@pitt1999filtEriNg; @johansen2008noTe], aS illusTrAteD In SecTioN \[sec:nUmericS:HiddenAr\]. In preseNtINg algoRIthms we FOCuS on bOotstrap particle fILtERs for simplicitY. When tHe TRaNSItiOn dEnsity is trAcTable, EXtensioNS oF THE CPf Include backwaRd sampling [@wHIteLeycomMeNtoNPmcmc; @LIndstEns:2013] And Ancestor samPlinG [@LindstenjS:2014], whicH Is benefICial in tHe propOseD apProaCH aS iLluStRAteD In secTIon \[Sec:numerIcS:hIddenAr\]. ThE COMPlexIty Of a sTandaRd CPF update is Of oRder $nt$, anD the mEmory RequIrEmentS are of Order $t + N\Log N$ [@jacob2015path].

ThE proPosed methOd rElIes On cPF keRNels buT is DifFerent fRom MarkOV chAiN mONtE Carlo (MCMC) estimatoRs: IT InVolves inDependENt CoPIes of unbIaSed EstiMATors oF $\pi(h)$. tHuS it will bE amenaBLe To ParalleL cOmputaTiOn aNd cOnfidENce iNtervaLs will be ConstRUcted in a differENt way than with STaNDArD mCMC OutPut [e.g. ChapteR 7 in @gELman2010HandBOoK]; seE sectiOn \[sec:CoMPaRIson\] for a comparison wItH existIng smOothers.

DebiasIng Markov cHAINs \[sec:debIasiNG\]
-----------------------------------------

WE Briefly recall tHe debIasing techNIque of @glYnn2014exAct, see alSo @McLeish:2011 [@rHEe:Glynn:2012; @vIhoLa2015uNbiAseD] ANd References theREIn. DeNoTe by $(X^{(n)})_{n\Geq 0}$ And $({\tildE{X}}^{(n)})_{N\geQ 0}$ twO MaRkOv chains wIth invarIaNt DiStRibUtion $\PI$, initialIzEd fRoM a dIstriBUtion $\pI_0$. AssuMe thAt, FoR All $N\geq 0$, $X^{(n)}$ aND ${\tILDe{X}}^{(n)}$ HaVe The sAme MaRginaL disTRibUtion, anD that $\lim_{n\To\iNFty} \mAtHbB{E}[h(X^{(n)})] = \pi(H)$. Writing limit As A telescopiC sUm, aNd swapPINg infiniTe sum and expectation, whicH Will be jUstIfied LateR on, we obtaIn $$\bEgin{alIgnED}
    \pi(h) 
    &= \maThbb{E}[h(x^{(0)})] + \sum_{n=1}^\InFty \MAThbb{E}[H(x^{(N)}) - h
 [@gordon:salmon:smith:199 3], whereparti cle s a re  pro paga ted from the m o deltransition, more sophi stica te d  fil t er s can  readil y  b e use din  th eC PF  proc edu re. For  instance,  pe rf ormance gain s  c an be obta ine d with auxil iar y part ic lef ilter s [ @pitt 1999fi l tering ; @johans en 2 008not e ], as i l l us trat ed in Section \[s e c: n umerics:hidden ar\].In pr e s ent ing  algorithm swe fo c us on b o ot s t r app article filte rs for simp l ici ty. Wh en  th e  trans ition  d e nsi ty is tract able , extensi ons of the CPF include  backw ard  sa mpli n g[@ whi te l eyc o mm ent o npm cmc; @Li nd st enS:2 013] a n d  anc est or s ampli ng [@Lindsten JS: 2014 ] , w hichis be nefi ci al in  the p ropos ed  approach as il lust rated inSec ti on\[ sec:n u merics :hi dde nar\].The com p lex it y o fa standard CPF upd at e is  of orde r $NT$ ,  a nd the memo ry  re quir e m entsareo forder $T  + N\l o gN$  [@jaco b2 015pat h] .
The  prop o sedmethod  relieson CP F  kernels but i s  different fr o mM a rk o v ch ain  Monte Carl o (M C MC)esti m at ors :  it i nvolv es in d ependent copies ofun biased  esti mators of $\p i(h)$. Thu s i t will b e am e na b le to parallel  comp utation an d  confide nce i ntervals  will bec o nstructe d i n a  di ffe r e nt  way than wit h stan da rd MCMC  ou tput [e .g.  Ch apt er7in @gelma n2010han db oo k] ;see  Sect i on \[sec :c omp ar iso n\] f o r a co mpari sonwi th exi sting s m oo t h ers. 
De bias ing  M arkov  cha i ns\[sec:d ebiasing\ ]
- - ---- -- -- ------- ------------- -- ---------
W e b riefly r ecall th e debiasing technique o f  @glynn 201 4exac t, s ee also @ McL eish:2 011 [@Rhee :Glynn :2012 ;@vi h o la201 5 u nb ias ed ] and refe r e nce s the re in.Denoteby $(X^{(n)})_{n\g e q 0 }$ and $({\ti lde {X}} ^ { (n )}) _ {n \ geq  0 } $ t w o  Markov chainswith invar ia n tdistributi o n $ \p i$, ini tialize d fro m  a dist ribution$\pi_0$.As sume t hat , for all$n\geq 0 $, $X^{(n ) }$ an d  $ {\til de{ X}}^{( n) }$havethe sa m e m argin al dis tr ibutio n, an dthat $\l im_{n\to\infty} \mathbb {E}[h( X^{(n )}) ] = \pi(h )$. Wri ting limi t as  a telesco pic  su m, an d s w appin g in f in ite sum a nd e x pectation ,  w hic h wi ll be justi f i e d l ateron, we obt ain$$\begin{aligned}     \pi(h) 
   &= \ mat hbb { E}[h (X ^{(0)})] + \su m_{ n= 1 } ^\infty\m athbb{E}[h( X^{(n)})  - h
 [@gordon:salmon:smith:1993],_where particles_are propagated from the_model transition,_more_sophisticated filters_can_readily be used_in the CPF_procedure. For instance, performance_gains can be_obtained_with auxiliary particle filters [@pitt1999filtering; @johansen2008note], as illustrated in Section \[sec:numerics:hiddenar\]. In presenting algorithms_we_focus on_bootstrap_particle_filters for simplicity. When the_transition density is tractable, extensions_of the_CPF include backward sampling [@whiteleycommentonpmcmc; @LindstenS:2013] and ancestor_sampling_[@LindstenJS:2014], which is_beneficial in the proposed approach as illustrated in Section_\[sec:numerics:hiddenar\]. The complexity of a standard_CPF update is_of_order_$NT$, and the memory_requirements are of order $T +_N\log N$ [@jacob2015path].

The proposed method relies_on CPF kernels but is different from_Markov chain Monte Carlo (MCMC) estimators:_it involves independent copies of_unbiased estimators_of $\pi(h)$. Thus it will_be amenable to_parallel computation_and confidence intervals_will be constructed in a different_way than with_standard MCMC output [e.g. Chapter 7_in_@gelman2010handbook]; see Section_\[sec:comparison\]_for_a comparison_with existing smoothers.

Debiasing_Markov_chains \[sec:debiasing\]
-----------------------------------------

We_briefly_recall the debiasing technique of @glynn2014exact,_see_also @McLeish:2011 [@Rhee:Glynn:2012; @vihola2015unbiased] and references therein._Denote by $(X^{(n)})_{n\geq 0}$_and_$({\tilde{X}}^{(n)})_{n\geq 0}$ two Markov_chains with invariant distribution $\pi$,_initialized from a distribution $\pi_0$. Assume_that, for_all $n\geq_0$, $X^{(n)}$ and ${\tilde{X}}^{(n)}$ have the same marginal distribution, and that_$\lim_{n\to\infty} \mathbb{E}[h(X^{(n)})] = \pi(h)$. Writing limit_as a telescopic sum,_and swapping_infinite_sum and expectation,_which_will be_justified later on, we obtain $$\begin{aligned}
 _ _\pi(h) 
    &=_\mathbb{E}[h(X^{(0)})] + \sum_{n=1}^\infty \mathbb{E}[h(X^{(n)})_-_h