

[^2]: The authors are with the Department of Electronic Systems, Aalborg University, Denmark (e-mail: {mib,tlh,bfl}@es.aau.dk).

[^3]: When $K$ and the frequencies are given, the complex amplitudes can be easily estimated with the linear least-squares method.

[^4]: Variational methods are deterministic inference techniques which provide analytical approximations of posterior pdfs, unlike the stochastic method of Markov chain Monte Carlo (MCMC) sampling. The convergence of MCMC methods can be prohibitively slow and difficult to diagnose. MCMC sampling has been previously used for LSE, see [@Andrieu1999] and the references therein.

[^5]: While $p_{W_i\mid S_i}(w_i\mid s_i=1)$ should model some prior knowledge about the amplitudes, for the design of our estimator we select a zero-mean Gaussian pdf mainly for computational convenience (see Sec. \[sec:Infer\_W\_S\]). In fact, in the simulation experiments we generate the complex amplitudes in  from a distribution different than Gaussian.

[^6]: The KL divergence of a pdf $p$ from a pdf $q$ (both defined on some set $\mathcal{X}$) is $\mathcal{D}_{\text{KL}}(q || p)=\int_{\mathcal{X}} q(x) \ln\frac{q(x)}{p(x)}\operatorname{d}\!x$.

[^7]: The assumed factorization of $q_{\bm{\Theta}\mid\bm{Y}}$ is also referred to as a naïve mean field approximation.

[^8]: The angle $\phi$ between two complex vectors $\mathbf{u}$ and $\mathbf{v}$ satisfies $\cos(\phi) = \frac{\Re(\mathbf{u}^{\Herm}\mathbf{v})}{\|\mathbf{u}\|\|\mathbf{v}\|}$.

[^9]: When we do not have any prior information about $\Theta$, we can set the concentration $\kappa_{\text{a}} = 0$, in which case the prior pdf becomes the uniform circular pdf $p_{\Theta}(\theta)=1/(2\pi)$.

[^10]: Alternatively, we can select an MVM prior, if we wish to use a multimodal distribution.

[^11]: Actually, $\bm{\gamma}$ is the sample autocovariance of $\
[ ^2 ]: The authors are with the Department of Electronic Systems, Aalborg University, Denmark (e - mail: { mib,tlh,bfl}@es.aau.dk). 

 [ ^3 ]: When $ K$ and the frequencies are give, the complex amplitude can be easily estimated with the linear least - square method. 

 [ ^4 ]: Variational methods are deterministic inference proficiency which put up analytical approximations of posterior pdfs, unlike the stochastic method of Markov range Monte Carlo (MCMC) sampling. The convergence of MCMC methods can be prohibitively slow and unmanageable to diagnose. MCMC sampling has been previously used for LSE, visualize   [ @Andrieu1999 ] and the references therein. 

 [ ^5 ]: While $ p_{W_i\mid S_i}(w_i\mid s_i=1)$ should model some prior cognition about the amplitudes, for the design of our estimator we choose a zero - mean Gaussian pdf mainly for computational convenience (see Sec.   \[sec: Infer\_W\_S\ ]). In fact, in the simulation experiments we render the complex amplitudes in    from a distribution different than Gaussian. 

 [ ^6 ]: The KL divergence of a pdf $ p$ from a pdf $ q$ (both defined on some set $ \mathcal{X}$) is $ \mathcal{D}_{\text{KL}}(q || p)=\int_{\mathcal{X } } q(x) \ln\frac{q(x)}{p(x)}\operatorname{d}\!x$. 

 [ ^7 ]: The assume factorization of $ q_{\bm{\Theta}\mid\bm{Y}}$ is also referred to as a naïve mean field approximation. 

 [ ^8 ]: The angle $ \phi$ between two complex vector $ \mathbf{u}$ and $ \mathbf{v}$ satisfies $ \cos(\phi) = \frac{\Re(\mathbf{u}^{\Herm}\mathbf{v})}{\|\mathbf{u}\|\|\mathbf{v}\|}$. 

 [ ^9 ]: When we do not have any prior information about $ \Theta$, we can set the concentration $ \kappa_{\text{a } } = 0 $, in which case the prior pdf becomes the uniform circular pdf $ p_{\Theta}(\theta)=1/(2\pi)$. 

 [ ^10 ]: Alternatively, we can choose an MVM prior, if we wish to practice a multimodal distribution. 

 [ ^11 ]: Actually, $ \bm{\gamma}$ is the sample autocovariance of $ \


[^2]: Thf authors are with the Dtpartment of Elecjrinic Sbstems, Zalborg Jniversity, Denmark (e-mail: {mib,vlh,bdl}@es.aqu.dk).

[^3]: When $K$ and the frdquencies are givwn, tie complex amplivhdes cak be swsilv xstimated with jhe linear laast-squares medhud.

[^4]: Variational methods are determiniseic infrrfnce techniquef whpcr prknibe analytical approximations of posterpor pdfs, unlike tne stochastic method of Magkov chain Monte Carlo (MCMC) samplung. Eye convergenze of MCMC methods can be prohibitively slow and diffkcult to diagnowe. MCLW sampling ias bevn previously used fos LSE, sre [@Andrieu1999] and bhe rxferwnces therein.

[^5]: While $p_{X_i\mid S_i}(w_i\mid s_i=1)$ shoold model voje prior knowledgw qbout the ampuutuaes, fpr the dfsijn of our eatimator we select a zero-mean Batwsian pdf maihly fow somputational convenience (see Sec. \[sec:Inftr\_W\_S\]). Jn fact, in the simulatiin experiments we gengrate the somplex amplitudes in  from a distribution differett then Gabwsian.

[^6]: Rhf KL divergence of a pdf $p$ from a pdf $q$ (both qsfonvd on some set $\mabhcal{X}$) is $\mathcal{D}_{\yedt{LJ}}(q || p)=\int_{\mathcxl{X}} q(x) \ln\rrac{q(x)}{p(x)}\operatornale{d}\!x$.

[^7]: Thg assuned factowizayion of $q_{\bm{\Theta}\mid\bm{Y}}$ is aoso referred ro as a naïve mean yield approxnmatiom.

[^8]: The angle $\phi$ between two eomples vectors $\mwthbf{u}$ ans $\mathbf{v}$ satisfids $\bos(\pvi) = \frac{\Re(\mathbf{u}^{\Herm}\mathbs{v})}{\|\mathbf{u}\|\|\nathyf{v}\|}$.

[^9]: When we co not have any orior information about $\Hheta$, wa can set hhe concentration $\kappa_{\text{a}} = 0$, mi which case jhe prpor pdf bzcomes the uniform sircular pdf $p_{\Jheta}(\thetc)=1/(2\pi)$.

[^10]: Algernativelj, we can velect an MDM prior, if wa wish to use a multiiodao diwtributkun.

[^11]: Actually, $\bm{\bamma}$ is nht sample aytocovariance of $\
[^2]: The authors are with the Department Systems, University, Denmark {mib,tlh,bfl}@es.aau.dk). [^3]: When given, complex amplitudes can easily estimated with linear least-squares method. [^4]: Variational methods deterministic inference techniques which provide analytical approximations of posterior pdfs, unlike the stochastic of Markov chain Monte Carlo (MCMC) sampling. The convergence of MCMC methods can prohibitively and to MCMC sampling has been previously used for LSE, see [@Andrieu1999] and the references therein. [^5]: While S_i}(w_i\mid s_i=1)$ should model some prior knowledge about amplitudes, for the design our estimator we select a Gaussian mainly for convenience Sec. In fact, in simulation experiments we generate the complex amplitudes in from a distribution different than Gaussian. [^6]: The KL of a from a $q$ defined some set $\mathcal{X}$) || p)=\int_{\mathcal{X}} q(x) \ln\frac{q(x)}{p(x)}\operatorname{d}\!x$. [^7]: The $q_{\bm{\Theta}\mid\bm{Y}}$ is also referred to as a naïve field approximation. The angle $\phi$ between two complex $\mathbf{u}$ and $\mathbf{v}$ satisfies $\cos(\phi) = \frac{\Re(\mathbf{u}^{\Herm}\mathbf{v})}{\|\mathbf{u}\|\|\mathbf{v}\|}$. [^9]: we do not have any prior information about $\Theta$, we can set the concentration $\kappa_{\text{a}} in which case the pdf becomes the circular $p_{\Theta}(\theta)=1/(2\pi)$. Alternatively, can select MVM prior, if we wish to use a multimodal distribution. [^11]: $\bm{\gamma}$ is the sample autocovariance of $\


[^2]: The authors are with the DeparTment of EleCtronIc SYstEmS, AalBorg university, DenmARk (e-mAil: {mib,tlh,bfl}@es.aau.dk).

[^3]: WheN $K$ and ThE FreqUEnCies aRe given, THe COMplEx AmPliTuDEs Can be EasIly estiMated with tHe lInEar least-squaREs Method.

[^4]: VariAtiOnal methods aRe dEtermiNiStiC InferEncE techNiques WHich prOvide analYtICal appROximatiONS oF posTerior pdfs, unlike tHE sTOchastic method Of MarkOv CHaIN monTe CArlo (MCMC) saMpLing. THE converGEnCE OF MCmc methods can be ProhibitiveLY slOw and dIfFicULt to diAgnosE. McmC sAmpling has bEen pReviously Used foR lSE, see [@ANDrieu1999] anD the reFerEncEs thEReIn.

[^5]: whiLe $P_{w_i\mID S_I}(w_i\MId s_I=1)$ should mOdEl Some pRior KNOWLedgE abOut tHe ampLitudes, for the DesIgn oF Our EstimAtor wE selEcT a zerO-mean GAussiAn Pdf mainly for comPutaTional conVenIeNce (SeE Sec. \[sEC:Infer\_w\_S\]). IN faCt, in the SimulatIOn eXpERIMeNts we generate the coMpLEX aMplitudeS in  froM A dIsTRibution DiFfeRent THAn GauSsiaN.

[^6]: thE KL diverGence oF A pDf $P$ from a pDf $Q$ (both dEfIneD on Some sET $\matHcal{X}$) iS $\mathcal{d}_{\text{kl}}(q || p)=\int_{\mathcal{X}} Q(X) \ln\frac{q(x)}{p(x)}\opERaTORnAMe{d}\!x$.

[^7]: the Assumed factOrizATion Of $q_{\bM{\thEta}\MId\bm{Y}}$ Is alsO rEFeRRed to as a naïve mean fiElD approXimatIon.

[^8]: The angle $\phI$ between twO COMplex vecTors $\MAtHBf{u}$ and $\mathbf{v}$ sAtisfIes $\cos(\phi) = \fRAc{\Re(\mathBf{u}^{\HeRm}\mathbf{V})}{\|\mathbf{u}\|\|\mATHbf{v}\|}$.

[^9]: When We dO noT haVe aNY PrIor informatioN ABout $\thEta$, we caN seT the conCenTraTioN $\kaPpA_{\text{a}} = 0$, in wHich case ThE pRiOr Pdf BecomES the unifOrM ciRcUlaR pdf $p_{\tHeta}(\thEta)=1/(2\pi)$.

[^10]: alteRnAtIVelY, we can sELeCT An MVm pRiOr, if We wIsH to usE a muLTimOdal disTribution.

[^11]: actUAlly, $\Bm{\GaMma}$ is thE sample autocoVaRiance of $\


[^2]: The authors are wi th the Dep artme ntofEl ectr onic  Systems, Aalb o rg U niversity, Denmark (e- mail:  { m ib,t l h, bfl}@ es.aau. d k) . 
[^ 3] :Whe n$ K$  andthe  freque ncies aregiv en , the comple x  a mplitudescan  be easily e sti matedwi tht he li nea r lea st-squ a res me thod.

[^ 4] :  Varia t ional m e t ho ds a re deterministici nf e rence techniqu es whi ch pr o v ide  an alytical a pp roxim a tions o f  p o s t eri o r pdfs, unlik e the stoch a sti c meth od  of Markov  chai nM ont e Carlo (MC MC)sampling.  The c o nvergen c e of MC MC met hod s c an b e  p ro hib it i vel y  s low and  difficu lt  t o dia gnos e . M CMCsam plin g has  been previou sly  use d  fo r LSE , see  [@A nd rieu1 999] a nd th ereferences ther ein. 

[^5]: W hil e$p_ {W _i\mi d  S_i}( w_i \mi d s_i=1 )$ shou l d m od e l so me prior knowledge  a b o ut  the amp litude s ,fo r  the des ig n o f ou r estim ator we  selecta zero - me an  Gaussi an  pdf m ai nly  fo r com p utat ionalconvenie nce ( s ee Sec. \[sec: I nfer\_W\_S\]) .  I n fa c t, i n t he simulati on e x peri ment s  w e g e nerat e the  c o mp l ex amplitudes in  f ro m a di strib ution differe nt than Ga u s s ian.

[^ 6]:T he KL divergenceof apdf $p$ fr o m a pdf$q$ ( both def ined on s o m e set $\ mat hca l{X }$) i s$\mathcal{D}_ { \ text {K L}}(q | | p )=\int_ {\m ath cal {X} }q(x) \ln\ frac{q(x )} {p (x )} \op erato r name{d}\ !x $.
[ ^7] : The assume d fac tori za ti o n o f $q_{\ b m{ \ T heta }\ mi d\bm {Y} }$  is a lsor efe rred to  as a naï vem eanfi el d appro ximation.

[^ 8] : The angl e$\p hi$ be t w een twocomplex vectors $\mathb f {u}$ an d $ \math bf{v }$ satisf ies  $\cos (\p h i) = \ frac{\ Re(\m at hbf { u }^{\H e r m} \ma th bf{v})}{\| \ m ath bf{u} \| \|\m athbf{v }\|}$.

[^9]: When wedo not have a nyprio r in for m at i onab o ut$ \ Theta$, we canset the co nc e nt ration $\k a ppa _{ \text{a }} = 0$ , inw hich ca se the pr ior pdf b ec omes t heuniform ci rcular p df $p_{\T h eta}( \ th eta)= 1/( 2\pi)$ .
[^ 10]:Altern a tiv ely,we can  s electan MV Mprior, i f we wish to use a mult imodal  dist rib ution.

[ ^11 ] : A ctually,$\bm {\gamma}$isthe  samp lea utoco vari a nc e o f  $\


[^2]: The_authors are_with the Department of_Electronic Systems,_Aalborg_University, Denmark_(e-mail:_{mib,tlh,bfl}@es.aau.dk).

[^3]: When $K$_and the frequencies_are given, the complex_amplitudes can be_easily_estimated with the linear least-squares method.

[^4]: Variational methods are deterministic inference techniques which provide_analytical_approximations of_posterior_pdfs,_unlike the stochastic method of_Markov chain Monte Carlo (MCMC)_sampling. The_convergence of MCMC methods can be prohibitively slow_and_difficult to diagnose._MCMC sampling has been previously used for LSE, see [@Andrieu1999]_and the references therein.

[^5]: While $p_{W_i\mid_S_i}(w_i\mid s_i=1)$ should_model_some_prior knowledge about the_amplitudes, for the design of our_estimator we select a zero-mean Gaussian_pdf mainly for computational convenience (see Sec. \[sec:Infer\_W\_S\])._In fact, in the simulation experiments_we generate the complex amplitudes_in  from_a distribution different than Gaussian.

[^6]:_The KL divergence_of a_pdf $p$ from_a pdf $q$ (both defined on_some set $\mathcal{X}$)_is $\mathcal{D}_{\text{KL}}(q || p)=\int_{\mathcal{X}} q(x) \ln\frac{q(x)}{p(x)}\operatorname{d}\!x$.

[^7]:_The_assumed factorization of_$q_{\bm{\Theta}\mid\bm{Y}}$_is_also referred_to as a_naïve_mean field_approximation.

[^8]:_The angle $\phi$ between two complex_vectors_$\mathbf{u}$ and $\mathbf{v}$ satisfies $\cos(\phi) = \frac{\Re(\mathbf{u}^{\Herm}\mathbf{v})}{\|\mathbf{u}\|\|\mathbf{v}\|}$.

[^9]:_When we do not_have_any prior information about_$\Theta$, we can set the_concentration $\kappa_{\text{a}} = 0$, in which_case the_prior pdf_becomes the uniform circular pdf $p_{\Theta}(\theta)=1/(2\pi)$.

[^10]: Alternatively, we can select an_MVM prior, if we wish to_use a multimodal distribution.

[^11]:_Actually, $\bm{\gamma}$_is_the sample autocovariance_of_$\