 a discrete noise term, viz. $$M_i(t)=\xi _i^1 m^1(t) + \alpha \chi(t-1)\sigma _i(t-1)
        + F\sum_{t'=0}^{t-2} \alpha
         \left[\prod_{s=t'}^{t-1} \chi(s)\right] \, \sigma _i(t')  \,.
         \label{eq:MM}$$ Since different architectures contain different correlations not all terms in these final equations are present, as is apparent through $F$. We remark that for the asymmetric diluted and the layered feedforward architecture $M_i(t)=\xi _i^1 m^1(t)$ so that in these cases the local field consists out of a signal term plus Gaussian noise for [*all*]{} time steps [@BSVZ],[@BSV].

For the architectures treated here we still have to determine the probability density $f_{h_i(t)}$ in eq. (\[eq:chi\]). This can be done by looking at the form of $M_i(t)$ given by eq. (\[eq:MM\]). The evolution equation tells us that $\sigma _i(t')$ can be replaced by $g_b(h_i(t'-1))$ such that the second and third terms of $M_i(t)$ are the sums of stepfunctions of correlated variables. These are also correlated through the dynamics with the normally distributed part of $h_i(t)$. Therefore, the local field can be considered as a transformation of a set of correlated normally distributed variables $x_s$, which we choose to normalize. Defining the correlation matrix $W = \left(\rho(s,s')\equiv \E[x_s x_{s'}] \right)$ we arrive at the following expression for $f_{h_i(t)}$ for the fully connected model $$\begin{aligned}
     f_{h_i(t)}(y)&=&\int dx_t \,\prod_{s=0}^{t-2} dx_s  ~
         \delta \left(y - M_i(t)-\sqrt{V(t)}\,x_t\right)
             \nonumber\\
             &\times& \frac{1}{\sqrt{\mbox{det}(2\pi W)}}
            ~\mbox{exp}\left(-\frac{1}{2
a discrete noise term, viz. $ $ M_i(t)=\xi _ i^1 m^1(t) + \alpha \chi(t-1)\sigma _ i(t-1) 
         + F\sum_{t'=0}^{t-2 } \alpha 
          \left[\prod_{s = t'}^{t-1 } \chi(s)\right ] \, \sigma _ i(t')   \, . 
          \label{eq: MM}$$ Since different architectures control unlike correlations not all terms in these concluding equations are present, as is apparent through $ F$. We comment that for the asymmetric diluted and the layered feedforward architecture $ M_i(t)=\xi _ i^1 m^1(t)$ so that in these case the local field consists out of a signal term plus Gaussian noise for [ * all * ] { } time dance step [ @BSVZ],[@BSV ]. 

 For the architectures treated here we even accept to determine the probability density $ f_{h_i(t)}$ in eq.   (\[eq: chi\ ]). This can be done by looking at the form of $ M_i(t)$ contribute by eq.   (\[eq: MM\ ]). The evolution equation tells us that $ \sigma _ i(t')$ can be substitute by $ g_b(h_i(t'-1))$ such that the second and third terms of $ M_i(t)$ are the sums of stepfunctions of correlated variables. These are besides correlated through the moral force with the normally distributed part of $ h_i(t)$. Therefore, the local field can be study as a transformation of a set of correlated normally distributed variables $ x_s$, which we choose to normalize. Defining the correlation coefficient matrix $ W = \left(\rho(s, s')\equiv \E[x_s x_{s' } ] \right)$ we arrive at the follow expression for $ f_{h_i(t)}$ for the fully connected model $ $ \begin{aligned } 
      f_{h_i(t)}(y)&=&\int dx_t \,\prod_{s=0}^{t-2 } dx_s   ~ 
          \delta \left(y - M_i(t)-\sqrt{V(t)}\,x_t\right) 
              \nonumber\\ 
              & \times & \frac{1}{\sqrt{\mbox{det}(2\pi W) } } 
             ~\mbox{exp}\left(-\frac{1}{2
 a fiscrete noise term, viz. $$O_i(t)=\xi _i^1 m^1(t) + \alpkq \chi(t-1)\vigma _j(t-1)
        + F\sum_{t'=0}^{t-2} \alpha
         \left[\'rod_{w=t'}^{t-1} \cyi(s)\right] \, \sigma _i(t')  \,.
         \lahel{eq:MM}$$ Winct different archivsctures contajk difyecent correlatioks not all derms in these fkncl equations are present, as is apparqnt thrpuhh $F$. We remark thau fjr tgv csymmetric diluted and the layeded feevforward architrcture $M_i(t)=\xi _i^1 m^1(t)$ so that ln tjese cases the locwl field cobsisew out of a skgnal term plus Gaussizn noise for [*all*]{} time steps [@BSVX],[@BSV].

Fpr the arcyirechores treated here we still hayv to dedermine the probabiliby deisitt $f_{h_i(t)}$ in eq. (\[eq:chi\]). Thiv can be done by ljoking at tke form of $M_i(t)$ given vy eq. (\[eq:KM\]). Tve exilugioh xquztion helms us that $\sigma _i(t')$ cqn be replaced by $g_n(h_y(n'-1))$ such that tge secjnq and third terms of $M_i(t)$ are the sums ox sfepfunctions of correlared variables. These ate also cowrelated through the dynamics with the normally dhstriuuged pwfr lf $h_i(t)$. Therefore, the local field can be consiqsrtd ss a transformction of a set og fottelated normaluy discdiguted variables $x_s$, which re chiose to njrmakize. Defining the correlatiin matrix $W = \oeft(\rho(s,s')\equiv \E[x_s x_{s'}] \right)$ wz arrife at the following expressiun fkr $f_{h_i(t)}$ for the fullg connected model $$\benin{dligned}
     f_{h_i(t)}(y)&=&\int dx_t \,\pwod_{s=0}^{t-2} dx_s  ~
         \aelts \left(r - M_i(t)-\sqrt{G(t)}\,x_t\rlcht)
             \nojumbet\\
             &\tiles& \frac{1}{\sqrt{\mbox{det}(2\pi W)}}
            ~\mbox{exp}\lefj(-\frdc{1}{2
a discrete noise term, viz. $$M_i(t)=\xi _i^1 \alpha _i(t-1) + \alpha \left[\prod_{s=t'}^{t-1} \chi(s)\right] Since architectures contain different not all terms these final equations are present, as apparent through $F$. We remark that for the asymmetric diluted and the layered architecture $M_i(t)=\xi _i^1 m^1(t)$ so that in these cases the local field consists of signal plus noise for [*all*]{} time steps [@BSVZ],[@BSV]. For the architectures treated here we still have to determine probability density $f_{h_i(t)}$ in eq. (\[eq:chi\]). This can done by looking at form of $M_i(t)$ given by (\[eq:MM\]). evolution equation us $\sigma can be replaced $g_b(h_i(t'-1))$ such that the second and third terms of $M_i(t)$ are the sums of stepfunctions of correlated These are through the with normally part of $h_i(t)$. local field can be considered as a set of correlated normally distributed variables $x_s$, we choose normalize. Defining the correlation matrix $W \left(\rho(s,s')\equiv \E[x_s x_{s'}] \right)$ we arrive at the expression for $f_{h_i(t)}$ for the fully connected model $$\begin{aligned} f_{h_i(t)}(y)&=&\int dx_t \,\prod_{s=0}^{t-2} dx_s ~ \delta M_i(t)-\sqrt{V(t)}\,x_t\right) \nonumber\\ &\times& \frac{1}{\sqrt{\mbox{det}(2\pi ~\mbox{exp}\left(-\frac{1}{2
 a discrete noise term, viz. $$M_i(t)=\xI _i^1 m^1(t) + \alpha \cHi(t-1)\siGma _I(t-1)
        + F\SuM_{t'=0}^{t-2} \aLpha
         \Left[\prod_{s=t'}^{t-1} \chi(S)\RighT] \, \sigma _i(t')  \,.
         \label{eq:MM}$$ Since DiffeReNT arcHItEcturEs contaIN dIFFerEnT cOrrElATiOns noT alL terms iN these finaL eqUaTions are presENt, As is appareNt tHrough $F$. We remArk That foR tHe aSYmmetRic DilutEd and tHE layerEd feedforWaRD archiTEcture $M_I(T)=\Xi _I^1 m^1(t)$ sO that in these cases THe LOcal field consiSts out Of A SiGNAl tErm Plus GaussiAn Noise FOr [*all*]{} tiME sTEPS [@BSvz],[@BSV].

For the arcHitectures tREatEd here We StiLL have tO deteRmINe tHe probabiliTy deNsity $f_{h_i(t)}$ In eq. (\[eq:CHi\]). This cAN be done By lookIng At tHe foRM oF $M_I(t)$ gIvEN by EQ. (\[eQ:MM\]). tHe eVolution EqUaTion tElls US THAt $\siGma _I(t')$ caN be rePlaced by $g_b(h_i(t'-1))$ SucH thaT The SeconD and tHird TeRms of $m_i(t)$ are The suMs Of stepfunctions Of coRrelated vAriAbLes. thEse arE Also coRreLatEd throuGh the dyNAmiCs WITH tHe normally distribuTeD PArT of $h_i(t)$. ThEreforE, ThE lOCal field CaN be ConsIDEred aS a trANsFormatioN of a seT Of CoRrelateD nOrmallY dIstRibUted vARiabLes $x_s$, wHich we chOose tO Normalize. DefinINg the correlatIOn MATrIX $W = \leFt(\rHo(s,s')\equiv \E[x_S x_{s'}] \rIGht)$ wE arrIVe At tHE follOwing ExPReSSion for $f_{h_i(t)}$ for the fuLlY conneCted mOdel $$\begin{aligNed}
     f_{h_i(t)}(y)&=&\inT DX_T \,\prod_{s=0}^{t-2} dX_s  ~
         \deLTa \LEft(y - M_i(t)-\sqrt{V(t)}\,x_T\righT)
             \nonumber\\
             &\tIMes& \frac{1}{\sQrt{\mbOx{det}(2\pi W)}}
            ~\Mbox{exp}\leFT(-\Frac{1}{2
 a discrete noise term, vi z. $$M_i(t )=\xi  _i ^1m^ 1(t)  + \ alpha \chi(t-1 ) \sig ma _i(t-1)
        + F \sum_ {t ' =0}^ { t- 2} \a lpha
    \ le ft [\p ro d _{ s=t'} ^{t -1} \ch i(s)\right ] \ ,\sigma _i(t' )  \,.
       \label{eq:MM }$$  Since  d iff e rentarc hitec turesc ontain  differen tc orrela t ions no t al l te rms in these fina l  e q uations are pr esent,  a s  i s app are nt through  $ F$. W e  remark th a t for the asymmetri c diluted a n d t he lay er edf eedfor wardar c hit ecture $M_i (t)= \xi _i^1m^1(t) $  so tha t  in the se cas esthe  loc a lfi eld  c o nsi s ts  ou t  of  a signa lte rm pl us G a u s s iannoi se f or [* all*]{} timeste ps [ @ BSV Z],[@ BSV]. 

Fo rthe a rchite cture streated here we  sti ll have t o d et erm in e the probab ili tydensity  $f_{h_ i (t) }$ i n  e q. (\[eq:chi\]). T hi s ca n be don e by l o ok in g  at thefo rmof $ M _ i(t)$  giv e nby eq. ( \[eq:M M \] ).  The ev ol utioneq uat ion  tell s  usthat $ \sigma _ i(t') $  can be replac e d by $g_b(h_i ( t' - 1 )) $  suc h t hat the sec onda nd t hird te rms of $M _i(t) $a re the sums of stepfun ct ions o f cor related varia bles. Thes e a re alsocorr e la t ed through the  dyna mics witht he norma lly d istribut ed part o f $h_i(t)$ . T her efo re, t he  local fieldc a n be  c onsider edas a tr ans for mat ion  o f a set o f correl at ed  n or mal ly di s tributed  v ari ab les  $x_s $ , whic h wechoo se  t o  no rmalize .  D e f inin gth e co rre la tionmatr i x $ W = \le ft(\rho(s ,s' ) \equ iv  \ E[x_s x _{s'}] \right )$  we arrive  a t t he fol l o wing exp ression for $f_{h_i(t)} $  for th e f ullyconn ected mod el$$\beg in{ a ligned }
    f_{h _i (t) } ( y)&=& \ i nt  dx _t  \,\prod_{ s = 0}^ {t-2}  d x_s ~
        \delta \left( y  -M_i(t)-\sqrt{ V(t )}\, x _ t\ rig h t)        \nonumber\\
          & \t imes& \fra c {1} {\ sqrt{\m box{det }(2\p i  W)}}
          ~\mbox{ ex p}\l e f t(- \frac{1}{2 
 a_discrete noise_term, viz. $$M_i(t)=\xi _i^1_m^1(t) +_\alpha_\chi(t-1)\sigma _i(t-1)
__  _  _+ F\sum_{t'=0}^{t-2} \alpha
 _  __   \left[\prod_{s=t'}^{t-1} \chi(s)\right] \, \sigma _i(t')  \,.
    __ __\label{eq:MM}$$_Since different architectures contain different_correlations not all terms in_these final_equations are present, as is apparent through $F$._We_remark that for_the asymmetric diluted and the layered feedforward architecture $M_i(t)=\xi__i^1 m^1(t)$ so that in these_cases the local_field_consists_out of a signal_term plus Gaussian noise for [*all*]{}_time steps [@BSVZ],[@BSV].

For the architectures treated_here we still have to determine the_probability density $f_{h_i(t)}$ in eq. (\[eq:chi\]). This_can be done by looking_at the_form of $M_i(t)$ given by_eq. (\[eq:MM\]). The evolution_equation tells_us that $\sigma__i(t')$ can be replaced by $g_b(h_i(t'-1))$_such that the_second and third terms of $M_i(t)$_are_the sums of_stepfunctions_of_correlated variables._These are also_correlated_through the_dynamics_with the normally distributed part of_$h_i(t)$._Therefore, the local field can be considered_as a transformation of_a_set of correlated normally_distributed variables $x_s$, which we_choose to normalize. Defining the correlation_matrix $W_= \left(\rho(s,s')\equiv_\E[x_s x_{s'}] \right)$ we arrive at the following expression for $f_{h_i(t)}$_for the fully connected model $$\begin{aligned}
_   _f_{h_i(t)}(y)&=&\int dx_t_\,\prod_{s=0}^{t-2}_dx_s  ~
__ _     \delta \left(y_- M_i(t)-\sqrt{V(t)}\,x_t\right)
_     _   __ \nonumber\\
    _     _  &\times& \frac{1}{\sqrt{\mbox{det}(2\pi W)}}
___    _    ~\mbox{exp}\left(-\frac{1}{2