=============

Visual perception coupled with gaze shifts should be considered the *Drosophila* of perception-action loops. Among the variety of active behaviors the organism can fluently engage to purposively act upon and perceive the world (e.g, moving the body, turning the head, manipulating objects), oculomotor behavior is the minimal, least energy, unit. To perform $3$-$4$ saccades per second, the organism roughly spends $300$ msecs to close the loop ($200$ msecs for motor preparation and execution, $100$ msecs left for perception).

![The perception-action loop unfolded in time as a dynamic PGM. $\mathcal{A}(t)$ denotes the ensemble of time-varying RVs defining the oculomotor action setting; $\mathcal{W}(t)$ stands for the ensemble of time-varying RVs characterising the scene as actively perceived by the observer; $\mathcal{G}$ summarizes the given goal(s), To simplify the graphics, conditional dependencies $\mathcal{G} \rightarrow \mathcal{A}(t+1)$ and $\mathcal{G} \rightarrow \mathcal{W}(t+1)$ have been omitted.[]{data-label="Fig:loop"}](FigLoop.jpg)

One way to make justice of this forgotten link is going back to first principles by re-shaping the problem as the action-perception loop, which is presented in Figure \[Fig:loop\] in the form of a dynamic PGM. The model relies upon the following assumptions:

-   The scene that will be perceived at time $t+1$, namely $\mathcal{W}(t+1)$ is inferred from the raw data $\mathbf{I}$, gazed at $\mathbf{r}_{F}(t+1)$, under the goal $\mathcal{G}$ assigned to the observer, and is conditionally dependent on current perception $\mathcal{W}(t)$. Thus, the perceptual inference problem is summarised by the conditional distribution $P( \mathcal{W}(t+1)|\mathcal{W}(t), \mathbf{r}_{F}(t+1), \mathbf{I},\mathcal{G})$;

-   The external goal $\mathcal{G}$ being assigned, the oculomotor action setting at time $t+1$, $\mathcal{A}(t+1)$, is drawn conditionally on current action setting $\mathcal{A}(t)$ and the perceived scene $\mathcal
= = = = = = = = = = = = = 

 Visual perception coupled with gaze shifts should be consider the * Drosophila * of percept - action loops. Among the variety of active behavior the organism can fluently engage to purposively act upon and perceive the worldly concern (e.g, move the body, sour the head, manipulating object), oculomotor behavior is the minimal, least energy, whole. To do $ 3$-$4 $ saccades per second, the organism approximately spends $ 300 $ millisecond to close up the loop ($ 200 $ msecs for motor preparation and murder, $ 100 $ msecs left for perception). 

! [ The perception - military action loop unfolded in time as a dynamic PGM. $ \mathcal{A}(t)$ denotes the corps de ballet of time - varying RVs defining the oculomotor action setting; $ \mathcal{W}(t)$ stand for the ensemble of time - varying RVs characterising the scene as actively perceived by the observer; $ \mathcal{G}$ summarizes the given goal(s), To simplify the artwork, conditional dependencies $ \mathcal{G } \rightarrow \mathcal{A}(t+1)$ and $ \mathcal{G } \rightarrow \mathcal{W}(t+1)$ have been omitted.[]{data - label="Fig: loop"}](FigLoop.jpg) 

 One way to name department of justice of this forgotten link is run back to first principles by re - shaping the trouble as the action - perception loop, which is presented in Figure \[Fig: loop\ ] in the form of a dynamic PGM. The model relies upon the following assumptions: 

 -    The scene that will be perceive at time $ t+1 $, namely $ \mathcal{W}(t+1)$ is understand from the raw data $ \mathbf{I}$, gazed at $ \mathbf{r}_{F}(t+1)$, under the goal $ \mathcal{G}$ assigned to the perceiver, and is conditionally dependent on current perception $ \mathcal{W}(t)$. Thus, the perceptual inference problem is summarised by the conditional distribution $ P (\mathcal{W}(t+1)|\mathcal{W}(t), \mathbf{r}_{F}(t+1), \mathbf{I},\mathcal{G})$; 

 -    The external goal $ \mathcal{G}$ being assigned, the oculomotor action plant at fourth dimension $ t+1 $, $ \mathcal{A}(t+1)$, is drawn conditionally on current action dress $ \mathcal{A}(t)$ and the perceived view $ \mathcal
=============

Viskal perception coupled wlth gaze shifts should ue consjdered tfe *Drosophila* of perception-artiob lookf. Among the varieth of actine behaviirs uhe organism can hmuently engags to 'ucposively act ukon and percaive the world (e.e, loving the body, turning the head, magipulatonh objects), oculjmotpw begavior is the minimal, least energy, unit. Tm perform $3$-$4$ savcades per second, the orgajism roughly spends $300$ mdecs to clowe trw loop ($200$ msecr for motog preparatikn and execution, $100$ msecs left fof pereeption).

![The kzeceojion-action liop ugfolded in tlke as d dynamoc PGM. $\mathcal{S}(t)$ venores the ensemble of tmme-varying RVs definyng the owumomotor action sertung; $\mdthcdl{W}(t)$ wtavds fpr the ejsejble of tije-varying RCs characterising tne wcene as actibely pqrseived by the observer; $\mathcal{G}$ summariees tge given goal(s), To simplufy the graphics, condltional dqpendencies $\mathcal{G} \rightarrow \mathcal{A}(t+1)$ and $\matvcal{G} \figkbwfeoa \mathcal{W}(t+1)$ have been omitted.[]{data-label="Fig:loop"}](SjgKopp.jpg)

One way tj make justocf ps this forgotjen link ia going back to figst prigciplws by re-srapimg the problem as the actiob-perception jiop, which is preseuted in Figuxe \[Fig:koop\] on the form of a dynamie PGM. Fhe model rflies upoh the following arsukpdions:

-   Ufe scene that wilj be percxived at timd $t+1$, mamely $\mathcal{W}(t+1)$ is ikxerred from the raa datc $\matvbf{I}$, gazed at $\mathbf{r}_{F}(t+1)$, under the goal $\mavical{G}$ assignec do nhe obserrer, anc is conditiogally dependenj on currznt pefception $\mzthcal{W}(v)$. Thus, the pqrceptual infatence problem is summwriswd bt the cuvditional disttibution $I( \iathxal{W}(t+1)|\mathcal{W}(t), \matmbf{r}_{F}(j+1), \jathbf{I},\mathcal{G})$;

-   Uhw external goak $\mxthsap{G}$ bqhng assigned, the ocjkomotur action scttkng st time $t+1$, $\mathcal{A}(t+1)$, hs ddawn conditionally ok current action fetting $\mathcsl{A}(t)$ and the percelved vceie $\matncaj
============= Visual perception coupled with gaze shifts considered *Drosophila* of loops. Among the organism fluently engage to act upon and the world (e.g, moving the body, the head, manipulating objects), oculomotor behavior is the minimal, least energy, unit. To $3$-$4$ saccades per second, the organism roughly spends $300$ msecs to close the ($200$ for preparation execution, $100$ msecs left for perception). ![The perception-action loop unfolded in time as a dynamic PGM. denotes the ensemble of time-varying RVs defining the action setting; $\mathcal{W}(t)$ stands the ensemble of time-varying RVs the as actively by observer; summarizes the given To simplify the graphics, conditional dependencies $\mathcal{G} \rightarrow \mathcal{A}(t+1)$ and $\mathcal{G} \rightarrow \mathcal{W}(t+1)$ have been omitted.[]{data-label="Fig:loop"}](FigLoop.jpg) One to make this forgotten is back first principles by problem as the action-perception loop, which Figure \[Fig:loop\] in the form of a dynamic The model upon the following assumptions: - The that will be perceived at time $t+1$, namely is inferred from the raw data $\mathbf{I}$, gazed at $\mathbf{r}_{F}(t+1)$, under the goal $\mathcal{G}$ assigned observer, and is conditionally on current perception Thus, perceptual problem summarised by conditional distribution $P( \mathcal{W}(t+1)|\mathcal{W}(t), \mathbf{r}_{F}(t+1), \mathbf{I},\mathcal{G})$; - The external goal $\mathcal{G}$ assigned, the oculomotor action setting at time $t+1$, $\mathcal{A}(t+1)$, is on action setting $\mathcal{A}(t)$ the perceived scene $\mathcal
=============

Visual perception coupled wiTh gaze shifTs shoUld Be cOnSideRed tHe *Drosophila* of PErcePtion-action loops. Among tHe varIeTY of aCTiVe behAviors tHE oRGAniSm CaN flUeNTlY engaGe tO purposIvely act upOn aNd Perceive the wORlD (e.g, moving tHe bOdy, turning thE heAd, maniPuLatINg objEctS), oculOmotor BEhavioR is the minImAL, least ENergy, unIT. to PerfOrm $3$-$4$ saccades per secONd, THe organism rougHly speNdS $300$ MsECS to CloSe the loop ($200$ mSeCs for MOtor prePArATIOn aND execution, $100$ mseCs left for peRCepTion).

![ThE pErcEPtion-aCtion LoOP unFolded in timE as a Dynamic PGm. $\mathcAL{A}(t)$ denoTEs the enSemble Of tIme-VaryINg rVS deFiNIng THe OcuLOmoTor actioN sEtTing; $\mAthcAL{w}(T)$ StanDs fOr thE enseMble of time-varYinG RVs CHarActerIsing The sCeNe as aCtivelY percEiVed by the observeR; $\matHcal{G}$ summAriZeS thE gIven gOAl(s), To sImpLifY the graPhics, coNDitIoNAL DePendencies $\mathcal{G} \RiGHTaRrow \mathCal{A}(t+1)$ aND $\mAtHCal{G} \righTaRroW \matHCAl{W}(t+1)$ hAve bEEn Omitted.[]{dAta-labEL="FIg:Loop"}](FigloOp.jpg)

ONe Way To mAke juSTice Of this ForgotteN link IS going back to fiRSt principles bY Re-SHApINg thE prOblem as the aCtioN-PercEptiON lOop, WHich iS presEnTEd IN Figure \[Fig:loop\] in the FoRm of a dYnamiC PGM. The model rElies upon tHE FOllowing AssuMPtIOns:

-   The scene thaT will Be perceiveD At time $t+1$, nAmely $\Mathcal{W}(T+1)$ is inferrED From the rAw dAta $\MatHbf{i}$, GAzEd at $\mathbf{r}_{F}(t+1)$, UNDer tHe Goal $\matHcaL{G}$ assigNed To tHe oBseRvEr, and is coNditionaLlY dEpEnDenT on cuRRent percEpTioN $\mAthCal{W}(t)$. tHus, the PercePtuaL iNfERenCe problEM iS SUmmaRiSeD by tHe cOnDitioNal dIStrIbution $p( \mathcal{W}(T+1)|\maTHcal{w}(t), \MaThbf{r}_{F}(t+1), \Mathbf{I},\mathcaL{G})$;

-   the externaL gOal $\MathcaL{g}$ Being assIgned, the oculomotor actioN Setting At tIme $t+1$, $\mAthcAl{A}(t+1)$, is draWn cOnditiOnaLLy on cuRrent aCtion SeTtiNG $\MathcAL{a}(t)$ And ThE perceived SCEne $\MathcAl
=============

Visual perc eption cou pledwit h g az e sh ifts  should be con s ider ed the *Drosophila* of  perc ep t ion- a ct ion l oops. A m on g the  v ar iet yo factiv e b ehavior s the orga nis mcan fluently en gage to pu rpo sively act u pon  and p er cei v e the  wo rld ( e.g, m o ving t he body,tu r ning t h e head, m an ipul ating objects), o c ul o motor behavior  is th em in i m al,  le ast energy ,unit. To perf o rm $ 3 $-$ 4 $ saccades pe r second, t h e o rganis mrou g hly sp ends$3 0 0$msecs to cl osethe loop($200$ msecs f o r motor  prepa rat ion  and ex ec uti on ,  $1 0 0$  ms e csleft for  p er cepti on). ! [ Theper cept ion-a ction loop un fol dedi n t ime a s a d ynam ic  PGM.  $\mat hcal{ A} (t)$ denotes th e en semble of  ti me -va ry ing R V s defi nin g t he ocul omotora cti on s e tt ing; $\mathcal{W}( t) $ st ands for  the e n se mb l e of tim e- var ying R Vs ch arac t er ising th e scen e  a sactivel ypercei ve d b y t he ob s erve r; $\m athcal{G }$ su m marizes the gi v en goal(s), T o  s i m pl i fy t hegraphics, c ondi t iona l de p en den c ies $ \math ca l {G }  \rightarrow \mathc al {A}(t+ 1)$ a nd $\mathcal{ G} \righta r r o w \mathc al{W } (t + 1)$ have beenomitt ed.[]{data - label="F ig:lo op"}](Fi gLoop.jpg ) 
One way  to  ma kejus t i ce  of this forg o t tenli nk is g oin g backtofir stpri nc iples byre-shapi ng  t he  p rob lem a s  the act io n-p er cep tionl oop, w hichis p re se n ted  in Fig u re \ [Fig :l oo p\]inth e for m of a d ynamicPGM. Themod e l re li es  upon t he followingas sumptions: 
-  The s c e ne thatwill be perceived at ti m e $t+1$ , n amely  $\m athcal{W} (t+ 1)$ is  in f erredfrom t he ra wdat a $\mat h b f{ I}$ ,gazed at $ \ m ath bf{r} _{ F}(t +1)$, u nder the goal $\ma t hca l{G}$ assigne d t o th e ob ser v er ,  an di s c o n ditionally depe ndent on c ur r en t percepti o n $ \m athcal{ W}(t)$.  Thus ,  the pe rceptualinference  p robl e m  is  summarise d by the  conditio n al di s tr ibuti on$P( \m at hca l{W}( t+1)|\ m ath cal{W }(t),\m athbf{ r}_{F }( t+1), \m athbf{I},\mathcal{G})$; 

-  The e xte rnal goal  $\ m ath cal{G}$ b eing  assigned,  th e o culom oto r  acti on s e tt ing at ti me $ t +1$, $\ma t hc al{ A } (t +1)$, is dr a w n  co nditi ona l ly oncurr ent action settin g  $\mathcal{A}( t)$a n d t hep erce iv ed scene $\mat hca l
=============

Visual perception_coupled with_gaze shifts should be_considered the_*Drosophila*_of perception-action_loops._Among the variety_of active behaviors_the organism can fluently_engage to purposively_act_upon and perceive the world (e.g, moving the body, turning the head, manipulating objects),_oculomotor_behavior is_the_minimal,_least energy, unit. To perform_$3$-$4$ saccades per second, the_organism roughly_spends $300$ msecs to close the loop ($200$_msecs_for motor preparation_and execution, $100$ msecs left for perception).

![The perception-action loop_unfolded in time as a dynamic_PGM. $\mathcal{A}(t)$ denotes_the_ensemble_of time-varying RVs defining_the oculomotor action setting; $\mathcal{W}(t)$ stands_for the ensemble of time-varying RVs_characterising the scene as actively perceived by_the observer; $\mathcal{G}$ summarizes the given_goal(s), To simplify the graphics,_conditional dependencies_$\mathcal{G} \rightarrow \mathcal{A}(t+1)$ and $\mathcal{G}_\rightarrow \mathcal{W}(t+1)$ have_been omitted.[]{data-label="Fig:loop"}](FigLoop.jpg)

One_way to make_justice of this forgotten link is_going back to_first principles by re-shaping the problem_as_the action-perception loop,_which_is_presented in_Figure \[Fig:loop\] in_the_form of_a_dynamic PGM. The model relies upon_the_following assumptions:

-   The scene that_will be perceived at_time_$t+1$, namely $\mathcal{W}(t+1)$ is_inferred from the raw data_$\mathbf{I}$, gazed at $\mathbf{r}_{F}(t+1)$, under the_goal $\mathcal{G}$_assigned to_the observer, and is conditionally dependent on current perception $\mathcal{W}(t)$. Thus,_the perceptual inference problem is summarised_by the conditional distribution_$P( \mathcal{W}(t+1)|\mathcal{W}(t),_\mathbf{r}_{F}(t+1),_\mathbf{I},\mathcal{G})$;

-  _The_external goal_$\mathcal{G}$ being assigned, the oculomotor action setting_at time_$t+1$, $\mathcal{A}(t+1)$, is drawn conditionally on_current action setting $\mathcal{A}(t)$_and_the perceived scene $\mathcal