 to integrate with all detectors for fair comparison of the *detector* matching performances. So we overlook the description performance.

Method
======

This section defines ELF, a detection method valid for any trained CNN. Keypoints are local maxima of a saliency map computed as the feature gradient *w.r.t* the image. We use the data adaptive Kapur method [@kapur1985new] to automatically threshold the saliency map and keep only the most salient locations, then run NMS for local maxima detection.

![(Bigger version Figure \[fig:big\_saliency\_coco\].) Saliency maps computed from the feature map gradient $\left| ^TF^l(x) \cdot \frac{\partial F^l}{\partial \mathbf{I}} \right|$. Enhanced image contrast for better visualisation. Top row: gradients of VGG $pool_2$ and $pool_3$ show a loss of resolution from $pool_2$ to $pool_3$. Bottom: $(pool_i)_{i \in [1,2,5]}$ of VGG on Webcam, HPatches and Coco images. Low level saliency maps activate accurately whereas higher saliency maps are blurred.[]{data-label="fig:saliency_coco"}](fig2_saliency_bis.png){width="\linewidth"}

Feature Specific Saliency
-------------------------

We generate a saliency map that activates on the most informative image region for a specific CNN feature level $l$. Let $\mathbf{I}$ be a vector image of dimension $D_I = H_I \cdot W_I \cdot C_I$. Let $F^l$ be a vectorized feature map of dimension $D_F= H_l \cdot W_l \cdot C_l$. The saliency map $S^l$, of dimension $D_I$, is $S^l(\mathbf{I})=\left| ^tF^l(\mathbf{I}) \cdot \nabla_I F^l \right|$, with $\nabla_I F^l$ a $D_F \times D_I$ matrix.

The saliency activates on the image regions that contribute the most to the feature representation $F^l(\mathbf{I})$. The term $\nabla_I F^l$ explicits the correlation between the feature space of $F^l$ and the image space in general.
to integrate with all detectors for fair comparison of the * detector * matching performance. therefore we overlook the description performance. 

 Method 
 = = = = = = 

 This section define ELF, a detection method valid for any educate CNN. Keypoints are local maxima of a saliency function calculate as the feature gradient * w.r.t * the image. We practice the data adaptive Kapur method [ @kapur1985new ] to mechanically threshold the saliency map and keep only the most salient locations, then run NMS for local maximum detection. 

! [ (Bigger version number \[fig: big\_saliency\_coco\ ] .) Saliency maps computed from the feature function gradient $ \left| ^TF^l(x) \cdot \frac{\partial F^l}{\partial \mathbf{I } } \right|$. Enhanced trope contrast for better visualisation. Top rowing: gradients of VGG $ pool_2 $ and $ pool_3 $ show a loss of resolution from $ pool_2 $ to $ pool_3$. Bottom: $ (pool_i)_{i \in [ 1,2,5]}$ of VGG on Webcam, HPatches and Coco images. Low level saliency maps activate accurately whereas higher saliency maps are blurred.[]{data - label="fig: saliency_coco"}](fig2_saliency_bis.png){width="\linewidth " } 

 Feature Specific Saliency 
 ------------------------- 

 We generate a saliency map that trip on the most informative prototype area for a specific CNN feature level $ l$. Let $ \mathbf{I}$ be a vector image of dimension $ D_I = H_I \cdot W_I \cdot C_I$. Let $ F^l$ be a vectorized feature map of property $ D_F= H_l \cdot W_l \cdot C_l$. The saliency map $ S^l$, of dimension $ D_I$, is $ S^l(\mathbf{I})=\left| ^tF^l(\mathbf{I }) \cdot \nabla_I F^l \right|$, with $ \nabla_I F^l$ a $ D_F \times D_I$ matrix. 

 The saliency activates on the image region that contribute the most to the feature representation $ F^l(\mathbf{I})$. The term $ \nabla_I F^l$ explicits the correlation between the feature outer space of $ F^l$ and the image space in general.
 to integrate with all detegtors for fair comparismn of fhe *deteztor* matching performances. Sl qe ovtglook the description performajce.

Methoe
======

Thiw section dxrines ELF, a dsbectimi method valid nor any trahned CNN. Keypohngs are local maxima of a saliency map computrd as the featurg gracyent *w.r.t* the image. We use the data adaltive Kepur method [@kapir1985new] to automatically thrfshopd the saliency mao and keep inly rhe most salkent locatpmns, then ron NMS for local maxima detectiov.

![(Biggzr version Diturf \[fig:big\_salixncy\_cobo\].) Saliency maps compgted frpm the feature ma' grqdient $\left| ^TF^l(x) \cdot \frac{\partial F^l}{\parjial \mathbx{I}} \right|$. Enhanced inate cottravt fue bdtttr tishalisahioi. Top row: gdadients of VGG $pool_2$ and $pool_3$ xhjq a loss of rssolutyog from $pool_2$ to $pool_3$. Bottom: $(pool_i)_{i \in [1,2,5]}$ ox VFG on Webcam, HPatches abd Coco images. Low legel saliegcy maps activate accurately whereas higher salietcy mepr axc cougred.[]{data-label="fig:saliency_coco"}](fig2_saliency_bis.png){rjduh="\lpnewidth"}

Feature Siecific Saliency
-------------------------

We gfnrtate a salienci map tkzt activates on the lost insormarive imagt regoon for a specific CNN featyre level $l$. Jwt $\mathbf{I}$ be a veetor image oy dimemsion $D_I = H_I \cdot W_I \cdot C_I$. Let $F^l$ be a veftorized rdature map of dioenximn $D_F= H_l \cdot W_l \cdot C_l$. Tre salienry ma' $S^l$, of aimemsion $Q_I$, is $S^l(\mahhbf{I})=\left| ^tF^l(\mathbf{I}) \cdoh \nabpa_H F^l \right|$, with $\nabla_I F^l$ a $D_F \times D_I$ mevrix.

The saliemcf abtivates jn thc image regions that contribuje the moft to the featuge represxntation $F^l(\mwthbf{I})$. The tesl $\nabla_I F^l$ xxplicits the coreelatiov between the frature spcee of $F^l$ qnd the image spacc in esneral.
to integrate with all detectors for fair the matching performances. we overlook the section ELF, a detection valid for any CNN. Keypoints are local maxima of saliency map computed as the feature gradient *w.r.t* the image. We use the adaptive Kapur method [@kapur1985new] to automatically threshold the saliency map and keep only most locations, run for local maxima detection. ![(Bigger version Figure \[fig:big\_saliency\_coco\].) Saliency maps computed from the feature map gradient ^TF^l(x) \cdot \frac{\partial F^l}{\partial \mathbf{I}} \right|$. Enhanced image for better visualisation. Top gradients of VGG $pool_2$ and show loss of from to Bottom: $(pool_i)_{i \in of VGG on Webcam, HPatches and Coco images. Low level saliency maps activate accurately whereas higher saliency are blurred.[]{data-label="fig:saliency_coco"}](fig2_saliency_bis.png){width="\linewidth"} Saliency ------------------------- generate saliency that activates on informative image region for a specific $l$. Let $\mathbf{I}$ be a vector image of $D_I = \cdot W_I \cdot C_I$. Let $F^l$ a vectorized feature map of dimension $D_F= H_l W_l \cdot C_l$. The saliency map $S^l$, of dimension $D_I$, is $S^l(\mathbf{I})=\left| ^tF^l(\mathbf{I}) \cdot \nabla_I with $\nabla_I F^l$ a \times D_I$ matrix. saliency on image that contribute most to the feature representation $F^l(\mathbf{I})$. The term $\nabla_I F^l$ explicits correlation between the feature space of $F^l$ and the image general.
 to integrate with all detectoRs for fair cOmparIsoN of ThE *detEctoR* matching perfoRMancEs. So we overlook the descrIptioN pERforMAnCe.

MetHod
======

This SEcTIOn dEfInEs ElF, A DeTectiOn mEthod vaLid for any tRaiNeD CNN. KeypointS ArE local maxiMa oF a saliency maP coMputed As The FEaturE grAdienT *w.r.t* thE Image. WE use the daTa ADaptivE kapur meTHOd [@KapuR1985new] to automaticalLY tHReshold the saliEncy maP aND kEEP onLy tHe most saliEnT locaTIons, theN RuN nms foR Local maxima deTection.

![(BiggER veRsion FIgUre \[FIg:big\_sAlienCy\_COco\].) saliency mapS comPuted from The feaTUre map gRAdient $\lEft| ^TF^l(X) \cdOt \fRac{\pARtIaL F^l}{\PaRTiaL \MaThbF{i}} \riGht|$. EnhanCeD iMage cOntrAST FOr beTteR visUalisAtion. Top row: grAdiEnts OF VGg $pool_2$ And $poOl_3$ shOw A loss Of resoLutioN fRom $pool_2$ to $pool_3$. BoTtom: $(Pool_i)_{i \in [1,2,5]}$ oF VGg oN WeBcAm, HPaTChes anD CoCo iMages. LoW level sALieNcY MAPs Activate accurately WhEREaS higher sAliencY MaPs ARe blurreD.[]{dAta-LabeL="FIg:salIencY_CoCo"}](fig2_salIency_bIS.pNg){Width="\liNeWidth"}

FEaTurE SpEcifiC saliEncy
-------------------------

We Generate A saliENcy map that actiVAtes on the most INfORMaTIve iMagE region for a SpecIFic CnN feATuRe lEVel $l$. LEt $\matHbF{i}$ bE A vector image of dimenSiOn $D_I = H_I \Cdot W_i \cdot C_I$. Let $F^l$ bE a vectorizED FEature maP of dIMeNSion $D_F= H_l \cdot W_l \Cdot C_L$. The salienCY map $S^l$, of DimenSion $D_I$, is $s^l(\mathbf{I})=\LEFt| ^tF^l(\matHbf{i}) \cdOt \nAblA_i f^l \Right|$, with $\nablA_i f^l$ a $D_f \tImes D_I$ mAtrIx.

The saLieNcy ActIvaTeS on the imaGe regionS tHaT cOnTriBute tHE most to tHe FeaTuRe rEpresENtatioN $F^l(\maThbf{i})$. THe TErm $\Nabla_I F^L$ ExPLIcitS tHe CorrElaTiOn betWeen THe fEature sPace of $F^l$ aNd tHE imaGe SpAce in geNeral.
 to integrate with all det ectors for  fair  co mpa ri sonof t he *detector*m atch ing performances. So w e ove rl o ok t h edescr iptionp er f o rma nc e. 

M et h od 
==== ==
This s ection def ine sELF, a detec t io n method v ali d for any tr ain ed CNN .Key p oints  ar e loc al max i ma ofa salienc ym ap com p uted as t he  fea ture gradient *w. r .t *  the image. We  use t he da t a  ad apt ive Kapurme thod[ @kapur1 9 85 n e w ] t o  automaticall y threshold the  salie nc y m a p andkeepon l y t he most sal ient  location s, the n  run NM S  for lo cal ma xim a d etec t io n. 

! [( B igg e rver s ion  Figure\[ fi g:big \_sa l i e n cy\_ coc o\]. ) Sal iency maps co mpu tedf rom  thefeatu re m ap  grad ient $ \left |^TF^l(x) \cdot\fra c{\partia l F ^l }{\ pa rtial \mathb f{I }}\right| $. Enha n ced  i m a g econtrast for bette rv i su alisatio n. Top ro w: gradient sofVGG$ p ool_2 $ an d  $ pool_3$show a lo ss  of res ol utionfr om$po ol_2$ to $ pool_3 $. Botto m: $( p ool_i)_{i \in[ 1,2,5]}$ of V G Go n  W e bcam , H Patches and  Coc o  ima ges. Lo w l e vel s alien cy ma p s activate accurate ly  where as hi gher saliency  maps areb l u rred.[]{ data - la b el="fig:salien cy_co co"}](fig2 _ saliency _bis. png){wid th="\line w i dth"}

F eat ure  Sp eci f i cSaliency
---- - - ---- -- ------- --- ---

We  ge ner ate  asa liency ma p that a ct iv at es  on  them ost info rm ati ve  im age r e gion f or aspec if ic CNN  featur e  l e v el $ l$ .Let$\m at hbf{I }$ b e  avectorimage ofdim e nsio n$D _I = H_ I \cdot W_I \ cd ot C_I$. L et  $F ^l$ be a  vectori zed feature map of dime n sion $D _F=  H_l\cdo t W_l \cd otC_l$.The salien cy map  $S^l $,  of d imens i o n$D_ I$ , is $S^l( \ m ath bf{I} )= \lef t| ^tF^ l(\mathbf{I}) \cdo t  \n abla_I F^l \r igh t|$, w it h $ \ na b la_ IF ^l$ a  $D_F \times D_ I$ matrix. 
T he  saliencya cti va tes onthe ima ge re g ions th at contri bute themo st t o the  feature r epresent ation $F^ l (\mat h bf {I})$ . T he ter m$\n abla_ I F^l$ exp licit s theco rrelat ion b et ween the  feature space of $F^l$  and t he im age  space in  ge n era l.
 to_integrate with_all detectors for fair_comparison of_the_*detector* matching_performances._So we overlook_the description performance.

Method
======

This_section defines ELF, a_detection method valid_for_any trained CNN. Keypoints are local maxima of a saliency map computed as the_feature_gradient *w.r.t*_the_image._We use the data adaptive_Kapur method [@kapur1985new] to automatically_threshold the_saliency map and keep only the most salient_locations,_then run NMS_for local maxima detection.

![(Bigger version Figure \[fig:big\_saliency\_coco\].) Saliency maps_computed from the feature map gradient_$\left| ^TF^l(x) \cdot_\frac{\partial_F^l}{\partial_\mathbf{I}} \right|$. Enhanced image_contrast for better visualisation. Top row:_gradients of VGG $pool_2$ and $pool_3$_show a loss of resolution from $pool_2$_to $pool_3$. Bottom: $(pool_i)_{i \in [1,2,5]}$_of VGG on Webcam, HPatches_and Coco_images. Low level saliency maps_activate accurately whereas_higher saliency_maps are blurred.[]{data-label="fig:saliency_coco"}](fig2_saliency_bis.png){width="\linewidth"}

Feature_Specific Saliency
-------------------------

We generate a saliency map_that activates on_the most informative image region for_a_specific CNN feature_level_$l$._Let $\mathbf{I}$_be a vector_image_of dimension_$D_I_= H_I \cdot W_I \cdot C_I$._Let_$F^l$ be a vectorized feature map of_dimension $D_F= H_l \cdot_W_l_\cdot C_l$. The saliency_map $S^l$, of dimension $D_I$,_is $S^l(\mathbf{I})=\left| ^tF^l(\mathbf{I}) \cdot \nabla_I F^l_\right|$, with_$\nabla_I F^l$_a $D_F \times D_I$ matrix.

The saliency activates on the image regions_that contribute the most to the_feature representation $F^l(\mathbf{I})$. The_term $\nabla_I_F^l$_explicits the correlation_between_the feature_space of $F^l$ and the image space_in general.