 focus on a relatively small-scale problem, recognition of a few hundreds different items at most, whilst usually several thousands products are on sale in a real shop. George [@george2014recognizing] address more realistic settings and propose a multi-stage system capable of recognizing $\sim3400$ different products based on a single model image per product. The authors’ contribution includes releasing the dataset employed in their experiments, which we will use in our evaluation. More recently, [@yoruk2016efficient] has tackled the problem using a standard local feature based recognition pipeline and an optimized Hough Transform to detect multiple object instances and filter out inconsistent matches, which brings in a slight performance improvement.

Nowadays, CNN-based systems are dominating object detection benchmarks and can be subdivided into two main families of algorithms based on the number of stages required to perform detection. On one hand, we have the slower but more accurate two stage detectors [@ren2015faster], which decompose object detection into a region proposal followed by an independent classification for each region. On the other hand, fast one stage approaches [@redmon2016yolo9000; @huang2016speed] can perform detection and classification jointly. A very recent work has also addressed the specific domain of grocery products, so as to propose an ad hoc detector [@qiao2017scalenet] that analyzes the image at multiple scales to produce more meaningful region proposals.

Besides, deploying CNNs to obtain rich image representations is an established approach to pursue image search, both as a strong off-the-shelf baseline [@sharif2014cnn] and as a key component within more complex pipelines [@gordo2016deep]. Inspiration for our product recognition approach came from [@schroff2015facenet; @bell2015learning]. In [@schroff2015facenet], Schroff train a CNN using triplets of samples to create an embedding for face recognition and clustering while in [@bell2015learning] Bell rely on a CNN to learn an image embedding to recognize the similarity between design products. Similarly, in the related field of fashion items recognition, relying on learned global descriptor rather than classifiers is an established solution shared among many recent works [@hadi2015buy; @wang2014learning; @shankar2017deep].

Proposed Approach {#sec:product_detection_recognition}
=================

![image](pipeline_completa.pdf){width="75.00000%"}

shows an overview of our proposed pipeline
focus on a relatively small - scale problem, realization of a few hundred unlike items at most, whilst usually several thousand products are on sale in a real shop. George [ @george2014recognizing ] savoir-faire more naturalistic settings and propose a multi - stage system capable of recognizing $ \sim3400 $ unlike products based on a single model trope per product. The writer ’ contribution includes releasing the dataset use in their experiments, which we will use in our evaluation. More recently, [ @yoruk2016efficient ] has tackled the trouble using a standard local feature establish recognition grapevine and an optimized Hough Transform to detect multiple aim instances and filter out inconsistent matches, which bring in a slight performance improvement. 

 Nowadays, CNN - based systems are dominating aim signal detection benchmark and can be subdivided into two main families of algorithms based on the number of stages required to do signal detection. On one hand, we have the slower but more accurate two stagecoach detectors [ @ren2015faster ], which decompose object signal detection into a region marriage proposal followed by an independent classification for each area. On the other hand, fast one stage approaches [ @redmon2016yolo9000; @huang2016speed ] can perform signal detection and classification jointly. A very recent work has also addressed the specific domain of grocery product, so as to propose an ad hoc detector [ @qiao2017scalenet ] that analyzes the image at multiple scales to produce more meaningful area proposals. 

 Besides, deploying CNNs to obtain rich image representations is an established approach to pursue trope search, both as a strong off - the - ledge baseline [ @sharif2014cnn ] and as a key component within more complex pipelines [ @gordo2016deep ]. Inspiration for our merchandise recognition access came from [ @schroff2015facenet; @bell2015learning ]. In [ @schroff2015facenet ], Schroff educate a CNN using triplets of sample to produce an embedding for face recognition and clustering while in [ @bell2015learning ] Bell rely on a CNN to learn an image embedding to recognize the similarity between blueprint products. Similarly, in the related field of manner items recognition, relying on learned global descriptor rather than classifier is an established solution shared among many recent works [ @hadi2015buy; @wang2014learning; @shankar2017deep ]. 

 Proposed Approach { # sec: product_detection_recognition } 
 = = = = = = = = = = = = = = = = = 

! [ image](pipeline_completa.pdf){width="75.00000% " } 

 shows an overview of our propose grapevine
 fofus on a relatively smalu-scale problem, texognitmon of z few huvdreds different items at modt, whilwt usually several thojsands prlducts aee oi sale in a real shop. George [@gslrge2014xerognizing] addrexs more redlistic settincs aud propose a multi-stage system capabje of rrclgnizing $\sim3400$ dyffegegt pdoducts based on a single model imzge per product. The suthors’ contribution inclufes geleasing the datadet employee in rheir experioents, which we will usg in our evaluation. More recentlh, [@yorbk2016efficient] hqs hdckled the 'roblei using a standard lmcal festure based regognivion pipeline and an optikized Hough Transfjrm to dedeet multiple object inwtqnces and filgwr uut iicohsistejt jatches, whjch brings un a slight performsnsv improvement.

Howadars, CNN-based systems are dominating object defection benchmarks and xan be subdivided intl two maig families of algorithms based on the number of sdages feqblved gi oerform detection. On one hand, we have the slorsr blt more accurate bwo stage detectorx [@gem2015saster], which aecompose object detection lnto a tegion proposal folkowed by an independent clawsification yor each region. On thz other hand, fasj one xtage approaches [@redmon2016volo9000; @hhang2016speed] cwn perforj detection and cuasxixication jointly. A very resent work has also aadrexsed tre specifif domain of grocery prodkcts, do as to prooose an ad hoc detector [@qiao2017scalenet] that anakyses the imaye at kultiple scalqs to produce kore mecningfjl region iroposals.

Uesides, depljying CNNs to lbtain rich mmage repwesebtatuons is xn established approach to pursue image search, both as z strong off-the-wheof baseline [@shatif2014znn] ajd af a key compotent wignin mure comkjew pkpelones [@gordo2016deep]. Inspisatikn for our product rccognitiob approash came from [@xchroff2015facenet; @belp2015leariing]. Ii [@schrpff2015sacenet], Schroff train a CNN usjng triplfts of samples eo cveatg an embeddnng for face recognition and clustering xhile in [@bell2015learning] Bwll rely on a CNN tp learn an ikage qmbedding to recognize the sinilarity between cesign products. Similzrly, it the related field of fashion items recognition, relying on learned global desxriptoc wather than claxsifivrs ns an eftabpmshed solution shsred among many recent works [@havi2015buy; @wang2014necrning; @shankar2017deep].

Proposed Aplruach {#sec:produzt_detection_recognition}
=================

![imzge](pipelone_completa.pdf){width="75.00000%"}

shows an ovetview of our proposed piieline
focus on a relatively small-scale problem, recognition few different items most, whilst usually sale a real shop. [@george2014recognizing] address more settings and propose a multi-stage system of recognizing $\sim3400$ different products based on a single model image per product. authors’ contribution includes releasing the dataset employed in their experiments, which we will in evaluation. recently, has tackled the problem using a standard local feature based recognition pipeline and an optimized Hough to detect multiple object instances and filter out matches, which brings in slight performance improvement. Nowadays, CNN-based are object detection and be into two main of algorithms based on the number of stages required to perform detection. On one hand, we have slower but two stage [@ren2015faster], decompose detection into a followed by an independent classification for the other hand, fast one stage approaches [@redmon2016yolo9000; can perform and classification jointly. A very recent has also addressed the specific domain of grocery so as to propose an ad hoc detector [@qiao2017scalenet] that analyzes the image at multiple produce more meaningful region Besides, deploying CNNs obtain image is established approach pursue image search, both as a strong off-the-shelf baseline [@sharif2014cnn] and a key component within more complex pipelines [@gordo2016deep]. Inspiration for recognition came from [@schroff2015facenet; In [@schroff2015facenet], Schroff train CNN triplets of samples to embedding face while [@bell2015learning] rely on a CNN learn an image embedding to the similarity between design field of fashion items recognition, relying on learned descriptor rather than classifiers is an established shared among many recent works [@hadi2015buy; @wang2014learning; @shankar2017deep]. Proposed Approach {#sec:product_detection_recognition} ================= shows an our proposed pipeline
 focus on a relatively small-scAle problem, RecogNitIon Of A few HundReds different iTEms aT most, whilst usually seveRal thOuSAnds PRoDucts Are on saLE iN A ReaL sHoP. GeOrGE [@gEorge2014RecOgnizinG] address moRe rEaListic settinGS aNd propose a MulTi-stage systeM caPable oF rEcoGNizinG $\siM3400$ diffErent pROducts Based on a sInGLe modeL Image peR PRoDuct. the authors’ contribUTiON includes releaSing thE dATaSET emPloYed in their ExPerimENts, whicH We WILL usE In our evaluatiOn. More recenTLy, [@yOruk2016efFiCieNT] has taCkled ThE ProBlem using a sTandArd local fEature BAsed recOGnition PipeliNe aNd aN optIMiZeD HoUgH traNSfOrm TO deTect multIpLe ObjecT insTANCEs anD fiLter Out inConsistent matCheS, whiCH brIngs iN a sliGht pErFormaNce impRovemEnT.

Nowadays, CNN-basEd syStems are dOmiNaTinG oBject DEtectiOn bEncHmarks aNd can be SUbdIvIDED iNto two main families Of ALGoRithms baSed on tHE nUmBEr of stagEs ReqUireD TO perfOrm dETeCtion. On oNe hand, WE hAvE the sloWeR but moRe AccUraTe two STage DetectOrs [@ren2015faSter], wHIch decompose obJEct detection iNTo A REgIOn prOpoSal followed By an INdepEndeNT cLasSIficaTion fOr EAcH Region. On the other hanD, fAst one Stage Approaches [@redMon2016yolo9000; @huaNG2016SPeed] can pErfoRM dETection and clasSificAtion jointLY. A very reCent wOrk has alSo addressED The speciFic DomAin Of gROCeRy products, so aS TO proPoSe an ad hOc dEtector [@QiaO2017scAleNet] ThAt analyzeS the imagE aT mUlTiPle ScaleS To producE mOre MeAniNgful REgion pRoposAls.

BEsIdES, dePloying cnNS TO obtAiN rIch iMagE rEpresEntaTIonS is an esTablished AppROach To PuRsue imaGe search, both aS a Strong off-tHe-SheLf baseLINe [@sharif2014Cnn] and as a key component wiTHin more ComPlex pIpelInes [@gordo2016DeeP]. InspiRatIOn for oUr prodUct reCoGniTIOn appROAcH caMe From [@schrofF2015FAceNet; @beLl2015LearNing]. In [@sChroff2015facenet], SchroFF trAin a CNN using tRipLets OF SaMplES tO CreAtE An eMBEdding for face reCognition aNd CLuStering whiLE in [@BeLl2015learnIng] Bell Rely oN A CNN to lEarn an imaGe embeddiNg To reCOGniZe the similArity betWeen desigN ProduCTs. similArlY, in the ReLatEd fieLd of faSHioN itemS recogNiTion, reLying On Learned gLobal descriptor rather thAn clasSifieRs iS an establIshED soLution shaRed aMong many reCenT woRks [@haDi2015bUY; @wang2014LearNInG; @shANkar2017dEep].

PROposed AppROaCh {#sEC:PrOduct_detectION_RecOgnitIon}
=================

![IMage](piPeliNe_completa.pdf){widtH="75.00000%"}

Shows an overvieW of oUR ProPosED pipElIne
 focus on a relatively sma ll-scale p roble m,rec og niti on o f a few hundre d s di fferent items at most,  whil st usua l ly  seve ral tho u sa n d s p ro du cts  a r eon sa lein a re al shop. G eor ge  [@george201 4 re cognizing]  ad dress more r eal isticse tti n gs an d p ropos e a mu l ti-sta ge system  c a pableo f recog n i zi ng $ \sim3400$ differe n tp roducts basedon a s in g le m ode l i mage per p ro duct. The aut h or s ’ con t ribution incl udes releas i ngthe da ta set employ ed in  t h eir  experiment s, w hich we w ill us e  in our evaluat ion. M ore  re cent l y,  [ @yo ru k 201 6 ef fic i ent ] has ta ck le d the  pro b l e m  usi nga st andar d local featu rebase d  re cogni tionpipe li ne an d an o ptimi ze d Hough Transfo rm t o detectmul ti ple  o bject instan ces  an d filte r out i n con si s t e nt  matches, which br in g s  i n a slig ht per f or ma n ce impro ve men t.
N o waday s, C N N- based sy stemsa re  d ominati ng  objec tdet ect ion b e nchm arks a nd can b e sub d ivided into tw o  main familie s  o f al g orit hms  based on t he n u mber  ofs ta ges requi red t op er f orm detection. On o ne  hand,  we h ave the slowe r but more a c curate t wo s t ag e  detectors [@r en201 5faster],w hich dec ompos e object  detectio n into a r egi onpro pos a l  f ollowed by an i ndep en dent cl ass ificati onfor  ea chre gion. Onthe othe rha nd ,fas t one stage ap pr oac he s [ @redm o n2016y olo90 00;@h ua n g20 16speed ]  c a n  per fo rm  det ect io n and  cla s sif ication  jointly.  Av eryre ce nt work  has also add re ssed the s pe cif ic dom a i n of gro cery products, so as to propose  an  ad h oc d etector [ @qi ao2017 sca l enet]that a nalyz es  th e image a tmul ti ple scales t o p roduc emore  meanin gful region propos a ls. 

Besides, de plo ying C NN s t o  o b tai nr ich i mage representa tions is a ne st ablished a p pro ac h to pu rsue im age s e arch, b oth as astrong of f- the- s h elf  baseline[@sharif 2014cnn]a nd as akey c omp onentwi thi n mor e comp l expipel ines [ @g ordo20 16dee p] . Inspir ation for our product r ecogni tionapp roach cam e f r om[@schroff 2015 facenet; @ bel l20 15lea rni n g]. I n [@ s ch rof f 2015f acen e t], Schro f ftra i n  a  CNN usingt r i ple ts of  sa m ples t o cr eate an embedding for face recog niti o n  an d c l uste ri ng while in [@ bel l2 0 1 5learnin g]  Bell relyon a CNN  t o  lear n an i mage e mbeddin g to recogn izethe  similari tybe t ween de si gn produc ts.Si milarl y, int he r e l ated field of fa shion i temsr eco gniti on , relyi n g on  learned g lobal descr iptorrath er th an clas si fiersisan  establish e d solutio n sha red amo ng  man y r ecentwork s [@had i201 5b uy;  @wang201 4 l ea r ni ng ;  @s hank ar201 7d eep] .

Propos e d Approa ch{ #sec:pr od uct _ d etecti o n_ r e cognition} 
== ===== = = ========
! [ima g e] ( pipel ine_co mpleta .pdf){w i dth =" 75.0000 0%" } 
shows an  overview ofou r pr oposed p ip elin e
 focus_on a_relatively small-scale problem, recognition_of a_few_hundreds different_items_at most, whilst_usually several thousands_products are on sale_in a real_shop._George [@george2014recognizing] address more realistic settings and propose a multi-stage system capable of recognizing_$\sim3400$_different products_based_on_a single model image per_product. The authors’ contribution includes_releasing the_dataset employed in their experiments, which we will_use_in our evaluation._More recently, [@yoruk2016efficient] has tackled the problem using a_standard local feature based recognition pipeline_and an optimized_Hough_Transform_to detect multiple object_instances and filter out inconsistent matches,_which brings in a slight performance_improvement.

Nowadays, CNN-based systems are dominating object detection_benchmarks and can be subdivided into_two main families of algorithms_based on_the number of stages required_to perform detection._On one_hand, we have_the slower but more accurate two_stage detectors [@ren2015faster],_which decompose object detection into a_region_proposal followed by_an_independent_classification for_each region. On_the_other hand,_fast_one stage approaches [@redmon2016yolo9000; @huang2016speed] can_perform_detection and classification jointly. A very recent_work has also addressed_the_specific domain of grocery_products, so as to propose_an ad hoc detector [@qiao2017scalenet] that_analyzes the_image at_multiple scales to produce more meaningful region proposals.

Besides, deploying CNNs to_obtain rich image representations is an_established approach to pursue_image search,_both_as a strong_off-the-shelf_baseline [@sharif2014cnn]_and as a key component within more_complex pipelines_[@gordo2016deep]. Inspiration for our product recognition_approach came from [@schroff2015facenet;_@bell2015learning]._In [@schroff2015facenet], Schroff train a CNN_using triplets of samples to create_an embedding for face recognition_and_clustering_while in [@bell2015learning] Bell rely_on a CNN to learn an_image embedding to_recognize the similarity between design products. Similarly,_in_the related field of fashion items_recognition,_relying on learned global descriptor rather_than_classifiers_is an established solution shared_among many recent works [@hadi2015buy; @wang2014learning;_@shankar2017deep].

Proposed Approach {#sec:product_detection_recognition}
=================

![image](pipeline_completa.pdf){width="75.00000%"}

shows an overview of our proposed pipeline