 a well-trained annotator three minutes to complete a bounding box annotation on one image). We strike a middle ground by grouping items of the same types, that often also appear in similar location (e.g. *jacket, coat, t-shirt*) into a high-level class (e.g. *top*). Our complete list of top-level detection class for apparel items is as follows: *headwear, eyewear, earring, belt, bottom, dress, top, suit, tie, footwear, swimsuit, bag, wristwear, scarf, necklace* and *one-piece*.

On the same setting, different object detectors usually have different strengths with respect to object sizes and scales ([@Huang2017SpeedAccuracyTF]). To boost recall for offline processes, such as index building, we use an array of multi-box object detectors operating at different levels of image resolutions: SSD-512 Resnet50 ([@liu2016ssd]), YOLO V3 Darknet53 300 and 416 ([@Yolov3]). Their results are combined using non-maximum suppression. During inference time, we use SSD-512 with a VGG backbone for real-time response.

Fine-Grained Product Type Classification and Feature Extraction {#fine-grained-product-type-classification-and-feature-extraction.unnumbered}
---------------------------------------------------------------

We build one fine-grained classifier for each of the high-level classes in the previous section. For example, the top classifier will try to classify all detected top bounding boxes into one of the 33 product types such as *denim jacket, tunic, blouse, vest*… Taking run-time into considerations, we chose the Resnet18 ([@resnetHeZRS15]) as the backbone for all fine-grained classifiers. To exploit better all available supervised signal in our training sets, we extended the network to perform multi-task classification. For example, for the *top* classifier, we additionally classify *color, pattern, shape, shoulder type, neck type, sleeve type…* For each branch corresponding to one of these tasks, a fully connected layer with a 128-D output is inserted between *pool5* and its *softmax* layers. We observe that by using joint multi-task training, product-type classification as well as search relevance are both improved.

![image](Picture2.png){width=".60\linewidth"}

The overall loss for the
a well - trained annotator three minutes to complete a bounding box note on one prototype). We strike a middle earth by group items of the same type, that much also look in exchangeable location (for example * jacket, coat, t - shirt *) into a high - horizontal surface class (for example * top *). Our accomplished tilt of top - level detection class for apparel detail is as follows: * headwear, eyewear, earring, belt, bottom, attire, top, suit, necktie, footwear, swimsuit, bag, wristwear, scarf, necklace * and * one - piece *. 

 On the same setting, different aim detectors usually have different strengths with respect to aim size and scales ([ @Huang2017SpeedAccuracyTF ]). To boost recall for offline processes, such as index building, we use an array of multi - box object detectors operating at unlike degree of image resolution: SSD-512 Resnet50 ([ @liu2016ssd ]), YOLO V3 Darknet53 300 and 416 ([ @Yolov3 ]). Their result are combined using non - maximum inhibition. During inference time, we practice SSD-512 with a VGG backbone for real - time reception. 

 Fine - Grained Product Type Classification and Feature Extraction { # fine-grained-product-type-classification-and-feature-extraction.unnumbered } 
 --------------------------------------------------------------- 

 We build one fine - grained classifier for each of the high - level classes in the previous section. For example, the top classifier will try to classify all detected top bounding box into one of the 33 merchandise types such as * denim jacket, tunic, blouse, vest * … Taking run - time into retainer, we chose the Resnet18 ([ @resnetHeZRS15 ]) as the backbone for all fine - grained classifiers. To exploit better all available supervised signal in our training set, we extended the net to perform multi - task classification. For example, for the * top * classifier, we additionally classify * color, form, shape, shoulder character, neck type, sleeve type … * For each outgrowth corresponding to one of these tasks, a in full connected level with a 128 - D output is inserted between * pool5 * and its * softmax * layer. We observe that by using joint multi - task training, product - type categorization as well as search relevance are both improved. 

! [ image](Picture2.png){width=".60\linewidth " } 

 The overall personnel casualty for the
 a aell-trained annotator thvee minutes to complete a bouhding bob annotation on one image). We srrike a middle ground by gruuping itvms of thw sanw types, thef often also zipear mn similar locajion (e.g. *jackat, coat, t-shirt*) ivtl a high-level class (e.g. *top*). Our compjete lixt of top-level dgtectpog clzss for apparel items is as followa: *headwtar, eyewear, earrinb, belt, bottom, dress, top, sult, tle, footwear, swimsult, bag, wrisjseaw, scarf, necklxce* and *ont-pnece*.

On the aame setting, different object ddtectprs usualli gagg different wtrendths with respect to object sizes and scakes ([@Huqng2017SpeedAccuracyTF]). To boost recall for jffline psoeesses, such as index vuuldinc, we use qn xrrzy or multl-boe object defectors opeeating at different lqnrls of image resolttyons: SSD-512 Resnet50 ([@liu2016ssd]), YOLO V3 Darknet53 300 dnd 416 ([@Yolov3]). Their results aee combined using non-laximum stppression. During inference time, we use SSD-512 with d VGG cacjbjvw vor real-time response.

Fine-Grained Product Type Dlssxification and Feature Exyrwcyyon {#fine-graingd-produef-tgpe-classification-ajd-featute-extrqction.unntmbeted}
---------------------------------------------------------------

We build one fine-grained classifier yor each of the high-lzvel classes in jhe prrvious section. For exam'le, ths top classlfier wilm try to classify alk getected top bounding boxef into onx of che 33 proauct types such as *dfnim mdcket, tunic, blouse, vest*… Tdking run-tlme into considerations, we chosx the Resnet18 ([@testetVeZRS15]) as the nackbone for alj fine-grained elassifizrs. To exploit bvtter all available fupervised sicjal in our tcaining sqts, qe eztended ghe network to perform multi-task xlassification. For exxjple, for the *to'* xlassifier, we acdigiogaplb clafvify *color, pdttefn, rnape, rhoulder tyie, veck type, sleeve type…* Fos eadh branch correspomdlng to ong of thesq tasks, a fulky connected layer with a 128-V outpit ys inserted between *pool5* and ifs *softmad* lwyers. We obsqrve that by usiug joint multi-task training, product-type rlassification as well qs search relevance sre both im'roved.

![ymage](Pictgre2.png){width=".60\linewidth"}

Rhe overall loss nor the
a well-trained annotator three minutes to complete box on one We strike a of same types, that also appear in location (e.g. *jacket, coat, t-shirt*) into high-level class (e.g. *top*). Our complete list of top-level detection class for apparel is as follows: *headwear, eyewear, earring, belt, bottom, dress, top, suit, tie, footwear, bag, scarf, and On the same setting, different object detectors usually have different strengths with respect to object sizes scales ([@Huang2017SpeedAccuracyTF]). To boost recall for offline processes, as index building, we an array of multi-box object operating different levels image SSD-512 ([@liu2016ssd]), YOLO V3 300 and 416 ([@Yolov3]). Their results are combined using non-maximum suppression. During inference time, we use SSD-512 a VGG real-time response. Product Classification Feature Extraction {#fine-grained-product-type-classification-and-feature-extraction.unnumbered} build one fine-grained classifier for each classes in the previous section. For example, the classifier will to classify all detected top bounding into one of the 33 product types such *denim jacket, tunic, blouse, vest*… Taking run-time into considerations, we chose the Resnet18 ([@resnetHeZRS15]) as for all fine-grained classifiers. exploit better all supervised in training we extended network to perform multi-task classification. For example, for the *top* classifier, additionally classify *color, pattern, shape, shoulder type, neck type, sleeve each corresponding to one these tasks, a fully layer a 128-D output is *pool5* its observe by joint multi-task training, product-type as well as search relevance both improved. ![image](Picture2.png){width=".60\linewidth"} The
 a well-trained annotator threE minutes to ComplEte A boUnDing Box aNnotation on one IMage). we strike a middle ground bY grouPiNG iteMS oF the sAme typeS, ThAT OftEn AlSo aPpEAr In simIlaR locatiOn (e.g. *jacket, CoaT, t-Shirt*) into a hiGH-lEvel class (e.G. *toP*). Our complete LisT of top-LeVel DEtectIon Class For appARel iteMs is as folLoWS: *headwEAr, eyeweAR, EaRrinG, belt, bottom, dress, tOP, sUIt, tie, footwear, sWimsuiT, bAG, wRIStwEar, Scarf, necklAcE* and *oNE-piece*.

ON ThE SAMe sETting, differenT object deteCTorS usualLy HavE DifferEnt stReNGthS with respecT to oBject sizeS and scALes ([@HuanG2017speedAcCuracytF]). TO boOst rECaLl For OfFLinE PrOceSSes, Such as inDeX bUildiNg, we USE AN arrAy oF mulTi-box Object detectoRs oPeraTIng At difFerenT levElS of imAge resOlutiOnS: SSD-512 Resnet50 ([@liu2016ssD]), YOLo V3 Darknet53 300 And 416 ([@yoLov3]). thEir reSUlts arE coMbiNed usinG non-maxIMum SuPPREsSion. During inferencE tIME, wE use SSD-512 wIth a VGg BaCkBOne for reAl-TimE resPONse.

FiNe-GrAInEd ProducT Type CLAsSiFicatioN aNd FeatUrE ExTraCtion {#FIne-gRained-Product-tYpe-clASsification-and-FEature-extractIOn.UNNuMBereD}
---------------------------------------------------------------

We Build one finE-graINed cLassIFiEr fOR each Of the HiGH-lEVel classes in the prevIoUs sectIon. FoR example, the toP classifieR WILl try to cLassIFy ALl detected top bOundiNg boxes intO One of the 33 ProduCt types sUch as *deniM JAcket, tunIc, bLouSe, vEst*… tAKiNg run-time into CONsidErAtions, wE chOse the REsnEt18 ([@rEsnEtHEZrS15]) as the baCkbone foR aLl FiNe-GraIned cLAssifierS. TO exPlOit BetteR All avaIlablE supErViSEd sIgnal in OUr TRAiniNg SeTs, we ExtEnDed thE netWOrk To perfoRm multi-taSk cLAssiFiCaTion. For Example, for the *ToP* classifieR, wE adDitionALLy classiFy *color, pattern, shape, shouLDer type, NecK type, SleeVe type…* For EacH brancH coRResponDing to One of ThEse TASks, a fULLy ConNeCted layer wITH a 128-D OutpuT iS insErted beTween *pool5* and its *sofTMax* Layers. We obserVe tHat bY USiNg jOInT MulTi-TAsk TRAining, product-tyPe classifiCaTIoN as well as sEArcH rElevancE are botH imprOVed.

![imagE](Picture2.pNg){width=".60\liNeWidtH"}

tHe oVerall loss For the
 a well-trained annotatorthree minu tes t o c omp le te a  bou nding box anno t atio n on one image). We st rikeam iddl e  g round  by gro u pi n g  it em softh e  s ame t ype s, that  often als o a pp ear in simil a rlocation ( e.g . *jacket, c oat , t-sh ir t*) intoa h igh-l evel c l ass (e .g. *top* ). Our co m plete l i s tof t op-level detectio n  c l ass for appare l item si sa s  fo llo ws: *headw ea r, ey e wear, e a rr i n g , b e lt, bottom, d ress, top,s uit , tie,  f oot w ear, s wimsu it ,  ba g, wristwea r, s carf, nec klace* and *on e -piece* .

Onthe  sa me s e tt in g,di f fer e nt  ob j ect  detecto rs  u suall y ha v e d iffe ren t st rengt hs with respe ctto o b jec t siz es an d sc al es ([ @Huang 2017S pe edAccuracyTF]).  Toboost rec all  f orof fline proces ses , s uch asindex b u ild in g , we  use an array of m ul t i -b ox objec t dete c to rs operatin gatdiff e r ent l evel s  o f imageresolu t io ns : SSD-5 12  Resne t5 0 ( [@l iu201 6 ssd] ), YOL O V3 Dar knet5 3  300 and 416 ( [ @Yolov3]). Th e ir r es u ltsare  combined u sing non- maxi m um  su p press ion.Du r in g  inference time, we  u se SSD -512with a VGG ba ckbone for r e al-timeresp o ns e .

Fine-Graine d Pro duct TypeC lassific ation  and Fea ture Extr a c tion {#f ine -gr ain ed- p r od uct-type-clas s i fica ti on-and- fea ture-ex tra cti on. unn um bered}
-- -------- -- -- -- -- --- ----- - -------- -- --- -- --- ----- - ------ ----- -

W ebu i ldone fin e -g r a ined  c la ssif ier  f or ea ch o f  th e high- level cla sse s  inth epreviou s section. Fo rexample, t he  to p clas s i fier wil l try to classify all d e tectedtop  boun ding  boxes in toone of  th e  33 pr oducttypes  s uch a s *de n i mjac ke t, tunic,b l ous e, ve st *… T aking r un-time into consi d era tions, we cho setheR e sn et1 8  ( [ @re sn e tHe Z R S15]) as the ba ckbone for  a l lfine-grain e d c la ssifier s. To e xploi t  better  all avai lable sup er vise d sig nal in our  trainin g sets, w e  exte n de d the  ne tworkto  pe rform  multi - tas k cla ssific at ion. F or ex am ple, for  the *top* classifier,we add ition all y classif y * c olo r, patter n, s hape, shou lde r t ype,nec k  type , sl e ev e t y pe…*Fore ach branc h  c orr e s po nding to on e o f t hesetas k s, a f ully  connected layerw ith a 128-D ou tput i s i nse r tedbe tween *pool5*and  i t s  *softma x*  layers. We  observe  t h at by  using  joint  multi- t a sk traini ng,pro duct-type  cl as s ificati on  a s  wellas s ea rch re levanc e  are b oth improved.

! [imag e ] (Pict u re2 .png) {w idth=". 6 0\li newidth"}
The overal l loss  for  the
 a_well-trained annotator_three minutes to complete_a bounding_box_annotation on_one_image). We strike_a middle ground_by grouping items of_the same types,_that_often also appear in similar location (e.g. *jacket, coat, t-shirt*) into a high-level class_(e.g._*top*). Our_complete_list_of top-level detection class for_apparel items is as follows:_*headwear, eyewear,_earring, belt, bottom, dress, top, suit, tie, footwear,_swimsuit,_bag, wristwear, scarf,_necklace* and *one-piece*.

On the same setting, different object detectors_usually have different strengths with respect_to object sizes_and_scales_([@Huang2017SpeedAccuracyTF]). To boost recall_for offline processes, such as index_building, we use an array of_multi-box object detectors operating at different levels_of image resolutions: SSD-512 Resnet50 ([@liu2016ssd]),_YOLO V3 Darknet53 300 and_416 ([@Yolov3])._Their results are combined using_non-maximum suppression. During_inference time,_we use SSD-512_with a VGG backbone for real-time_response.

Fine-Grained Product Type_Classification and Feature Extraction {#fine-grained-product-type-classification-and-feature-extraction.unnumbered}
---------------------------------------------------------------

We build_one_fine-grained classifier for_each_of_the high-level_classes in the_previous_section. For_example,_the top classifier will try to_classify_all detected top bounding boxes into one_of the 33 product_types_such as *denim jacket,_tunic, blouse, vest*… Taking run-time_into considerations, we chose the Resnet18_([@resnetHeZRS15]) as_the backbone_for all fine-grained classifiers. To exploit better all available supervised signal_in our training sets, we extended_the network to perform_multi-task classification._For_example, for the_*top*_classifier, we_additionally classify *color, pattern, shape, shoulder type,_neck type,_sleeve type…* For each branch corresponding_to one of these_tasks,_a fully connected layer with a_128-D output is inserted between *pool5*_and its *softmax* layers. We_observe_that_by using joint multi-task training,_product-type classification as well as search_relevance are both_improved.

![image](Picture2.png){width=".60\linewidth"}

The overall loss for the