 becomes more powerful and ubiquitous, the ability for misuse becomes greater. While MS-Celeb-1M contains only “celebrity" identities, this classification of an individual should not negate informed consent in the development of powerful surveillance technologies. Face recognition systems are unique among biometrics as the face can be easily captured at distance without one’s knowledge. The face uniquely identifies an individual, and it is difficult to opt-out of these systems without wearing a mask or other means of obfuscation, drawing undue attention to one’s self. From a legal perspective, the concept of informed consent in the analysis of images of individuals’ faces has traction in some jurisdictions. As reported by the New York Times with reference to potential financial liabilities of MegaFace [@hill_2019], the Illinois Biometric Information Privacy Act [@bipa2008] is a State law enacted in 2008 that gives Illinois residents the right to seek financial compensation from entities using their face scans without their informed consent.

The experiments in this work aim to simulate a real-world testing environment of a state-of-the-art face recognition system, with a gallery of more than one million images. These findings, therefore, may hold for systems that are currently deployed in the real-world.

Conclusion
==========

In this work we present the first study to investigate the role of inclusion in face recognition training data on a derived system’s ability to identify an individual. Through the construction of two sets of probe data that overlap and are distinct from the training data of a state-of-the-art system, we conduct a large-scale face identification experiment. We find a modest 4% improvement in face identification accuracy for individuals who are present in training data, which is highly problematic given the norm in the field is to not gather informed consent in the collection of training datasets. Future work will apply this methodology to more models, training datasets and distance metrics (i.e. cosine distance) to see if results are consistent. Following prior work [@buolamwini2018gender; @Raji2019; @cook2019demographic], analysis of face recognition model bias with respect to gender, skin type and their intersections in large-scale face identification tasks is needed, as well as tying results to representational bias in training data. Additionally, the relationship between the *number of images* of an individual in training data and their ability to be identified is an interesting area of study. Finally, analysis of a face recognition model’s
becomes more powerful and ubiquitous, the ability for misuse becomes great. While MS - Celeb-1 M control only “ celebrity " identities, this categorization of an individual should not negate informed consent in the growth of powerful surveillance technologies. confront recognition systems are singular among biometrics as the face can be easily capture at distance without one ’s cognition. The face uniquely identifies an person, and it is difficult to choose - out of these system without wearing a mask or other mean of obfuscation, drawing undue attention to one ’s self. From a legal perspective, the concept of inform consent in the analysis of images of individuals ’ faces has grip in some jurisdictions. As reported by the New York Times with reference to potential financial liabilities of MegaFace [ @hill_2019 ], the Illinois Biometric Information Privacy Act [ @bipa2008 ] is a State jurisprudence enacted in 2008 that gives Illinois residents the right to seek financial compensation from entities using their face scan without their informed consent. 

 The experiments in this oeuvre target to simulate a real - world examination environment of a state - of - the - artwork face recognition system, with a veranda of more than one million images. These findings, therefore, may hold for systems that are currently deployed in the real - world. 

 Conclusion 
 = = = = = = = = = = 

 In this work we present the inaugural study to investigate the function of inclusion in face recognition training data on a derive system ’s ability to identify an individual. Through the construction of two sets of probe data that overlap and are distinct from the training datum of a state - of - the - art system, we conduct a large - plate face identification experiment. We find a modest 4% improvement in boldness identification accuracy for individual who are present in training data, which is highly problematic given the norm in the battlefield is to not gather informed consent in the solicitation of training datasets. Future work will apply this methodology to more models, education datasets and distance metrics (i.e. cosine distance) to see if results are consistent. follow prior work [ @buolamwini2018gender; @Raji2019; @cook2019demographic ], analysis of face recognition model diagonal with respect to gender, skin type and their intersections in large - scale face designation undertaking is needed, as well as tying results to representational bias in training datum. Additionally, the relationship between the * number of images * of an individual in training data and their ability to be identified is an interesting area of study. Finally, psychoanalysis of a face recognition model ’s
 befomes more powerful and mbiquitous, the ayulity hor mishse becooes greater. While MS-Celeb-1M clnrains only “celebrity" identigies, this classifucatmon of an indivivhal shomjd nkb negctx informed consgnt in the davelopment of [odexful surveillance technologies. Face wecogniyiln systems are uniate ajong biometrics as the face can be easily captured at cistance without one’s knowpedgf. The face uniquelj identifiew an undividual, avd it is dpyficult to kpt-out of these systems without wearnng a mask ir otjgr means of ibfusbation, drawinn undue attentoon to one’s sekf. Hrom a legal perspective, vhe concept of inforied consett in the analysis if imaggs of indkcidjala’ hacss has trection in skme jurisdixtions. As reported ny nne New York Fimes rieh reference to potential financial liatiljties of MegaFace [@hill_2019], rhe Illinois Biometrif Informaeion Privacy Act [@bipa2008] is a State law enacted in 2008 dhat jixes Ijuunlis residents the right to seek financial com[snxanion from entitief using theor fsse scans withuut thzjr informed consent.

Tje expetimentw in this worl aim to simulate a real-worod testing euvieonment of a state-lf-the-art faee recpgnitoon system, with a gallexy of jore than oje millioh images. These fivdikgs, therefore, may hold for syftems thav are currengly ceployqd in the geal-world.

Conclusion
==========

In thls wotk we [resent thf first study to investigate thx role of inckuviot in facz reconnition trainind data on a detived syscem’s acility to pdentify en individuaj. Through the fonstruction of two fets of probe dxga that overlal and are distinct drom the training vata kf a state-of-the-cxt system, we condict a jagge-xcwne face idendifizatkpn exoerimenu. Wc fknd s modest 4% improvemend in face identificatipn accuraci for indyviduals who sre present in tralning dava, whivh ys highly problematic given ths norm in thc field is to not gather infoxmed consent in the collection of trainiig datasets. Future work will apply this mejhocology to mpre mjdels, trahning datasets and dustance metrics (i.t. cosine distance) to ses if rasultd are consistent. Following prior work [@buolamwini2018gender; @Raji2019; @cook2019demographuc], analysis of facs revogniniou mpdel byas xivh respect to gencer, skin type and their intersertions in naxge-scale face identification yarks is needed, as well as tying resulta to reptesentational bias in training cata. Additionally, the rekationshup befween nge *number of images* pf an nndivieual in tralning data and thriv ability ho bt idzntified is an interesting area od studt. Vinally, analysis of a face vegognitpon modgl’s
becomes more powerful and ubiquitous, the ability becomes While MS-Celeb-1M only “celebrity" identities, should negate informed consent the development of surveillance technologies. Face recognition systems are among biometrics as the face can be easily captured at distance without one’s The face uniquely identifies an individual, and it is difficult to opt-out of systems wearing mask other means of obfuscation, drawing undue attention to one’s self. From a legal perspective, the concept informed consent in the analysis of images of faces has traction in jurisdictions. As reported by the York with reference potential liabilities MegaFace [@hill_2019], the Biometric Information Privacy Act [@bipa2008] is a State law enacted in 2008 that gives Illinois residents the to seek from entities their scans their informed consent. in this work aim to simulate environment of a state-of-the-art face recognition system, with gallery of than one million images. These findings, may hold for systems that are currently deployed the real-world. Conclusion ========== In this work we present the first study to investigate the inclusion in face recognition data on a system’s to an Through the of two sets of probe data that overlap and are distinct the training data of a state-of-the-art system, we conduct a identification We find a 4% improvement in face accuracy individuals who are present data, is the in field is to not informed consent in the collection training datasets. Future work more models, training datasets and distance metrics (i.e. distance) to see if results are consistent. prior work [@buolamwini2018gender; @Raji2019; @cook2019demographic], analysis of face recognition model bias with to gender, and their intersections in large-scale face identification tasks needed, as well as results to representational bias in training data. Additionally, the between *number of of an individual training data and ability to be an interesting of Finally, face recognition model’s
 becomes more powerful and ubiQuitous, the AbiliTy fOr mIsUse bEcomEs greater. While ms-CelEb-1M contains only “celebriTy" ideNtITies, THiS clasSificatIOn OF An iNdIvIduAl SHoUld noT neGate infOrmed conseNt iN tHe developmenT Of Powerful suRveIllance technOloGies. FaCe RecOGnitiOn sYstemS are unIQue amoNg biometrIcS As the fACe can be EASiLy caPtured at distance wIThOUt one’s knowledgE. The faCe UNiQUEly IdeNtifies an iNdIviduAL, and it iS DiFFICulT To opt-out of theSe systems wiTHouT weariNg A maSK or othEr meaNs OF obFuscation, drAwinG undue attEntion TO one’s seLF. From a lEgal peRspEctIve, tHE cOnCepT oF InfORmEd cONseNt in the aNaLySis of ImagES OF IndiVidUals’ Faces Has traction in SomE jurISdiCtionS. As rePortEd By the new YorK TimeS wIth reference to pOtenTial finanCiaL lIabIlIties OF MegaFAce [@HilL_2019], the IllInois BiOMetRiC iNFoRmation Privacy Act [@bIpA2008] IS a state law EnacteD In 2008 ThAT gives IlLiNoiS resIDEnts tHe riGHt To seek fiNanciaL CoMpEnsatioN fRom entItIes UsiNg theIR facE scans Without tHeir iNFormed consent.

THE experiments iN ThIS WoRK aim To sImulate a reaL-worLD tesTing ENvIroNMent oF a staTe-OF-tHE-art face recognition SyStem, wiTh a gaLlery of more thAn one milliON IMages. TheSe fiNDiNGs, therefore, may Hold fOr systems tHAt are curRentlY deployeD in the reaL-WOrld.

ConcLusIon
==========

in tHis WORk We present the fIRSt stUdY to inveStiGate the RolE of IncLusIoN in face reCognitioN tRaInInG daTa on a DErived syStEm’s AbIliTy to iDEntify An indIvidUaL. THRouGh the coNStRUCtioN oF tWo seTs oF pRobe dAta tHAt oVerlap aNd are distIncT From ThE tRaining Data of a state-oF-tHe-art systeM, wE coNduct a LARge-scale Face identification experIMent. We fInd A modeSt 4% imProvement In fAce ideNtiFIcatioN accurAcy foR iNdiVIDuals WHO aRe pReSent in traiNINg dAta, whIcH is hIghly prOblematic given the nORm iN the field is to Not GathER InForMEd COnsEnT In tHE Collection of traIning datasEtS. fuTure work wiLL apPlY this meThodoloGy to mORe modelS, training Datasets aNd DistANCe mEtrics (i.e. coSine distAnce) to see IF resuLTs Are coNsiStent. FOlLowIng prIor worK [@BuoLamwiNi2018gendEr; @raji2019; @coOk2019demOgRaphic], anAlysis of face recognition Model bIas wiTh rEspect to gEndER, skIn type and TheiR intersectIonS in Large-ScaLE face IdenTIfIcaTIon taSks iS Needed, as wELl As tYINg Results to rePRESenTatioNal BIas in tRainIng data. AdditionalLY, the relationshIp beTWEen The *NUmbeR oF images* of an indIviDuAL In trainiNg Data and theiR ability To BE idenTified Is an inTerestiNG ArEA of stuDy. FiNalLy, analysiS of A fACe recogNiTiON model’S
 becomes more powerful and  ubiquitou s, th e a bil it y fo r mi suse becomes g r eate r. While MS-Celeb-1M c ontai ns only “c elebr ity" id e nt i t ies ,th iscl a ss ifica tio n of an  individua l s ho uld not nega t einformed c ons ent in the d eve lopmen tofp owerf ulsurve illanc e  techn ologies.Fa c e reco g nitions y st emsare unique amongb io m etrics as theface c an be e asi lycaptured a tdista n ce with o ut o n e’s knowledge. Th e face uniq u ely  ident if ies an ind ividu al ,  an d it is dif ficu lt to opt -out o f  theses ystemswithou t w ear inga  m as k o ro the r  m ean s  of  obfusca ti on , dra wing u n d ue a tte ntio n toone’s self. F rom  a l e gal  pers pecti ve,th e con cept o f inf or med consent intheanalysisofim age sof in d ividua ls’  fa ces has  tracti o n i ns o m ejurisdictions. Asre p o rt ed by th e NewY or kT imes wit href eren c e  to p oten t ia l financ ial li a bi li ties of  M egaFac e[@h ill _2019 ] , th e Illi nois Bio metri c  Information P r ivacy Act [@b i pa 2 0 08 ]  isa S tate law en acte d  in2008 th atg ivesIllin oi s  r e sidents the right t oseek f inanc ial compensat ion from e n t i ties usi ng t h ei r  face scans wi thout  their inf o rmed con sent. 

The ex periments i n this w ork  ai m t o s i m ul ate a real-wo r l d te st ing env iro nment o f a  st ate -of -t he-art fa ce recog ni ti on  s yst em, w i th a gal le ryof  mo re th a n onemilli on i ma ge s . T hese fi n di n g s, t he re fore , m ay  hold  for sys tems th at are cu rre n tlyde pl oyed in  the real-wor ld .

Conclus io n
= ====== = = =

In th is work we present thef irst st udy  to i nves tigate th e r ole of  in c lusion  in fa ce re co gni t i on tr a i ni ngda ta on a de r i ved  syst em ’s a bilityto identify an ind i vid ual. Throughthe  con s t ru cti o no f t wo set s of probe data t hat overla pa nd  are disti n ctfr om thetrainin g dat a  of a s tate-of-t he-art sy st em,w e  co nduct a la rge-scal e face id e ntifi c at ion e xpe riment .Wefinda mode s t 4 % imp roveme nt  in fa ce id en tificati on accuracy for individ uals w ho ar e p resent in  tr a ini ng data,whic h is highl y p rob lemat icg iventhen or m i n  thefiel d  is to no t  g ath e r  i nformed con s e n t i n the  co l lectio n of  training dataset s . Future workwill a ppl y t h is m et hodology to mo remo d e ls, trai ni ng datasets  and dis ta n ce me trics(i.e.cosined i st a nce) t o se e i f results  ar ec onsiste nt .F ollowi ng p ri or wor k [@bu o lamw i n i2018gender; @Ra ji201 9 ;  @coo k 201 9demo gr aphic], anal ysis of fa ce recognit ion mo delbiaswith re sp ect to  ge nd er, skin t y pe and th eir i ntersec ti onsinlarge- scal e faceiden ti fic ation tas k s  i s  n ee d ed,  aswellas  tyi ng result s  to repr ese n tationa lbia s in tra i ni n g  data. Add iti onall y ,  the relat i onsh i pb etwee n the*numbe r of im a ges *of an i ndi v i dual in t raining d a taan d th eir abil it y to  b e i de ntified is an i nteresti ng areao f  study . F i nall y , anal ys is of a face  reco gn i tion mo d e l’s 
 becomes_more powerful_and ubiquitous, the ability_for misuse_becomes_greater. While_MS-Celeb-1M_contains only “celebrity"_identities, this classification_of an individual should_not negate informed_consent_in the development of powerful surveillance technologies. Face recognition systems are unique among biometrics_as_the face_can_be_easily captured at distance without_one’s knowledge. The face uniquely_identifies an_individual, and it is difficult to opt-out of_these_systems without wearing_a mask or other means of obfuscation, drawing undue_attention to one’s self. From a_legal perspective, the_concept_of_informed consent in the_analysis of images of individuals’ faces_has traction in some jurisdictions. As_reported by the New York Times with_reference to potential financial liabilities of_MegaFace [@hill_2019], the Illinois Biometric_Information Privacy_Act [@bipa2008] is a State_law enacted in_2008 that_gives Illinois residents_the right to seek financial compensation_from entities using_their face scans without their informed_consent.

The_experiments in this_work_aim_to simulate_a real-world testing_environment_of a_state-of-the-art_face recognition system, with a gallery_of_more than one million images. These findings,_therefore, may hold for_systems_that are currently deployed_in the real-world.

Conclusion
==========

In this work_we present the first study to_investigate the_role of_inclusion in face recognition training data on a derived system’s ability_to identify an individual. Through the_construction of two sets_of probe_data_that overlap and_are_distinct from_the training data of a state-of-the-art system,_we conduct_a large-scale face identification experiment. We_find a modest 4%_improvement_in face identification accuracy for individuals_who are present in training data,_which is highly problematic given_the_norm_in the field is to_not gather informed consent in the_collection of training_datasets. Future work will apply this methodology_to_more models, training datasets and distance_metrics_(i.e. cosine distance) to see if_results_are_consistent. Following prior work [@buolamwini2018gender;_@Raji2019; @cook2019demographic], analysis of face recognition_model bias with respect to gender, skin type and_their intersections in_large-scale face identification tasks is_needed,_as_well as tying results to representational bias in training data._Additionally, the_relationship between the_*number of images* of an individual in training data and_their ability to be identified is an_interesting area of study. Finally, analysis of a face recognition model’s