
keey-sameepa poruguvaari algorithm

ganankalalo, k "-sameepa porugu algorithm (k"-nn) anedi 1951loe evelin fixes mariyu joseph hodges abhivruddhi chesina, taruvaata thamus cover dwara vistarinchina, parametric kaani paryaveekshinchabadina abhyasa paddhati. idhi vargeekarana mariyu tirogamananiki upayoginchabadutundi. rendu sandarbhaallo, input dayta setlooni "k" sameepa sikshanaa udaaharanalanu kaligi untundi. avtput vargeekarana ledhaa tirogamanam kosam "k"-nn upayoginchabadutundaa anae daanipai aadharapadi untundih
"k"-nn anedi oka rakamaina vargeekarana, ikkada function sthaanikamgaa matrame anchanaa veyabadutundi mariyu function moolyaankanam varaku anni gananalu vaida vaeyabadataayi. eee algorithm vargeekarana kosam doorampai aadharapadatam valla, lakshanaalu ververu bhouthika unitlanu suuchisthee ledhaa chaalaa bhinnamaina pramaanaalalo vasthe, sikshanaa daetaanu saadhaaraneekarinchadam daani khachitatvanni natakeeyamgaa meruguparustundi.
vargeekarana mariyu tirogamanam rendintikee, poruguvaari sahakaaraaniki baruvulanu ketayinchadam upayogakaramaina saanketikata kaavacchu, tadwara sameepa poruguvaaru marinta suduura praantaala kante sagatuku ekkuva dohadam chestaaru. udaaharanaku, oka saadhaarana baruvu pathakam prati poruguvaariki 1/"d" baruvunu ivvadam, ikkada "d" anedi poruguvaariki dhooram.
taragati ("k"-nn vargeekarana kosam) ledhaa vastuvu aasti viluva ("k"-nn regression kosam) telisina vastuvula samiti nundi poruguvaarini teesukuntaaru. spashtamaina sikshanaa dasha avasaram laenappatikee, dheenini algorithm kosam sikshanaa samitigaa bhaavinchavachchu.
k"-nn algorithm yokka pratyekata emitante idhi dayta yokka sthaanika nirmaanaaniki sunnitamgaa untundi.
ganaanka amarika.
suutram _ 2 loe viluvalanu teesukune jatala suutram _ 1 undani anukundam, taragati label ekkada undhi, kabatti suutram _ 4 (mariyu sambhaavyata pampinhee suutram _ 5) kosam suutram _ 3. suutram _ 7 paie konni praamaanika suutram _ 6 mariyu oka point suutram _ 8 ichinatlayithe, suutram _ 9 anedi suutram _ 10 vanti sikshanaa dayta yokka punarvyavastheekaranagaa undanivvandi.
algorithm.
sikshana udaaharanalu bahula dimensional feature space loe vectors, prati okkati class lebultho untaayi. algorithm yokka sikshanaa dasalo sikshanaa namuunaala yokka feature vectors mariyu class labelsnu matrame nilva chestaaru.
vargeekarana dasalo, "k" anedi viniyogadaaru nirvachinchina sthiraamkam, mariyu label cheyani vector (prasna ledhaa pareeksha sthaanam) aaa prasna binduvuku daggaragaa unna "k" sikshanaa namoonaalalo chaalaa tarachugaa unde lebulnu ketayinchadam dwara vargeekarinchabadutundi.
nirantara chararaasulaku saadhaaranamgaa upayoginche dhoora metrik euclidean dhooram. vachana vargeekarana vanti vivikta chararaasula kosam, ativyaapti metrik (ledhaa hamming dhooram) vanti maroka metriknu upayoginchavacchu. janyu vyakteekarana microare dayta sandarbhamlo, udaaharanaku, "k"-nn anedi piersone mariyu spearman vanti paraspara sambandha gunakaalato metrikga upayoginchabadindi. tarachugaa, suduura metriknu sameepa porugu ledhaa porugu bhagala vislaeshanha vanti pratyeka algorithamlatho neerchukuntee "k"-nn yokka vargeekarana khachitatvanni gananeeyamgaa meruguparachavacchu.
taragati pampinhee vakreekarinchabadinappudu praathamika "majority oating" vargeekaranalo lopam erpadutundi. antey, marinta tarachugaa vachhe taragati yokka udaaharanalu kotta udaaharana yokka anchanaanu aadhipatyam chestaayi, endukante avi "k" sameepa poruguvaarilo vaati pedda sankhya kaaranamgaa saadhaaranam. eee samasyanu adhigaminchadaaniki oka maargam emitante, pariksha sthaanam nundi daani prati "k" sameepa poruguvaariki unna dooraanni parigananaloki teesukoni vargeekarananu baruvu pettadam. sameepa binduvulaloni prati "k" yokka taragati (ledhaa viluva, tirogamana samasyalalo) aaa binduvu nundi pareeksha binduvuku dhooram yokka vilomaaniki anulomaanupaatamlo baruvutho guninchabadutundi. vakratanu adhigaminchadaaniki maroka maargam dayta praatinidhyamlo sangrahinchadam. udaaharanaku, sweeya-vyavastheekruta patamlo (soam), prati node anedi asalu sikshanaa detaalo vaati saandratatoe sambandham lekunda, saaruupya paayintla samuuhaaniki pratinidhi (kendram). "k"-nn nuu somku vartimpajeyavachu.
paramiti empika.
k" yokka uttama empika detapai aadharapadi untundi; saadhaaranamgaa, "k" yokka pedda viluvalu vargeekaranapai sabdam yokka prabhavanni taggistaayi, conny taragatula madhya sarihaddulanu takkuva vibhinnamgaa chestaayi. vividha huristic paddhatula dwara manchi "k" nuu enchukovachhu (hyperparameter optimisation chudandi). taragati sameepa sikshanaa namuunaa yokka taragatigaa anchanaa veyabadina pratyeka kesu (i.ii. k" = 1) nii sameepa porugu algorithm anie pilustaaru.
k"-nn algorithm yokka khachitatvam sabdam ledhaa asambaddhamaina lakshanaala uniki dwara ledhaa feature scales vaati praamukhyataku anugunamgaa lekapothe teevramgaa ksheeninchavacchu. vargeekarananu meruguparachadaaniki lakshanaalanu enchukovadam ledhaa scaling cheyadamlo chaalaa parisoedhana prayatnaalu jarigaayi. feature scalingnu optimize cheyadaaniki parinaamaatmaka algorithamla vadakam mukhyamgaa prajaadarana pondina vidhanam. sikshana taragatulato sikshanaa dayta yokka paraspara samacharam dwara lakshanaalanu kolavadam maroka prajaadarana pondina vidhanam.
binary (rendu taragati) vargeekarana samasyalalo, "k" nuu besi sankhyagaa enchukovadam sahaayapadutundi, endukante idhi tide otlanu nivaaristundi. eee amarikalo anubhaavikamgaa saraina "k" nuu enchukoovadaaniki oka prasiddha maargam bootstrop paddhati dwara.
sameepa porugu vargeekarana.
atyanta sahajamaina sameepa porugu rakam vargeekarana anedi oka sameepa porugu vargeekarana, idhi feature spacelo daani sameepa porugu taragatiki oka binduvunu ketayistundi, antey suutram _ 11.
sikshana dayta sett parimaanam anantaniki cherukuntunnanduna, oka sameepa porugu vargeekarana bayes dosham raetu (dayta pampinhee icchina kaneesa saadhinchagala dosham raetu) kante rendu retlu adhvaannamgaa undadani haamii istundi.
baruvutho kuudina sameepa porugu vargeekarana.
sameepa porugu vargeekarananu sameepa poruguvaariki baruvu suutram _ 12 mariyu migataa anni baruvulanu ketayinchinatlu chudavachu. dheenini baruvutho kuudina sameepa porugu vargeekaranalaku saadhaaraneekarinchavachchu. antey, ikkada sameepa poruguvaariki suutram _ 14 thoo baruvu suutram _ 13 ketayinchabadutundi. baruvunna sameepa porugu vargeekaranakaarula balamaina sthirathvampai saaruupya phalitam kooda untundi.
suutram _ 15 anedi baruvula suutram _ 16 thoo baruvutho kuudina sameepa vargeekarananu suuchistumdi. kramabaddhata paristhitulaku lobadi, ivi lakshanarahita siddhaantamlo sharatulatho kuudina chararaasulu, ivi konni pramaanaalatoo paaraamitula madhya thedaanu gurtinchadaaniki anchanaalu avasaram. taragati pampinheelalo adanapu pramaadam krindi lakshanarahita vistarananu kaligi untundi
suutram _ 17
sthiraamkaala suutram _ 18 mariyu suutram _ 19 kosam suutram _ 20 mariyu suutram _ 21.
paie pradarsanalooni rendu padaalanu samatulyam chese optimal weiting skeem formula _ 22 eee krindi vidhamgaa ivvabadindi suutram _ 23nii sett cheyandi, 
suutram _ 25 kosam suutram _ 24 mariyu 
suutram _ 27 kosam suutram _ 26.
saraina baruvulatho, adanapu pramaadam yokka lakshanarahita vistaranalo aadhipatya padam formula _ 28. daggari porugu vargeekarana sanchini upayogistunnappudu ilanti phalitaalu nijamavutaayi.
aastulu.
"k"-nn anedi ekareeti kernaltho kuudina chara-bandwidth, kernell saandrata "beloon" anchanaa yokka pratyeka kesu.
algorithm yokka amayaka samskarananu pareeksha udaaharana nundi anni nilva chesina udaaharanalaku dhooraalanu lekkinchadam dwara amalu cheyadam sulabham, conny idhi pedda sikshanaa setlaku gananaparamgaa teevramgaa untundi. sameepa porugu shodhana algorithamnu upayoginchadam valla pedda dayta setlaku kooda "k-" nn gananaparamgaa gurtinchadaginadigaa chestundi. sameepa porugu shodhana algorithamlu aneka samvatsaraalugaa pratipaadinchabaddaayi; ivi saadhaaranamgaa vaastavaaniki nirvahinchina dhoora madimpula sankhyanu tagginchadaaniki prayatnistaayi.
"k-" nn konni balamaina sthirathvam phalitaalanu kaligi undhi. dayta mottam anantaniki cherukunnappudu, rendu-taragati "k-" nn algorithm bayes error rate (dayta pampinhee icchina kaneesa saadhinchagala error rate) kante rendu retlu ekkuva error retunu ivvadani haamii ivvabadutundi. saameepya graphlanu upayoginchadam dwara "k"-nn vaegaaniki vividha merugudalalu saadhyamavutaayi.
bahula-taragati "k-" nn vargeekarana kosam, cover mariyu haart (1967) yokka eguva sarihaddu lopam retunu niroopistundi
suutram _ 29
ikkada suutram _ 30 anedi bayes dosham raetu (idhi saadhyamayye kaneesa dosham raetu), suutram _ 31 anedi "k-" nn dosham raetu, mariyu samasyaloni taragatula sankhya. suutram _ 32 kosam mariyu biasian dosha raetu suutram _ 30 sunnaki cherukunnappudu, eee parimiti "biasian dosha raetu kante rettimpu kante ekkuva kaadu" kuu taggutundi.
dosha raetlu.
sameepa porugu vargeekaranala dosha retupai aneka phalitaalu unnaayi. sameepa porugu vargeekarana anedi balamgaa untundi (antey suutram _ 34 paie edainaa ummadi pampinhee kosam) sthiramgaa andinchina suutram _ 35 vibhedistundi mariyu suutram _ 36 suutram _ 37 gaa sunnaki kalustundi.
suutram _ 38 sikshana parimaanam aadhaaramgaa sameepa porugu vargeekarananu suuchistumdi. konni kramabaddhamaina paristhitulalo, adanapu pramaadam krindi lakshanarahita vistarananu istundi.
suutram _ 39
konni sthiraamkaala suutram _ 40 mariyu suutram _ 41 kosam.
empika suutram _ 23 paie pradarsanalooni rendu padaala madhya maarpidini andistundi, dheeni kosam suutram _ 43-sameepa porugu lopam optimal (minimax) raetu suutram _ 28 vadda bayes lopanki kalustundi.
metrik learning.
keey-sameepa porugu vargeekarana paniteerunu tarachugaa (paryaveekshinchabadina) metrik learning dwara gananeeyamgaa meruguparachavacchu. prajaadarana pondina algorithamlu porugu bhagala vislaeshanha mariyu pedda anchu sameepa porugu. paryaveekshinchabadina metrik learning algorithamlu kotta metrik ledhaa suudoe-metrik neerchukoevadaaniki label samacharanni upayogistaayi.
feature velikiteeta.
oka algorithanku input dayta proses cheyadaaniki chaalaa peddadigaa unnappudu mariyu adhi anavasaramainadigaa anumaaninchabadinappudu (udhaa.zii. adugulu mariyu meterlu rendintiloonuu oke kolata) appudu input dayta lakshanaala taggina praatinidhya samitigaa maarchabadutundi (feature vector anie kooda pilustaaru). input daetaanu lakshanaala samitigaa marchadanni feature velikiteeta antaaru. sekarinchina lakshanaalanu jagrattagaa enchukunte, puurti parimaana inputku badulugaa eee taggina praatinidhyaanni upayoginchi kaavalasina panini nirvahinchadaaniki feature sett input dayta nundi sambandhita samacharanni sekaristundani bhaavistunnaaru. feature space loe roopaantaram chendina detapai "k"-nn algorithamnu vartimpajese mundu mudi detapai feature velikiteeta nirvahinchabadutundi.
mukha gurtimpu kosam "k"-nn upayoginchi oka saadhaarana computer drushti ganana pipeline yokka udaaharana, indulo feature velikiteeta mariyu dimension taggimpu prii-prosessing dasalu (saadhaaranamgaa openseeveetho amalu cheyabadataayi) unnaih
parimaanam taggimpu.
adhika-dimensional dayta kosam (udhaa.zii., 10 kante ekkuva kolatala sankhyatho) dimension yokka saapam yokka prabhavalanu nivaarinchadaaniki "k"-nn algorithamnu vartimpajese mundu dimension taggimpu saadhaaranamgaa nirvahinchabadutundi.
k"-nn sandarbhamlo dimensionality saapam antey praathamikamgaa euclidean dhooram adhika kolatalalo sahayapadadani ardham, endukante anni vahakalu shodhana prasna vektarku daadaapu samaana dhooramlo untaayi (oka vruttamlo ekkuva ledhaa takkuva unna bahula binduvulu madhyalo prasna binduvutoe unnatlu oohinchukondi; shodhana sthalamlooni anni dayta paayintlaku prasna nundi dhooram daadaapu okate).
pradhana bhagala vislaeshanha (pca), leanier discriminant vislaeshanha (lda), ledhaa canonical correlation vislaeshanha (cca) paddhatulanu prii-prosessing dasagaa upayoginchi lakshanaala velikiteeta mariyu parimaana taggimpunu oka dasalo kalapavacchu, taruvaata taggina-parimaana sthalamlo feature vektarlapai "keey"-nn dwara clustering cheyavachu. eee prakriyanu takkuva-dimensional embedding anie kooda pilustaaru.
chaalaa adhika-dimensional datasetla kosam (udhaa.zii. pratyaksha veediyo streamlu, dna dayta ledhaa adhika-dimensional time siriisloo saaruupyata shodhana chesetappudu) locality sensitive hashing, "yaadruchchika anchanaalu", "sketchlu" ledhaa itara adhika-dimensional saaruupyata shodhana paddhatulanu upayoginchi vegavantamaina sumaru "keey"-nn shodhananu naduputunnappudu vldb toolbox nundi matrame saadhyamayye empika kaavacchu.
nirnaya sarihaddu.
prabhaavamlo unna sameepa porugu niyamaalu nirnaya sarihaddunu parokshamgaa lekkistaayi. nirnaya sarihaddunu spashtamgaa lekkinchadam mariyu samarthavantamgaa cheyadam kooda saadhyamavutundi, tadwara ganana sanklishtata anedi sarihaddu sanklishtata yokka vidhi.
dayta taggimpu.
bhaarii dayta setlatho pani cheyadaaniki dayta taggimpu anedi atyanta mukhyamaina samasyalalo okati. saadhaaranamgaa, khachitamaina vargeekarana kosam konni dayta paayintlu matrame avasaram. aaa daetaanu "prototypes" anie pilustaaru mariyu eee krindi vidhamgaa kanugonavachuhu
taragati-bahya shrenula empika.
itara taragatula udaaharanalatoo chuttumuttabadina sikshanaa udaaharananu class avtlier antaaru. taragati avtlaiyarla kaaranaalu
k"-nn thoo taragati avtlaiyarlu sabdaanni utpatti chestaayi. bhavishyat vislaeshanha kosam vaatini gurtinchi vaeru cheyavachu. rendu sahaja sankhyalu, "k"> "r"> 0 ichinatlayithe, daani "k" sameepa poruguvaaru itara taragatula "r" udaaharanala kante ekkuva unte, oka sikshanaa udaaharananu a ("k", "r") nn class-avtlier anie pilustaaru.
dayta taggimpu kosam sameepa poruguvaarini ghaneebhavinchaaru.
ghaneebhavinchina sameepa porugu (cnn, "haart algorithm") anedi "keey"-nn vargeekarana kosam dayta setnu tagginchadaaniki roopondinchina algorithm. idhi sikshanaa dayta nundi prototypela samitini "yuu" nuu enchukuntundi, antey "yuu" thoo 1nn mottam dayta settho 1nn chesinatle udaaharanalanu daadaapu khachitamgaa vargeekarinchagaladu.
sikshana samiti "x" icchinappudu, cnn punaraavrutamgaa panichestundihi
vargeekarana kosam "x" kuu badulugaa "u" nuu upayoginchandi. prototypelu kaani udaaharanalanu "soshinchabadina" paayintlu antaaru.
sarihaddu nishpatti taggutunna kramamlo sikshanaa udaaharanalanu skaan cheyadam samarthavantamgaa untundi. sikshana udaaharana "x" yokka sarihaddu nishpatti ilaa nirvachinchabadindi 
x" kante bhinnamaina rangu kaligina sameepa udaaharana "y" kii dhooram ekkada undhi, mariyu "x" anae lebultho "y" nundi daani sameepa udaaharana "x" kuu dhooram ekkada undhi?
sarihaddu nishpatti viramamlo [0,1] untundi endukante eppuduu minchadu. eee kramam "yuu" namuunaala samitilo chaerchadaaniki taragatula sarihaddulaku praadhaanyata istundi. x" kante bhinnamaina label yokka binduvunu "x" kii baahyamgaa pilustaaru. sarihaddu nishpatti yokka ganana kudi vaipuna unna chitram dwara vivarinchabadindi. dayta paayintlu rangula dwara label cheyabadataayih prarambha point "x" mariyu daani label erupu. bahya binduvulu neelam mariyu aakupaccha rangulo untaayi. x" bahya binduvuku atyanta daggaragaa unna binduvu "y". y" erupu binduvuku atyanta daggaragaa unna binduvu "x". sarihaddu nishpatti anedi prarambha binduvu "x" yokka lakshanam.
krinda varusa bommallo cnn yokka udaaharana undhi. moodu taragatulu (erupu, aakupaccha mariyu neelam) unnaayi. fig. 1: praarambhamlo prati taragatilo 60 paayintlu untaayi. fig. 2 anedi 1nn vargeekarana pataanni chooputundih prati pixel mottam daetaanu upayoginchi 1nn dwara vargeekarinchabadutundi. fig. 3 anedi 5nn vargeekarana pataanni chooputundi. tellani praantaalu vargeekarinchani praantaalaku anugunamgaa untaayi, ikkada 5nn oating mudipadi untundi (udaaharanaku, 5 sameepa poruguvaarilo rendu aakupaccha, rendu erupu mariyu oka neelam paayintlu unte). fig. 4 taggina dayta setnu chooputundi. siluvalu (3,2) nn niyamam dwara empika cheyabadina taragati-avtlaiyarlu (eee sandarbhaala yokka moodu sameepa poruguvaaru itara taragatulaku chendinavaaru); chaturasraalu prototypelu, mariyu khaalii vruttaalu soshinchabadina paayintlu. edama diguva muulaloe moodu taragatulaku taragati-avtlaiyarlu, prototypelu mariyu soshinchabadina paayintla sankhyanu chooputundi. eee udaaharanalo vividha taragatulaku namuunaala sankhya 15 saatam nundi 20 saatam varaku untundi. fig. 5 namuunaalatoe kuudina 1nn vargeekarana patam prarambha dayta samititoe chaalaa pooli untundani choopistundi. eee bommalu mirks opplet upayoginchi tayaaru cheyabaddaayi.
"k"-nn regression.
k"-nn regressionlo, nirantara chararaasulanu anchanaa vaeyadaaniki "k"-nn algorithm upayoginchabadutundi. atuvanti oka algorithm "k" sameepa poruguvaari yokka baruvunna sagatunu upayogistundi, vaati dhooram yokka vilomam dwara baruvutho untundi. eee algorithm eee krindi vidhamgaa panichestundihi
"k"-nn avtlier.
k" va sameepa poruguvaariki dooraanni sthaanika saandrata anchanaga kooda chudavachu, anduvalla kramaraahityaanni gurtinchadamlo idhi oka prasiddha avtlier score kooda. k"-nn kuu dhooram entha ekkuvagaa unte, sthaanika saandrata entha takkuvagaa unte, prasna binduvu avtlier ayye avakaasam antha ekkuvagaa untundi. chaalaa saralamainappatikee, eee bahya namuunaa, maroka classic dayta maining paddhati, sthaanika bahya kaarakamtho paatu, pedda ettuna prayogaatmaka vislaeshanha prakaram, iteevali mariyu marinta sanklishtamaina vidhaanaalatho poliste kooda baga panichestundi.
phalitaala dhruvikarana.
gandaragolam maatrika ledhaa "saripolika maatrika" tarachugaa "k"-nn vargeekarana yokka khachitatvanni dhruveekarinchadaaniki oka saadhanamgaa upayoginchabadutundi. sambhaavyata-nishpatti pareeksha vanti marinta balamaina ganaanka paddhatulanu kooda vartimpajeyavachu.

