Njengoko amashishini amaninzi esebenzisa amandla ee-algorithms ukwenza ngokuzenzekelayo ukusebenza kunye nokwenza ukhetho, ukufunda ngoomatshini kuba yinxalenye ebalulekileyo yendlela elisebenza ngayo ihlabathi langoku.
Umba wokuthambekela ecaleni ekufundeni koomatshini kubalulekile ukuba kuthathelwe ingqalelo xa iimodeli zokufunda ngoomatshini zidityaniswa kwiinkqubo zokuthatha izigqibo zemibutho eyahlukeneyo.
Ukuqinisekisa ukuba ukhetho oluveliswa yi-algorithms alunamkhethe kwaye alunamkhethe kufuneka lube yinjongo yawo nawuphi na umbutho osebenzisa imifuziselo yokufunda koomatshini. Ukuqinisekisa ukuba iziphumo zemodeli zinokuthenjwa kwaye zibonwe njengezifanelekileyo, kubalulekile ukuqaphela kunye nokulungiswa yokufunda umatshini umkhethe.
Inxulumene nemibuzo yokuchazwa kwemodeli, okanye ukuba kulula kangakanani ukuba umntu aqonde indlela imodeli yokufunda yomatshini efikelele ngayo kwisigqibo. Iintsingiselo kunye neepateni ezenza imodeli yokufunda koomatshini imephu kwaye ifunde ivela kwidatha ngokwayo kunokuba ngophuhliso oluthe ngqo lomntu.
I-bias ekufundeni komatshini inokuvela ngenxa yezizathu ezahlukeneyo ukuba ayilawulwa kwaye ihlolwe. Xa imodeli isetyenzisiwe, ihlala idibana neemeko ezingabonakaliswa ngokuchanekileyo kwisampulu yedatha yoqeqesho.
Le modeli yayinokuba yi-overfit yolu qeqesho lungameleliyo lwedatha. Ngaphandle komgangatho ogqwesileyo wedatha yoqeqesho, imodeli isenokuthi ichatshazelwe kukuthambekela kwembali okubangelwa yimpembelelo yenkcubeko ebanzi.
Yakube iphunyeziwe, imodeli enomkhethe inokuthanda amaqela athile okanye iphulukane nokuchaneka ngeeseti ezithile zedatha. Oku kunokukhokelela kwizigwebo ezohlwaya ngokungekho sikweni iqela elithile labantu, ezinokuba neziphumo ezibi kwilizwe lokwenyani.
Eli nqaku lixoxa ngocalucalulo lokufunda koomatshini, kubandakanya nokuba yintoni na, indlela yokuyibona, iingozi ezibangelwayo, nokunye okuninzi.
Ke, yintoni i-Bias yokufunda ngoMatshini?
I-algorithm yokuvelisa iziphumo ezithambekele ngokucwangcisiweyo ngenxa yeengqikelelo ezibubuxoki ezenziwe ngexesha lenkqubo yokufunda koomatshini yaziwa ngokuba yi-bias yokufunda ngomatshini, eyaziwa ngokuba yi-algorithm bias okanye eyaziwa ngokuba yi-AI bias.
I-bias yokufunda ngoomatshini kukutyekela kwemodeli ukuthanda iseti ethile yedatha okanye iseti yedatha; isoloko iziswa ziiseti zedatha zoqeqesho ezingameliyo. Ngengqokelela ethile yedatha, imodeli ecalucalulo iya kusebenza ngaphantsi, okuya kulimaza ukuchaneka kwayo.
Kuseto lwehlabathi lokwenyani, oku kungathetha ukuba idatha yoqeqesho enomkhethe ikhokelele kwisiphumo somfuziselo esikhetha uhlanga oluthile, amanani abantu, okanye isini.
Ngenxa yoko, iziphumo zokufunda koomatshini zisenokungabi nabulungisa okanye zicalule. Uqeqesho olungamelanga iiseti zedatha zinokufaka isandla kumkhethe ekufundeni koomatshini.
Imodeli yesiphumo inokuthambekela kwelinye, iindidi ezingamelwanga kakuhle ukuba idatha yoqeqesho ayinanto okanye imele ngokugqithisileyo iqela elithile ledatha. Oku kunokwenzeka ukuba isampulu yedatha yoqeqesho ayihambelani ngokuchanekileyo nemeko yokusasazwa kwelizwe lokwenyani.
Ukufunda ngomatshini kwishishini lezempilo, elinokuthi lisetyenziswe ukujonga idatha yesigulane ngokuchasene nezifo okanye izifo ezaziwayo, ngumzekelo obalaseleyo. Iimodeli zinokukhawulezisa ukungenelela kwabasebenzi bezonyango xa zisetyenziswe ngokufanelekileyo.
Noko ke, ucalucalulo lunokwenzeka. Xa ucelwa ukuba uqikelele ukugula okunokwenzeka kwisigulane esidala, imodeli ayikwazi ukwenza kakuhle ukuba idatha yoqeqesho esetyenziselwa ukuyakha ikakhulu iqulethe idatha yesigulane ukusuka kwinqanaba elincinane leminyaka.
Ukongeza, izibalo zembali zinokugqweswa. Ngokomzekelo, ngenxa yokuba ngokwembali, uninzi lwabasebenzi yayingamadoda, imodeli eqeqeshelwe ukuhluza abagqatswa bemisebenzi yayiza kuthanda abafaki-zicelo abangamadoda.
Ukuthanda ukufunda ngoomatshini kuya kuba nefuthe ekuchanekeni kwemodeli kuzo zombini iimeko, kwaye kwezona meko zimbi kakhulu, kunokukhokelela kwizigqibo ezicalulayo nezingekho sikweni.
Izigqibo kufuneka ziqwalaselwe ngocoselelo ukuqinisekisa ukuba akukho mkhethe iimodeli zokufunda ngomatshini buyisela imisebenzi emininzi yezandla. Ngenxa yoko, iindlela zokulawula imodeli kuyo nayiphi na intlangano kufuneka ibandakanye ukubeka iliso kwi-bias yokufunda koomatshini.
Iindidi ezininzi ezahlukeneyo zemisebenzi kumashishini amaninzi awohlukeneyo ayagqitywa ngeemodeli zokufunda ngoomatshini. Namhlanje, iimodeli zisetyenziselwa ukuzenzekelayo iinkqubo ezikhulayo kunye nokuvelisa iingcebiso. Kule nkqubo yokwenziwa kwezigqibo, ukuthambekela ecaleni kuthetha ukuba imodeli inokuthanda iqela elithile ngaphezu kwelinye ngokusekelwe kumkhethe ofundiweyo.
Xa isetyenziselwa ukwenza izigwebo ezingakhuselekanga ezineziphumo zokwenyani, oku kunokuba neziphumo ezibi. Xa isetyenziselwa ukuvuma ngokuzenzekelayo izicelo zemali-mboleko, umzekelo, imodeli ecalucalulo inokudlwengulwa ngabantu abathile. Kumashishini alawulwayo apho naziphi na izenzo zinokuhlolwa okanye zihlolwe, le yinto ebaluleke kakhulu ukuba ithathelwe ingqalelo.
Iintlobo ze-Bias yokuFunda koomatshini
- I-algorithm ye-Bias -Oku kwenzeka xa kukho i-bug kwi-algorithm eyenza izibalo eziqhuba izibalo zokufunda koomatshini.
- Isampulu ye-Bias – Xa idatha isetyenziswa qeqesha umatshini wokufunda imodeli inomcimbi, oku kuyenzeka. Kwiimeko zolu hlobo lomkhethe, isixa okanye umgangatho wedatha esetyenzisiweyo ukuqeqesha inkqubo awonelanga. I-algorithm iya kuqeqeshelwa ukukholelwa ukuba bonke ootitshala ngabasetyhini ukuba, umzekelo, idatha yoqeqesho yenziwe ngootitshala ababhinqileyo ngokupheleleyo.
- Ukungakhethi cala Oku kwenzeka xa inqaku ledatha ebalulekileyo lingekho kwiseti yedatha esetyenziswayo, enokuthi yenzeke ukuba iimodeli ziyasilela ukuqonda ukubaluleka kwendawo yedatha engekhoyo.
- Umkhethe womkhethe – Kulo mzekelo, umatshini wokufunda ngokwawo uthambekele ekubeni idatha esetyenziselwa ukuqeqesha inkqubo ibonakalisa ucalucalulo lwehlabathi lokwenyani olunjengokucalula, ukucingela izinto ezicingelwayo, kunye neengcinga ezingalunganga zentlalo. Umzekelo, ukuba idatha kwiingcali zonyango ibinokubandakanywa kwinkqubo yekhompyuter ebandakanya kuphela oogqirha abangamadoda kunye nabongikazi abangabasetyhini, ingqikelelo yesini sokwenyani malunga nabasebenzi bezempilo iya kuqhubeka.
- I-Measurement Bias - Njengoko igama lithetha, olu khetho luvela kwimiba ebalulekileyo kunye nomgangatho wedatha kunye neendlela ezisetyenziselwa ukuqokelela okanye ukuyivavanya. Inkqubo eqeqeshelwa ukuvavanya ngokuchanekileyo ubunzima iya kuba nomkhethe ukuba iintsimbi eziqulethwe kwidatha yoqeqesho ziye zasongwa ngokuqhubekayo, kwaye ukusebenzisa imifanekiso yabasebenzi abanelisekile ukuqeqesha inkqubo ejoliswe ukuhlola indawo yokusebenza inokuthambekela ukuba abaqeshwa abasemifanekisweni bebesazi. babelinganiswa ngolonwabo.
Ziziphi izinto ezinegalelo kucalucalulo ekufundeni koomatshini?
Nangona kukho izizathu ezininzi ze-bias yokufunda koomatshini, ihlala ivela kwi-bias kwidatha yoqeqesho ngokwayo. Kukho izizathu ezininzi ezinokubakho zokuthatha icala kwidatha yoqeqesho.
Owona mzekeliso ucacileyo yidatha yoqeqesho, eyi-subset yeemeko ezibonwa kwinkqubo esetyenzisiweyo engaqhelekanga. Oku kunokuba yidatha yoqeqesho enokumelwa ngaphantsi kolunye udidi okanye ubungakanani obungalinganiyo bolunye.
Oku kwaziwa njengesampulu yokuthatha icala, kwaye kunokukhokelela ekuqokelelweni kwedatha yoqeqesho olungakhethiswanga. Iindlela ezisetyenziselwa ukuqokelela, ukuhlalutya, okanye ukwahlula idatha, kunye neengcambu zembali yedatha, zonke zinokukhokelela ekukhetheni kwidatha ngokwayo.
Ulwazi lunokuthi luthambekele ngokwembali kwinkcubeko enkulu apho yayiqokelelwa khona.
Ukuthanda ukufunda ngoomatshini kubangelwa ikakhulu:
- I-biases ebangelwa ngabantu okanye uluntu kwidatha yembali isetyenziselwa ukuqeqesha i-algorithms.
- Idatha yoqeqesho engabonisi iimeko zehlabathi lokwenyani.
- Ukuthatha icala ngelixa uleyibhile okanye ulungiselela idatha yokufunda koomatshini ebekwe iliso.
Ngokomzekelo, ukunqongophala kweyantlukwano kwidatha yoqeqesho kunokubangela ukumela ummeli. Ukuchaneka kweemodeli zokufunda koomatshini kuhlala kuchaphazeleka ngokuthambekela kwembali kwinkcubeko ebanzi.
Ngamanye amaxesha oku kubhekiselwa kuko njengokuthatha icala kwezentlalo okanye komntu. Ukufumana intaphane yengqokelela yedatha engatyekelanga kucalucalulo loluntu kunokuba ngumngeni. Inqanaba lokwenziwa kwedatha kumjikelo wobomi bokufunda ngomatshini lichaphazeleka ngokulinganayo kucalucalulo lwabantu.
Idatha ebhalwe yaza yalungiswa ngusosayensi wedatha okanye enye ingcali iyimfuneko ekufundeni koomatshini. Nokuba ivela kwiintlobo ngeentlobo zedatha ecocwayo, indlela amanqaku edatha abhalwe ngayo, okanye ukhetho lweempawu, utyekelo kule nkqubo yokuleyibhela kunokukhokelela kucala lokufunda koomatshini.
Imingcipheko yokuFunda ngoomatshini
Ekubeni iimodeli zizixhobo zokwenza izigqibo eziqhutywa yidatha, kucingelwa ukuba zibonelela ngezigwebo ezingenamkhethe. Iimodeli zokufunda ngoomatshini zihlala zine-bias, ezinokuchaphazela iziphumo.
Amashishini amaninzi asebenzisa ukufundwa koomatshini endaweni yesoftware kunye neenkqubo eziphelelwe lixesha. Iimodeli ezinomkhethe zinokuba neziphumo ezibi kwihlabathi lokwenyani xa imisebenzi entsonkothileyo izenzekela kusetyenziswa iimodeli.
Ukufunda ngomatshini akwahlukanga kwezinye iinkqubo zokwenza izigqibo kuba imibutho kunye nabantu ngabanye balindele ukuba kube sobala kwaye kulingane. Kuba ukufunda ngoomatshini kuyinkqubo ezenzekelayo, izigwebo ezenziwe ngokusetyenziswa kwazo ngamanye amaxesha zijongwa ngakumbi.
Kubalulekile ukuba imibutho ithathe amanyathelo okujongana neengozi kuba ucalucalulo ekufundeni koomatshini lunokuhlala luneziphumo zocalucalulo okanye ezingalunganga kwabanye abantu. Kwimixholo elawulwayo, ngokukodwa, ukubakho kwe-bias ekufundeni komatshini kufuneka kuthathelwe ingqalelo.
Umzekelo, ukufunda ngoomatshini ebhankini kunokusetyenziselwa ukwamkela ngokuzenzekelayo okanye ukwala abafaki zicelo zokubambisa emva kokuhlolwa kokuqala. Imodeli etyekele kwiqela elithile labaviwa inokuba neziphumo ezibi kumgqatswa nakumbutho.
Nakuphi na ukuthambekela okufunyenwe kwindawo yokuthunyelwa apho izenzo zinokujongwa kunokukhokelela kwiingxaki ezinkulu. Imodeli isenokungasebenzi kwaye, kwezona meko zimbi kakhulu, isenokujika ibe lucalucalulo ngabom.
I-bias kufuneka ivavanywe ngononophelo kwaye ilungiselelwe njengoko inokubangela ukuba imodeli isuswe ngokupheleleyo ekusetyenzisweni. Ukufumana ukuzithemba kwizigqibo zemodeli kufuna ukuqonda kunye nokujongana ne-bias yokufunda koomatshini.
Inqanaba lokuthembana ngaphakathi kwintlangano kunye naphakathi kwabasebenzisi benkonzo yangaphandle kunokuchatshazelwa kukuthambekela okubonwayo kumzekelo wokwenziwa kwezigqibo. Ukuba iimodeli azithenjwa, ngakumbi xa zikhokela ukhetho olusemngciphekweni omkhulu, aziyi kusetyenziselwa amandla azo apheleleyo ngaphakathi kumbutho.
Xa uvavanya ukucaciswa komzekelo, ukubalwa kwecala kufuneka kube yinto ekufuneka ithathelwe ingqalelo. Ukunyaniseka kunye nokuchaneka kokukhethwa kwemodeli kunokuchaphazeleka kakhulu kukungaqwalaselwanga kokukhetha umatshini wokufunda.
Ngamanye amaxesha kunokukhokelela kwizenzo zocalucalulo ezinokuchaphazela abantu okanye amaqela athile. Zininzi izicelo ezikhoyo kwiintlobo ezahlukeneyo zemodeli yokufunda koomatshini, kwaye nganye isengozini yokufunda ngomatshini ukuya kuthi ga kwinqanaba elithile.
Umkhethe wokufunda ngoomatshini uboniswa ngu:
- Ngenxa yokungabikho kweentlobo ezahlukeneyo kwidatha yoqeqesho, i-algorithms yokuqaphela ubuso inokungachaneki kangako kwamanye amaqela eentlanga.
- Inkqubo inokubona ucalucalulo lobuhlanga kunye nesini kwidatha ngenxa yokucalucalulwa kwabantu okanye ngokwembali.
- Ngolwimi lwengingqi okanye isivakalisi esithile, ukusetyenzwa kolwimi lwendalo kunokuchaneka ngakumbi, kwaye kusenokungakwazi ukusetyenzwa ngesivakalisi esingamelwanga kwidatha yoqeqesho.
Ukusombulula i-Bias ekuFundeni koMatshini
Iimodeli zokubeka iliso kunye nokuqeqeshwa kwakhona xa kufunyenwe i-bias zimbini iindlela zokujongana ne-bias yokufunda koomatshini. Kwiimeko ezininzi, imodeli ye-bias isalathiso se-bias kwidatha yoqeqesho, okanye ubuncinci i-bias inokuhambelana nesigaba soqeqesho somjikelo wobomi bokufunda umatshini.
Inqanaba ngalinye lemodeli yobomi kufuneka libe neenkqubo zokubamba icala okanye imodeli yokukhukuliseka. Iinkqubo zokubeka iliso kumatshini wokufunda emva kokuthunyelwa nazo zibandakanyiwe. Kubalulekile ukukhangela rhoqo imodeli kunye neeseti zedatha ukwenzela ukuthambekela.
Oku kunokubandakanya ukuphonononga idatha yoqeqesho ukubona ukuba amaqela asasazwa njani kwaye amelwe njani apho. Kuyenzeka ukuguqula kunye/okanye ukuphucula iiseti zedatha ezingamelwanga ngokupheleleyo.
Ukongeza, ukuthambekela kufuneka kuqwalaselwe ngelixa kuvavanywa ukusebenza kwemodeli. Ukuvavanya ukusebenza komzekelo kwii-subsets ezahlukeneyo zedatha kunokubonisa ukuba i-biased okanye i-overfitted ngokumalunga neqela elithile.
Kuyenzeka ukuvavanya ukusebenza kwemodeli yokufunda koomatshini kwiiseti ezithile zedatha ngokusebenzisa iindlela zokuqinisekisa ezinqamlezileyo. Inkqubo ibandakanya ukwahlula-hlula idatha kwiiseti zedatha zoqeqesho kunye novavanyo olwahlukileyo.
Unokuphelisa ucalucalulo ekufundeni koomatshini ngokuthi:
- Xa kuyimfuneko, phinda uqeqeshe imodeli usebenzisa iiseti ezinkulu, ezimele ngakumbi zoqeqesho.
- Ukuseka inkqubo yokujonga iziphumo ezithatha icala kunye nezigwebo ezingaqhelekanga.
- Iimpawu zokunciphisa umzimba kunye nokulungelelanisa i-hyperparameters njengoko kuyimfuneko kunokunceda ukuhlawula i-bias.
- Ukukhuthaza ukusonjululwa kocalu-calulo olufunyenweyo ngomjikelo oqhubekayo wokufunyanwa kunye nokwenza ngcono.
isiphelo
Kuyahenda ukukholelwa ukuba xa sele uqeqeshiwe, imodeli yokufunda ngomatshini iya kusebenza ngokuzimeleyo. Enyanisweni, imeko yokusebenza yemodeli ihlala itshintsha, kwaye abaphathi kufuneka baphinde baqeqeshe imodeli besebenzisa iiseti zedatha entsha rhoqo.
Ukufunda ngoomatshini ngoku sesinye sesakhono setekhnoloji esinomdla esinenzuzo yokwenyani kwezoqoqosho. Ukufunda ngoomatshini, xa kudityaniswe neetekhnoloji ezinkulu zedatha kunye namandla amakhulu okubalekayo afumaneka kwilifu likawonke-wonke, kunamandla okuguqula indlela abantu abanxibelelana ngayo netekhnoloji, kwaye mhlawumbi namashishini apheleleyo.
Nangona kunjalo, nangona ubugcisa bokufunda ngoomatshini buthembisa, kufuneka kucwangciswe ngenyameko ukuze kuphetshwe ucalucalulo olungenziwa ngabom. Ukusebenza kwezigwebo ezenziwe ngoomatshini kunokuchaphazeleka kakhulu ngokucalucalulo, into leyo abaphuhlisi bemodeli yokufunda koomatshini kufuneka bayithathele ingqalelo.
Shiya iMpendulo