Njengoba izimboni eziningi zisebenzisa amandla ama-algorithms ukwenza imisebenzi ngokuzenzakalela nokwenza izinqumo, ukufunda ngomshini kuba yingxenye ebalulekile yendlela umhlaba wamanje osebenza ngayo.
Indaba yokuchema ekufundeni komshini ibalulekile ukuthi inakwe lapho amamodeli okufunda omshini ehlanganiswa ezinqubweni zokuthatha izinqumo zezinhlangano ezahlukahlukene.
Ukuqinisekisa ukuthi ukukhetha okukhiqizwa ama-algorithms akuchemi futhi akunakuchema kufanele kube umgomo wanoma iyiphi inhlangano esebenzisa amamodeli okufunda omshini. Ukuqinisekisa ukuthi okuphumayo kwemodeli kungathenjelwa kukho futhi kubonakale njengokufanelekile, kubalulekile ukuqaphela nokubhekana nakho ukufunda imishini ukukhetha.
Kuhlobene nemibuzo yokuchazwa kwemodeli, noma ukuthi kulula kangakanani ngomuntu ukuthi abambe ukuthi imodeli yokufunda yomshini ifinyelele kanjani esiphethweni. Amathrendi namaphethini amamodeli okufunda omshini enza imephu futhi awafunde avela kudatha ngokwayo esikhundleni sokuthuthuka komuntu okuqondile.
Ukuchema ekufundeni komshini kungavela ngezizathu ezahlukahlukene uma kungalawulwa futhi kungahlolisiswa. Uma imodeli isetshenziswa, ivamise ukuhlangana nezimo ezingavezwanga kahle kusampula yedatha yokuqeqeshwa.
Imodeli kungenzeka ukuthi ifanele kakhulu le sethi yokuqeqeshwa engameleli yedatha. Naphezu kwekhwalithi enhle kakhulu yedatha yokuqeqeshwa, imodeli isengase ithintwa ukuchema okungokomlando okubangelwa imithelela yamasiko ebanzi.
Uma isisetshenzisiwe, imodeli echemile ingase ivune amaqembu athile noma ilahlekelwe ukunemba ngamasethi athile edatha. Lokhu kungase kubangele izahlulelo ezijezisa ngokungafanele iqembu elithile labantu, okungaba nemiphumela engemihle emhlabeni wangempela.
Lesi sihloko sidingida ukuchema kokufunda komshini, okuhlanganisa ukuthi kuyini, ukuthi kubonwa kanjani, izingozi ezinazo, nokunye okuningi.
Ngakho-ke, Yini i-Machine Learning Bias?
I-algorithm ekhiqiza imiphumela echemile ngokuhlelekile njengomphumela wokuqagela okungamanga okwenziwe phakathi nenqubo yokufunda komshini kwaziwa njengokuchema komshini, okubuye kwaziwe ngokuthi ukuchema kwe-algorithm noma okwaziwa ngokuthi ukuchema kwe-AI.
Ukuchema kokufunda komshini ukuthambekela kwemodeli ukukhetha isethi ethile yedatha noma isethi engaphansi yedatha; kuvame ukulethwa amasethi edatha okuqeqeshwa angameleli. Ngeqoqo elithile ledatha, imodeli echemile izosebenza ngaphansi kokulindelwe, okuzolimaza ukunemba kwayo.
Esilungiselelweni somhlaba wangempela, lokhu kungasho ukuthi idatha yokuqeqeshwa echemile iphumele ekuphumeni kwemodeli evuna uhlanga oluthile, uhlobo lwabantu, noma ubulili.
Ngenxa yalokho, imiphumela yokufunda komshini ingase ingabi nabulungisa noma ibandlulule. Ukuqeqeshwa okungameleli amasethi edatha angaba nomthelela ekuchemani ekufundeni komshini.
Imodeli ewumphumela ingachema kwezinye, izigaba ezingamelwe kakhulu uma idatha yokuqeqeshwa ishoda noma imele ngokweqile ukuqoqwa kwedatha ethile. Lokhu kungenzeka uma isampula yedatha yokuqeqeshwa ingafani ncamashi nendawo yokusebenza yomhlaba wangempela.
Ukufunda ngomshini embonini yezokunakekelwa kwempilo, engasetshenziswa ukuhlola idatha yesiguli ngokumelene nezifo ezaziwayo noma izifo, kuyisibonelo esiyinhloko. Amamodeli angasheshisa ukungenelela kodokotela lapho esetshenziswa ngendlela efanele.
Nokho, ubandlululo lungenzeka. Lapho icelwa ukuthi ibikezele ukugula okungenzeka esigulini esikhulile, imodeli ayikwazi ukusebenza kahle uma idatha yokuqeqeshwa esetshenziselwa ukuyakha ngokuvamile iqukethe idatha yesiguli evela ebangeni lobudala elincane.
Ukwengeza, izibalo zomlando zingahlanekezelwa. Ngokwesibonelo, ngenxa yokuthi ngokomlando, iningi lezisebenzi kwakungamadoda, imodeli eqeqeshelwe ukuhlunga abantu abazongenela umsebenzi yayizovuna abafaki zicelo besilisa.
Ukuchema komshini wokufunda kuzoba nomthelela ekunembeni kwemodeli kuzo zombili izimo, futhi ezimeni ezimbi kakhulu, kungase kubangele ngisho neziphetho ezicwasayo nezingalungile.
Izinqumo kufanele zibuyekezwe ngokucophelela ukuze kuqinisekiswe ukuthi akukho ukuchema njengoba amamodeli wokufunda wemishini buyisela imisebenzi yezandla eyengeziwe. Njengomphumela walokho, izinqubo zokuphatha eziyimodeli kunoma iyiphi inhlangano kufanele zifake ukuqapha kokuchema komshini wokufunda.
Izinhlobo eziningi ezahlukene zemisebenzi ezimbonini eziningi ezahlukene ziqedwa ngamamodeli okufunda emishini. Namuhla, amamodeli asetshenziselwa ukwenza ngokuzenzakalelayo izinqubo eziba nzima kakhulu nokwenza iziphakamiso. Kule nqubo yokuthatha izinqumo, ukuchema kusho ukuthi imodeli ingase ivune iqembu elithile kunelinye ngokusekelwe ekucheleni okufundiwe.
Uma kusetshenziselwa ukwenza izinqumo ezingaphephile ezinemiphumela yangempela, lokhu kungaba nemiphumela emibi kakhulu. Uma isetshenziselwa ukugunyaza ngokuzenzakalelayo izicelo zemali mboleko, isibonelo, imodeli echemile ingabandlulula inani elithile labantu. Emabhizinisini alawulwayo lapho noma yiziphi izenzo zingahlolwa noma zicutshungulwe, lokhu kuyisici esibaluleke kakhulu okufanele sicatshangelwe.
Izinhlobo ze-Machine Learning Bias
- Ukuchema kwe-algorithm - Lokhu kwenzeka uma kunesiphazamisi ku-algorithm esenza izibalo eziqhuba izibalo zokufunda komshini.
- Ukuchema Kwesampula - Lapho idatha isetshenziswa qeqesha umshini wokufunda imodeli inenkinga, lokhu kuyenzeka. Ezimeni zalolu hlobo lokuchema, inani noma ikhwalithi yedatha esetshenziselwa ukuqeqesha isistimu ayanele. I-algorithm izoqeqeshelwa ukukholelwa ukuthi bonke othisha bangabesifazane uma, ngokwesibonelo, idatha yokuqeqeshwa yenziwe ngothisha besifazane ngokuphelele.
- Ukukhetha ukukhishwa - Lokhu kwenzeka lapho iphuzu ledatha elibalulekile lingekho kusethi yedatha esetshenziswayo, okungenzeka uma abamodelayo behluleka ukuqaphela ukubaluleka kwephoyinti ledatha elingekho.
- Ubandlululo - Kulesi sibonelo, ukufunda komshini ngokwawo kuchemile njengoba idatha esetshenziswa ukuqeqesha isistimu ibonisa ukuchema komhlaba wangempela njengokucwasa, imibono engaguquki, nokuqagela okungalungile komphakathi. Isibonelo, uma idatha yochwepheshe bezokwelapha ibingafakwa ohlelweni lwekhompiyutha olufaka kuphela odokotela besilisa nabahlengikazi besifazane, inkolelo-mbono yobulili bomhlaba wangempela mayelana nabasebenzi bezokunakekelwa kwempilo ibingaqhutshwa njalo.
- Ukuchema Kokulinganisa - Njengoba igama lisho, lokhu kuchema kuvela ezindabeni ezibalulekile ngekhwalithi yedatha kanye nezindlela ezisetshenziselwa ukuyiqoqa noma ukuyihlola. Uhlelo oluqeqeshelwa ukuhlola isisindo ngokunembile luzochema uma izisindo eziqukethwe kudatha yokuqeqeshwa beziqoqwa njalo, futhi ukusebenzisa izithombe zabasebenzi abanelisekile ukuqeqesha uhlelo oluhloselwe ukuhlola indawo yokusebenza kungaba nokuchema uma abasebenzi abasezithombeni bebazi. babelinganiswa ngenjabulo.
Yiziphi izici ezinomthelela ekuchemani ekufundeni komshini?
Nakuba kunezizathu eziningi zokuchema komshini wokufunda, ngokuvamile kuvela ekuchemameni kwedatha yokuqeqeshwa ngokwayo. Kunezimbangela ezimbalwa ezingaba khona zokuchema kudatha yokuqeqeshwa.
Umfanekiso osobala kakhulu idatha yokuqeqeshwa, okuyingxenye yezimo ezibonwa kusistimu esetshenzisiwe engeyona ejwayelekile. Lokhu kungase kube idatha yokuqeqesha enokumelela kancane kwesigaba esithile noma inani elingenakulinganiswa lesinye.
Lokhu kwaziwa njengokuchema kwesampula, futhi kungabangelwa ukuqoqwa kwedatha yokuqeqeshwa okungahleliwe. Izindlela ezisetshenziselwa ukuqoqa, ukuhlaziya, noma ukuhlukanisa idatha, kanye nezimpande zomlando zedatha, zonke zingaholela ekuchemani kwedatha ngokwayo.
Ulwazi lungase lucheme ngokomlando esikweni elikhulu lapho lwaluqoqwe khona.
Ukuchema kokufunda komshini kubangelwa kakhulu:
- Ukuchema okudalwe abantu noma umphakathi kudatha yomlando kusetshenziswa ukuqeqesha ama-algorithms.
- Idatha yokuqeqesha engabonisi izimo zomhlaba wangempela.
- Ukuchema ngenkathi ulebula noma ulungiselela idatha yokufunda komshini ogadiwe.
Isibonelo, ukuntuleka kokwehluka kwedatha yokuqeqeshwa kungase kubangele ukuchema kokumelela. Ukunemba kwamamodeli okufunda komshini kuvame ukuthintwa ukuchema komlando esikweni elibanzi.
Lokhu ngezinye izikhathi kubizwa ngokuthi ukuchema kwezenhlalo noma komuntu. Ukuthola amaqoqo amaningi edatha angajwayele ukuchema kungaba inselele. Isigaba sokucubungula idatha somjikelezo wokuphila wokufunda komshini sisengozini ngokulinganayo ekuchemani kwabantu.
Idatha efakwe ilebula futhi yacutshungulwa usosayensi wedatha noma omunye uchwepheshe iyadingeka ekufundeni komshini ogadiwe. Ukuthi ivela ezinhlobonhlobo zedatha ehlanzwayo, indlela amaphuzu edatha alebulwe ngayo, noma ukukhethwa kwezici, ukuchema kule nqubo yokulebula kungaholela ekuchemani ekufundeni komshini.
Izingozi Zokuchema Kokufunda Ngomshini
Njengoba amamodeli engamathuluzi okwenza izinqumo aqhutshwa yidatha, kucatshangwa ukuthi anikeza izahlulelo ezingachemile. Amamodeli okufunda omshini ngokuvamile aqukethe ukuchema, okungathinta imiphumela.
Izimboni eziningi zisebenzisa ukufundwa kwemishini esikhundleni sesoftware nezinqubo eziphelelwe yisikhathi. Amamodeli achemile angaba nemiphumela engemihle emhlabeni wangempela lapho imisebenzi eyinkimbinkimbi yenziwa ngokuzenzakalelayo kusetshenziswa amamodeli.
Ukufunda ngomshini akuhlukile kwezinye izinqubo zokuthatha izinqumo lapho izinhlangano nabantu ngabanye balindele ukuthi kube sobala futhi kulingane. Ngenxa yokuthi ukufunda komshini kuyinqubo ezenzakalelayo, izinqumo ezenziwa ngokuwusebenzisa ngezinye izikhathi zihlolwa ngokuseduze nakakhulu.
Kubalulekile ukuthi izinhlangano zibambe iqhaza ekubhekaneni nezingozi njengoba ukwenzelela ekufundeni komshini kuvamise ukuba nemiphumela ecwasayo noma engemihle kwabanye abantu. Ngokuqukethwe okulawulwayo, ikakhulukazi, ukuthi kungenzeka kube nokuchema ekufundeni komshini kufanele kucatshangelwe.
Isibonelo, ukufunda ngomshini ebhange kungase kusetshenziselwe ukwamukela ngokuzenzakalelayo noma ukwenqaba abafake izicelo zendlu yezindlu ngemuva kokuhlolwa kokuqala. Imodeli echemile eqenjini elithile lamakhandidethi ingase ibe nemiphumela elimazayo kukho kokubili ikhandidethi nenhlangano.
Noma yikuphi ukuchema okutholakala endaweni yokuthunyelwa lapho izenzo zingacutshungulwa kungase kubangele izinkinga ezinkulu. Imodeli ingase ingasebenzi futhi, ezimeni ezimbi kakhulu, ingase ibonakale ibandlulula ngamabomu.
Ukuchema kufanele kuhlolwe ngokucophelela futhi kulungiselelwe ngoba kungase kubangele ukuthi imodeli isuswe ngokuphelele ekusetshenzisweni. Ukuthola ukuzethemba ezinqumweni zemodeli kudinga ukuqonda nokubhekana nokuchema komshini wokufunda.
Izinga lokwethembana ngaphakathi kwenhlangano naphakathi kwabathengi besevisi yangaphandle lingase lithintwe ukuchema okubonakalayo ekuthathweni kwezinqumo okuyimodeli. Uma amamodeli engathenjwa, ikakhulukazi lapho eqondisa ukukhetha okunobungozi obuphezulu, ngeke aze asetshenziselwe amandla awo agcwele ngaphakathi kwenhlangano.
Lapho kuhlolwa ukuchazwa kwemodeli, ukubalwa kwezimali ngokuchema kufanele kube isici okufanele sicatshangelwe. Ukufaneleka nokunemba kwezinketho zamamodeli kungase kuthinteke kakhulu ukuchema okungahloliwe kokufunda komshini.
Ngezinye izikhathi kungase kubangele izenzo zokubandlulula ezingase zithinte abantu noma amaqembu athile. Kunezinhlelo zokusebenza eziningi ezikhona zezinhlobo ezahlukene zamamodeli okufunda komshini, futhi ngayinye isengozini yokuchema ngomshini ngezinga elithile.
Ukuchema kokufunda komshini kuboniswa yilokhu:
- Ngenxa yokungabi bikho kwezinhlobonhlobo kudatha yokuqeqeshwa, ama-algorithms okubona ubuso angaba nenembile kancane kwezinye izinhlanga.
- Uhlelo lungathola ukuchema kobuhlanga nobulili kudatha ngenxa yokucwasa kwabantu noma komlando.
- Ngolimi lwesigodi oluthile noma isishoshovu, ukucutshungulwa kolimi lwemvelo kungase kube nembe kakhudlwana, futhi kungase kungakwazi ukucubungula iphimbo elingamelelwe kancane kudatha yokuqeqeshwa.
Ukuxazulula Ukuchema Ekufundeni Ngomshini
Amamodeli okuqapha nokuqeqesha kabusha lapho kutholakala ukwenzelela izindlela ezimbili zokubhekana nokuchema komshini wokufunda. Ezimweni eziningi, ukuchema kwemodeli kuwuphawu lokuchema kudatha yokuqeqeshwa, noma okungenani ukuchema kungahlotshaniswa nesigaba sokuqeqeshwa somjikelezo wokuphila wokufunda komshini.
Zonke izigaba zomjikelezo wempilo wemodeli kufanele zibe nezinqubo zokubamba ukuchema noma ukukhukhuleka kwemodeli. Izinqubo zokuqapha ukufunda komshini ngemva kokuthunyelwa nazo zifakiwe. Kubalulekile ukuhlola njalo imodeli namasethi edatha ukuze uthole ukuchema.
Lokhu kungase kuhlanganise ukuhlola idathasethi yokuqeqeshwa ukuze ubone ukuthi amaqembu asakazwa futhi amelelwa kanjani lapho. Kungenzeka ukuguqula kanye/noma ukuthuthukisa amasethi edatha angameleli ngokuphelele.
Ukwengeza, ukuchema kufanele kucatshangelwe ngenkathi kuhlolwa ukusebenza kwemodeli. Ukuhlola ukusebenza kwemodeli kumasethi angaphansi ahlukene edatha kungabonisa uma ichemile noma ifakwe ngokweqile ngokuhlobene neqembu elithile.
Kungenzeka ukuhlola ukusebenza kwemodeli yokufunda komshini kumasethi amancane edatha ngokusebenzisa amasu okuqinisekisa okuphambene. Inqubo ihlanganisa ukuhlukanisa idatha ibe amasethi edatha okuqeqesha nokuhlola ahlukene.
Ungasusa ukwenzelela ekufundeni komshini ngokwenza lokhu:
- Uma kunesidingo, phinda uqeqeshe imodeli usebenzisa amasethi amakhulu, amele kakhulu okuqeqesha.
- Ukusungula inqubo yokubheka imiphumela echemile nezinqumo ezingajwayelekile.
- Izici zokunciphisa isisindo kanye nokulungisa ama-hyperparameter njengoba kudingeka kungasiza ekuphenduleni ngokuchema.
- Ukukhuthaza ukuxazululwa kokuchema okutholakele ngomjikelezo oqhubekayo wokuthola nokwenza kahle.
Isiphetho
Kuyalinga ukukholelwa ukuthi uma usuqeqeshiwe, imodeli yokufunda ngomshini izosebenza ngokuzimele. Eqinisweni, indawo yokusebenza yemodeli ihlala ishintsha, futhi abaphathi kufanele baqeqeshe kabusha amamodeli besebenzisa amasethi edatha amasha njalo.
Ukufunda ngomshini okwamanje kungenye yamakhono ezobuchwepheshe athakazelisa kakhulu anezinzuzo zezomnotho zomhlaba wangempela. Ukufunda ngomshini, uma kubhangqwe nobuchwepheshe bedatha enkulu namandla amakhulu okuhlanganisa atholakala ngamafu omphakathi, kunamandla okuguqula indlela abantu abasebenzisana ngayo nobuchwepheshe, futhi mhlawumbe nezimboni zonke.
Nokho, nakuba ubuchwepheshe bokufunda ngomshini buthembisa, kumelwe buhlelwe ngokucophelela ukuze kugwenywe ukuchema okungahlosiwe. Ukusebenza kokwahlulela okwenziwa imishini kungase kuthinteke kakhulu ngokuchema, okuyinto okufanele abathuthukisi bemodeli yokufunda komshini bayicabangele.
shiya impendulo