Isiqulatho[Fihla][Bonisa]
Ayinto intsha ukuba neefoto neevidiyo zomgunyathi. Ukusukela ekusetyenzisweni okuxhaphakileyo kwe-intanethi, abantu bebesenza ubuqhetseba benzelwe ukukhohlisa okanye ukuhlekisa oko bekukho imifanekiso kunye neefilimu.
Nangona kunjalo, kukho uhlobo olutsha lobuxoki obuveliswe ngoomatshini obunokuthi ngenye imini kwenze kube nzima kuthi ukwahlula inyaniso kumabali obuxoki.
Ezi mgunyathi zahlukile kubuchule bemifanekiso obulula obuveliswe ngokuhlela isoftware efana nePhotoshop okanye iifilimu ezenziwe ngobuchule zangaphambili.
Ii-Deepfakes ngowona mzekelo waziwa kakhulu “wemidiya yokwenziwa”—imifanekiso, izandi, kunye neevidiyo ekubonakala ngathi ziveliswe kusetyenziswa iindlela eziqhelekileyo kodwa zenziwe ngesoftware entsonkothileyo.
I-Deepfakes ikhona ixesha elide, kwaye ngelixa esona sicelo sabo sidumileyo kukubeka iintloko zabantu abadumileyo kwimizimba yabadlali kwiifilimu ezingamanyala, banamandla okuvelisa imifanekiso eqinisekileyo yakhe nabani na owenza nantoni na, naphi na.
Kule posi, siza kujonga kwi-Deepfakes, indlela esebenza ngayo, unokuzivelisa njani ngokwakho, nokunye okuninzi.
Ke, yintoni i-DeepFake?
I-deepfake-indibaniselwano yamabinzana ukufunda okunzulu kunye nenkohliso-liqhekeza imidiya yokwenziwa apho ukufana komnye umntu kusetyenziswa ukuvala indawo yomntu kwifoto okanye ividiyo esele ikhona.
Ii-Deepfakes zisebenzisa ubugcisa bokufunda koomatshini obuntsonkothileyo kunye nobuchule bokwenziwa kobukrelekrele ukuguqula kunye nokudala ulwazi olubonwayo kunye nolwesandi olunamandla aphezulu okukhohlisa.
Iindlela zokufunda nzulu njengeencoder ezizenzekelayo kunye nothungelwano lotshaba oluvelisayo yeyona ndlela iphambili yemveliso ye-deepfake (GAN).
Le mifuziselo isetyenziselwa ukuhlalutya iimvakalelo zobuso kunye neentshukumo zomntu kunye nokudibanisa imifanekiso yobuso yabanye abantu ababonisa iintetho kunye neentshukumo ezifanayo.
Ukusetyenziswa kwee-deepfakes kwiividiyo zeponografi ezidumileyo, iindaba ezingeyonyani, ubuqhetseba, nobuqhophololo bezemali kutsale ingqalelo enkulu. Zombini ishishini kunye norhulumente baphendule ngokuzama ukuzifumana kunye nokunciphisa ukusetyenziswa kwazo.
IModeli yoMyalelo wokuQala weNyuvesi
Xa uzama ukuphuhlisa ubunyani obunzulu kwixesha elidlulileyo, umba yayikukuba sifuna uhlobo oluthile lolwazi olongezelelweyo, okanye izinto eziphambili, ukuze ezi ndlela zisebenze.
Njengomzekeliso, iziphawuli zobuso ziyafuneka ukuba sifuna ukulandelela intshukumo yentloko. Ukuma koqikelelo bekuyimfuneko ukuba sinqwenela ukwenza imaphu yentshukumo yomzimba wonke.
Oko kwatshintsha kwinkomfa ye-NeurIPS kulo nyaka uphelileyo xa iqela lophando elivela kwiYunivesithi yaseToronto libonisa umsebenzi walo, "IModeli yokuQala eshukumayo yoMfanekiso woMfanekiso weMifanekiso. "
Akukho lwazi lungaphaya lopopayi oluyimfuneko kule ndlela. Ukongeza, emva kokuba le modeli iqeqeshiwe, ingasetyenziselwa utshintshelo lokufunda kwaye isetyenziswe kuyo nayiphi na into ewela phantsi kodidi olufanayo.
Makhe sijonge ukusebenza kwale ndlela kancinci. I-Motion Extraction kunye ne-Generation yenza isiqingatha sokuqala senkqubo yonke. Ividiyo yokuqhuba kunye nemifanekiso yomthombo isetyenziswa njengamagalelo.
Ukukhupha ukubonakaliswa kwentshukumo yokuqala, equkethe amanqaku angundoqo amancinci kunye nokuguqulwa kwe-affine yendawo, i-extractor yentshukumo isebenzisa i-autoencoder ukuchonga amanqaku abalulekileyo.
Ukwenza i-optical flow exineneyo kunye nemephu ye-occlusion kunye nenethiwekhi yentshukumo eshinyeneyo, bayaqeshwa kunye nevidiyo yokuqhuba. Ijenereyitha emva koko inikezela ngomfanekiso ekujoliswe kuwo usebenzisa iziphumo ezisuka kuthungelwano lwentshukumo eshinyeneyo kunye nomfanekiso wemvelaphi.
Kuyo yonke ibhodi, lo msebenzi uqhuba ngcono kunemeko yobugcisa. Ikwanayo neempawu ezingenazo ezinye iimodeli. Isebenza kwiindidi zemifanekiso ezininzi, ukuze ukwazi ukuyisebenzisa kwimifanekiso yobuso, umzimba, iikhathuni, njl., nto leyo intle kakhulu.
Amathuba amaninzi amatsha adaleka koku. Enye inkalo eyothusayo yesicwangciso sethu kukuba ngoku ikuvumela ukuba uvelise i-Deepfakes ekumgangatho ophezulu usebenzisa umfanekiso omnye wento ekujoliswe kuyo, efana nendlela esenza ngayo. YOLO into ukwamkelwa.
Inkqubo yokuyila imodeli ye-Deepfake
Iinkqubo ezintathu ziyimfuneko kwisizukulwana esinzulu: ukutsalwa, uqeqesho kunye nokudala. Amanqaku aphambili esi sigaba ngasinye kunye nendlela anxulumana ngayo nenkqubo iyonke aya kuchazwa kweli candelo.
U kucinywa
I-Deepfakes isebenzisa iinethiwekhi ezinzulu ze-neural ukutshintsha ubuso kwaye zidinga idatha eninzi (imifanekiso) ukuze isebenze ngokuchanekileyo nangokukholisayo. Inkqubo yokutsalwa linqanaba apho zonke iifreyimu ezivela kwikliphu zevidiyo zitsalwa, ubuso bubonwa, kwaye ubuso bulungelelaniswa ukuze kwandiswe ukusebenza.
uqeqesho
Kwinqanaba loqeqesho, i inethiwekhi yomnatha inokutshintsha ubuso obunye bube kobunye. Ngokuxhomekeke kubungakanani beseti yokuziqhelanisa kunye negajethi yoqeqesho, uqeqesho lunokuthatha iiyure ezininzi okanye iintsuku.
Uqeqesho kufuneka lugqitywe kube kanye, njengolunye uqeqesho lweneural network. Emva koqeqesho, imodeli iya kukwazi ukutshintsha ubuso ukusuka kumntu A ukuya kumntu B.
Indalo
Emva kokuba imodeli iqeqeshiwe, i-deepfake inokuveliswa. Iifreyimu zithathwa kwividiyo kwaye emva koko zilungelelaniswe kubo bonke ubuso. Inethiwekhi ye-neural eqeqeshiweyo emva koko isetyenziselwa ukuguqula isakhelo ngasinye.
Ubuso obuguquliweyo kufuneka budityaniswe nesakhelo sokuqala njengenyathelo lokugqibela.
Ukwakha iModeli yokuFumana i-Deepfake
Ukunyuka kunye nokuQinisa i-GitHub Repo
Ukwazi ukusebenzisa iiGPU zikaGoogle simahla ngelixa usebenza eColab kunenzuzo ukufunda okunzulu. Inzuzo eyongezelelweyo kukukwazi ukunyusa i-Google Drive kumatshini we-cloud virtual (VM).
Ngokufikelela ngokulula kuzo zonke izinto zakhe, umsebenzisi uvuliwe. Inkqubo efunekayo ukunyusa i-Google Drive kumatshini wenyani kwilifu iya kufumaneka kweli candelo.
Ukuthathwa ngaphandle kweeModyuli
Ngoku, siya kungenisa zonke iimodyuli eziyimfuneko.
Ukwenza imodeli
Siza kusebenzisa umzekelo odibanisa ifoto emileyo kaPutin (umfanekiso womthombo) kunye nevidiyo ka-Obama. Isiphumo yividiyo kaPutin ethetha kwaye ebambe ngesandla ngenkangeleko yobuso efanayo neyasetyenziswa ngu-Obama xa eqhuba.
Ngaphambi kokubonisa umphumo wemodeli, imidiya iya kulayishwa kwaye imisebenzi iya kubhengezwa. Iindawo zokukhangela ziya kulayishwa kwaye imodeli iya kwakhiwa. Emva kokudala inkohliso enzulu, iindlela ezimbini ezahlukeneyo zoopopayi ziya kuboniswa.
UPutin udlalwa ziintshukumo zika-Obama esebenzisa indawo ephambili yokufuduswa. Indlela iimvakalelo zobuso buka-Obama kunye nolwimi lomzimba ziboniswa kakuhle kwaye ngokucacileyo kuPutin ngexesha levidiyo yakhe iyamangalisa.
Kukho iimpazamo ezincinci ezincinci, ngakumbi xa u-Obama ephakamisa amashiya kwaye eqhwanyaza amehlo akhe. Ezi nkcazo azifani ncam kwizakhelo zikaPutin.
Ngaphandle kwe-deepfake backdrop, ifilimu kaPutin iya kubonakala ithembekile kwaye iyinyani ukuba ibinokujongwa kwiTV okanye. Imidiya yokuncokola.
Ukwenziwa kwemodeli
Ngoku, siza kusebenzisa iindawo zokukhangela eziqeqeshwe kwangaphambili ukwenza imodeli epheleleyo.
Ukubhaqwa okunzulu
I-Relative keypoint displacement isetyenziselwa uku-animate izinto ezikwiseli engezantsi. Iseli elandelayo isebenzisa ulungelelwaniso olupheleleyo endaweni yoko, kodwa yonke imilinganiselo yezinto iya kuthathwa kwividiyo yokuqhuba ngale ndlela.
Ukuphucula imveliso usebenzisa ulungelelwaniso olupheleleyo
Uya kuba nakho ukuphuhlisa ubhaqo olunzulu ngale ndlela.
Yeyiphi imingcipheko yeTekhnoloji ye-Deepfake?
Iividiyo ezinzulu ngoku zibandakanya kwaye ziyonwabisa ukubukela ngenxa yobutsha bazo. Nangona kunjalo, kukho umngcipheko onokuthi uphume kulawulo olele phantsi kobu buchwepheshe bubonakala buhlekisa.
Ngokuqinisekileyo kuya kuba ngumceli mngeni ukwahlula phakathi kweevidiyo ezingeyonyani kunye nezokwenyani njenge Itekhnoloji enzulu iqhubeleka phambili. Kubantu abadumileyo kunye nabantu abadumileyo, ngakumbi, oku kunokuba neziphumo ezibi. Ii-Deepfakes ezikhohlakele ngabom zinamandla okonakalisa ngokupheleleyo imisebenzi kunye nobomi.
Ezi zinokusetyenziswa ngumntu onenjongo embi yokudlulisela kwabanye kwaye athathe ithuba kubahlobo bakhe, izalamane kunye nabo basebenza nabo. Bakwayakwazi ukuvusa iingxabano zehlabathi kunye neemfazwe kusetyenziswa iifilimu zobuqhetseba zeenkokeli zamanye amazwe.
isiphelo
Isishwankathelo, sikwixesha elingaqhelekanga kunye nendawo engaqhelekanga. Kunanini na ngaphambili, kulula ukuvelisa iindaba zobuxoki kunye neefilimu kunye nokuzisasaza. Ukuqonda into eyinyani kunye nento engeyiyo kuya kuba nzima ngakumbi.
Namhlanje, kubonakala ngathi asinakukwazi ukuthembela kwiingqondo zethu.
Ngaphandle kwento yokuba iividiyo zobuxoki ziye zaphuhliswa, ngumcimbi nje wexesha ngaphambi kokuba umsantsa wolwazi ube mxinwa kangangokuba nezona zichongi zigqwesileyo zobuxoki aziyi kukwazi ukugqiba ukuba ividiyo iyinyani okanye hayi.
Shiya iMpendulo