Table of Contents[Hide][Show]
Nws tsis yog tshiab kom muaj cov duab cuav thiab yeeb yaj kiab. Txij li thaum muaj kev siv internet dav dav, cov tib neeg tau tsim kev dag ntxias lossis kev lom zem txij li thaum muaj cov duab thiab yeeb yaj kiab.
Txawm li cas los xij, muaj ib hom tshiab ntawm lub tshuab tsim cov khoom cuav uas tej zaum yuav ua rau nws nyuaj rau peb kom paub qhov txawv ntawm qhov tseeb ntawm cov ntawv tseeb.
Cov fakes no txawv ntawm cov duab yooj yim manipulations generated los ntawm editing software xws li Photoshop los yog cleverly manipulated films yav dhau los.
Deepfakes yog cov piv txwv zoo tshaj plaws ntawm "synthetic media" - cov duab, suab, thiab cov yeeb yaj kiab uas zoo li tau tsim los siv cov txheej txheem ib txwm siv tab sis tau ua tiag tiag siv software sophisticated.
Deepfakes tau nyob ib ntus, thiab thaum lawv daim ntawv thov nrov tshaj plaws tseem tau muab lub taub hau ntawm cov neeg nto moo rau lub cev ntawm cov neeg ua yeeb yam hauv cov yeeb yaj kiab duab liab qab, lawv muaj peev xwm tsim cov duab zoo nkauj ntawm txhua tus neeg ua dab tsi, nyob qhov twg.
Hauv tsab xov xwm no, peb yuav saib Deepfakes, nws ua haujlwm li cas, koj tuaj yeem tsim lawv li cas ntawm koj tus kheej, thiab ntau ntxiv.
Yog li, DeepFake yog dab tsi?
Ib qho kev sib sib zog nqus-ua ke ntawm cov kab lus sib sib zog nqus kev kawm thiab cuav-yog ib qho ntawm hluavtaws media nyob rau hauv uas qhov zoo ib yam ntawm lwm tus neeg yog siv los hloov tus neeg nyob rau hauv ib tug twb-existed duab los yog video.
Deepfakes ntiav cov kev kawm tshuab txawj ntse thiab cov txuj ci txuj ci dag kom hloov kho thiab tsim cov ntaub ntawv pom thiab lub suab uas muaj peev xwm ua rau kev dag ntxias.
Cov kev kawm sib sib zog nqus zoo li autoencoders thiab generative adversarial networks yog cov txheej txheem tseem ceeb rau kev tsim khoom sib sib zog nqus (GAN).
Cov qauv no yog siv los txheeb xyuas tus neeg lub ntsej muag lub ntsej muag thiab kev txav mus los thiab sib txuas cov duab ntsej muag ntawm lwm tus neeg uas qhia txog kev sib piv thiab kev txav.
Kev siv cov yeeb yaj kiab zoo nkauj hauv cov yeeb yaj kiab duab liab qab, xov xwm cuav, kev dag ntxias, thiab kev dag nyiaj txiag tau ua rau muaj kev xav ntau. Ob qho kev lag luam thiab tsoomfwv tau teb los ntawm kev sim nrhiav lawv thiab txwv lawv txoj kev siv.
Thawj Order Motion Model
Thaum sim tsim kev sib sib zog nqus fakes yav dhau los, qhov teeb meem yog tias peb xav tau qee yam kev paub ntxiv, lossis ua ntej, rau cov kev ua haujlwm no.
Raws li ib qho piv txwv, yuav tsum muaj cov cim ntsej muag yog tias peb xav taug qab lub taub hau txav. Pose kwv yees yog qhov tsim nyog yog tias peb xav ua daim ntawv qhia tag nrho lub cev.
Qhov ntawd tau hloov pauv ntawm NeurIPS lub rooj sib tham xyoo tas los thaum pab pawg tshawb fawb los ntawm University of Toronto nthuav qhia lawv txoj haujlwm, "Thawj Order Motion Model rau Duab Animation. "
Tsis muaj kev paub ntxiv ntawm cov animation yog qhov tsim nyog rau txoj hauv kev no. Tsis tas li ntawd, tom qab cov qauv no tau raug cob qhia, nws tuaj yeem siv rau kev hloov pauv kev kawm thiab siv rau txhua yam khoom poob rau hauv tib qeb.
Cia peb saib ntawm txoj haujlwm no me ntsis ntxiv. Motion Extraction thiab Generation ua rau thawj ib nrab ntawm tag nrho cov txheej txheem. Kev tsav tsheb video thiab cov duab los yog siv los ua cov khoom siv.
Txhawm rau rho tawm thawj qhov kev txiav txim siab sawv cev, uas muaj cov ntsiab lus tseem ceeb tsis sib xws thiab cov kev hloov pauv hauv zos affine, lub suab extractor siv autoencoder los txheeb xyuas cov ntsiab lus tseem ceeb.
Txhawm rau tsim cov duab deverical ntws thiab occlusion daim ntawv qhia nrog cov lus qhia txog kev siv hluav taws xob, lawv tau ua haujlwm nrog kev tsav video. Lub tshuab hluav taws xob ces muab cov duab phiaj siv cov txiaj ntsig los ntawm cov lus siv hluav taws xob tuab thiab cov duab.
Thoob plaws hauv lub rooj tsavxwm, txoj haujlwm no ua tau zoo dua li lub xeev ntawm kev kos duab. Nws kuj muaj cov yam ntxwv uas lwm cov qauv tsuas yog tsis muaj. Nws ua haujlwm ntawm ntau hom duab, yog li koj tuaj yeem siv nws rau cov duab ntawm lub ntsej muag, lub cev, cartoons, thiab lwm yam, uas yog qhov zoo heev.
Ntau lub sijhawm tshiab yog tsim los ntawm qhov no. Lwm qhov tseem ceeb ntawm peb lub tswv yim yog tias tam sim no tso cai rau koj los tsim cov khoom zoo Deepfakes siv tsuas yog ib daim duab ntawm lub hom phiaj khoom, zoo ib yam li peb ua nrog. YOLO rau khoom paub.
Txheej txheem ntawm Tsim Deepfake qauv
Peb txheej txheem yog tsim nyog rau kev sib sib zog nqus fake tiam: extraction, kev cob qhia, thiab creation. Cov ntsiab lus tseem ceeb ntawm txhua theem no thiab seb lawv cuam tshuam li cas rau tag nrho cov txheej txheem yuav raug suav nrog hauv ntu no.
Extraction
Deepfakes siv sib sib zog nqus neural tes hauj lwm los hloov lub ntsej muag thiab xav tau ntau cov ntaub ntawv (duab) los ua haujlwm kom raug thiab ntseeg tau. Cov txheej txheem rho tawm yog theem nyob rau hauv uas tag nrho cov thav duab los ntawm cov yeeb yaj kiab clips raug rho tawm, lub ntsej muag raug lees paub, thiab lub ntsej muag tom qab ntawd ua raws li kev ua tau zoo tshaj plaws.
Kev kawm
Nyob rau theem kev cob qhia, lub neural network tuaj yeem hloov ib lub ntsej muag mus rau lwm qhov. Nyob ntawm qhov luaj li cas ntawm cov txheej txheem thiab cov cuab yeej kev cob qhia, kev cob qhia tuaj yeem siv sijhawm ob peb teev lossis ib hnub.
Kev cob qhia tsuas yog yuav tsum tau ua tiav ib zaug, zoo ib yam li lwm yam kev cob qhia neural network. Tom qab kev cob qhia, tus qauv yuav tuaj yeem hloov lub ntsej muag ntawm tus neeg A mus rau tus neeg B.
creation
Tom qab tus qauv tau raug cob qhia, ib qho kev sib sib zog nqus yuav raug tsim. Ncej yog muab los ntawm ib tug yees duab thiab ces dlhos mus rau tag nrho cov ntsej muag. Kev cob qhia neural network yog siv los hloov txhua tus ncej.
Lub ntsej muag hloov pauv yuav tsum tau muab sib xyaw nrog tus ncej qub raws li cov kauj ruam kawg.
Tsev Deepfake Detection Model
Mounting thiab Cloning GitHub Repo
Muaj peev xwm siv Google's GPUs dawb thaum ua haujlwm ntawm Colab yog qhov zoo rau kawm tob. Ib qho ntxiv kom zoo dua yog lub peev xwm ntawm kev txhim kho Google Drive ntawm huab virtual tshuab (VM).
Nrog kev nkag tau yooj yim rau tag nrho nws cov khoom, tus neeg siv tau qhib. Qhov kev zov me nyuam xav tau los txuas Google Drive rau lub tshuab virtual hauv huab yuav pom nyob rau hauv ntu no.
Importing Modules
Tam sim no, peb yuav import tag nrho cov tsim nyog modules.
Ua tus qauv
Peb mam li siv ib qho piv txwv uas muab ib daim duab tseem ceeb ntawm Putin (qhov chaw daim duab) nrog ib daim vis dis aus ntawm Obama. Qhov tshwm sim yog ib daim vis dis aus ntawm Putin hais lus thiab gesticulating nrog tib lub ntsej muag uas Obama siv thaum tsav tsheb.
Ua ntej tso tawm qhov tshwm sim ntawm tus qauv, cov xov xwm yuav raug thauj khoom thiab cov haujlwm yuav raug tshaj tawm. Cov chaw kuaj xyuas yuav raug thauj khoom thiab cov qauv yuav raug tsim. Tom qab tsim qhov sib sib zog nqus fake, ob qhov sib txawv ntawm cov animation yuav tshwm sim.
Putin yog animated los ntawm Obama txoj kev txav uas siv cov txheeb ze tseem ceeb hloov chaw. Txoj kev Obama lub ntsej muag lub ntsej muag thiab lub cev lus tau piav qhia zoo nkauj thiab meej rau Putin thaum nws cov yeeb yaj kiab yog qhov xav tsis thoob.
Muaj ob peb qhov yuam kev me me, tshwj xeeb tshaj yog thaum Obama tsa nws ob lub qhov muag thiab nws lub qhov muag. Cov kab lus no tsis yog replicated nyob rau hauv Putin tus ncej.
Yog tsis muaj qhov cuam tshuam tob tob, cov yeeb yaj kiab Putin yuav tshwm sim kom ntseeg tau thiab muaj tseeb yog tias nws yuav tsum tau saib hauv TV lossis kev tawm.
Qauv tsim
Tam sim no, peb yuav tau siv cov chaw kuaj xyuas ua ntej los tsim cov qauv ua tiav.
Deepfake nrhiav pom
Relative keypoint displacement yog siv los ua kom cov khoom hauv lub cell hauv qab no. Lub xovtooj tom ntej no siv cov kev sib koom ua tiav, tab sis tag nrho cov khoom sib faib yuav raug coj los ntawm kev tsav tsheb hauv cov qauv no.
Txhim kho cov zis siv cov kev tswj xyuas meej
Koj yuav muaj peev xwm txhim kho qhov kev tshawb nrhiav tob tob hauv qhov no.
Dab tsi yog qhov txaus ntshai ntawm Deepfake Technology?
Deepfake cov yeeb yaj kiab tam sim no tau koom nrog thiab lom zem saib vim lawv qhov tshiab. Txawm li cas los xij, muaj kev pheej hmoo uas tuaj yeem tawm ntawm kev tswj hwm nyob hauv qab ntawm qhov zoo li kev siv thev naus laus zis no.
Nws yeej yuav nyuaj kom paub qhov txawv ntawm cov yeeb yaj kiab cuav thiab tiag tiag li deepfake tshuab txuas ntxiv mus. Rau cov neeg tseem ceeb thiab cov neeg muaj koob muaj npe, tshwj xeeb, qhov no yuav muaj kev cuam tshuam loj heev. Deepfakes uas txhob txwm ua phem muaj peev xwm ua kom puas tsuaj rau txoj haujlwm thiab lub neej.
Cov no tuaj yeem siv los ntawm ib tus neeg uas muaj lub siab xav dhau mus rau lwm tus thiab coj kom zoo dua ntawm lawv cov phooj ywg, cov txheeb ze, thiab cov neeg ua haujlwm. Lawv kuj muaj peev xwm ua rau muaj kev sib cav thoob ntiaj teb thiab txawm tias kev tsov rog siv cov yeeb yaj kiab ntawm cov thawj coj txawv teb chaws.
xaus
Hauv cov ntsiab lus, peb nyob hauv lub sijhawm txawv txawv thiab ib puag ncig txawv txawv. Ntau dua puas tau, nws yooj yim los tsim cov xov xwm cuav thiab yeeb yaj kiab thiab nthuav tawm lawv. Kev nkag siab qhov tseeb thiab qhov tsis yog yog qhov nyuaj zuj zus.
Niaj hnub no, nws tshwm sim, peb tsis tuaj yeem tso siab rau peb tus kheej lub siab.
Txawm hais tias qhov tseeb tias cov cuab yeej yees duab cuav tau tsim los, nws tsuas yog ib qho teeb meem ntawm lub sijhawm ua ntej cov ntaub ntawv sib txawv yog nqaim heev uas txawm tias qhov zoo tshaj plaws fake detectors yuav tsis tuaj yeem txiav txim siab seb cov vis dis aus yog tiag lossis tsis.
Sau ntawv cia Ncua