Kungumsebenzi obalulekile futhi ofiselekayo embonweni wekhompuyutha kanye nemifanekiso ukukhiqiza amafilimu e-portrait anobuciko eqophelo eliphezulu kakhulu.
Nakuba kuye kwahlongozwa amamodeli amaningana asebenzayo we-portrait image toonification asekelwe ku-StyleGAN enamandla, lezi zindlela ezigxile ezithombeni zinezihibe ezicacile uma zisetshenziswa namavidiyo, njengosayizi wozimele ongashintshi, imfuneko yokuqondanisa ubuso, ukungabikho kwemininingwane engeyona yobuso. , kanye nokungahambisani kwesikhashana.
Uhlaka lwe-VToonify oluguquguqukayo lusetshenziselwa ukubhekana nokudluliswa kwesitayela sevidiyo enokucaca okuphezulu okulawulwayo.
Sizohlola ucwaningo lwakamuva kakhulu nge-VToonify kulesi sihloko, okuhlanganisa ukusebenza kwayo, izithiyo, nezinye izici.
Yini i-Vtoonify?
Uhlaka lwe-VToonify luvumela ukudluliswa kwesitayela sevidiyo enokucaca okuphezulu okwenziwa ngokwezifiso.
I-VToonify isebenzisa izendlalelo ezimaphakathi neziphezulu ze-StyleGAN ukuze idale izithombe ezisezingeni eliphezulu zobuciko ezisuselwa kuzici zokuqukethwe ezinezilinganiso eziningi ezibuyiswe isishumeki ukuze kugcinwe imininingwane yozimele.
Umphumela wezakhiwo oguquguqukayo ngokugcwele uthatha ubuso obungaqondile kumamuvi anosayizi oguquguqukayo njengokufakwayo, okuholela ezifundeni ezinobuso obuphelele ezinokunyakaza kwangempela kokuphumayo.
Lolu hlaka luhambisana namamodeli amanje asuselwa ku-StyleGAN ezithombe zokukhanyisa, eziwavumela ukuthi anwetshwe ku-toonification yevidiyo, futhi azuze njengefa izici ezikhangayo njengombala olungisekayo nokuqina ngokwezifiso.
Lokhu cwaningo yethula izethulo ezimbili ze-VToonify ezisuselwe ku-Toonify kanye ne-DualStyleGAN zokudlulisa isitayela sevidiyo esuselwe eqoqweni nesekelwe kusibonelo, ngokulandelana.
Okutholwe okubanzi kokuhlola kubonisa ukuthi uhlaka oluhlongozwayo lwe-VToonify ludlula izindlela ezikhona zokwenza amamuvi wesithombe sobuciko wekhwalithi ephezulu, ahambisana nesikhashana anemingcele yesitayela esihlukile.
Abacwaningi banikeza i I-notebook ye-Google Colab, ukuze ungcolise izandla zakho kuso.
Isebenza kanjani?
Ukuze kufezwe ukudluliswa kwesitayela sevidiyo enokucaca okuphezulu okulungisekayo, i-VToonify ihlanganisa izinzuzo zohlaka lokuhumusha isithombe nohlaka olusekelwe ku-StyleGAN.
Ukuze kuhlangatshezwane nosayizi abahlukahlukene bokufakwayo, isistimu yokuhumusha izithombe isebenzisa amanethiwekhi e-convolutional ngokugcwele. Ukuqeqeshwa kusukela ekuqaleni, ngakolunye uhlangothi, kwenza ukudluliswa kwesitayela esinokulungiswa okuphezulu nokulawulwa kungenzeki.
Imodeli ye-StyleGAN eqeqeshwe kusengaphambili isetshenziswa ohlakeni olusekelwe ku-StyleGAN ukuze kudluliswe isitayela esinokulungiswa okuphezulu nokulawulwayo, nakuba ikhawulelwe kusayizi wesithombe ongashintshi kanye nokulahlekelwa kwemininingwane.
I-StyleGAN ishintshiwe ohlakeni oluxubile ngokususa isici saso sokufaka usayizi ongashintshi kanye nezendlalelo ezinokulungiswa okuphansi, okuholela ekwakhiweni kwe-architecture eguqukayo ngokugcwele yesifaki khodi esifana nesohlaka lokuhumusha isithombe.
Ukuze ulondoloze imininingwane yozimele, qeqesha isifaki khodi ukuze sikhiphe izici zokuqukethwe kwezikali eziningi zozimele wokufaka njengemfuneko yokuqukethwe eyengeziwe kujeneretha. I-Vtoonify izuza njengefa lesitayela sokulawula isitayela semodeli ye-StyleGAN ngokuyifaka kujeneretha ukuze ikhiphe kokubili idatha yayo nemodeli.
Imikhawulo ye-StyleGAN kanye ne-Vtoonify ehlongozwayo
Izithombe zobuciko zivamile ezimpilweni zethu zansuku zonke kanye nasemabhizinisini okudala afana nobuciko, social media ama-avatar, amamuvi, ukukhangisa kwezokuzijabulisa, nokunye.
Ngokuthuthukiswa kwe ukufunda okujulile ubuchwepheshe, manje sekungenzeka ukuthi udale izithombe zobuciko zekhwalithi ephezulu kusuka ezithombeni zobuso bangempela usebenzisa ukudluliswa kwesitayela sokuma ngobude okuzenzakalelayo.
Kunezindlela ezihlukahlukene eziphumelelayo ezidalelwe ukudluliswa kwesitayela okusekelwe ezithombeni, eziningi zazo ezifinyeleleka kalula kubasebenzisi abaqalayo ngezinhlelo zokusebenza zeselula. Izinto zevidiyo seziphenduke insika yokuphakelwa kwethu kwenkundla yezokuxhumana eminyakeni embalwa edlule.
Ukunyuka kwenkundla yezokuxhumana kanye namafilimu esikhathi eside kukhuphule isidingo sokuhlela ividiyo okusha, njengokudluliswa kwesitayela sevidiyo yesithombe, ukuze kukhiqizwe amavidiyo ayimpumelelo nahehayo.
Izindlela ezikhona ezisekelwe ezithombeni zinokungalungi okukhulu uma zisetshenziswa kumamuvi, zikhawulela ukusetshenziswa kwazo ekwenziweni isitayela kwevidiyo ekuma ngobude okuzenzakalelayo.
I-StyleGAN iwumgogodla ovamile wokuthuthukisa imodeli yokudluliswa kwesitayela sesithombe ngenxa yomthamo waso wokudala ubuso bekhwalithi ephezulu ngokuphathwa kwesitayela esilungisekayo.
Isistimu esekelwe ku-StyleGAN (eyaziwa nangokuthi i-toonification yesithombe) ihlanganisa ubuso bangempela kusikhala esicashile se-StyleGAN bese isebenzisa ikhodi yesitayela ewumphumela kwenye i-StyleGAN ecushwe kahle kudathasethi yesithombe sobuciko ukuze kwakhe inguqulo eyenziwe ngesitayela.
I-StyleGAN idala izithombe ezinobuso obuqondile futhi ezinosayizi ongashintshi, ongakhethi ubuso obuguqukayo ezithombeni zomhlaba wangempela. Ukunqampuna kobuso nokuqondanisa kuvidiyo ngezinye izikhathi kubangela ukuba nobuso obuncane kanye nokuthinta okungajwayelekile. Abacwaningi babiza lolu daba 'ngokuvinjelwa kwesivuno esilungisiwe' sika-StyleGAN.
Ngobuso obungaqondile, i-StyleGAN3 ihlongozwa; nokho, isekela kuphela usayizi wesithombe osethiwe.
Ngaphezu kwalokho, ucwaningo lwakamuva luthole ukuthi ukubhala ngekhodi ubuso obungaqondile kuyinselele kakhulu kunobuso obuqondile. Umbhalo wekhodi wobuso ongalungile uyingozi ekudluliselweni kwesitayela sokuma ngobude, okuholela ezinkingeni ezifana nokuguqulwa kobunikazi kanye nezingxenye ezingekho kozimele abakhiwe kabusha nababhalwe isitayela.
Njengoba kuxoxiwe, indlela ephumelelayo yokudluliswa kwesitayela sevidiyo ekuma ngobude kufanele isingathe lezi zinkinga ezilandelayo:
- Ukuze ulondoloze ukunyakaza okungokoqobo, le ndlela kufanele ikwazi ukubhekana nobuso obungaqondile nosayizi abahlukahlukene bevidiyo. Usayizi wevidiyo omkhulu, noma i-engeli ebanzi yokubuka, ingathwebula ulwazi olwengeziwe ngenkathi igcina ubuso bungasuki ohlakeni.
- Ukuze uqhudelane namagajethi e-HD asetshenziswa kakhulu namuhla, ividiyo enokulungiswa okuphezulu iyadingeka.
- Ukulawulwa kwesitayela esivumelana nezimo kufanele kunikelwe ukuze abasebenzisi baguqule futhi bakhethe ukukhetha kwabo lapho bethuthukisa isistimu yokusebenzisana yangempela yomsebenzisi.
Kuleyo njongo, abacwaningi basikisela i-VToonify, uhlaka oluyinhlanganisela lwenoveli lwe-toonification yevidiyo. Ukuze banqobe umkhawulo omisiwe wezitshalo, abacwaningi baqale bafunde ukulingana kokuhumusha ku-StyleGAN.
I-VToonify ihlanganisa izinzuzo zesakhiwo esisekelwe ku-StyleGAN kanye nohlaka lokuhumusha isithombe ukuze kuzuzwe ukudluliswa kwesitayela sevidiyo enokucaca okuphezulu okulungiswayo.
Okulandelayo yiminikelo emikhulu:
- Abacwaningi baphenya isithiyo se-StyleGAN sesivuno esingaguquki futhi baphakamise isisombululo esisekelwe ekulinganeni kokuhumusha.
- Abacwaningi bethula uhlaka oluhlukile oluphelele lwe-VToonify lokudlulisa isitayela sevidiyo esinokulungiswa okuphezulu okulawulwayo okusekela ubuso obungaqondile nosayizi abahlukene bevidiyo.
- Abacwaningi bakha i-VToonify kumgogodla we-Toonify kanye ne-DualStyleGAN futhi bafinyanisa iqolo ngokuya kwakho kokubili idatha nemodeli ukuze banike amandla ukudluliswa kwesitayela sevidiyo esekelwe eqoqweni nesekelwe esibonelo.
Ukuqhathanisa i-Vtoonify namanye amamodeli asezingeni eliphezulu
I-Toonify
Isebenza njengesisekelo sokudluliswa kwesitayela okusekelwe eqoqweni ebusweni obuqondile kusetshenziswa i-StyleGAN. Ukuze ubuyise amakhodi esitayela, abacwaningi kufanele baqondanise ubuso futhi banqampune izithombe ezingu-256256 ze-PSP. I-Toonify isetshenziselwa ukukhiqiza umphumela owenziwe isitayela ngamakhodi esitayela angu-1024*1024.
Ekugcineni, baphinda baqondanise umphumela kuvidiyo endaweni yayo yangempela. Indawo engafakwanga isitayela isethwe ukuze ibe mnyama.
I-DualStyleGAN
Kuwumgogodla wokudluliswa kwesitayela okusekelwe kusibonelo okusekelwe ku-StyleGAN. Basebenzisa amasu afanayo ngaphambi nangemuva kokucubungula idatha njenge-Toonify.
I-Pix2pixHD
Kuyimodeli yokuhumusha isithombe-kuya-isithombe evame ukusetshenziselwa ukufingqa amamodeli aqeqeshwe kusengaphambili ukuze ahlelwe ngokulungiswa okuphezulu. Iqeqeshwa kusetshenziswa idatha ebhanqiwe.
Abacwaningi basebenzisa i-pix2pixHD njengokufakwayo kwemephu eyisibonelo eyengeziwe njengoba isebenzisa imephu yokuhlaziya ekhishiwe.
I-oda Lokuqala Lokunyakaza
I-FOM iyimodeli evamile yokugqwayiza yesithombe. Iqeqeshwe ezithombeni ezingu-256256 futhi ayisebenzi kahle nabanye osayizi bezithombe. Njengomphumela, abacwaningi baqale balinganise amafreyimu evidiyo abe ngu-256*256 ukuze i-FOM ibe opopayi bese beshintsha usayizi wemiphumela ibe usayizi wayo wangempela.
Ukuze kuqhathaniswe okulungile, i-FOM isebenzisa uhlaka lokuqala olwenziwe isitayela lwendlela yayo njengesithombe sesitayela sereferensi.
I-DaGAN
Kuyimodeli yopopayi yobuso be-3D. Basebenzisa izindlela ezifanayo zokulungiselela idatha nezindlela zokuphinda zicutshungulwe njenge-FOM.
Izinzuzo
- Ingaqashwa kwezobuciko, ama-avatar ezinkundla zokuxhumana, amamuvi, ukukhangisa kwezokuzijabulisa, njalonjalo.
- I-Vtoonify ingasetshenziswa futhi ku-metaverse.
Ukulinganiselwa
- Le ndlela yokwenza ikhipha kokubili idatha kanye nemodeli kusukela kumgogodla we-StyleGAN, okuholela kudatha nokuchema kwemodeli.
- Ama-artifact abangelwa kakhulu umehluko wosayizi phakathi kwesifunda sobuso obufakwe isitayela nezinye izigaba.
- Leli su aliphumelelanga kangako uma usebenzelana nezinto ezisesifundeni sobuso.
Isiphetho
Okokugcina, i-VToonify iwuhlaka lwe-toonification yevidiyo elawulwa ngesitayela elawulwa ngesitayela.
Lolu hlaka lufeza ukusebenza okuhle ekuphatheni amavidiyo futhi lunikeze amandla ukulawula okubanzi phezu kwesitayela sesakhiwo, isitayela sombala, kanye neziqu zesitayela ngokufinyanisa amamodeli wezithombe ezisuselwa ku-StyleGAN ngokuya ngazo zombili. idatha yokwenziwa kanye nezakhiwo zenethiwekhi.
shiya impendulo