I-Neural rendering bubuchule obuvelayo bokufunda nzulu obujolise ekwandiseni umbhobho wakudala wemizobo yekhompyuter enothungelwano lwe-neural.
I-algorithm yonikezelo lwe-neural iya kufuna isethi yemifanekiso emele ii-engile ezahlukeneyo zesimo esifanayo. Le mifanekiso iya kuthi emva koko ifakwe kwinethiwekhi ye-neural ukwenza imodeli enokuthi ikhuphe ii-engile ezintsha zesimo esifanayo.
Ubukhazikhazi obusemva konikezelo lwe-neural bulele kwindlela enokwenza ngayo ngokuchanekileyo imiboniso yefotorealistic eneenkcukacha ngaphandle kokuxhomekeka kwiindlela zeklasiki ezinokuthi zibe yimfuneko ngakumbi.
Phambi kokungena kwindlela esebenza ngayo i-neural rendering, makhe sijonge iziseko zonikezelo lwakudala.
Yintoni i-Classical Rendering?
Masiqale siqonde iindlela eziqhelekileyo ezisetyenziswa kunikezelo lwakudala.
Unikezelo lwakudala lubhekisa kwiseti yeendlela ezisetyenzisiweyo ukwenza umfanekiso we-2D wescene enomacala amathathu. Ikwabizwa ngokuba yi-image synthesis, unikezelo lwakudala lusebenzisa ii-algorithms ezahlukeneyo ukulinganisa indlela ukukhanya okuhlangana ngayo neendidi ezahlukeneyo zezinto.
Umzekelo, ukwenza isitena esiluqilima kuya kufuna isethi ethile ye-algorithms ukumisela indawo yesithunzi okanye ukuba kukhanyiswe kangakanani na icala ngalinye eludongeni. Ngokufanayo, izinto ezibonisa okanye ezibonisa ukukhanya, njengesipili, into ekhanyayo, okanye amanzi amaninzi, ziya kufuna iindlela zabo zobugcisa.
Kunikezelo lwakudala, i-asethi nganye imelwe nge-polygon mesh. Inkqubo ye-shader iya kuthi emva koko isebenzise i-polygon njengegalelo ukumisela ukuba into iya kujongeka njani na xa inikwe ukukhanya okuchaziweyo kunye ne-engile.
Unikezelo oluyinyani luya kufuna amandla okubala ngakumbi kuba ii-asethi zethu ziphela zinezigidi zeepolygons zokuzisebenzisa njengegalelo. Imveliso eyenziwe ngekhompyuter eqhelekileyo kwiibhlobhusta zaseHollywood ihlala ithatha iiveki okanye iinyanga ukuyinikezela kwaye inokubiza izigidi zeedola.
Indlela yokulandela imitha ixabisa kakhulu kuba ipikseli nganye ekumfanekiso wokugqibela ifuna ukubalwa kwendlela yokukhanya esuka kumthombo wokukhanya ukuya kwinto nakwikhamera.
Ukuqhubela phambili kwihardware kwenze ukuba imizobo ifikeleleke ngakumbi kubasebenzisi. Umzekelo, uninzi lwamva nje Iimidlalo yevidiyo vumela iziphumo ezilandelwa yi-ray ezifana nokubonakaliswa kwe-photo-realistic kunye nezithunzi ukuba nje i-hardware yazo iphezulu kumsebenzi.
IiGPU zamva nje (iiyunithi zokusetyenzwa kwemizobo) zakhiwe ngokukodwa ukunceda i-CPU ukubamba izibalo ezintsonkothileyo ezifunekayo ukunika imizobo eyinyani yefoto.
Ukunyuka kweNeural Rendering
Unikezelo lwe-Neural luzama ukujongana nengxaki yonikezelo ngendlela eyahlukileyo. Endaweni yokusebenzisa ii-algorithms ukulinganisa indlela ukukhanya okuhlangana ngayo nezinto, kuthekani ukuba sidale imodeli efunda ukuba umboniso kufuneka ujongeke njani kwi-engile ethile?
Unokucinga ngayo njengendlela emfutshane yokwenza imiboniso ye-photorealistic. Ngonikezelo lwe-neural, akufuneki ukubala ukuba ukukhanya kudibana njani nento, sifuna nje idatha yoqeqesho eyaneleyo.
Le ndlela ivumela abaphandi ukuba benze unikezelo olukumgangatho ophezulu wemiboniso enzima ngaphandle kokwenza
Ziziphi iindawo zeNeural?
Njengoko bekutshiwo ngaphambili, uninzi lwabanikezeli be-3D basebenzisa i-polygon meshes ukugcina idatha kwimilo kunye nokwakheka kwento nganye.
Nangona kunjalo, amasimi e-neural afumana ukuthandwa njengenye indlela yokumela izinto ezinomacala amathathu. Ngokungafaniyo ne-polygon meshes, imimandla ye-neural iyahlukana kwaye iyaqhubeka.
Sithetha ukuthini xa sisithi imimandla ye-neural iyahluka?
Imveliso ye-2D evela kwi-neural field ngoku inokuqeqeshwa ukuba ibe yi-photorealistic ngokuhlenga-hlengisa iintsimbi zothungelwano lwe-neural.
Sisebenzisa imimandla ye-neural, akusafuneki ukuba silingise ifiziksi yokukhanya ukunika indawo. Ulwazi lwendlela unikezelo lokugqibela oluya kukhanyiswa ngayo ngoku lugcinwe ngokufihlakeleyo ngaphakathi kobunzima bethu inethiwekhi yomnatha.
Oku kusivumela ukuba senze imifanekiso yenoveli kunye neevidiyo ngokukhawuleza ukusuka kwiifoto nje ezimbalwa okanye ividiyo.
Indlela yokuqeqesha i-Neural Field?
Ngoku siyazi iziseko zendlela icandelo le-neural elisebenza ngayo, makhe sijonge indlela abaphandi abakwazi ngayo ukuqeqesha i-neural radiance field okanye NeRF.
Okokuqala, kuya kufuneka senze isampulu yolungelelwaniso olungakhethiyo lwendawo kwaye sondle kwinethiwekhi ye-neural. Le nethiwekhi iya kuthi ngoko ikwazi ukuvelisa imiyinge yentsimi.
Izixa zentsimi eziveliswayo zibhekwa njengeesampuli ezivela kwi-domain efunwayo yokwakhiwa kwakhona kwendawo esifuna ukuyidala.
Emva koko kuya kufuneka senze imaphu yolwakhiwo kwimifanekiso eyi-2D. I-algorithm iya kubala impazamo yokwakhiwa kwakhona. Le mpazamo iya kukhokela inethiwekhi ye-neural ukwandisa ukukwazi kwayo ukwakha kwakhona indawo.
Usetyenziso lweNeural Rendering
I-Novel View Synthesis
Ukuhlanganiswa kwembono yenoveli kubhekiselele kumsebenzi wokudala iimbono zekhamera ukusuka kwii-engile ezintsha usebenzisa idatha esuka kwinani eliqingqiweyo leembono.
Ubuchwephesha bonikezelo lwe-Neural buzama ukuqikelela indawo enxulumene nekhamera kumfanekiso ngamnye kwidathasethi kwaye yondle loo datha kwinethiwekhi ye-neural.
Inethiwekhi ye-neural iya kuthi emva koko idale umboniso we-3D wendawo apho indawo nganye kwindawo ye-3D inombala ohambelanayo kunye nobuninzi.
Ukuphunyezwa okutsha kwe-NeRFs kwi Street View Google isebenzisa indlela yokujonga inoveli ukuvumela abasebenzisi ukuba baphonononge iindawo zehlabathi zokwenyani ngokungathi balawula ikhamera ethatha ividiyo. Oku kuvumela abakhenkethi ukuba baphonononge iindawo ekusingwa kuzo ngendlela entywilayo phambi kokuba bathathe isigqibo sokuya kwindawo ethile.
Ii-avatar zokwenyani zefoto
Ubuchwephesha obukwinqanaba eliphambili ekunikezelweni kwe-neural kusenokuvula indlela yee-avatar zedijithali ezinokwenyani. Ezi avatar zinokusetyenziselwa iindima ezahlukeneyo njengabancedisi abanyanisekileyo okanye inkonzo yabathengi, okanye njengendlela yabasebenzisi yokufaka ukufana kwabo umdlalo yevidiyo okanye unikezelo olufanisiweyo.
Umzekelo, a iphepha epapashwe ngoMatshi ka-2023 icebisa ukusebenzisa ubuchule bokunikezela nge-neural ukwenza i-avatar eyinyani yefoto emva kwemizuzu embalwa yomboniso wevidiyo.
isiphelo
Ukunikezelwa kwe-Neural yinkalo enomdla yokufunda enokuthi itshintshe yonke imboni yemizobo yekhompyuter.
Itekhnoloji inokunciphisa umqobo wokungena ekudalweni kwe-asethi ye-3D. Amaqela eziphumo zokubonwayo akusayi kufuneka ukuba alinde iintsuku ukuze anike imizuzu embalwa yemizobo eyinyani.
Ukudibanisa itekhnoloji kunye ne-VR esele ikhona kunye nezicelo ze-AR zinokuvumela abaphuhlisi ukuba benze amava antywilayo ngakumbi.
Ucinga ukuba yintoni enokwenzeka yokwenene yonikezelo lwe-neural?
Shiya iMpendulo