Ukunikezwa kwe-Neural kuyindlela evelayo yokufunda okujulile ehlose ukukhulisa ipayipi lakudala lemifanekiso yekhompyutha ngamanethiwekhi emizwa.
I-neural rendering algorithm izodinga isethi yezithombe ezimele ama-engeli ahlukene esigcawu esifanayo. Lezi zithombe zizobe sezifakwa kunethiwekhi ye-neural ukuze kwakhiwe imodeli engakhipha ama-engeli amasha esigcawu esifanayo.
Ubuhlakani obusemuva kwe-neural rendering bulele ekutheni ingaphinda idale kanjani ngokunembile izigcawu ezinemininingwane ye-photorealistic ngaphandle kokuncika ezindleleni zakudala ezingase zidinge kakhulu ngokwekhompyutha.
Ngaphambi kokungena kokuthi i-neural rendering isebenza kanjani, ake sihlole izisekelo zokuhumusha kwakudala.
Iyini i-Classical Rendering?
Ake siqale siqonde izindlela ezijwayelekile ezisetshenziswa ekuhumusheni kwakudala.
Ukunikezwa kwakudala kubhekisela kusethi yamasu asetshenziswa ukudala isithombe se-2D sesigcawu esinezinhlangothi ezintathu. Okwaziwa nangokuthi ukuhlanganiswa kwesithombe, ukuhumusha kwakudala kusebenzisa ama-algorithms ahlukahlukene ukuze kulingise ukuthi ukukhanya kuhlangana kanjani nezinhlobo ezihlukile zezinto.
Isibonelo, ukunikeza isitini esiqinile kuzodinga isethi ethile yama-algorithms ukuze kunqunywe indawo yesithunzi noma ukuthi yiluphi uhlangothi lodonga luzokhanya kahle kangakanani. Ngokufanayo, izinto ezibonisa noma ezihlanza ukukhanya, njengesibuko, into ecwebezelayo, noma amanzi amaningi, zizodinga amasu azo nawo.
Ekunikezeni kwakudala, impahla ngayinye imelwe nge-polygon mesh. Uhlelo lwe-shader luzobe selusebenzisa i-polygon njengokufaka ukuze lunqume ukuthi into izobukeka kanjani uma kubhekwa ukukhanya okucacisiwe ne-engeli.
Ukunikezwa okungokoqobo kuzodinga amandla amaningi okubala njengoba izimpahla zethu zigcina zinezigidi zamapholigoni ukuze zisetshenziswe njengokufaka. Okuphumayo okukhiqizwa ngekhompuyutha okuvamile kuma-blockbuster aseHollywood ngokuvamile kuthatha amasonto noma ngisho izinyanga ukwenza futhi kungabiza izigidi zamaRandi.
Indlela yokulandelela ama-ray ibiza kakhulu ngoba iphikseli ngayinye esesithombeni sokugcina idinga ukubalwa kwendlela ukukhanya okuthatha kusukela emthonjeni wokukhanya kuya entweni nasekhamera.
Ukuthuthuka kwehadiwe kwenze ihluzo ezinikezela ukuthi zifinyeleleke kakhulu kubasebenzisi. Ngokwesibonelo, eziningi zakamuva amageyimu evidiyo vumela imiphumela elandelelwe ngama-ray njengokuboniswa kwesithombe namathunzi inqobo nje uma izingxenyekazi zekhompuyutha zazo ziphezu komsebenzi.
Ama-GPU akamuva (amayunithi okucubungula izithombe) akhelwe ngokukhethekile ukusiza i-CPU ukuthi ibambe izibalo eziyinkimbinkimbi kakhulu ezidingekayo ukuze inikeze imifanekiso engokoqobo yesithombe.
Ukunyuka Kokunikezwa Kwe-Neural
Ukunikezwa kwe-Neural kuzama ukubhekana nenkinga yokunikezela ngendlela ehlukile. Esikhundleni sokusebenzisa ama-algorithms ukuze silingise indlela ukukhanya okuhlangana ngayo nezinto, kuthiwani uma sidale imodeli efunda ukuthi isigcawu kufanele sibukeke kanjani endaweni ethile?
Ungacabanga ngakho njengesinqamuleli sokudala izigcawu ze-photorealistic. Ngokunikezwa kwe-neural, asikho isidingo sokubala ukuthi ukukhanya kuhlangana kanjani nento, sidinga idatha eyanele yokuqeqeshwa.
Le ndlela ivumela abacwaningi ukuthi bakhe ukunikezwa kwekhwalithi ephezulu kwezigcawu eziyinkimbinkimbi ngaphandle kokwenza
Yiziphi izinkambu ze-Neural?
Njengoba kushiwo ngaphambili, iningi labanikezeli be-3D lisebenzisa ama-polygon meshes ukugcina idatha ngesimo nokuthungwa kwento ngayinye.
Kodwa-ke, izinkambu ze-neural zithola ukuduma njengenye indlela yokumela izinto ezinezinhlangothi ezintathu. Ngokungafani nama-polygon meshes, izinkambu ze-neural ziyahlukaniswa futhi ziyaqhubeka.
Sisho ukuthini uma sithi izinkambu ze-neural ziyahlukaniswa?
Umphumela we-2D ovela kunkambu ye-neural manje ungaqeqeshelwa ukuba yi-photorealistic ngokumane ulungise izisindo zenethiwekhi ye-neural.
Sisebenzisa izinkambu ze-neural, asisadingi ukulingisa i-physics yokukhanya ukuze sinikeze isigcawu. Ulwazi lokuthi i-render yokugcina izokhanyiswa kanjani manje lugcinwe ngokuphelele ngaphakathi kwezisindo zethu inethiwekhi ye-neural.
Lokhu kusivumela ukuthi sakhe izithombe zenoveli namavidiyo ngokushesha ukusuka ezithombeni ezimbalwa noma amavidiyo.
Indlela Yokuqeqesha I-Neural Field?
Manje njengoba sesazi izisekelo zendlela inkambu ye-neural esebenza ngayo, ake sibheke ukuthi abacwaningi bakwazi kanjani ukuqeqesha inkambu yokukhanya kwe-neural noma I-NeRF.
Okokuqala, sizodinga ukuthatha isampula yezixhumanisi ezingahleliwe zesigcawu futhi siphakele kunethiwekhi ye-neural. Le nethiwekhi izobe isikwazi ukukhiqiza amanani enkambu.
Amanani enkundla akhiqiziwe abhekwa njengamasampula asuka esizindeni sokwakha kabusha esifiselekayo sesehlakalo esifuna ukusidala.
Sizobe sesidinga ukumaka ukwakhiwa kabusha ezithombeni zangempela ze-2D. I-algorithm izobe isibala iphutha lokwakha kabusha. Leli phutha lizoqondisa inethiwekhi ye-neural ukuze ithuthukise amandla ayo okwakha kabusha isigameko.
Izicelo Zokunikezela Nge-Neural
I-Novel View Synthesis
Ukuhlanganiswa kokubuka kwenoveli kubhekisela emsebenzini wokudala imibono yekhamera ngama-engeli amasha kusetshenziswa idatha esuka kwinani elilinganiselwe lemibono.
Amasu okunikezela nge-Neural azama ukuqagela indawo ehlobene yekhamera yesithombe ngasinye kudathasethi futhi ifake leyo datha kunethiwekhi ye-neural.
Inethiwekhi ye-neural izobe isidala ukumelwa kwe-3D kwesigcawu lapho iphuzu ngalinye esikhaleni se-3D linombala ohlobene nokuminyana.
Ukuqaliswa okusha kwe-NeRFs ku Google Street View isebenzisa ukuhlanganiswa kokubuka kwenoveli ukuvumela abasebenzisi ukuthi bahlole izindawo zomhlaba wangempela njengokungathi balawula ikhamera ethatha ividiyo. Lokhu kuvumela izivakashi ukuthi zihlole izindawo okuyiwa kuzo ngendlela egxilile ngaphambi kokuthatha isinqumo sokuya endaweni ethile.
Izithombe ezingokoqobo
Amasu athuthukile ekunikezelweni kwe-neural angaphinda avule indlela yama-avatar edijithali angokoqobo. Lezi zithombe zingase zisetshenziselwe izindima ezahlukahlukene njengabasizi ababonakalayo noma isevisi yamakhasimende, noma njengendlela yokuthi abasebenzisi bafake ukufana kwabo umdlalo we video noma ukunikezwa okulingiswayo.
Isibonelo, a iphepha eshicilelwe ngoMashi 2023 iphakamisa ukusebenzisa amasu okunikezela nge-neural ukuze udale isithombe esingokoqobo ngemva kwemizuzu embalwa yokuqoshwa kwevidiyo.
Isiphetho
I-Neural rendering iwumkhakha wokufunda othokozisayo onamandla okushintsha yonke imboni yezithombe zekhompyutha.
Ubuchwepheshe bunganciphisa umgoqo wokungena ekudalweni kwezimpahla ze-3D. Amathimba wemiphumela ebonakalayo angeke kusadingeka alinde izinsuku ukuze anikeze imizuzu embalwa yezithombe ezingokoqobo.
Ukuhlanganisa ubuchwepheshe nezinhlelo zokusebenza ezikhona ze-VR ne-AR kungase futhi kuvumele onjiniyela ukuthi bakhe ukuzizwisa okugxile kakhulu.
Ucabanga ukuthi yiliphi ithuba leqiniso lokunikezwa kwe-neural?
shiya impendulo