Okuqukethwe[Fihla][Bonisa]
Sawubona, bewazi yini ukuthi isigcawu se-3D singadalwa kusuka kokufakwayo kwedatha ye-2D ngemizuzwana ngemodeli ye-NVIDIA's Instant NeRF neural rendering, futhi izithombe zaleso sigcawu zinganikezwa ngama-millisecond?
Kungenzeka ukuguqula ngokushesha iqoqo lezithombe ezinganyakazi libe endaweni yedijithali ye-3D usebenzisa indlela eyaziwa ngokuthi ukunikezwa okuphambene, okwenza i-AI ikwazi ukulingisa indlela ukukhanya okusebenza ngayo emhlabeni wangempela.
Ingenye yamamodeli okuqala ohlobo lwayo angahlanganisa ukuqeqeshwa kwenethiwekhi ye-neural eshesha kakhulu kanye nokunikeza okusheshayo, ngenxa yesu eliklanywe ithimba labacwaningi le-NVIDIA eliqeda ukusebenza ngokushesha okukhulu - cishe ngaso leso sikhathi.
Lesi sihloko sizohlola i-NeRF ye-NVIDIA ngokujulile, okuhlanganisa isivinini sayo, izimo zokusebenzisa, nezinye izici.
Ngakho-ke, yini I-NeRF?
I-NeRF imele izinkambu zokukhanya kwe-neural, okubhekisela kumasu okudala ukubukwa okuhlukile kwezigcawu eziyinkimbinkimbi ngokucwenga umsebenzi wesigcawu sevolumu yevolumu eqhubekayo kusetshenziswa inombolo encane yokubuka okokufaka.
Uma unikezwa iqoqo lezithombe ze-2D njengokufakwayo, ama-NeRF e-NVIDIA ayasebenza amanethiwekhi we-neural ukumela nokwenza izigcawu ze-3D.
Inombolo encane yezithombe ezivela emagumbini ahlukahlukene azungeze indawo ziyadingeka inethiwekhi ye-neural, kanye nendawo yekhamera kuhlaka ngalunye.
Lapho lezi zithombe zithathwa ngokushesha, kuba ngcono, ikakhulukazi ezigcawini ezinabalingisi abanyakazayo noma izinto.
Isigcawu se-3D esikhiqizwe yi-AI sizongcoliswa uma kunokunyakaza okuningi ngesikhathi senqubo yokuthwebula izithombe ze-2D.
Ngokubikezela umbala wokukhanya ophuma nhlangothi zonke ukusuka kunoma iyiphi indawo endaweni ye-3D, i-NeRF igcwalisa ngempumelelo izikhala ezishiywe yile datha ukuze yakhe isithombe sonke.
Njengoba i-NeRF ingakwazi ukukhiqiza isigcawu se-3D ngama-millisecond ambalwa ngemva kokuthola okokufaka okufanele, iyindlela eshesha kakhulu ye-NeRF kuze kube manje.
I-NeRF isebenza ngokushesha kangangokuthi icishe ibe khona manjalo, yingakho igama layo. Uma izethulo ezijwayelekile ze-3D ezifana ne-polygonal meshes kuyizithombe zevekhtha, ama-NeRF ayizithombe ze-bitmap: zithwebula ngendlela ukukhanya ophuma ngayo entweni noma ngaphakathi kwesigcawu.
I-NeRF esheshayo ibalulekile ku-3D njengoba amakhamera edijithali kanye nokuminyanisa kwe-JPEG kuye kwaba ezithombeni ze-2D, okuthuthukisa kakhulu isivinini, ukunethezeka, kanye nokufinyeleleka kokuthwebula nokwabelana kwe-3D.
I-Instant NeRF ingasetshenziselwa ukukhiqiza ama-avatar noma ngisho nama-sceneries aphelele emihlabeni ebonakalayo.
Ukuze uhloniphe izinsuku zokuqala zezithombe ze-Polaroid, ithimba loCwaningo le-NVIDIA lidale kabusha isithombe esidumile sika-Andy Warhol ethatha isithombe esisheshayo futhi wasiguqula saba isigcawu se-3D sisebenzisa i-Instant NeRF.
Ingabe ishesha izikhathi ezingu-1,000 ngempela?
Isigcawu se-3D singathatha amahora ukudalwa ngaphambi kwe-NeRF, kuye ngobunkimbinkimbi nekhwalithi yaso.
I-AI yasheshisa kakhulu inqubo, kodwa kusengathatha amahora ukuqeqeshwa kahle. Isebenzisa indlela ebizwa ngokuthi i-multi-resolution hash encoding, eyasungulwa yi-NVIDIA, i-Instant NeRF inciphisa izikhathi zokunikezwa ngesici esingu-1,000.
Iphakethe le-Tiny CUDA Neural Networks kanye nekhithi yamathuluzi ye-NVIDIA CUDA kusetshenziswe ukudala imodeli. Ngokusho kwe-NVIDIA, ngenxa yokuthi iyinethiwekhi ye-neural engasindi, ingaqeqeshwa futhi isetshenziswe ku-NVIDIA GPU eyodwa, namakhadi e-NVIDIA Tensor Core asebenza ngesivinini esisheshayo.
Sebenzisa Icala
Izimoto ezizishayelayo zingenye yezinto ezibaluleke kakhulu ezisetshenziswa lobu buchwepheshe. Lezi zimoto zisebenza kakhulu ngokucabangela indawo ezizungezile njengoba zihamba.
Kodwa-ke, inkinga ngobuchwepheshe banamuhla ukuthi buyaxaka futhi buthatha isikhathi eside kakhulu.
Nokho, kusetshenziswa i-Instant NeRF, okudingekayo ukuze imoto ezishayelayo ilinganise/iqonde usayizi nokuma kwezinto zomhlaba wangempela ukuthwebula izithombe ezimile, uziguqule zibe yi-3D, bese usebenzisa lolo lwazi.
Kungase kube nokunye ukusetshenziswa ku-metaverse noma umdlalo we video izimboni zokukhiqiza.
Ngoba i-Instant NeRF ikuvumela ukuthi wakhe ama-avatar noma ngisho nawo wonke umhlaba obonakalayo ngokushesha, lokhu kuyiqiniso.
Cishe kancane Uhlamvu lwe-3D ukumodela kuzodingeka ngoba konke okudingeka ukwenze ukusebenzisa inethiwekhi ye-neural, futhi kuzokwakhela umlingiswa.
Ngaphezu kwalokho, i-NVIDIA isahlola ukusebenzisa lobu buchwepheshe kwezinye izinhlelo zokusebenza ezihlobene nokufunda komshini.
Ngokwesibonelo, ingase isetshenziselwe ukuhumusha izilimi ngokunembe kakhulu kunangaphambili futhi kuthuthukise inhloso evamile ukufunda okujulile ama-algorithms manje asesetshenziselwa uhla olubanzi lwemisebenzi.
Isiphetho
Izinkinga eziningi zezithombe zincike ezinhlakeni zedatha eziqondene nomsebenzi othile ukuze kusetshenziswe ubushelelezi benkinga noma ubungako.
Okunye okusebenzisekayo okusekelwe ekufundeni okunikezwa yi-NVIDIA's multi-resolution hashi encoding igxila ngokuzenzakalelayo emininingwaneni efanelekile, kungakhathaliseki ukuthi ungakanani umsebenzi.
Ukuze ufunde kabanzi mayelana nokuthi izinto zisebenza kanjani ngaphakathi, bheka isikhulu GitHub indawo yokugcina.
shiya impendulo