Table of Contents[Hide][Show]
Hav, koj puas paub, tias 3D scene tuaj yeem tsim los ntawm 2D cov ntaub ntawv nkag hauv vib nas this nrog NVIDIA's Instant NeRF neural rendering qauv, thiab cov duab ntawm qhov chaw tuaj yeem ua rau hauv milliseconds?
Nws yog qhov ua tau kom hloov pauv cov ntawv sau ntawm cov duab tseem nyob rau hauv ib puag ncig digital 3D siv cov txheej txheem hu ua inverse rendering, uas ua rau AI tuaj yeem ua raws li lub teeb ua haujlwm hauv lub ntiaj teb tiag tiag.
Nws yog ib qho ntawm thawj tus qauv ntawm nws hom uas tuaj yeem sib txuas cov kev cob qhia hauv lub network ultra-ceev ceev thiab kev ua haujlwm sai, ua tsaug rau cov txheej txheem uas NVIDIA pab pawg tshawb fawb tau tsim ua tiav cov haujlwm ua tiav sai sai - ze li sai tau.
Kab lus no yuav tshuaj xyuas NVIDIA's NeRF qhov tob, suav nrog nws qhov nrawm, siv rooj plaub, thiab lwm yam.
Yog li, yog dab tsi NeRF?
NeRF stands rau neural radiance fields, uas yog hais txog ib tug txheej txheem los tsim tshwj xeeb views ntawm complex scenes los ntawm refining ib tug underlying nruam volumetric scene muaj nuj nqi siv ib tug me me ntawm input views.
Thaum muab ib qho kev sau ntawm 2D duab raws li cov tswv yim, NVIDIA's NeRFs ntiav neural networks los sawv cev thiab tsim 3D scenes.
Ib tug me me ntawm cov duab los ntawm ntau lub ces kaum nyob ib ncig ntawm lub cheeb tsam yog xav tau rau lub neural network, ua ke nrog qhov chaw ntawm lub koob yees duab hauv txhua tus ncej.
Cov duab no sai npaum li cas, qhov zoo dua, tshwj xeeb tshaj yog nyob rau hauv scenes nrog txav lam los yog khoom.
AI-tsim 3D scene yuav smudged yog hais tias muaj ntau dhau lawm thaum lub sij hawm 2D duab capture txheej txheem.
Los ntawm kev kwv yees cov xim ntawm lub teeb emanating nyob rau hauv txhua qhov kev taw qhia los ntawm ib qho chaw nyob rau hauv 3D ib puag ncig, NeRF ua tau zoo nyob rau hauv qhov khoob ntawm cov ntaub ntawv no los tsim tag nrho cov duab.
Txij li thaum NeRF tuaj yeem tsim ib qho 3D scene hauv ob peb milliseconds tom qab tau txais cov tswv yim tsim nyog, nws yog qhov nrawm tshaj plaws NeRF mus rau hnub tim.
NeRF ua haujlwm sai heev uas nws tau txais tam sim ntawd, yog li nws lub npe. Yog tias tus qauv 3D sawv cev zoo li polygonal meshes yog cov duab bitmap, lawv densely ntes txoj kev lub teeb emanates los ntawm ib qho khoom lossis sab hauv qhov chaw.
Instant NeRF Nws yog ib qho tseem ceeb rau 3D raws li cov koob yees duab digital thiab JPEG compression tau mus rau 2D kev yees duab, ua kom nrawm nrawm, yooj yim, thiab ncav cuag 3D ntes thiab sib koom.
Instant NeRF tuaj yeem siv los tsim avatars lossis txawm tias tag nrho sceneries rau lub ntiaj teb virtual.
Txhawm rau ua kev zoo siab rau hnub thaum ntxov ntawm Polaroid cov duab, NVIDIA Kev Tshawb Fawb Pab Pawg tau tsim cov koob npe nrov ntawm Andy Warhol noj cov duab tam sim thiab hloov nws mus rau hauv 3D scene siv Instant NeRF.
Puas yog 1,000 zaus sai dua?
Ib qho 3D scene tuaj yeem siv sij hawm los tsim ua ntej NeRF, nyob ntawm nws qhov tsis sib xws thiab qhov zoo.
AI tau nrawm heev rau cov txheej txheem, tab sis nws tseem tuaj yeem siv sijhawm ntau teev los cob qhia kom raug. Siv ib txoj kev hu ua multi-resolution hash encoding, pioneered los ntawm NVIDIA, Instant NeRF txo cov sij hawm ua los ntawm ib qho ntawm 1,000.
Cov pob me me CUDA Neural Networks thiab NVIDIA CUDA Toolkit tau siv los tsim tus qauv. Raws li NVIDIA, vim tias nws yog lub teeb yuag neural network, nws tuaj yeem raug cob qhia thiab siv ntawm ib qho NVIDIA GPU, nrog NVIDIA Tensor Core phaib ua haujlwm ntawm qhov nrawm tshaj plaws.
Siv Case
Kev tsav tsheb tus kheej yog ib qho ntawm cov kev siv tseem ceeb tshaj plaws ntawm cov tshuab no. Cov tsheb no feem ntau ua haujlwm los ntawm kev xav txog lawv ib puag ncig thaum lawv mus.
Txawm li cas los xij, qhov teeb meem nrog niaj hnub thev naus laus zis yog qhov tsis txaus ntseeg thiab siv sijhawm ntev me ntsis.
Txawm li cas los xij, siv Instant NeRF, txhua yam uas yuav tsum tau ua rau lub tsheb tsav tus kheej kom kwv yees / nkag siab qhov loj thiab cov duab ntawm lub ntiaj teb tiag tiag yog khaws cov duab tseem ceeb, tig mus rau 3D, thiab tom qab ntawd siv cov ntaub ntawv ntawd.
Tseem yuav muaj lwm yam siv nyob rau hauv metaverse los yog kev ua si video ntau lawm kev lag luam.
Vim tias Instant NeRF tso cai rau koj los tsim avatars lossis txawm tias tag nrho lub ntiaj teb virtual sai sai, qhov no yog qhov tseeb.
Yuav luag me me Lub cim 3D modeling yuav tsum tau vim txhua yam koj yuav tau ua yog khiav lub neural network, thiab nws yuav tsim ib tug cim rau koj.
Tsis tas li ntawd, NVIDIA tseem tab tom tshawb nrhiav siv cov thev naus laus zis no rau kev kawm ntxiv txog kev siv tshuab.
Piv txwv li, nws yuav raug siv los txhais cov lus kom raug dua li yav dhau los thiab txhim kho lub hom phiaj dav dav kawm tob algorithms tam sim no siv rau ntau yam haujlwm.
xaus
Ntau cov teeb meem duab cia siab rau cov haujlwm tshwj xeeb cov ntaub ntawv tsim kom siv qhov teeb meem smoothness lossis sparsity.
Cov kev kawm ua tau zoo-raws li lwm txoj hauv kev muab los ntawm NVIDIA's multi-resolution hash encoding cia li mloog zoo rau cov ntsiab lus tseem ceeb, tsis hais txog kev ua haujlwm.
Yog xav paub ntxiv txog yuav ua li cas cov khoom ua haujlwm sab hauv, mus saib tus nom GitHub repository.
Sau ntawv cia Ncua