Neural rendering ndi njira yomwe ikubwera mukuphunzira mwakuya yomwe ikufuna kukulitsa mapaipi akale azithunzi zamakompyuta ndi ma neural network.
Neural rendering algorithm ifunika seti ya zithunzi zoyimira makona osiyanasiyana a chochitika chimodzi. Zithunzizi zidzalowetsedwa mu neural network kuti apange chitsanzo chomwe chingathe kutulutsa ma angles atsopano a zochitika zomwezo.
Ubwino wa neural rendering uli momwe ungapangirenso zowonera zatsatanetsatane popanda kudalira njira zakale zomwe zingakhale zovuta kwambiri.
Tisanalowe m'mene matembenuzidwe a neural amagwirira ntchito, tiyeni tikambirane zoyambira za classical rendering.
Kodi Classical Rendering ndi chiyani?
Choyamba tiyeni timvetsetse njira zomwe zimagwiritsidwa ntchito pomasulira zakale.
Kumasulira kwachikale kumatanthawuza njira zomwe zimagwiritsidwa ntchito popanga chithunzi cha 2D cha magawo atatu. Kumatchedwanso kaphatikizidwe ka zithunzi, kumasulira kwachikale kumagwiritsa ntchito ma aligorivimu osiyanasiyana kuyerekezera momwe kuwala kumayendera ndi mitundu yosiyanasiyana ya zinthu.
Mwachitsanzo, kupanga njerwa yolimba kumafunika ma aligorivimu enaake kuti mudziwe malo a mthunzi kapena mbali zonse za khomazo zidzayatsidwa bwino. Mofananamo, zinthu zomwe zimawonetsa kapena kuwunikira kuwala, monga galasi, chinthu chonyezimira, kapena madzi ambiri, zidzafunanso luso lawo.
Pakumasulira kwachikale, chinthu chilichonse chimayimiridwa ndi mauna a polygon. Pulogalamu ya shader idzagwiritsa ntchito poligoni ngati cholowetsa kuti mudziwe momwe chinthucho chidzawonekere potengera kuunikira ndi mbali yake.
Kupereka zenizeni kudzafuna mphamvu zambiri zowerengera popeza katundu wathu amatha kukhala ndi mamiliyoni a ma polygons kuti agwiritse ntchito ngati cholowetsa. Kutulutsa kopangidwa ndi makompyuta komwe kumakhala kofala ku Hollywood blockbusters nthawi zambiri kumatenga milungu kapena miyezi kuti kuperekedwe ndipo kungawononge madola mamiliyoni ambiri.
Njira yolondolera ma ray ndiyokwera mtengo kwambiri chifukwa pixel iliyonse pachithunzi chomaliza imafunikira kuwerengera njira yomwe kuwala kumachokera kugwero la kuwala kupita ku chinthucho ndi kamera.
Kupita patsogolo kwa Hardware kwapangitsa kuti zithunzi zizipezeka mosavuta kwa ogwiritsa ntchito. Mwachitsanzo, zambiri zaposachedwa masewera akanema lolani zotsatira zotsatiridwa ndi ray monga zowunikira zenizeni ndi mithunzi malinga ngati zida zawo zikugwira ntchitoyo.
Ma GPU aposachedwa (magawo opangira zojambulajambula) amapangidwa makamaka kuti athandize CPU kuwerengera zovuta kwambiri zomwe zimafunikira kuti iwonetse zithunzi zenizeni.
Kuwonjezeka kwa Neural Rendering
Neural rendering imayesa kuthana ndi vuto loperekera mwanjira ina. M'malo mogwiritsa ntchito ma algorithms kutengera momwe kuwala kumayendera ndi zinthu, bwanji ngati tipanga chojambula chomwe chimaphunzira momwe chowonekera chiyenera kukhalira kuchokera kukona inayake?
Mutha kuziganizira ngati njira yachidule yopangira zithunzi zazithunzi. Ndi neural rendering, sitifunika kuwerengera momwe kuwala kumayendera ndi chinthu, timangofunika chidziwitso chokwanira.
Njirayi imalola ochita kafukufuku kupanga mawonekedwe apamwamba azithunzi zovuta popanda kuchita
Kodi Neural fields ndi chiyani?
Monga tanena kale, omasulira ambiri a 3D amagwiritsa ntchito ma polygon meshes kusunga deta pamawonekedwe ndi mawonekedwe a chinthu chilichonse.
Komabe, ma neural fields akuyamba kutchuka ngati njira ina yoyimira zinthu zitatu-dimensional. Mosiyana ndi ma polygon meshes, minda ya neural ndi yosiyana komanso yopitilira.
Kodi tikutanthauza chiyani tikamanena kuti minda ya neural ndiyosiyana?
Kutulutsa kwa 2D kuchokera ku neural field tsopano kutha kuphunzitsidwa kukhala chithunzithunzi pongosintha zolemera za neural network.
Pogwiritsa ntchito ma neural fields, sitifunikanso kutsanzira fiziki ya kuwala kuti tipange chochitika. Chidziwitso cha momwe kumasulira komaliza kudzawunikiridwa tsopano kwasungidwa mkati mwa zolemera zathu neural network.
Izi zimatithandiza kupanga zithunzi ndi makanema atsopano mwachangu kuchokera pazithunzi zochepa kapena makanema.
Kodi Mungaphunzitse Bwanji Neural Field?
Tsopano popeza tadziwa zoyambira momwe gawo la neural limagwirira ntchito, tiyeni tiwone momwe ofufuza amatha kuphunzitsa gawo la neural kuwala kapena NeRF.
Choyamba, tifunika kuyesa zomwe zachitika mwachisawawa ndikuzidyetsa mu neural network. Netiweki iyi imatha kupanga kuchuluka kwamunda.
Kuchuluka kwa magawo opangidwa kumatengedwa ngati zitsanzo kuchokera kudera lomwe tikufuna kukonzanso komwe tikufuna kupanga.
Kenako tifunika kupanga mapu omanganso zithunzi zenizeni za 2D. Kenako algorithm idzawerengera zolakwika zomanganso. Cholakwika ichi chiwongolera neural network kuti ikwaniritse kuthekera kwake kokonzanso zochitikazo.
Ntchito za Neural Rendering
Novel View Synthesis
Mawonekedwe a Novel amatanthauza ntchito yopanga mawonedwe a kamera kuchokera kumakona atsopano pogwiritsa ntchito deta kuchokera kumagulu ochepa.
Njira zofotokozera za Neural zimayesa kulosera momwe kamera ilili pachithunzi chilichonse mu dataset ndikuyika datayo mu neural network.
Neural network ipanga choyimira cha 3D cha malo pomwe mfundo iliyonse mu danga la 3D ili ndi mtundu ndi kachulukidwe kogwirizana.
Kukhazikitsa kwatsopano kwa NeRFs mu View Google Street amagwiritsa ntchito kaphatikizidwe katsopano kolola ogwiritsa ntchito kufufuza malo enieni ngati akuwongolera kamera yomwe ikutenga kanema. Izi zimathandiza odzaona malo kufufuza mozama kwambiri asanasankhe kupita kumalo enaake.
Zithunzi zenizeni
Njira zotsogola pakumasulira kwa neural zithanso kuyambitsa njira ya ma avata a digito owoneka bwino. Ma avatar awa amatha kugwiritsidwa ntchito pazinthu zosiyanasiyana monga othandizira kapena makasitomala, kapena ngati njira yoti ogwiritsa ntchito aziyika mawonekedwe awo mu masewera kanema kapena kumasulira kofananira.
Mwachitsanzo, a pepala lofalitsidwa mu Marichi 2023 akuwonetsa kugwiritsa ntchito njira zopangira ma neural kupanga avatar yowoneka bwino pakatha mphindi zochepa za kanema.
Kutsiliza
Neural rendering ndi gawo losangalatsa la maphunziro lomwe lingathe kusintha makampani onse azithunzi zamakompyuta.
Ukadaulo ukhoza kutsitsa chotchinga cholowera pakupanga zinthu za 3D. Magulu a zowoneka sangadikirenso masiku kuti apereke mphindi zochepa zazithunzi zenizeni.
Kuphatikiza ukadaulo ndi mapulogalamu omwe alipo a VR ndi AR amathanso kulola opanga kupanga zokumana nazo zambiri.
Kodi mukuganiza kuti kuthekera kwenikweni kwa neural rendering ndi chiyani?
Siyani Mumakonda