M'ndandanda wazopezekamo[Bisani][Show]
GPT-3, neural network yayikulu pakadali pano, idasindikizidwa mu Meyi 2020 ndi OpenAI, Kuyambitsa kwa AI komwe kunakhazikitsidwa ndi Elon Musk ndi Sam Altman. GPT-3 ndi mtundu wotsogola wachilankhulo wokhala ndi magawo 175 biliyoni poyerekeza ndi magawo 1,5 biliyoni m'magawo ake a GPT-2.
GPT-3 idapambana mtundu wa Microsoft wa NLG Turing (Turing Natural Language Generation), yomwe idakhala ndi mbiri ya neural network yayikulu kwambiri yokhala ndi magawo 17 biliyoni.
Chitsanzo cha chinenero chatamandidwa, kudzudzulidwa, ndipo ngakhale kuunikanso; yatulutsanso ntchito zatsopano komanso zochititsa chidwi. Ndipo tsopano pali malipoti kuti GPT-4, kope lotsatira la OpenAI chinenero chitsanzo, ikubweradi posachedwapa.
Mwafika pamalo oyenera ngati mukufuna kudziwa zambiri za GPT-4. Tiwona GPT-4 mozama m'nkhaniyi, kuphimba magawo ake, momwe ikufananizira ndi mitundu ina, ndi zina zambiri.
Ndiye, GPT-4 ndi chiyani?
Kuti timvetsetse kukula kwa GPT-4, choyamba tiyenera kumvetsetsa GPT-3, kalambulabwalo wake. GPT-3 (Generative Pre-trained Transformer, m'badwo wachitatu) ndi chida chodzipangira chokha chopangira zinthu.
Ogwiritsa amalowetsa deta mu a makina kuphunzira chitsanzo, chomwe chitha kutulutsa zolemba zambiri zofunikira poyankha, malinga ndi OpenAI. GPT-4 idzakhala yabwinoko pakuchita zambiri m'malo owombera pang'ono - mtundu wa makina kuphunzira - kubweretsa zotsatira pafupi kwambiri ndi za anthu.
GPT-3 imawononga ndalama zokwana madola mamiliyoni ambiri kuti imangidwe, koma GPT-4 ikuyembekezeka kuwononga ndalama zambiri chifukwa idzakhala yaikulu kuwirikiza mazana asanu. Kuyika izi moyenera,
GPT-4 ikhoza kukhala ndi mawonekedwe ambiri monga ma synapses muubongo. GPT-4 idzagwiritsa ntchito njira zomwezo monga GPT-3, motero m'malo mongodumphadumpha, GPT-4 idzakulitsa zomwe GPT-3 ikukwaniritsa pano - koma ndi kuthekera kokulirapo.
GPT-3 idalola ogwiritsa ntchito chilankhulo chachilengedwe kuti agwiritse ntchito, koma idafunikirabe ukatswiri kuti apange mwachangu zomwe zingabweretse zotsatira zabwino. GPT-4 idzakhala yabwinoko pakulosera zolinga za ogwiritsa ntchito.
Kodi magawo a GPT-4 adzakhala chiyani?
Ngakhale ndi imodzi mwazotukuka za AI zomwe zikuyembekezeredwa kwambiri, palibe chomwe chimadziwika za GPT-4: momwe idzawonekere, idzakhala ndi makhalidwe otani, ndi mphamvu zomwe idzakhala nazo.
Chaka chatha, Altman adachita Q&A ndikuwulula zingapo zokhumbira za OpenAI za GPT-4. Sizingakhale zazikulu kuposa GPT-3, malinga ndi Altman. GPT-4 ndiyokayikitsa kuti ndiyomwe imagwiritsidwa ntchito kwambiri chinenero chitsanzo. Ngakhale chitsanzocho chidzakhala chachikulu poyerekeza ndi mibadwo yapitayi mawindo a neural, kukula kwake sikudzakhala chikhalidwe chake chosiyanitsa. GPT-3 ndi Gopher ndi omwe ali ovomerezeka kwambiri (175B-280B).
Nvidia ndi Microsoft's Megatron-Turing NLG adasunga mbiri ya neural network yambiri magawo pa 530B - katatu kuposa GPT-3 - mpaka posachedwa pomwe Google's PaLM idatenga pa 540B. Chodabwitsa n'chakuti angapo ang'onoang'ono amitundu yochepa adaposa MT-NLG.
Malinga ndi kulumikizidwa kwa malamulo amphamvu, a Jared Kaplan a OpenAI ndi anzawo adatsimikiza mu 2020 kuti pakuwonjezeka kwa bajeti kumagwiritsidwa ntchito makamaka pakuwonjezera kuchuluka kwa magawo, magwiridwe antchito amakhala bwino kwambiri. Google, Nvidia, Microsoft, OpenAI, DeepMind, ndi makampani ena opanga zilankhulo momvera amatsatira malamulowo.
Altman adawonetsa kuti sakungoyang'ananso pakupanga mitundu yayikulu, koma kukulitsa magwiridwe antchito amitundu yaying'ono.
Ofufuza a OpenAI anali ochirikiza oyambilira a kukulitsa malingaliro, koma mwina adapeza kuti njira zowonjezera, zomwe sizinaululidwe m'mbuyomu zitha kubweretsa zitsanzo zapamwamba. GPT-4 sidzakhala yaikulu kwambiri kuposa GPT-3 pazifukwa izi.
OpenAI idzayang'ana kwambiri mbali zina, monga deta, ma algorithms, parameterization, ndi kuyanjanitsa, zomwe zingathe kubweretsa phindu lalikulu mofulumira. Tiyenera kudikirira ndikuwona zomwe mtundu wokhala ndi magawo a 100T ungachite.
Mfundo Zothandiza:
- Kukula kwachitsanzo: GPT-4 idzakhala yaikulu kuposa GPT-3, koma osati kwambiri (MT-NLG 530B ndi PaLM 540B). Kukula kwachitsanzo kudzakhala kosadabwitsa.
- Kuchita bwino: GPT-4 idzagwiritsa ntchito zinthu zambiri kuposa GPT-3. Idzagwiritsa ntchito zidziwitso zatsopano za parameterization (ma hyperparameter abwino kwambiri) ndi njira zowonjezera (chiwerengero cha zizindikiro zophunzitsira ndizofunikira monga kukula kwachitsanzo).
- Multimodality: GPT-4 idzatha kutumiza ndi kulandira mauthenga (osati multimodal). OpenAI ikufuna kukankhira zitsanzo za zilankhulo ku malire awo musanasinthe kupita kumitundu yama multimodal ngati DALLE 2, zomwe amalosera kuti pamapeto pake zidzaposa machitidwe amtundu uliwonse.
- Sparsity: GPT-4, monga akale GPT-2 ndi GPT-3, adzakhala chitsanzo wandiweyani (magawo onse adzagwiritsidwa ntchito pokonza zolowa iliyonse). M'tsogolomu, sparsity idzakhala yofunika kwambiri.
- mayikidwe: GPT-4 idzatiyandikira pafupi kwambiri kuposa GPT-3. Iyika zomwe yaphunzira kuchokera ku InstructGPT, yomwe idapangidwa ndi kulowetsedwa kwa anthu. Komabe, kulumikizana kwa AI kuli kutali kwambiri, ndipo zoyeserera ziyenera kuwunikiridwa mosamala osati kukokomeza.
Kutsiliza
Artificial General Intelligence. Ndi cholinga chachikulu, koma opanga OpenAI akugwira ntchito kuti akwaniritse. Cholinga cha AGI ndikupanga chitsanzo kapena "wothandizira" wokhoza kumvetsetsa ndikuchita ntchito iliyonse yomwe munthu angathe.
GPT-4 ikhoza kukhala sitepe yotsatira kuti mukwaniritse cholinga ichi, ndipo zikuwoneka ngati chinachake kuchokera mufilimu yopeka ya sayansi. Mutha kukhala mukuganiza kuti ndizowona bwanji kupeza AGI.
Tifika pofika chaka cha 2029, malinga ndi a Ray Kurzweil, Director of Engineering wa Google. Poganizira izi, tiyeni tiyang'ane mozama za GPT-4 ndi zotsatira za chitsanzochi pamene tikuyandikira AGI (Artificial General Intelligence).
Siyani Mumakonda