Isiqulatho[Fihla][Bonisa]
I-GPT-3, inethiwekhi enkulu ye-neural yelo xesha, yapapashwa ngoMeyi ka-2020 ngu I-OpenAI, Isiqalo se-AI esisekwe ngu-Elon Musk kunye no-Sam Altman. I-GPT-3 imodeli yolwimi oluphambili kunye ne-175 yeebhiliyoni zeeparamitha xa kuthelekiswa ne-1,5 yeebhiliyoni zeeparamitha kwi-GPT-2 eyandulelayo.
I-GPT-3 igqwesile imodeli ye-Microsoft ye-NLG Turing (i-Turing Natural Language Generation), ebikade ibambe irekhodi yolona thungelwano olukhulu lwe-neural ene-17 yeebhiliyoni zeeparamitha.
Imodeli yolwimi iye yanconywa, yagxekwa, yade yaphononongwa; iye yavelisa usetyenziso olutsha nolunika umdla. Kwaye ngoku kukho iingxelo zokuba i-GPT-4, uhlelo olulandelayo lwe-OpenAI imodeli yolwimi, eneneni iza kufika kungekudala.
Ufikile kwindawo elungileyo ukuba ufuna ukufunda ngakumbi nge-GPT-4. Siza kujonga i-GPT-4 ngokunzulu kweli nqaku, ukugubungela iiparamitha zayo, indlela ethelekisa ngayo nezinye iimodeli, kunye nokunye.
Ke, Yintoni i-GPT-4?
Ukuqonda ububanzi be-GPT-4, kufuneka siqale siqonde i-GPT-3, i-precursor yayo. I-GPT-3 (i-Generative Pre-trained Transformer, isizukulwana sesithathu) sisixhobo esizimeleyo sokuvelisa umxholo.
Abasebenzisi bafaka idatha kwi-a yokufunda umatshini imodeli, enokuthi emva koko ivelise inani elikhulu lokubhala okufanelekileyo ekuphenduleni, ngokutsho kwe-OpenAI. I-GPT-4 iya kuba ngcono kakhulu kwi-multitasking kwiimeko ezimbalwa zokudubula - uhlobo lwe yokufunda umatshini - ukuzisa iziphumo kufutshane nezo zabantu.
I-GPT-3 ixabisa amakhulu ezigidi zeeponti ukwakha, kodwa i-GPT-4 iqikelelwa ukuba iya kuxabisa kakhulu kuba iya kuba ngamakhulu amahlanu aphindwe kabini kwisikali. Ukubeka oku ngokwembono,
I-GPT-4 inokuba neempawu ezininzi njenge-synapses engqondweni. I-GPT-4 iya kusebenzisa kakhulu iindlela ezifanayo njenge-GPT-3, ngaloo ndlela kunokuba ibe yi-paradigm leap, i-GPT-4 iya kwandisa oko i-GPT-3 iyenzayo ngoku - kodwa inamandla amakhulu kakhulu.
I-GPT-3 ivumele abasebenzisi ukuba bangene kulwimi lwendalo ngeenjongo ezisebenzayo, kodwa bekusafuneka ubuchwephesha bokuyila ukukhawuleza okuza kuzisa iziphumo ezilungileyo. I-GPT-4 iya kuba ngcono kakhulu ekuqikeleleni iinjongo zabasebenzisi.
Iza kuba yintoni iiparamitha ze-GPT-4?
Ngaphandle kokuba yenye yezona zinto zilindelwe kakhulu kwi-AI yokuqhubela phambili, akukho nto eyaziwayo malunga ne-GPT-4: ukuba iya kujongeka njani, zeziphi iimpawu eziya kuba nazo, kwaye yintoni amandla eya kuba nayo.
Kunyaka ophelileyo, u-Altman wenze i-Q&A kwaye watyhila iinkcukacha ezimbalwa malunga namabhongo e-OpenAI ye-GPT-4. Ayizukuba nkulu kune-GPT-3, ngokutsho kuka-Altman. I-GPT-4 akunakwenzeka ukuba ibe yeyona isetyenziswa kakhulu imodeli yolwimi. Nangona imodeli iya kuba enkulu xa kuthelekiswa nezizukulwana zangaphambili ze amanethiwekhi, ubungakanani bayo abuyi kuba luphawu lwayo olwahlulayo. I-GPT-3 kunye neGopher ngabona baviwa bafanelekileyo (175B-280B).
INvidia kunye neMicrosoft's Megatron-Turing NLG ibambe irekhodi le inethiwekhi ye-neural exineneyo iiparamitha kwi-530B - ngokuphindwe kathathu kwe-GPT-3 - kude kube kutshanje xa i-PaLM kaGoogle iyithatha kwi-540B. Okumangalisayo kukuba, ukubulawa kweemodeli ezincinci kuphumelele iMT-NLG.
Ngokonxibelelwano lomthetho wamandla, uJared Kaplan we-OpenAI kunye noogxa bakhe bagqiba ngo-2020 ukuba xa kusetyenzwa ukonyuka kohlahlo lwabiwo-mali kuchithwa ikakhulu ekwandiseni inani leeparamitha, ukusebenza kuphucula kakhulu. I-Google, i-Nvidia, iMicrosoft, i-OpenAI, i-DeepMind, kunye nezinye iinkampani ezibonisa ulwimi ngokuthobela ziyilandele imigaqo.
U-Altman ubonise ukuba abasagxininisi ekwakhiweni kweemodeli ezinkulu, kodwa ekwandiseni ukusebenza kweemodeli ezincinci.
Abaphandi be-OpenAI babengabaxhasi bokuqala be-hypothesis yokulinganisa, kodwa banokufumanisa ukuba ezongezelelweyo, iindlela ezingazange zifunyanwe ngaphambili zingakhokelela kwiimodeli eziphezulu. I-GPT-4 ayiyi kuba nkulu kakhulu kune-GPT-3 ngenxa yezi zizathu.
I-OpenAI iya kubeka ingqwalasela enkulu kwezinye iinkalo, ezifana nedatha, i-algorithms, i-parameterization, kunye nokulungelelaniswa, ezinokuthi zikwazi ukuvelisa inzuzo ebalulekileyo ngokukhawuleza. Kuya kufuneka silinde kwaye sibone ukuba imodeli eneparamitha ze-100T inokwenza ntoni.
Amaphuzu aphambili:
- Ubungakanani bemodeli: I-GPT-4 iya kuba nkulu kune-GPT-3, kodwa kungekhona kakhulu (MT-NLG 530B kunye nePaLM 540B). Ubungakanani bemodeli buya kuba bungabonakali.
- Ukuba nempumelelo: I-GPT-4 iya kusebenzisa izixhobo ezininzi kune-GPT-3. Iya kusebenzisa ulwazi olutsha olufanelekileyo kwi-parameterization (i-hyperparameters efanelekileyo) kunye neendlela zokulinganisa (inani lamathokheni oqeqesho libaluleke kakhulu njengobungakanani bemodeli).
- Multimodality: I-GPT-4 iya kukwazi kuphela ukuthumela nokufumana imiyalezo ebhaliweyo (hayi i-multimodal). I-OpenAI ijonge ukutyhala iimodeli zolwimi kwimida yazo ngaphambi kokuba itshintshele kwiimodeli ezininzi ezifana IDALLE 2, abaqikelela ukuba ekugqibeleni baya kudlula iinkqubo ezingaqhelekanga.
- Ubuncinci: I-GPT-4, njengabangaphambili bayo i-GPT-2 kunye ne-GPT-3, iya kuba yimodeli exineneyo (zonke iiparamitha ziya kusetyenziswa ukucubungula nayiphi na igalelo elinikeziweyo). Kwixesha elizayo, ubuncinci buya kubaluleka ngakumbi.
- ulungelelwaniso: I-GPT-4 iya kuthi ngokusondeleyo ngakumbi kune-GPT-3. Iya kubeka oko ikufundileyo kwi-InstructGPT, eyaphuhliswa ngegalelo lomntu. Sekunjalo, ukuhlangana kwe-AI kusekude, kwaye iinzame kufuneka zihlolwe ngononophelo kunokuba zibaxo.
isiphelo
Artificial Intelligence Jikelele. Yinjongo enkulu, kodwa abaphuhlisi be-OpenAI basebenzela ukuyiphumeza. Injongo ye-AGI kukudala imodeli okanye “i-arhente” ekwaziyo ukuqonda nokwenza nawuphi na umsebenzi anokuthi awenze umntu.
I-GPT-4 ingaba linyathelo elilandelayo ekufezekiseni le njongo, kwaye ivakala ngathi yinto ephuma kwifilimu yesayensi. Usenokuba uyazibuza ukuba kuyinyani kangakanani ukufumana i-AGI.
Siza kuwenza lo msebenzi ngo-2029, ngokuka-Ray Kurzweil, uMlawuli wobuNjineli wakwaGoogle. Ngale nto engqondweni, makhe sijonge nzulu kwi-GPT-4 kunye nemilinganiselo yalo mzekelo njengoko sisondela kwi-AGI (Artificial General Intelligence).
Shiya iMpendulo