Kajeno re bona phetohelo sebakeng sa ts'ebetso ea puo ea tlhaho. 'Me, ke 'nete hore ha ho na bokamoso ntle le bohlale ba maiketsetso. Re se re ntse re sebelisa "bathusi" ba fapaneng ba AI.
Li-chatbots ke mehlala e metle molemong oa rona. Li emela mehla e mecha ea puisano. Empa, ke eng e etsang hore li khethehe hakaale?
Li-chatbots tsa hajoale li khona ho utloisisa le ho araba lipotso tsa puo ea tlhaho ka nepo le lintlha tse tšoanang le tsa litsebi tsa batho. Hoa thabisa ho ithuta ka mekhoa e kenang ts'ebetsong.
Ikopanye 'me re fumane theknoloji e e tšehetsang.
Ho kenella ka har'a Theknoloji
AI Transformers ke lentsoe le ka sehloohong sebakeng sena. Ba tšoana le marangrang a neural tse fetotseng tshebediso ya puo ya tlhaho. Ha e le hantle, ho na le ho tšoana ho hoholo pakeng tsa li-transformer tsa AI le marang-rang a neural.
Ka bobeli li entsoe ka mekhahlelo e 'maloa ea likarolo tsa ts'ebetso tse etsang letoto la lipalo ho fetolela data e kentsoeng hore e be likhakanyo joalo ka tlhahiso. Ka poso ena, re tla sheba matla a AI Transformers le kamoo a fetolang lefatše le re potolohileng.
Monyetla oa Ts'ebetso ea Puo ea Tlhaho
A re qaleng ka lintho tsa motheo. Re e utloa hohle hoo e ka bang. Empa, hantle-ntle ho sebetsa puo ea tlhaho ke eng?
Ke karolo ea bohlale ba maiketsetso e shebaneng le tshebedisano ya batho le metjhini ka tshebediso ya puo ya tlhaho. Sepheo ke ho lumella lik'homphieutha ho lemoha, ho hlalosa le ho hlahisa puo ea batho ka mokhoa o utloahalang le oa 'nete.
Temoho ea puo, phetolelo ea puo, maikutlo a maikutlo, le kakaretso ea mongolo ke mehlala eohle ea lits'ebetso tsa NLP. Ka lehlakoreng le leng, mefuta ea setso ea NLP e ile ea sokola ho utloisisa likhokahano tse rarahaneng lipakeng tsa mantsoe a poleloana. Sena se entse hore maemo a holimo a ho nepahala mesebetsing e mengata ea NLP e se ke ea khoneha.
Mona ke ha AI Transformers e kenya setšoantšo. Ka mokhoa oa ho itlhokomela, li-transformer li ka ngola ho itšetleha ka nako e telele le lihokelo pakeng tsa mantsoe a poleloana. Mokhoa ona o nolofalletsa mohlala ho khetha ho latela likarolo tse fapaneng tsa tatellano ea ho kenya. Kahoo, e ka utloisisa moelelo le moelelo oa lentsoe le leng le le leng polelong.
Hantle-ntle ke Mehlala ea Transformers
AI transformer ke a thuto e tebileng meaho e utloisisang le ho sebetsana le mefuta e fapaneng ea tlhahisoleseling. E ipabola tabeng ea ho tseba hore na likotoana tse ngata tsa tlhahisoleseding li amana joang, joalo ka hore na mantsoe a fapaneng polelong a hokahanngoa joang kapa hore na likarolo tse fapaneng tsa setšoantšo li lumellana joang.
E sebetsa ka ho arola tlhahisoleseling ka likaroloana ebe o sheba likarolo tseo kaofela hang. Ho joalokaha eka liroboto tse ngata tse nyenyane li sebelisana 'moho ho utloisisa lintlha. E latelang, hang ha e tseba ntho e 'ngoe le e' ngoe, e kopanya likarolo tsohle ho fana ka karabo kapa tlhahiso.
Li-transformer tsa AI li bohlokoa haholo. Ba khona ho utloisisa moelelo oa taba le likamano tsa nako e telele lipakeng tsa tlhahisoleseling e fapaneng. Sena se bohlokoa bakeng sa mesebetsi e kang phetolelo ea puo, kakaretso, le likarabo tsa lipotso. Kahoo, ke likelello tse ka morao ho lintho tse ngata tse khahlisang tseo AI e ka li etsang!
Tlhokomelo ke Sohle Seo U se Hlokang
Sengoloa se reng "Tlhokomeliso ke Sohle Seo U se Hlokang" se bua ka sengoliloeng sa 2017 se hlahisitseng mofuta oa transformer. E ile ea fetola thuto ea puo ea tlhaho (NLP).
Bangoli ba lipatlisiso tsena ba boletse hore mokhoa oa ho itlhokomela oa transformer o ne o le matla ka ho lekaneng ho nka karolo ea mokhoa o tloaelehileng convolutional neural networks e sebelisetsoa mesebetsi ea NLP.
Ho Itlhokomela ke Eng Hantle?
Ke mokhoa o lumellang mohlala ho tsepamisa maikutlo ho likarolo tse fapaneng tsa tatellano ea ho kenya ha o etsa likhakanyo.
Ka mantsoe a mang, ho itlhokomela ho thusa mohlala ho bala palo ea lintlha tsa tlhokomelo bakeng sa ntho ka 'ngoe e amanang le likarolo tse ling kaofela, e leng se lumellang mohlala ho leka-lekanya bohlokoa ba karolo ka 'ngoe ea ho kenya.
Ka mokhoa o thehiloeng ho transformer, ho itlhokomela ho sebetsa ka tsela e latelang:
Tatelano ea ho kenya e kenngoa pele letotong la li-vector, e le 'ngoe bakeng sa setho se seng le se seng sa tatellano.
Bakeng sa ntho e 'ngoe le e' ngoe ka tatellano, mohlala o etsa lihlopha tse tharo tsa li-vector: vector ea lipotso, vector ea bohlokoa, le vector ea bohlokoa.
Vector ea lipotso e bapisoa le li-vector tsohle tsa bohlokoa, 'me ho tšoana ho baloa ho sebelisoa sehlahisoa sa matheba.
Lintlha tsa tlhokomelo tse hlahisoang ke tse tloaelehileng ho sebelisoa mosebetsi oa softmax, o hlahisang sete ea boima bo bontšang bohlokoa bo lekanyelitsoeng ba sengoathoana se seng le se seng ka tatellano.
Ho theha tlhahiso ea ho qetela ea tlhahiso, li-vector tsa boleng li atolosoa ka boima ba tlhokomelo le ho akaretsa.
Mefuta e thehiloeng ho li-transformer, e sebelisang ho itlhokomela, e ka atleha ho hapa likamano tsa nako e telele ka tatellano ea ho kenya ntle le ho itšetleha ka lifensetere tsa bolelele bo tsitsitseng, e leng se etsang hore e be tsa bohlokoa haholo bakeng sa mekhoa ea ho sebetsana le puo ea tlhaho.
mohlala
Nka hore re na le tatellano ea lintlha tse tšeletseng: "Katse e lutse holim'a 'mete." Letšoao le leng le le leng le ka emeloa e le vector, 'me tatellano ea ho kenya e ka bonoa ka tsela e latelang:
Ka mor'a moo, bakeng sa letšoao le leng le le leng, re tla etsa lihlopha tse tharo tsa li-vector: vector ea lipotso, vector ea bohlokoa, le vector ea bohlokoa. Vector ea token e kentsoeng e atolosoa ka li-matrices tse tharo tse ithutoang ho hlahisa li-vector tsena.
Bakeng sa lets'oao la pele "The," mohlala, potso, senotlolo, le li-vector tsa boleng e tla ba:
Vector ea potso: [0.4, -0.2, 0.1]
Vector ea bohlokoa: [0.2, 0.1, 0.5]
Vector ea boleng: [0.1, 0.2, 0.3]
Lintlha tsa tlhokomelo pakeng tsa para ka 'ngoe ea li-tokens ka tatellano ea ho kenya li baloa ke mochine oa ho itlhokomela. Mohlala, lintlha tsa tlhokomelo lipakeng tsa li-tokens 1 le 2 "The" li tla baloa joalo ka sehlahisoa sa letheba la potso ea bona le li-vector tsa bohlokoa:
Lintlha tsa tlhokomelo = dot_product(Potso vector of Token 1, Key vector of Token 2)
= (0.4 * 0.8) + (-0.2 * 0.2) + (0.1 * 0.1)
= 0.31
Lintlha tsena tsa tlhokomelo li bonts'a kamano e amanang le tokeneng ka 'ngoe ho latela tse ling.
Qetellong, bakeng sa tokenyo e 'ngoe le e' ngoe, tlhahiso ea tlhahiso e etsoa ka ho nka palo e boima ea li-vector tsa boleng, ka litekanyo tse khethiloeng ke lintlha tsa tlhokomelo. Kemelo ea tlhahiso ea lets'oao la pele "The," mohlala, e tla ba:
Vector ea tlhahiso bakeng sa Letšoao la 1 = (Lintlha tsa tlhokomelo le Letšoao la 1) * Vector ea boleng bakeng sa Letšoao la 2
+ (Ela hloko lintlha tse nang le Letšoao la 3) * Vector ea boleng bakeng sa Letšoao la 3
+ (Ela hloko lintlha tse nang le Letšoao la 4) * Vector ea boleng bakeng sa Letšoao la 4
+ (Ela hloko lintlha tse nang le Letšoao la 5) * Vector ea boleng bakeng sa Letšoao la 5
+ (Ela hloko lintlha tse nang le Letšoao la 6) * Vector ea boleng bakeng sa Letšoao la 6
= (0.31 * [0.1, 0.2, 0.3]) + (0.25 * [0.2, -0.1, 0.7]) + (0.08 * [0.3, 0.5, -0.1]) + (0.14 * [0.1, 0.3, -0.2] ) + (0.22 * [0.6, -0.3, 0.4])
= [0.2669, 0.1533, 0.2715]
Ka lebaka la ho itlhokomela, mohlala o thehiloeng ho transformer o ka khetha ho ea likarolong tse sa tšoaneng tsa tatellano ea ho kenya letsoho ha o theha tatellano ea lihlahisoa.
Lisebelisoa li feta kamoo u nahanang kateng
Ka lebaka la ho ikamahanya le maemo le bokhoni ba ho sebetsana le mesebetsi e mengata ea NLP, joalo ka phetolelo ea mochini, tlhahlobo ea maikutlo, kakaretso ea mongolo, le tse ling, li-transformer tsa AI li se li tumme lilemong tsa morao tjena.
Li-transformer tsa AI li 'nile tsa sebelisoa libakeng tse fapa-fapaneng, ho kenyelletsa le ho lemoha litšoantšo, mekhoa ea likhothaletso, esita le ho sibolloa ha lithethefatsi, ho phaella ho lisebelisoa tsa khale tse thehiloeng puong.
Li-transformer tsa AI li na le ts'ebeliso e batlang e se na moeli kaha li ka etsoa ho latela libaka tse ngata tsa mathata le mefuta ea data. Li-transformer tsa AI, ka bokhoni ba tsona ba ho sekaseka tatellano e rarahaneng ea data le ho hapa likamano tsa nako e telele, li behiloe ho ba ntlha ea bohlokoa ea ho khanna nts'etsopele ea lits'ebetso tsa AI lilemong tse tlang.
Ha ho bapisoa le tse ling tsa Neural Network Architectures
Ha ba ntse ba khona ho sekaseka tatellano ea ho kenya le ho utloisisa likamano tsa nako e telele tsa mongolo, li-transformer tsa AI li loketse haholo ts'ebetso ea puo ea tlhaho ha li bapisoa le lits'ebetso tse ling tsa neural network.
Mehaho e meng ea neural network, joalo ka convolutional neural networks (CNNs) le recurrent neural networks (RNNs), ka lehlakoreng le leng, e loketse hantle mesebetsi e amanang le ts'ebetso ea tlhahiso e hlophisitsoeng, joalo ka litšoantšo kapa letoto la lintlha.
Bokamoso bo Shebahale bo Khanyang
Bokamoso ba li-transformer tsa AI bo bonahala bo khanya. Karolo e 'ngoe ea thuto e ntseng e tsoela pele ke nts'etsopele ea mefuta e matla haholoanyane e khonang ho sebetsana le mesebetsi e ntseng e rarahane le ho feta.
Ho feta moo, ho ntse ho etsoa boiteko ba ho hokahanya li-transformer tsa AI le mahlale a mang a AI, joalo ka ho matlafatsa thuto, ho fana ka bokhoni bo tsoetseng pele ba ho etsa liqeto.
Indasteri e 'ngoe le e' ngoe e leka ho sebelisa bokhoni ba AI ho khanna boqapi le ho fihlela pheletso ea tlholisano. Kahoo, li-transformer tsa AI li kanna tsa kenyelletsoa butle-butle lits'ebetsong tse fapaneng, ho kenyeletsoa tlhokomelo ea bophelo bo botle, lichelete le tse ling.
Ka ntlafatso e tsoelang pele ea theknoloji ea AI transformer le monyetla oa lisebelisoa tsena tse matla tsa AI ho fetola tsela eo batho ba sebetsang le ho utloisisa puo ka eona, bokamoso bo bonahala bo khanya.
Leave a Reply