Namuhla sibona uguquko endaweni yokucubungula ulimi lwemvelo. Futhi, kuqinisekile ukuthi alikho ikusasa ngaphandle kobuhlakani bokwenziwa. Sesivele sisebenzisa “abasizi” be-AI abahlukahlukene.
Ama-Chatbots ayizibonelo ezinhle kakhulu kithi. Bamele inkathi entsha yokuxhumana. Kodwa, yini ebenza bakhetheke kangaka?
Ama-chatbot amanje angakwazi ukuqonda futhi aphendule imibuzo yolimi lwemvelo ngokunemba nangemininingwane efanayo njengochwepheshe babantu. Kuyajabulisa ukufunda mayelana nezinqubo ezingena ohlelweni.
Bopha futhi masithole ubuchwepheshe obusemuva kwakho.
Ukucwiliswa ku-Tech
I-AI Transformers iyigama elingukhiye elikhulu kule ndawo. Bafana amanethiwekhi we-neural eziguqule ukucutshungulwa kolimi lwemvelo. Eqinisweni, kunokufana okukhulu kwedizayini phakathi kweziguquli ze-AI namanethiwekhi e-neural.
Zombili zenziwe izendlalelo ezimbalwa zamayunithi okucubungula enza uchungechunge lwezibalo ukuze kuguqulwe idatha yokufaka ibe izibikezelo njengokuphumayo. Kulokhu okuthunyelwe, sizobheka amandla e-AI Transformers nokuthi awushintsha kanjani umhlaba osizungezile.
Amandla Okucubungula Ulimi Lwemvelo
Ake siqale ngezisekelo. Sizwa yonke indawo cishe. Kodwa, kuyini ngempela ukucubungula ulimi lwemvelo?
Kuyingxenye ye ukuhlakanipha okungekhona okwangempela egxile ekusebenzelaneni kwabantu nemishini ngokusetshenziswa kolimi lwemvelo. Umgomo uwukuvumela amakhompyutha ukuthi abone, ahumushe, futhi akhiqize ulimi lwabantu ngendlela enengqondo neyiqiniso.
Ukuqashelwa kwenkulumo, ukuhumusha ulimi, ukuhlaziywa kwemizwa, kanye nokufinyezwa kombhalo zonke ziyizibonelo zezinhlelo zokusebenza ze-NLP. Ngakolunye uhlangothi, amamodeli endabuko e-NLP, azabalaze ukubamba izixhumanisi eziyinkimbinkimbi phakathi kwamagama emshweni. Lokhu kwenza amazinga aphezulu okunemba emisebenzini eminingi ye-NLP angenzeki.
Kulapho i-AI Transformers ingena khona esithombeni. Ngenqubo yokuzinaka, ama-transformer angarekhoda ukuncika kwesikhathi eside kanye nezixhumanisi phakathi kwamagama emshweni. Le ndlela ivumela imodeli ukuthi ikhethe ukuhambela izigaba ezahlukahlukene zokulandelana kokokufaka. Ngakho, ingakwazi ukuqonda umongo nencazelo yegama ngalinye emshweni.
Ayini Kahle Amamodeli Ama-Transformers
I-AI transformer yi-a ukufunda okujulile izakhiwo eziqonda futhi zicubungule izinhlobo ezahlukene zolwazi. Isebenza kahle kakhulu ekunqumeni ukuthi izingcezu eziningi zolwazi zihlobana kanjani, njengokuthi amagama ahlukene emshweni axhunywe kanjani noma ukuthi izingxenye ezihlukene zesithombe zihlangana kanjani.
Isebenza ngokuhlukanisa imininingwane ibe izingcezu ezincane bese ibheka zonke lezo zingxenye ngesikhathi esisodwa. Kunjengokungathi amarobhothi amaningi amancane abambisana ukuze aqonde idatha. Okulandelayo, uma seyazi yonke into, ihlanganisa kabusha zonke izingxenye ukuze inikeze impendulo noma okukhiphayo.
Ama-AI transformer abaluleke kakhulu. Bangakwazi ukuqonda umongo kanye nezixhumanisi zesikhathi eside phakathi kolwazi oluhlukahlukene. Lokhu kubalulekile emisebenzini efana nokuhumusha ulimi, ukufingqa, nokuphendula imibuzo. Ngakho-ke, bayizingqondo ezingemuva kwezinto eziningi ezithakazelisayo i-AI engazifeza!
Ukunakwa Yikho Konke Okudingayo
Isihlokwana esithi "Ukunakwa Yikho Konke Okudingayo" sibhekisela ekushicilelweni kwango-2017 okuhlongoze imodeli ye-transformer. Iguqule isiyalo sokucutshungulwa kolimi lwemvelo (NLP).
Ababhali balolu cwaningo baveze ukuthi indlela yokuzinaka yemodeli ye-transformer yayinamandla ngokwanele ukuthatha indima yokuphindaphinda okuvamile kanye amanethiwekhi we-convolutional neural isetshenziselwa imisebenzi ye-NLP.
Kuyini Ukuzinaka Kahle?
Kuyindlela evumela imodeli ukuthi igxile kumasegimenti ahlukahlukene wokulandelana kokokufaka lapho ikhiqiza izibikezelo.
Ngamanye amazwi, ukuzinaka kwenza imodeli ikwazi ukubala isethi yamaphuzu okunaka ento ngayinye ephathelene nazo zonke ezinye izingxenye, okuvumela imodeli ukuthi ilinganisele ukubaluleka kwento ngayinye yokufaka.
Ngendlela esekelwe ku-transformer, ukuzinaka kusebenza ngale ndlela elandelayo:
Ukulandelana kokokufaka kuqala kushunyekwa ochungechungeni lwamavekhtha, eyodwa yelungu ngalinye lokulandelana.
Ku-elementi ngayinye ngokulandelana, imodeli idala amasethi amathathu ama-vector: i-vector yombuzo, i-vector yokhiye, kanye nevekhtha yenani.
Ivekhtha yombuzo iqhathaniswa nawo wonke ama-vector angukhiye, futhi ukufana kubalwa kusetshenziswa umkhiqizo wamachashazi.
Izikolo zokunaka eziwumphumela zijwayeleke kusetshenziswa umsebenzi we-softmax, okhiqiza isethi yezisindo ebonisa ukubaluleka okuhlobene kwesiqephu ngasinye ngokulandelana.
Ukudala ukumelwa kokukhishwayo kokugcina, amavekhtha yenani aphindaphindwa ngezisindo zokunaka futhi afingqwe.
Amamodeli asekelwe ku-Transformer, asebenzisa ukuzinaka, angase athwebule ngempumelelo ubudlelwano bebanga elide ngokulandelana kokufakwayo ngaphandle kokuncika kumafasitela komongo wobude obugxilile, awenze asebenziseke kakhulu ezinhlelweni zokucubungula ulimi lwemvelo.
Isibonelo
Cabanga ukuthi sinokulandelana kokufaka kwamathokheni ayisithupha: "Ikati lihleli kumata." Ithokheni ngayinye ingase imelelwe njengevekhtha, futhi ukulandelana kokufaka kungabonakala kanje:
Okulandelayo, kuthokheni ngalinye, sizokwakha amasethi amathathu ama-vector: i-vector yombuzo, i-vector engukhiye, kanye nevekhtha yenani. Ivekhtha yethokheni eshumekiwe iphindaphindwa ngamatrices esisindo afundiwe ukuze kukhiqizwe lawa ma-vector.
Kuthokheni yokuqala ethi “The,” ngokwesibonelo, umbuzo, ukhiye, namavekhtha wenani kuzoba:
Ivekhtha yombuzo: [0.4, -0.2, 0.1]
Ivekhtha engukhiye: [0.2, 0.1, 0.5]
Ivekhtha yenani: [0.1, 0.2, 0.3]
Izikolo zokunakwa phakathi kwepheya ngalinye lamathokheni ekulandeleni okokufaka abalwa ngomshini wokuzinaka. Isibonelo, amaphuzu okunakwa phakathi kwamathokheni 1 kanye no-2 "The" angabalwa njengomkhiqizo wamachashazi wombuzo wawo kanye namavekhtha angukhiye:
Isikolo sokunakwa = dot_product(Vector yombuzo we-Token 1, i-Vector engukhiye ye-Token 2)
= (0.4 * 0.8) + (-0.2 * 0.2) + (0.1 * 0.1)
= 0.31
Lawa maphuzu okunakwa abonisa ukuhambisana okuhlobene kwethokheni ngayinye ngokulandelana kwamanye.
Okokugcina, kuthokheni ngayinye, ukumelwa okukhiphayo kwakhiwa ngokuthatha isamba esinesisindo samavekhtha yenani, izisindo ezinqunywa amaphuzu wokunaka. Isethulo esiphumayo sethokheni yokuqala ethi “The,” ngokwesibonelo, kungaba:
Ivekhtha ephumayo yoThokheni 1 = (Isilinganiso sokunaka esinophawu 1) * Ivekhtha yenani lophawu 2
+ (Isilinganiso sokunakwa esinophawu 3) * Ivektha yenani yeTokheni 3
+ (Isilinganiso sokunakwa esinophawu 4) * Ivektha yenani yeTokheni 4
+ (Isilinganiso sokunakwa esinophawu 5) * Ivektha yenani yeTokheni 5
+ (Isilinganiso sokunakwa esinophawu 6) * Ivektha yenani yeTokheni 6
= (0.31 * [0.1, 0.2, 0.3]) + (0.25 * [0.2, -0.1, 0.7]) + (0.08 * [0.3, 0.5, -0.1]) + (0.14 * [0.1, 0.3, -0.2] ) + (0.22 * [0.6, -0.3, 0.4])
= [0.2669, 0.1533, 0.2715]
Njengomphumela wokuzinaka, imodeli esekelwe ku-transformer ingakhetha ukuhambela izigaba ezahlukene zokulandelana kokufaka lapho idala ukulandelana kokuphumayo.
Izicelo Zingaphezu Kokucabanga kwakho
Ngenxa yokuguquguquka kanye nekhono lokusingatha imisebenzi eminingi ye-NLP, njengokuhumusha ngomshini, ukuhlaziya imizwa, ukufingqwa kombhalo, nokunye, abaguquli be-AI bakhule ngokuduma eminyakeni yamuva.
Iziguquli ze-AI zisetshenziswe ezizindeni ezihlukene, okuhlanganisa ukuqashelwa kwezithombe, izinhlelo zokuncoma, kanye nokutholwa kwezidakamizwa, ngaphezu kwezinhlelo zokusebenza ezisekelwe olimini zakudala.
Ama-AI transformer anokusetshenziswa cishe okungenamkhawulo njengoba angafanelana nezindawo eziningi zezinkinga nezinhlobo zedatha. Iziguquli ze-AI, namandla azo okuhlaziya ukulandelana kwedatha eyinkimbinkimbi futhi zithwebule ubudlelwano besikhathi eside, zisethwe zibe yisici esibalulekile sokushayela ekuthuthukisweni kwezinhlelo zokusebenza ze-AI eminyakeni ezayo.
Ukuqhathanisa nezinye Neural Network Architectures
Njengoba bekwazi ukuhlaziya ukulandelana kokokufaka futhi babambe ubudlelwano bebanga elide embhalweni, iziguquli ze-AI zifaneleka kakhulu ukucutshungulwa kolimi lwemvelo uma ziqhathaniswa nezinye izinhlelo zokusebenza zenethiwekhi ye-neural.
Ezinye izakhiwo zenethiwekhi ye-neural, njengamanethiwekhi e-convolutional neural (CNNs) kanye namanethiwekhi e-neural aphindaphindiwe (RNNs), ngakolunye uhlangothi, afaneleka kangcono imisebenzi ehilela ukucutshungulwa kokufaka okuhleliwe, njengezithombe noma idatha yochungechunge lwesikhathi.
Ikusasa Libukeka Liqhakazile
Ikusasa lama-AI transformer libonakala liqhakazile. Enye ingxenye yocwaningo oluqhubekayo ukuthuthukiswa kwamamodeli anamandla aqhubekayo akwazi ukuphatha imisebenzi enzima ngokuya.
Ngaphezu kwalokho, kwenziwa imizamo yokuxhuma ama-AI transformer nobunye ubuchwepheshe be-AI, obufana ukuqinisa ukufunda, ukuhlinzeka ngamakhono okuthatha izinqumo athuthuke kakhulu.
Yonke imboni izama ukusebenzisa amandla e-AI ukuze iqhubekisele phambili izinto ezintsha futhi ifinyelele umkhawulo wokuncintisana. Ngakho-ke, abaguquli be-AI kungenzeka bafakwe kancane kancane ezinhlelweni ezahlukahlukene, kufaka phakathi ukunakekelwa kwezempilo, ezezimali, nokunye.
Ngokuthuthuka okuqhubekayo kubuchwepheshe be-transformer ye-AI kanye namandla alawa mathuluzi e-AI aqinile okuguqula indlela abantu abacubungula ngayo futhi baqonde ulimi, ikusasa libonakala liqhakazile.
shiya impendulo