A yau muna ganin juyin juya hali a fannin sarrafa harshe. Kuma, tabbas babu wata gaba ba tare da basirar wucin gadi ba. Mun riga muna amfani da "mataimakan AI" daban-daban.
Chatbots sune mafi kyawun misalai a yanayinmu. Suna wakiltar sabon zamanin sadarwa. Amma, menene ya sa su na musamman?
Bots na yau da kullun na iya fahimta da amsa tambayoyin harshe na yanayi tare da daidaici da daki-daki irin na ƙwararrun ɗan adam. Yana da ban sha'awa don koyo game da hanyoyin da ke shiga cikin tsari.
Kunna kuma bari mu gano fasahar da ke bayanta.
Nitsewa cikin Tech
AI Transformers shine babban maɓalli a wannan yanki. Suna kamar neural networks wadanda suka kawo sauyi ga sarrafa harshe. A zahiri, akwai daidaitattun ƙirar ƙira tsakanin masu canjin AI da cibiyoyin sadarwar jijiyoyi.
Dukansu sun ƙunshi nau'ikan nau'ikan nau'ikan sarrafawa da yawa waɗanda ke aiwatar da lissafin lissafi don canza bayanan shigarwa zuwa tsinkaya azaman fitarwa. A cikin wannan sakon, za mu kalli ikon AI Transformers da yadda suke canza duniya da ke kewaye da mu.
Yiwuwar Gudanar da Harshen Halitta
Bari mu fara da tushe. Muna jin shi a ko'ina kusan. Amma, menene ainihin sarrafa harshe na halitta?
Wani bangare ne na wucin gadi hankali wanda ke mayar da hankali kan hulɗar mutane da na'urori ta hanyar amfani da harshe na halitta. Manufar ita ce a ƙyale kwamfutoci su gane, fassara, da samar da harshen ɗan adam cikin ma'ana da ingantacciyar hanya.
Gane magana, fassarar harshe, tantance tunani, da taƙaitaccen rubutu duk misalai ne na aikace-aikacen NLP. Samfurin NLP na al'ada, a gefe guda, sun yi ƙoƙari don fahimtar hadaddun alaƙa tsakanin kalmomi a cikin jumla. Wannan ya sa manyan matakan daidaito a yawancin ayyukan NLP ba zai yiwu ba.
Wannan shine lokacin da AI Transformers suka shiga hoton. Ta hanyar kulawa da kai, masu canji na iya yin rikodin dogaro na dogon lokaci da haɗin kai tsakanin kalmomi a cikin jumla. Wannan hanya tana bawa samfurin damar zaɓar halartar sassa daban-daban na jerin shigarwar. Don haka, yana iya fahimtar mahallin da ma'anar kowace kalma a cikin jimla.
Menene ainihin Model na Transformers
Transformer AI shine a zurfin ilmantarwa gine-ginen da ke fahimta da sarrafa nau'ikan bayanai daban-daban. Ya yi fice wajen tantance yadda ɗimbin bayanai ke da alaƙa da juna, kamar yadda ake haɗa kalmomi daban-daban a cikin jimla ko yadda sassa daban-daban na hoto suka dace tare.
Yana aiki ta hanyar rarrabuwar bayanai zuwa ƙanƙanta sannan kuma duba duk waɗannan abubuwan a lokaci ɗaya. Kamar dai ƙananan robobi da yawa suna haɗin gwiwa don fahimtar bayanan. Bayan haka, da zarar ya san komai, ya sake haɗa dukkan abubuwan da aka gyara don ba da amsa ko fitarwa.
AI transformers suna da matukar daraja. Suna iya fahimtar mahallin da kuma dogon lokaci tsakanin bayanai daban-daban. Wannan yana da mahimmanci ga ayyuka kamar fassarar harshe, taƙaitawa, da amsa tambaya. Don haka, su ne kwakwalwar bayan abubuwa masu ban sha'awa da AI za su iya cim ma!
Hankali shine Duk Abinda kuke Bukata
Taken "Hankali shine Duk Abin da kuke Bukata" yana nufin littafin 2017 wanda ya ba da shawarar ƙirar taswira. Ya kawo sauyi a fannin sarrafa harshe na dabi'a (NLP).
Marubutan wannan binciken sun bayyana cewa tsarin na’urar taranfoma ya ba da hankali ga kansa ya isa ya dauki matsayin da aka saba yi akai-akai. hanyoyin sadarwa na zamani An yi amfani da shi don ayyukan NLP.
Menene Hankalin Kai Daidai?
Hanya ce da ke ba da damar ƙirar ta mai da hankali kan sassa daban-daban na shigarwa yayin samar da tsinkaya.
A takaice dai, hankalin kai yana bawa samfurin damar ƙididdige saitin ma'aunin hankali ga kowane kashi dangane da duk sauran abubuwan da suka shafi, yana barin ƙirar ta daidaita mahimmancin kowane ɓangaren shigarwa.
A tsarin da ya dogara da transformer, hankalin kai yana aiki kamar haka:
An fara shigar da jerin abubuwan da aka shigar a cikin jerin nau'i-nau'i, ɗaya ga kowane memba na jerin.
Ga kowane abu a cikin jerin, ƙirar yana haifar da saiti uku na vector: vector ɗin vector, da kuma vector ɗin.
Ana kwatanta alamar tambaya da duk maɓallan maɓalli, kuma ana ƙididdige kamanceceniya ta amfani da samfurin ɗigo.
An daidaita ma'aunin hankali wanda sakamakon ya daidaita ta amfani da aikin softmax, wanda ke haifar da saitin ma'aunin nauyi wanda ke nuna mahimmancin dangi na kowane yanki a cikin jeri.
Don ƙirƙirar wakilcin fitarwa na ƙarshe, ana ninka ma'aunin ƙima ta hanyar ma'aunin hankali da tarawa.
Samfurin tushen canji, waɗanda ke amfani da hankalin kai, na iya samun nasarar kama alakoki mai tsayi a cikin jerin shigarwa ba tare da dogaro da ƙayyadaddun windows mahallin tsayi ba, yana mai da su amfani musamman ga aikace-aikacen sarrafa harshe na halitta.
Example
A ɗauka muna da jerin shigarwar alama guda shida: "Kat ya zauna akan tabarma." Ana iya wakilta kowace alama a matsayin vector, kuma ana iya ganin jerin abubuwan shigar kamar haka:
Bayan haka, za mu samar da yaudara uku: Vector vector, da key vector. Ana ninka vector ɗin da aka saka alama ta matrix masu nauyi da aka koya don samar da waɗannan vectors.
Don alamar farko ta "The," alal misali, tambaya, maɓalli, da ƙima za su kasance:
Tambayar tambaya: [0.4, -0.2, 0.1]
Maɓalli mai mahimmanci: [0.2, 0.1, 0.5]
Ƙimar darajar: [0.1, 0.2, 0.3]
Makin hankali tsakanin kowane nau'i biyu na alamu a cikin jerin shigarwa ana ƙididdige su ta hanyar tsarin kulawa da kai. Misali, makin hankali tsakanin alamomin 1 da 2 “The” za a lissafta su azaman ɗigo na tambayar su da maɓalli:
Maki mai hankali = ɗigo_samfurin (Tambayoyin tambaya na Token 1, Maɓalli na Token 2)
= (0.4 * 0.8) + (-0.2 * 0.2) + (0.1 * 0.1)
= 0.31
Waɗannan maki na kulawa suna nuna alaƙar alaƙar kowane alama a cikin jeri ga sauran.
Ƙarshe, ga kowace alama, ana ƙirƙiri wakilcin fitarwa ta hanyar ɗaukar jimillar ma'aunin ƙima na ƙima, tare da ma'aunin da aka ƙayyade ta makin hankali. Wakilin fitarwa don alamar farko "The," alal misali, zai kasance:
Fitowar fitarwa don Token 1 = (Maki mai da hankali tare da Token 1) * Ƙimar darajar Token 2
+ (Maki mai da hankali tare da Token 3) * Vector darajar don Token 3
+ (Maki mai da hankali tare da Token 4) * Vector darajar don Token 4
+ (Maki mai da hankali tare da Token 5) * Vector darajar don Token 5
+ (Maki mai da hankali tare da Token 6) * Vector darajar don Token 6
= (0.31 * [0.1, 0.2, 0.3]) + (0.25 * [0.2, -0.1, 0.7]) + (0.08 * [0.3, 0.5, -0.1]) + (0.14 * [0.1, 0.3, -0.2]. ) + (0.22 * [0.6, -0.3, 0.4])
= [0.2669, 0.1533, 0.2715]
Sakamakon kulawa da kai, ƙirar taswira na iya zaɓar halartar sassa daban-daban na jerin abubuwan shigarwa lokacin ƙirƙirar jerin abubuwan fitarwa.
Aikace-aikace sun fi yadda kuke tunani
Saboda daidaitawarsu da iyawar su na gudanar da ayyuka masu yawa na NLP, irin su fassarar injin, nazarin jin daɗi, taƙaitaccen rubutu, da ƙari, masu canjin AI sun girma cikin shahara a cikin 'yan shekarun nan.
An yi amfani da masu canjin AI a wurare daban-daban, gami da tantance hoto, tsarin shawarwari, har ma da gano magunguna, ban da aikace-aikacen tushen harshe na gargajiya.
Masu taswirar AI suna da amfani kusan marasa iyaka tunda ana iya keɓance su zuwa yankuna da yawa na matsaloli da nau'ikan bayanai. Masu taswirar AI, tare da ikon su na nazarin jerin rikitattun bayanai da kuma ɗaukar alaƙa na dogon lokaci, an saita su don zama babban abin tuƙi a cikin haɓaka aikace-aikacen AI a cikin shekaru masu zuwa.
Kwatanta da Sauran Gine-ginen Cibiyar Sadarwar Jijiya
Kamar yadda za su iya nazarin jerin shigarwar da kuma fahimtar dangantaka mai nisa a cikin rubutu, masu canza canjin AI sun dace sosai don sarrafa harshe na halitta idan aka kwatanta da sauran aikace-aikacen cibiyar sadarwa.
Wasu gine-ginen hanyoyin sadarwa na jijiyoyi, irin su hanyoyin sadarwa na jijiyoyi (CNNs) da cibiyoyin sadarwa na yau da kullun (RNNs), a daya bangaren, sun fi dacewa da ayyukan da suka shafi sarrafa tsarin shigarwa, kamar hotuna ko bayanan jerin lokaci.
Gaba yana Neman Haske
Makomar AI taswira tana da haske. Wani yanki na binciken da ke gudana shine haɓaka samfura masu ƙarfi masu ƙarfi waɗanda za su iya ɗaukar ayyuka masu rikitarwa.
Bugu da ƙari, ana ƙoƙarin haɗa taswirar AI tare da sauran fasahar AI, kamar ƙarfafa ilmantarwa, don samar da ƙarin ƙarfin yanke shawara.
Kowace masana'antu tana ƙoƙarin yin amfani da yuwuwar AI don fitar da ƙididdigewa da cimma gasa. Don haka, ana iya shigar da masu canjin AI a hankali cikin aikace-aikace iri-iri, gami da kiwon lafiya, kuɗi, da sauransu.
Tare da ci gaba da inganta fasahar taswirar AI da kuma yuwuwar waɗannan kayan aikin AI masu ƙarfi don sauya yadda mutane ke aiwatarwa da fahimtar harshe, gaba yana da haske.
Leave a Reply