chakagadzirwa njere iri kushandura nzira yatinoronga uye kugadzira zvirimo. Zviri kukanganisawo kuti vanhu vanowana sei zvinhu, kubva pane zvavanotsvaga paGoogle kusvika kune zvavanogara vachiona paNetflix.
Zvakatonyanya kukosha, kune vatengesi vemukati, zvinoita kuti zvikwata zvikure nekuita otomatiki mamwe marudzi ekugadzirwa kwezvinhu uye kuongorora zvinhu zvazvino kuti uvandudze zvauri kuendesa uye kuenzanisa zvirinani chinangwa chevatengi.
Kune akati wandei anofamba zvidimbu muAI uye machine learning maitiro. Wakambobvunza mubatsiri akangwara (akadai saSiri kana Alexa) mubvunzo?
Mhinduro yacho ingangove "hongu," izvo zvinoratidza kuti iwe watoziva magadzirirwo emutauro wechisikigo pane imwe nhanho (NLP).
Alan Turing izita iro techie wese akambonzwa nezvaro. Muedzo weTuring unozivikanwa wakatanga kugadzirwa muna 1950 nenyanzvi yemasvomhu uye nyanzvi yekombuta Alan Turing.
Aizviti mubasa rake Computing Machinery uye Intelligence kuti muchina wakangwara kana uchigona kutaura nemunhu uye kumunyengera kuti afunge kuti ari kutaura nemunhu.
Izvi zvakashanda sehwaro hweNLP tekinoroji. Iyo inoshanda NLP sisitimu ichakwanisa kubata mubvunzo uye mamiriro ayo, kuiongorora, kusarudza nzira yakanaka yekuita, uye kupindura nemutauro unozonzwisiswa nemushandisi.
Yepasirese zviyero zvekupedzisa mabasa pane data zvinosanganisira hungwaru hwekugadzira uye hunyanzvi hwekudzidza muchina. Zvakadiniko nomutauro wavanhu, kunyanguvezvo?
Minda yechizvarwa chemutauro wechisikigo (NLG), kunzwisisa mutauro wechisikigo (NLU), uye kugadzirwa kwemutauro wechisikigo (NLP) zvese zvakawana kutariswa kwakawanda mumakore achangopfuura.
Asi nekuti vatatu ava vane mabasa akasiyana, zvakakosha kuti tisavhiringika. Vakawanda vanotenda kuti vanonzwisisa pfungwa idzi zvizere.
Sezvo mutauro wechisikigo wagara uripo mumazita, zvese zvaari kuita kugadzikiswa, kuzvinzwisisa, nekuzvigadzira. Takafunga kuti zvingabatsira kuti tidzikame zvishoma, zvisinei, tichifunga kuti kakawanda sei patinosangana nemitsara iyi inoshandiswa zvakasiyana.
Naizvozvo, ngatitangei nekunyatsoongorora imwe neimwe yadzo.
Chii chinonzi Natural Language Processing?
Chero mutauro wechisikigo unoonekwa sechinyorwa chemahara nemakomputa. Izvi zvinotevera kuti paunenge uchipinda data, hapana akagadziriswa mazwi panzvimbo dzakagadziriswa. Pamusoro pekusarongeka, mutauro wechisikigo unewo nzira dzakasiyana dzekutaura. Tora mitsara mitatu iyi semufananidzo:
- Mamiriro ekunze ari sei nhasi?
- Nhasi kune mukana wekunaya kwemvura here?
- Nhasi zvinoda kuti ndiuye neamburera yangu here?
Chimwe nechimwe chezvirevo izvi chiri kubvunza nezve mamiriro ekunze emazuva ano, inova iyo yakafanana denominator.
Sevanhu, tinogona kuona nekukasika aya hukama hwakakosha uye toita nemazvo.
Nekudaro, ichi ndicho dambudziko kumakomputa sezvo yega yega algorithm inoda iyo yekupinza kuti iteedzere fomati chaiyo, uye ese matatu zvirevo ane zvimiro zvakasiyana uye mafomati.
Uye zvinhu zvichanyanya kuoma munguva pfupi iri kutevera kana tikaedza kubatanidza mitemo yeshoko rega rega rega mumutauro wega wega kubatsira komputa kunzwisisa. NLP inopinda mumufananidzo mumamiriro ezvinhu aya.
Natural language processing (NLP), iyo inoedza ku muenzaniso mutauro wechisikigo wevanhu data, yakabva ku computational linguistics.
Pamusoro pezvo, NLP inotarisana nekushandisa muchina kudzidza uye nzira dzakadzama dzekudzidza uku uchigadzira huwandu hwakakosha hwekuisa kwevanhu. Inowanzo shandiswa muuzivi, mitauro, sainzi yekombuta, masisitimu eruzivo, uye kutaurirana.
Computational linguistics, syntax analysis, kucherechedzwa kwekutaura, kududzira muchina, uye mamwe masubfields eNLP angori mashoma. Kugadziriswa kwemutauro wechisikigo kunoshandura zvinhu zvisina kuumbwa kuita chimiro chakakodzera kana chinyorwa chakarongeka kuti chishande.
Kuti unzwisise zvinorehwa nemushandisi pavanotaura chero chinhu, inovaka algorithm uye inodzidzisa modhi ichishandisa yakawanda yakawanda data.
Inoshanda nekuunganidza masangano akasiyana pamwechete kuti azivikanwe (inozivikanwa sekuzivikanwa kwesangano) uye nekuziva mapatani emazwi. Lemmatization, tokenization, uye matekiniki ekugadzirisa anoshandiswa kutsvaga mazwi mapatani.
Kubvisa ruzivo, kucherechedzwa kwezwi, chikamu-che-yekutaura tagging, uye kupatsanura angori mashoma emabasa anoitwa neNLP.
Munyika chaiyo, NLP inoshandiswa kumabasa anosanganisira ontology populating, mutauro modhi, manzwiro ongororo, kutorwa kwemusoro wenyaya, kuzivikanwa kwesangano, zvikamu-zve-kutaura-tega, kuburitsa kwekubatanidza, kushandura nemuchina, uye mhinduro yemibvunzo yega.
Chii chinonzi Natural Language Kunzwisisa?
Chikamu chidiki chekugadzirisa mutauro wechisikigo kunzwisisa mutauro wechisikigo. Mushure mekunge mutauro warerutswa, software yekombuta inofanirwa kunzwisisa, kuburitsa zvinoreva, uye pamwe kunyange kuita ongororo yemanzwiro.
Chinyorwa chimwe chete chinogona kuva nerevo dzakawanda, mitsara yakati wandei inogona kuva nerevo imwe chete, kana kuti chirevo chinogona kuchinja zvichienderana nemamiriro ezvinhu.
NLU maalgorithms anoshandisa nzira dzemakombuta kugadzirisa zvinyorwa kubva kune akawanda masosi kuitira kuti unzwisise zvinyorwa zvekupinza, izvo zvinogona kuve zvakakosha sekuziva zvinorehwa nemutsara kana kuomarara sekududzira nhaurirano pakati pevanhu vaviri.
Chinyorwa chako chinoshandurwa kuita chimiro chinoverengwa nemuchina. Nekuda kweizvozvo, NLU inoshandisa matekiniki ehunyanzvi kutsanangura zvinyorwa uye kugadzira mhedzisiro.
NLU inogona kushandiswa mumamiriro akasiyana-siyana, sekunzwisisa nhaurirano pakati pevanhu vaviri, kuona kuti mumwe munhu anonzwa sei nezveimwe mamiriro ezvinhu, uye mamwe mamiriro akafanana.
Kunyanya, kune mana emitauro mazinga ekubata NLU:
- Syntax: Iyi ndiyo nzira yekuona kana girama iri kushandiswa nemazvo uye kuti mitsara inobatanidzwa sei. Somuenzaniso, mashoko akapoteredza chirevo uye girama zvinofanira kurangarirwa kuti zvionekwe kana zvine musoro.
- Semantics: Kana tikaongorora chinyorwa, chirevo chechirevo chechirevo chechirevo chechiito kana sarudzo yezwi pakati pevanhu vaviri iripo. Aya mabheti eruzivo anogona zvakare kushandiswa neNLU algorithm kupa mhedzisiro kubva kune chero mamiriro ezvinhu umo izwi rimwechete rinotaurwa rinogona kushandiswa.
- Izwi rekuti disambiguation: Inzira yekuona kuti izwi rega rega mumutsara rinorevei. Zvichienderana nezviri kutaurwa, rinopa izwi zvarinoreva.
- Pragmatic ongororo: Inobatsira mukunzwisisa marongero uye chinangwa chebasa.
NLU inokosha kune data masayendisiti nekuti, pasina iyo, vanoshaya kugona kuburitsa zvinoreva kubva kumatekinoroji senge chatbots uye software yekuziva kutaura.
Mushure mezvose, vanhu vajaira kuita hurukuro nebot inogonesa kutaura; makomputa, kune rumwe rutivi, haana umbozha uhwu hwekureruka.
Pamusoro pezvo, NLU inogona kuziva manzwiro uye zvinyadzi mukutaura sezvaunokwanisa. Izvi zvinoreva kuti masayendisiti edata anogona kunyatsoongorora akasiyana mafomu mafomati uye kuronga zvinyorwa vachishandisa kugona kweNLU.
NLG inoshanda zvinopesana zvakananga nekunzwisisa mutauro wechisikigo, iyo ine chinangwa chekuronga uye kuita pfungwa yedata risina kurongeka kuitira kuti rishandure kuita data rinoshandiswa. Tevere, ngatitsanangurirei NLG uye tiongorore nzira iyo data masayendisiti anoishandisa muzviitiko zvekushandisa.
Chii chinonzi Natural Language Generation?
Kugadziriswa kwemutauro wechisikigo kunosanganisirawo kugadzira mutauro wechisikigo. Makombiyuta anogona kunyora achishandisa kugadzirwa kwemutauro wechisikigo, asi kunzwisisa mutauro wechisikigo kunotarisa kunzwisisa kwekuverenga.
Nekushandisa kumwe kuisa data, NLG inogadzira mhinduro yakanyorwa mumutauro wevanhu. Masevhisi-ku-kutaura-kutaura inogona zvakare kushandiswa kushandura chinyorwa ichi kuita kutaura.
Kana masayendisiti edata achipa NLG system ine data, sisitimu inoongorora iyo data kuburitsa nganonyorwa dzinogona kunzwisiswa kuburikidza nenhaurirano.
Muchidimbu, NLG inoshandura seti yedata kuita mutauro watinonzwisisa tese, unonzi mutauro wechisikigo. Kuti ikwanise kupa kuburitsa kwakanyatso dzidza uye kwakaringana kusvika padanho rinogoneka, NLG inopihwa ruzivo rwemunhu chaiye-hupenyu.
Iyi nzira, iyo inogona kurondwa kumashure kune mamwe ezvinyorwa zvaAlan Turing zvatatokurukura, yakakosha pakuita kuti vanhu vabvume kuti komputa iri kukurukura navo nenzira inonzwisisika uye yemusikirwo, zvisinei nenyaya iripo.
NLG inogona kushandiswa nemasangano kugadzira nyaya dzekutaura dzinogona kushandiswa nemunhu wese mukati mekambani.
NLG, iyo inonyanya kushandiswa kune bhizinesi rehungwaru madhibhodhi, otomatiki kugadzirwa kwezvinhu, uye kunyatsoshanda kuongorora data, inogona kubatsira zvikuru kune nyanzvi dzinoshanda muzvikamu sekushambadzira, zviwanikwa zvevanhu, kutengesa, uye ruzivo rwehunyanzvi.
Ndeipi basa rinoitwa neNLU neNGL muNLP?
NLP inogona kushandiswa nemasainzi data uye chakagadzirwa njere nyanzvi kushandura isina kurongeka seti yedata kuita mafomu ayo makomputa anogona kuturikira kukutaura uye zvinyorwa - vanogona kutogadzira mhinduro dzinoenderana nemubvunzo waunovabvunza (funga zvakare kune chaivo vabatsiri vakaita saSiri neAlexa).
Asi NLU neNLG zvinokwana papi muNLP?
Kunyange zvazvo ose achiita mabasa akasiyana, ose ari matatu edzidziso idzi ane chinhu chimwe chete akafanana: ose anobata nemutauro wechisikigo. Saka, ndeupi musiyano pakati pevatatu?
Zvifunge seizvi: nepo NLU ichivavarira kunzwisisa mutauro unoshandiswa nevanhu, NLP inocherekedza iyo yakakosha data uye inoironga muzvinhu zvakaita semavara uye manhamba.
Inogona kutobatsira nezvinokuvadza encrypted kutaurirana. NLG, kune rumwe rutivi, inoshandisa kuunganidzwa kwe data isina kurongeka kuburitsa nyaya dzatinogona kududzira sedzinoreva.
Ramangwana reNLP
Kunyangwe NLP iine akawanda azvino kushandiswa kwekutengesa, mabhizinesi mazhinji akaona zvichinetsa kuitora zvakafara.
Izvi zvinonyanya kuitika nekuda kwezvinhu zvinotevera: Imwe nyaya inowanzobata masangano inyaya yakawandisa, izvo zvinoita kuti zvivaomere kuziva kuti ndeapi maseti edata akakosha mukati megungwa rinoita kunge risingaperi remamwe data.
Pamusoro pezvo, kuti ushandise NLP nemazvo, masangano anowanzo kuda dzimwe nzira nemidziyo inovagonesa kutora ruzivo rwakakosha kubva kudata.
Chekupedzisira asi chisiri chidiki, NLP inoreva kuti makambani anoda michina yekucheka-cheka kana vachida kubata uye kuchengetedza kuunganidzwa kwedata kubva kwakasiyana data masosi vachishandisa NLP.
Zvisinei nezvipingamupinyi kuchengetedza kuwanda kwemafemu kubva kutora NLP, zvinoita sekunge masangano mamwe chete aya anozopedzisira ambundira NLP, NLU, uye NLG kugonesa marobhoti avo kuchengetedza kwechokwadi, kudyidzana kwevanhu uye nhaurirano.
Semantics uye syntax maviri eNLP subfields yekutsvagisa ari kugamuchira kutariswa kwakawanda.
mhedziso
Tichifunga zvatakurukura kusvika pari zvino: Kugovera zvinoreva izwi nekunyora, NLU inoverenga nekunzwisisa mutauro wechisikigo, uye NLG inovandudza nekuburitsa mutauro mutsva nerubatsiro rwemichina.
Mutauro unoshandiswa neNLU kutora chokwadi, nepo NLG inoshandisa nzwisiso yakawanikwa neNLU kugadzira mutauro wechisikigo.
Chenjerera vatambi vakuru muindasitiri yeIT seApple, Google, neAmazon kuti vaenderere mberi nekudyara muNLP kuti vakwanise gadzira masisitimu zvinotevedzera maitiro evanhu.
Leave a Reply