M'ndandanda wazopezekamo[Bisani][Show]
Ndikukhulupirira kuti mudamvapo zanzeru zopangira, komanso mawu ngati kuphunzira pamakina ndi kukonza zilankhulo zachilengedwe (NLP).
Makamaka ngati mumagwira ntchito kukampani yomwe imagwira mazana, kapena masauzande, a makasitomala tsiku lililonse.
Kusanthula kwa data pama media ochezera, maimelo, macheza, mayankho otseguka, ndi magwero ena si njira yosavuta, ndipo imakhala yovuta kwambiri ikaperekedwa kwa anthu okha.
Ndicho chifukwa chake anthu ambiri amakondwera ndi kuthekera kwa nzeru zochita kupanga ntchito zawo zatsiku ndi tsiku ndi mabizinesi .
Kusanthula mawu koyendetsedwa ndi AI kumagwiritsa ntchito njira zingapo kapena ma algorithms osiyanasiyana kuti amasulire chilankhulo, chimodzi mwazomwe ndikusanthula mitu, yomwe imagwiritsidwa ntchito kuti ipeze mitu kuchokera m'malemba.
Mabizinesi atha kugwiritsa ntchito njira zowunikira mitu kusamutsa ntchito zosavuta pamakina m'malo molemetsa ogwira ntchito ndi data yochulukirapo.
Ganizirani kuchuluka kwa nthawi yomwe gulu lanu lingapulumutse ndikugwiritsa ntchito zofunika kwambiri ngati kompyuta ikhoza kusefa pamndandanda wamakasitomala osatha kapena zovuta zothandizira m'mawa uliwonse.
Mu bukhuli, tiwona za kutsanzira mitu, njira zosiyanasiyana zopangira mitu, ndikupeza luso lothandizira.
Kodi Topic Modelling ndi chiyani?
Kujambula mitu ndi mtundu wa zolemba zomwe zimawerengeredwa mosayang'aniridwa ndi kuyang'aniridwa makina kuphunzira Njira zimagwiritsidwa ntchito kuti zizindikire zomwe zikuchitika mumagulu kapena kuchuluka kwa mawu osalongosoka.
Zitha kutenga zolemba zanu zambiri ndikugwiritsa ntchito njira yofananira kuti musinthe mawuwo kukhala magulu a mawu ndikupeza mitu.
Izi zikuwoneka zovuta komanso zovuta, kotero tiyeni tifewetse ndondomeko yachitsanzo!
Tangoganizani kuti mukuwerenga nyuzipepala yomwe ili ndi zolemba zamitundumitundu m'manja mwanu.
Kodi zimenezo si zachikale?
Ndikuzindikira kuti masiku ano, ndi anthu ochepa amene amawerenga nyuzipepala zosindikizidwa; chilichonse ndi digito, ndipo zowunikira ndi zakale! Muzidziyerekezera kukhala bambo kapena mayi anu!
Choncho, mukamawerenga nyuzipepala, mumatsindika mfundo zofunika kwambiri.
Lingaliro linanso!
Mumagwiritsa ntchito mtundu wina kuti mutsindike mawu osakira amitu yosiyanasiyana. Mumagawa mawu osakira kutengera mtundu ndi mitu yomwe mwapatsidwa.
Gulu lililonse la mawu olembedwa ndi mtundu winawake ndi mndandanda wa mawu osakira pamutu womwe waperekedwa. Kuchuluka kwa mitundu yosiyanasiyana yomwe mwasankha kumawonetsa kuchuluka kwa mitu.
Ichi ndiye chitsanzo chofunikira kwambiri cha mitu. Imathandiza kumvetsetsa, kulinganiza, ndi kufotokoza mwachidule zosonkhanitsidwa zazikulu.
Komabe, dziwani kuti kuti mukhale ogwira mtima, mitu yodzipangira yokha imafunikira zambiri. Ngati muli ndi pepala lalifupi, mungafune kupita kusukulu yakale ndikugwiritsa ntchito zowunikira!
Zimakhalanso zopindulitsa kukhala ndi nthawi yodziwa zambiri. Izi zidzakupatsani chidziwitso cha zomwe mutu wa mutu uyenera kupeza.
Mwachitsanzo, diary imeneyo ikhoza kukhala yokhudza maubwenzi anu apano ndi am'mbuyomu. Chifukwa chake, ndimayembekezera kuti mnzanga waku mining robot abwere ndi malingaliro ofanana.
Izi zitha kukuthandizani kuti muwunike bwino za maphunziro omwe mwawapeza ndipo, ngati kuli kofunikira, sinthani mawu osakira.
Zigawo za Topic Modelling
Chitsanzo cha Probabilistic
Zosintha mwachisawawa ndi zogawika zotheka zimaphatikizidwa mu chiwonetsero cha chochitika kapena chodabwitsa mumamodeli otheka.
Chitsanzo chodziwikiratu chimapereka chiganizo chimodzi chotheka pazochitika, pamene chitsanzo cha probabilistic chimapereka mwayi wogawa ngati yankho.
Zitsanzozi zimaona kuti nthawi zambiri sitikhala ndi chidziwitso chokwanira pazochitika zinazake. Pali pafupifupi nthawi zonse chinthu chachisawawa choyenera kuganizira.
Mwachitsanzo, inshuwaransi ya moyo imatsogozedwa ndi zenizeni zomwe tikudziwa kuti tidzafa, koma sitikudziwa kuti liti. Zitsanzozi zitha kukhala zodziwikiratu pang'ono, zosasinthika pang'ono, kapena mwachisawawa.
Kubweza Zambiri
Information Retrieval (IR) ndi pulogalamu yamapulogalamu yomwe imalinganiza, kusunga, kupeza, ndikuwunika zambiri kuchokera m'malo osungira zolemba, makamaka zolemba.
Tekinolojeyi imathandiza ogwiritsa ntchito kuzindikira zomwe akufuna, koma sizipereka mayankho omveka bwino pafunso lawo. Imadziwitsa za kukhalapo ndi malo a mapepala omwe angapereke zofunikira.
Zolemba zoyenera ndi zomwe zimakwaniritsa zosowa za wogwiritsa ntchito. Dongosolo la IR lopanda cholakwika lidzabweza zolemba zosankhidwa zokha.
Kugwirizana kwa Mutu
Kugwirizana kwa mitu kumapeza mutu umodzi powerengera kuchuluka kwa kufanana kwa semantic pakati pa mawu opambana kwambiri a mutuwo. Ma metrics awa amathandiza kusiyanitsa pakati pa maphunziro omwe amatha kumasuliridwa mwamawu ndi mitu yomwe ili yongoyerekeza.
Ngati gulu la zonena kapena zowona zimathandizirana, zimanenedwa kukhala zogwirizana.
Chotsatira chake, mfundo yogwirizana ikhoza kumveka m'nkhani yomwe ikuphatikiza mfundo zonse kapena zambiri. “Masewerawa ndi maseŵera a m’timu,” “maseŵera amasewera ndi mpira,” ndipo “maseŵerawo amafunikira khama lalikulu” zonsezi ndi zitsanzo za mfundo zogwirizana.
Njira Zosiyanasiyana Zotsatsira Mutu
Njira yovutayi imatha kuchitidwa ndi ma algorithms osiyanasiyana kapena njira. Zina mwa izo ndi:
- Latent Dirichlet Allocation (LDA)
- Non Negative Matrix Factorization (NMF)
- Latent Semantic Analysis (LSA)
- Probabilistic Latent Semantic Analysis(pLSA)
Latent Dirichlet Allocation (LDA)
Kuti muwone maubwenzi pakati pa zolemba zingapo mugulu, lingaliro lachiwerengero ndi zithunzi za Latent Dirichlet Allocation amagwiritsidwa ntchito.
Pogwiritsa ntchito njira ya Variational Exception Maximization (VEM), kuyerekezera kwakukulu komwe kungachitike kuchokera pazolemba zonse kumakwaniritsidwa.
Mwachikhalidwe, mawu ochepa apamwamba ochokera m'thumba la mawu amasankhidwa.
Komabe, chiganizocho chilibe tanthauzo.
Malingana ndi njira iyi, malemba aliwonse adzayimiridwa ndi kugawidwa kwapadera kwa maphunziro, ndipo mutu uliwonse ndi kugawa kwa mawu.
Non Negative Matrix Factorization (NMF)
Matrix okhala ndi Non-Negative Values Factorization ndi njira yodula kwambiri.
Pakakhala mikhalidwe yambiri ndipo mawonekedwe ake ndi osamveka bwino kapena osadziwiratu bwino, NMF ndiyopindulitsa. NMF imatha kupanga mapangidwe ofunikira, maphunziro, kapena mitu pophatikiza mawonekedwe.
NMF imapanga gawo lililonse ngati kuphatikiza kwa mizere yoyambira.
Chigawo chilichonse chimakhala ndi ma coefficients omwe amayimira kufunikira kwa gawo lililonse pagawolo. Nambala iliyonse ndi mtengo uliwonse wamtundu uliwonse uli ndi coefficient yake.
Ma coefficients onse ndi abwino.
Latent Semantic Analysis
Ndi njira ina yophunzirira yosayang'aniridwa yomwe imagwiritsidwa ntchito pochotsa mayanjano pakati pa mawu muzolemba ndi kusanthula kwachinsinsi.
Izi zimatithandiza kusankha zikalata zoyenera. Ntchito yake yayikulu ndikuchepetsa kukula kwa kuchuluka kwa data yamalemba.
Deta zosafunikirazi zimakhala ngati phokoso lakumbuyo popeza chidziwitso chofunikira kuchokera mu data.
Probabilistic Latent Semantic Analysis(pLSA)
Probabilistic latent semantic analysis (PLSA), yomwe nthawi zina imadziwika kuti probabilistic latent semantic indexing (PLSI, makamaka m'mabwalo obweza chidziwitso), ndi njira yowerengera yosanthula deta yamitundu iwiri komanso yofanana.
M'malo mwake, chofanana ndi kusanthula kobisika kwa semantic, komwe PLSA idatulukira, kuyimira kocheperako kwa zosinthika zomwe zawonedwa zitha kutengedwa potengera kuyanjana kwawo kumitundu yobisika.
Manja ndi Topic Modelling mu Python
Tsopano, ndikuyendetsani gawo lachitsanzo ndi Python chinenero chamakono pogwiritsa ntchito chitsanzo chenicheni.
Ndikhala ndikutengera zolemba zofufuza. Dongosolo lomwe ndikhala ndikugwiritsa ntchito pano likuchokera ku kaggle.com. Mutha kupeza mosavuta mafayilo onse omwe ndikugwiritsa ntchito polemba izi tsamba.
Tiyeni tiyambe ndi Topic Modelling pogwiritsa ntchito Python poitanitsa malaibulale onse ofunikira:
Chotsatira ndikuwerenga ma dataset onse omwe ndikhala ndikugwiritsa ntchito pa ntchitoyi:
Kusanthula kwa Data
EDA (Exploratory Data Analysis) ndi njira yowerengera yomwe imagwiritsa ntchito zinthu zowoneka. Imagwiritsa ntchito chidule cha ziwerengero ndi zowonetsera kuti zipeze zomwe zikuchitika, mawonekedwe, ndi zongoyerekeza.
Ndisanthula deta yowunikira ndisanayambe kutsanzira mitu kuti ndiwone ngati pali machitidwe kapena maubale mu datayo:
Tsopano tipeza zinthu zopanda pake za dataset yoyeserera:
Tsopano ndikukonzekera histogram ndi boxplot kuti ndiwone mgwirizano pakati pa zosinthika.
Kuchuluka kwa zilembo mu Abstracts of the Train set zimasiyanasiyana kwambiri.
Pa sitimayi, tili ndi zilembo zosachepera 54 komanso zilembo zosachepera 4551. 1065 ndiye kuchuluka kwa zilembo.
Mayeserowa akuwoneka kuti ndi osangalatsa kwambiri kuposa momwe amaphunzitsira popeza mayeso ali ndi zilembo 46 pomwe maphunzirowo ali ndi 2841.
Chotsatira chake, kuyesedwa koyesedwa kunali ndi pakati pa zilembo za 1058, zomwe zimafanana ndi maphunziro.
Chiwerengero cha mawu mu phunziroli chimatsatira ndondomeko yofanana ndi chiwerengero cha zilembo.
Mawu osachepera 8 ndi mawu opitilira 665 amaloledwa. Zotsatira zake, kuchuluka kwa mawu apakatikati ndi 153.
Mawu osachepera asanu ndi awiri m'chidule komanso mawu opitilira 452 pamayeso amafunikira.
Wapakati, pankhaniyi, ndi 153, yemwe ndi wofanana ndi wapakatikati pamaphunzirowo.
Kugwiritsa Ntchito Ma tag pa Nkhani Zotsatsira
Pali njira zingapo zopangira mitu. Ndigwiritsa ntchito ma tag muzochita izi; tiyeni tiwone momwe tingachitire poyang'ana ma tag:
Kugwiritsa Ntchito Topic Modelling
- Chidule cha mawu chingagwiritsidwe ntchito kuzindikira mutu wa chikalata kapena buku .
- Itha kugwiritsidwa ntchito kuchotsa kukondera kwa ofuna kulowa mayeso.
- Kujambula mitu kungagwiritsidwe ntchito kupanga maulalo a semantic pakati pa mawu amitundu yotengera ma graph.
- Itha kupititsa patsogolo ntchito zamakasitomala pozindikira ndikuyankha mawu osakira pakufunsa kwa kasitomala. Makasitomala adzakukhulupirirani kwambiri popeza mwawapatsa chithandizo chomwe amafunikira panthawi yoyenera komanso osawabweretsera vuto lililonse. Zotsatira zake, kukhulupirika kwamakasitomala kumakwera kwambiri, ndipo kufunika kwa kampani kumawonjezeka.
Kutsiliza
Kujambula mitu ndi mtundu wa ziwerengero zomwe zimagwiritsidwa ntchito povumbulutsa "mitu" yomwe ilipo m'gulu la zolemba.
Ndi mtundu wa chiwerengero cha ziwerengero chomwe chimagwiritsidwa ntchito mu makina kuphunzira ndi kukonza zilankhulo zachirengedwe kuti avumbulutse malingaliro osamveka omwe amapezeka m'malemba.
Ndi njira yopangira migodi yomwe imagwiritsidwa ntchito kwambiri kuti mupeze mawonekedwe obisika pamawu amthupi.
Siyani Mumakonda