Isiqulatho[Fihla][Bonisa]
Idatha ikwindawo yonke ekujikelezileyo. Ngokwenyani, ichaphazela yonke inkalo yeshishini lakho. Isenokuvakala ngathi akukho xesha laneleyo lokuphonononga iinkcukacha zendlela elisebenza ngayo ishishini lakho xa uxakene nezigqibo malunga nendlela yokuphatha idatha yakho.
Qwalasela oku. Umbutho wakho usebenzisa idatha yeeyure ezingama-24 ngosuku. Ke ukuqonda ukuba ivela phi, ifike njani apho, kwaye ihamba njani kwinkampani kubalulekile ukuze uliqonde ixabiso layo.
Uluhlu lwedatha luba lubalulekile kule meko. Kulula ukuqonda indlela idatha eyenziwe ngayo, apho ivela khona, kwaye iya phi xa sinokulandela imvelaphi, ukufuduka, kunye notshintsho lwedatha.
Kule post, siza kujonga ngokusondeleyo kuMda weDatha, indlela esebenza ngayo, iimeko zokusetyenziswa kwayo, ubuchule, nokunye okuninzi.
Yintoni iData Lineage?
Uluhlu lwedatha lusebenza njengoluhlobo lwepaspoti yedijithali. Yeyona akhawunti ibanzi yohambo lwedatha, ichaza zonke iindawo zokumisa, ukujikwa, kunye nohlengahlengiso ukusuka kwimvelaphi yayo ukuya kwindawo yayo ekugqibeleni.
In ingundoqo, umgca wedatha uchaza imvelaphi, ukuguqulwa, kunye nokusetyenziswa kweqhekeza ledatha kwiinkqubo ezininzi kunye namaqonga. Isebenza njengesixhobo somcuphi ngokunika abasebenzisi ulwazi malunga nendlela idatha eveliswe ngayo, ivela phi, kunye nendlela esetyenziswe ngayo. Olu lwazi luvumela abasebenzisi ukuba baqaphele kwaye basombulule naziphi na iingxaki ezinokubakho.
Umda wedatha sisixhobo esixabisekileyo kwiinkampani ezixhomekeke kwidatha ukuqhuba imisebenzi yazo kuba ivumela abasebenzisi ukuba baphendule kwimibuzo ebalulekileyo efana nokuba ngubani, yintoni, nini, kwaye phi.
Umda wedatha, ukuyibeka ngokulula, ngowona mzila wedatha wokugqibela oqinisekisa ukuchaneka kwedatha, ukugqibelela, kunye nokungaguquguquki ngelixa unikezela ngembono ecacileyo nemfutshane yendlela epheleleyo yedatha.
Isebenza njani iData Lineage?
Uluhlu lwedatha yimephu yendlela eyenza ukuba silandele isiqwenga sedatha ukusuka kwindawo yokuqala ukuya ekupheleni kwayo. Qwalasela inqaku ledatha njengomhambi, kunye nencwadana yokundwendwela yayo ukuba ibe ngumda wayo wedatha ukuqonda ngcono indlela esebenza ngayo.
Imithombo yedatha, ukuguqulwa kwedatha, ukugcinwa kwedatha, kunye nemveliso yedatha yenza amacandelo amane aphambili epaspoti.
Iinkqubo ezininzi, izicelo, kunye namaqonga apho idatha ivela khona imelwe yimithombo yedatha, esebenza njengeendawo zokuqala zohambo lwedatha. Ukuguqulwa kwedatha linqanaba elilandelayo, kunye neetshathi zomgca wedatha ukuqhubela phambili kwedatha ukusuka kule mithombo ukuya kuyo.
Ukuguqulwa kwedatha kubhekiselele ekubunjweni, ekulungisweni, nasekulawuleni idatha ukuhlangabezana neemfuno zabasebenzisi. Isebenza njengendawo yokuphumla ngexesha lohambo lwedatha, ilungiselela umlenze olandelayo.
Idatha ke igcinwa phambi kokuba iye kwindawo yayo yokugqibela. Inokugcinwa kwiiseva zelifu, oovimba beenkcukacha, okanye olunye uhlobo lwesixhobo sogcino. Umda wedatha ugcina umkhondo wendawo apho idatha igcinwe khona, kunye nendlela ekhuselwe ngayo, igcinwe, kwaye ifunyenwe.
Isinyathelo sokugqibela sisiphumo sedatha, apho idatha ithunyelwa ukuba isetyenziswe. Iingxelo, i-infographics, okanye naluphi na olunye uhlobo lwemveliso yedatha enokusetyenziswa ukuyibonisa. Umgca wedatha ugcina umkhondo wesiphumo kwaye uqinisekisa ukuhambelana, ukuchaneka, kunye nokuphelela kwedatha.
Uluhlu lwedatha lusebenza ngokusisiseko ngokurekhoda inqanaba ngalinye lohambo lwedatha, ukusuka ekuqaleni ukuya kwimveliso yalo, kunye nokuqinisekisa ukuba lihlala lithembekile, lingaguquguquki, kwaye lilungile yonke indlela. Umda wedatha unceda imibutho ukuba yenze izigqibo ezifundisiweyo, ilungise iingxaki, kwaye ibambelele kwizibophelelo ezisemthethweni ngokunika umbono opheleleyo wobukho bedatha.
Ukuze uqonde i-asethi yedatha kunye nendlela ehamba ngayo kumbhobho wedatha, imethadatha iyinxalenye ebalulekileyo yenkqubo yomgca wedatha.
Uyakwazi ukubona indlela idatha eguqulwa ngayo kwaye isetyenziswe ngaphakathi kwintlangano usebenzisa izixhobo zomgca wedatha, ephakamisa imethadatha ukubonelela ngokubonisa okubonakalayo kokuhamba kwedatha. Oku kuvumela abasebenzisi ukuba bahlole amandla edatha ukubanceda benze izigqibo ezinolwazi olungcono.
Iindidi zoMda weDatha
Kukho iindlela ezintathu ezisisiseko zomda wedatha: umgca wedatha yangaphambili, umgca wedatha yangasemva, kunye ne-bi-directional data lineage.
Phambili Uluhlu lweDatha
Njengendlela enye yesitrato, umda wedatha wangaphambili ubandakanya ukulandelela iqhekeza ledatha ukusuka kwindawo yokuqala ukuya kwindawo yokuphela kwayo. Ukuqala kumthombo wedatha, ilandela idatha njengoko idlula kwiinguqu ezininzi kunye neenkqubo zokugcina ukufikelela kwimveliso yayo.
Ukuqonda ukusetyenzwa kunye nokuguqulwa kwedatha kunye nazo naziphi na iingxaki ezinokuthi zenzeke endleleni ziququzelelwa ngokuba nomda wedatha yolu hlobo. Inyathelo ngalinye likhokelela kwelinye; kufana nokulandela umkhondo wezonka zezonka.
Uluhlu lwedatha ngasemva
Umda wedatha ongasemva uyafana nohambo lokubuya umva apho silanda imveliso yedatha emva kwimvelaphi yayo. Inkqubo iqala kwindawo yokugqibela yedatha kwaye ibuyela ngasemva ngeendlela ezahlukeneyo zokugcina kunye neendlela zokuguqula ide ifike kumthombo wedatha.
Ukuchongwa komthombo woqobo wedatha, ukuqondwa kokuguqulwa kwayo, kunye nokuqinisekiswa kokuchaneka kwayo kunye nokugqibelela kwayo yonke into inokwenzeka ngoncedo lolu hlobo lomda wedatha. Isebenza njengesixhobo somcuphi, esivumela ukuba silandele umendo wedatha ngasemva.
Uluhlu lweDatha olumacala omabini
Isitalato esineendlela ezimbini, i-bi-directional data lineage idibanisa iingenelo zomda wedatha yangaphambili nasemva. Inika imbono ebanzi yendlela yedatha ngokuyilandela ukusuka kwindawo yayo ukuya kwindawo yayo kunye nokusuka kuloo ndawo ukuya kwindawo yokuqala.
Ukuze umisele imvelaphi yedatha, uqonde indlela eyatshintshwa ngayo, kwaye uqinisekise umgangatho wayo, ukungaguquguquki, kunye nokugqibelela kuyo yonke indlela, kuyanceda ukulandelela umnombo wedatha. Ngolwazi lwexesha lokwenyani malunga nendawo kunye nobume bayo, kufana nokuba ne-GPS tracker yedatha.
Ukuphunyezwa koMda weDatha
Ukuphumeza umgca wedatha kwintlangano ihlala ibandakanya ezi zigaba zilandelayo.
Chaza imithombo yedatha
Iisistim kunye nogcino-lwazi olugcina idatha onqwenela ukuyilandela kufuneka zonke zichongwe. Ukwenza oku, kufuneka uqale uchonge imithombo eyahlukeneyo yedatha, kubandakanywa iifayile, ii-APIs, kunye neenkonzo zefu.
Qokelela imetadata
Inqanaba elilandelayo kukufumana iinkcukacha malunga nedatha, kubandakanywa indawo yayo, ifomathi, kunye nombutho. Ukuqonda iimpawu zedatha kunye nendlela esetyenziswa ngayo kwenziwa ukuba kwenzeke yile metadata.
Chonga iziphene zedatha
Kulula ukuqonda indlela idatha ehlaziywa ngayo kwaye isetyenziswe ngaphakathi kwintlangano ukuba ukuhamba kwedatha kufakwe kwimephu ukusuka kumthombo wayo ukuya kwindawo eya kuyo, kubandakanywa naluphi na utshintsho okanye ukucubungula okwenzeka endleleni.
Landelela ukufikelela kwidatha
Ukugcina ukhuseleko lwedatha kunye nokuthotyelwa, umkhondo, kunye nokurekhoda ukuba ngubani ofikelela kwidatha.
Gcina kwaye ubone umnombo
Sebenzisa izixhobo zokubonisa ukubonisa umgca wokuqonda okulula kunye nokuhlalutya. Gcina imetadata eqokelelweyo kunye nolwazi lokuhamba kwedatha kwindawo yokugcina enye.
Phumeza isisombululo esizenzekelayo
Unokuqinisekisa ukuba umgca wedatha uyaqokelelwa kwaye ubekwe iliso ngokusebenzisa i-automation, eya kunceda ukunciphisa iimpazamo kunye nokwandisa imveliso.
Uphononongo kunye noHlaziyo
Yenza ukuba iirekhodi zomnombo zichanekile kwaye zisebenza ngoku rhoqo, kwaye uzihlaziye ngokufanelekileyo.
Inkqubo yokuphunyezwa inokufuneka iguqulwe okanye yongezwe kwizigaba ngokuxhomekeke kwiimfuno ezizodwa kunye nemida yombutho ngamnye.
IiTeknikhi zoMda weDatha
Ipatheni-based Lineage
Ngale ndlela, umnombo wenziwa ngaphandle kokunxibelelana nenkqubo eyenziwe okanye eguqule idatha. Uvavanyo lweMetadata yeetheyibhile, iikholamu, kunye neengxelo zoshishino zonke ziyinxalenye yalo. Iphonononga umnombo ngokujonga iintsingiselo usebenzisa le metadata.
Ngokomzekelo, kunokwenzeka ukuba ikholamu kwiiseti zedatha ezimbini ezinegama elifanayo kunye namaxabiso edatha afanayo imele idatha efanayo kwizigaba ezahlukeneyo zobukho bayo. Itshathi yomgca wedatha isetyenziselwa ukudibanisa loo miqolo mibini.
Umnombo osekelwe kwipateni unenzuzo ebalulekileyo yokuba iteknoloji ezimeleyo kuba ijonga nje idatha, kungekhona iindlela zokucwangcisa idatha. Nayiphi na iteknoloji yedatha, kuquka i-Oracle, i-MySQL, kunye ne-Spark, inokuyisebenzisa ngendlela efanayo. Ingxaki kukuba le ndlela ayisoloko ichanekile.
Xa ingqiqo yokusetyenzwa kwedatha ifihliwe kwikhowudi yekhompyutha kwaye ingabonakali lula kwimethadatha efundeka ngabantu, ngamanye amaxesha inokungahoyi ubudlelwane phakathi kwedatha.
Umnombo ngokuThegiswa kweDatha
Le ndlela iqikelelwe kwingcinga yokuba iithegi ze-injini yotshintsho okanye ngenye indlela idatha yabamakishi. Ilanda ithegi ukusuka ekuqaleni ukuya ekupheleni ukuze ufumane umnombo. Le ndlela inokuphumelela kuphela ukuba unesixhobo esithembekileyo soguqulo esilawula lonke ukudluliselwa kwedatha kwaye uqhelene nesakhiwo sokumaka isixhobo esisisebenzisayo.
Nokuba isixhobo esinjalo besinokubakho, akukho datha idaliweyo okanye yatshintshwa ngaphandle kwayo inokubekwa phantsi komgca ngokufaka ithegi yedatha. Kulinganiselwe kulo mba ukwenza umgca wedatha kwiinkqubo zedatha ezivaliweyo.
Umnombo oZimeleyo
Amanye amashishini anendawo yedatha ebandakanya ukugcinwa kweemethadatha, i-logic processing, kunye nolawulo lwedatha ye-master (MDM). Olu seto lubandakanya rhoqo a idatha echibini apho yonke idatha igcinwa kubo bonke ubomi bayo.
Umnombo unokunikezelwa ngokwemvelo ngolu hlobo lwenkqubo yokuzimela ngaphandle kwemfuneko yezibonelelo ezongezelelweyo. Nangona kunjalo, kanye ngendlela yokuthegiswa kwedatha, umnombo awuyi kuqaphela nantoni na eyenzekayo ngaphandle kwale meko ilawulwayo.
Uluhlu lweDatha ngokuPasa
Olona hlobo luntsonkothileyo lomnombo lolo lufunda ingqiqo yokwenziwa kwedatha ngokuzenzekelayo. Ukukhangela ngokucokisekileyo, ukuya ekupheleni, le ndlela ibuyisela umva iinjineli kwingqiqo yokuguqulwa kwedatha.
Kuba esi sisombululo kufuneka siqonde zonke Iilwimi zenkqubo kunye nezixhobo ezisetyenziselwa ukuguqula nokuthutha idatha, ukuthunyelwa kwayo kuyinkimbinkimbi. Oku kunokusebenzisa i-extract-transform-load (ETL) logic, i-SQL- kunye ne-Java-based solutions, iifomathi zedatha endala, izisombululo ezisekelwe kwi-XML, kunye nezinye iindlela.
Iimeko zokusetyenziswa komgca weDatha
Ukwenziwa kwedatha
Iinkampani kufuneka ziseke iziseko zedatha ezixhasayo ukuze zikwazi ukubona izinto ezininzi zedatha kunye nonxibelelwano phakathi kwazo ngaphakathi kwenkampani. Olu qhagamshelo luyimodeli kusetyenziswa umnombo wedatha, ekwabonisa ukuxhomekeka okuninzi okukhoyo kwi-ecosystem yedatha.
Ekubeni idatha itshintsha ngokuhamba kwexesha, imithombo yedatha emitsha ihlala ivela, ifuna ukuhlanganiswa kwedatha entsha, njl.
ukuthobela
Umda wedatha ubonelela ngendlela yokuthotyelwa kophicotho-zincwadi, ukuphucula ulawulo lomngcipheko, kunye nokuqinisekisa ukuba idatha igcinwa kwaye iphathwa ngokuhambelana nemigaqo-nkqubo yolawulo lwedatha kunye nemithetho.
Uhlalutyo lwempembelelo
Imiphumo yotshintsho oluthile lwezoshishino, njengazo naziphi na iingxelo ezisezantsi, zingabonwa ngokusebenzisa izixhobo zomgca wedatha. Umda wedatha, umzekelo, unokuncedisa abalawuli ekumiseleni ukuba zingaphi iideshibhodi ezinokuthi zichaphazele igama kwaye, ngenxa yoko, bangaphi abantu abafikelela kuloo ngxelo.
Ukufuduka kwedatha
Imibutho iqeshe ukufuduka kwedatha ukuqonda ukuba ibekwe phi idatha kunye nokuba sele ide kangakanani ngaphambi kokuyitshintshela kwinkqubo entsha yokugcina okanye ukusebenzisa isoftware entsha.
Uluhlu lwedatha lunceda amaqela alungiselele ukuphuculwa kwenkqubo okanye ukufuduka ngokubanika isishwankathelo sendlela idatha ehambe ngayo kulo lonke umbutho. Oku kukhawulezisa ukudluliselwa kwindawo entsha yokugcina jikelele.
Ukongeza, inika amaqela ithuba lokuchitha inkqubo yedatha ngokugcina okanye ukususa idatha ephelelwe lixesha okanye engenamsebenzi. Ngokwenza njalo, inkqubo yedatha iya kwenza ngcono ngokubanzi kwaye idinga ulawulo oluncinci lwedatha.
Imingeni yokuPhunyezwa koMda weDatha
- Ukhuseleko lwedatha: Ukhuseleko lwedatha yinkxalabo ephambili ngelixa kusakhiwa umnombo wedatha. Ukulandela uhambo lwedatha ukusuka kwindawo yokuqala ukuya kwindawo yayo yokugqibela, ukufikelela kwiinkcukacha ezinovakalelo kufuneka kunikwe, kwaye le datha kufuneka ikhuselwe ekufikeleleni okungagunyaziswanga kunye nokuphulwa.
- Ukunqongophala koMgangatho: Esinye sezithintelo eziphambili ekwamkeleni umgca wedatha kukungabikho kwemigangatho. Ekubeni amaqonga amaninzi, ii-apps, kunye neenkqubo zisebenzisa iindlela ezizodwa zokulandelela kunye nokurekhoda ukuvela kwedatha, kunokuba nzima ukuhlanganisa kunye umfanekiso odibeneyo wohambo lwedatha.
- IiSilo zeDatha: Iisilo zedatha ngomnye umba ovela ngelixa uphumeza umnombo wedatha. Xa idatha isasazwa kwiinkqubo ezininzi kunye neenkqubo, kunokuba ngumngeni ukulandelela uhambo lwayo ukusuka kwenye ukuya kwenye. Oku kunokukhokelela kuluhlu lwedatha olungachanekanga okanye olungaphelelanga.
isiphelo
Ukuqukumbela, umda wedatha yinxalenye ebalulekileyo yeshishini ngalinye eliqhutywa yidatha. Ibonelela ngembono ebanzi yendlela yedatha ukusuka kwindawo yayo yokuqala ukuya kwindawo yayo yokugqibela, iqinisekisa ukuchaneka kwayo, ukugqibelela, kunye nokungaguquguquki.
I-automation yomgca wedatha yexesha elizayo kunye nokubekwa emgangathweni kulindeleke ukuba kwandiswe, ukwenza ukuphunyezwa kunye nokugcinwa kwemibutho kube lula. Ekugqibeleni, ukubaluleka komgca wedatha akunakugxininiswa.
Inika iinkampani izixhobo ezizidingayo ukuze zenze ukhetho lobulumko, ziqhube imisebenzi yazo ngokufanelekileyo, kwaye zifezekise impumelelo.
Shiya iMpendulo