Mitundu yofalikira yasesa dziko lonse lapansi ndi mkuntho ndikutulutsidwa kwa Chithunzi cha E2, Zithunzi za Google, Kufalikira Kokhazikikandipo Ulendo wapakati, kuyambitsa luso komanso kutambasula malire a kuphunzira makina.
Zitsanzozi zimatha kupanga zithunzi zopanda malire kuchokera ku mawu olimbikitsa, kuphatikizapo photorealistic, zamatsenga, futuristic, ndipo, ndithudi, zithunzi zokongola.
Kuthekera kumeneku kumaganiziranso zomwe zikutanthauza kuti anthu amalumikizana ndi silicon, zomwe zimatipatsa luso lopanga pafupifupi chithunzi chilichonse chomwe tingaganizire.
Zitsanzozi zikamakula kapena kutengera zinthu zina, anthu azitha kupanga zithunzi, makanema, ndi zochitika zina zozama ndi lingaliro lokha.
Mu positi iyi, tikambirana za kufalitsa chitsanzo, kufalikira kokhazikika, momwe zimagwirira ntchito, ndi maphunziro ophatikizira opaka utoto, mwa zina.
Kodi Diffusion model ndi chiyani?
Mitundu yophunzirira makina yomwe imatha kupanga zatsopano kuchokera ku data yophunzitsira imatchedwa zitsanzo zopanga. Mitundu ina yopangira imaphatikizapo mitundu yoyendera, ma autoencoder osiyanasiyana, ndi ma generative adversarial network (GANs).
Aliyense akhoza kupanga zithunzi zabwino kwambiri. Mitundu yophatikizika imaphunzira kubweza detayo posintha njira yowonjezerera phokoso iyi pambuyo powononga deta yophunzitsira powonjezera phokoso. Kunena mwanjira ina, mitundu yofalikira imatha kupanga zithunzi zolumikizana kuchokera paphokoso.
Zitsanzo zosakanikirana zimaphunzira poyambitsa phokoso pazithunzi, zomwe pambuyo pake chitsanzocho chikhoza kuchotsa. Pofuna kupanga zowoneka zenizeni, chitsanzocho chimagwiritsa ntchito njira yochepetsera phokoso ku njere zachisawawa.
Pokonza njira yopangira zithunzi, zitsanzozi zitha kugwiritsidwa ntchito molumikizana ndi chiwongolero chazithunzi kuti apange zithunzi zopanda malire kuchokera pamawu okha. Mbewu zitha kuwongoleredwa ndi zolowetsa monga CLIP kuti zipereke kuthekera kwamphamvu pazithunzi.
Mitundu yosiyanasiyana imatha kugwira ntchito zosiyanasiyana, kuphatikiza kupanga zithunzi, kutulutsa mawu, kupaka utoto, kupaka utoto, ndi kufalitsa pang'ono.
Tsopano, kufalikira kokhazikika ndi chiyani?
Stable Diffusion ndi mtundu wamakina ophunzirira pamakina opangira zithunzi operekedwa ndi Kukhazikika.AI. Imatha kupanga zithunzi kuchokera pamawu.
Zigawo za kufalikira kokhazikika
Kufalikira Kokhazikika ndi dongosolo lopangidwa ndi zigawo zingapo ndi malingaliro. Sichitsanzo chimodzi. Tikayang'ana kuseri kwa hood, chinthu choyamba chomwe tikuwona ndikuti pali chigawo chomvetsetsa malemba chomwe chimatembenuza mauthenga a malemba kukhala chiwerengero cha manambala chomwe chimajambula mfundo za malemba.
Titha kutcha encoder mawuwa Transformer chinenero chitsanzo (mwaukadaulo: encoder yamawu amtundu wa CLIP). Zimatengera mawu olowera ndikupanga mndandanda wazinthu zonse (vector) pa liwu lililonse/chizindikiro m'mawuwo. Detayo imaperekedwa kwa Image Generator, yomwe ili ndi zigawo zingapo.
Pali njira ziwiri mu jenereta ya zithunzi:
1. Mlengi Information Information
Chigawo chachikulu mu Stable Diffusion ndi chinthu ichi. Ndipamene kuwongolera kochulukira kwa magwiridwe antchito kuposa matembenuzidwe akale amapangidwira.
Gawoli limadutsa magawo angapo kuti lipereke deta yazithunzi. Wopanga zidziwitso za zithunzi amagwira ntchito mkati mwachidziwitso cha zithunzi zokha (kapena malo obisika).
Ndiwofulumira kuposa mitundu yofananira yakale yomwe idagwira ntchito mu malo a pixel chifukwa chamtunduwu. Kunena mwaukadaulo, gawoli limapangidwa ndi dongosolo lokonzekera ndi UNet neural network.
Njira yomwe imachitika mu gawoli imatchedwa "kufalikira". Chithunzi chapamwamba kwambiri chimapangidwa chifukwa cha chidziwitso chomwe chikukonzedwa m'masitepe (ndi gawo lotsatira, decoder ya chithunzi).
2. Image Decoder
Pogwiritsa ntchito zomwe adalandira kuchokera kwa wopanga zidziwitso, chojambula zithunzi chimapanga chithunzi. Imangochita kamodzi kuti ipange chithunzi chomaliza cha pixel kumapeto kwa ntchitoyo.
Maphunziro a Stable Diffusion Impainting
Kujambula kwa Stable Diffusion ndi njira yodzaza malo osowa kapena owonongeka a chithunzi. Cholinga cha kujambula zithunzi ndikubisa kuti chithunzicho chabwezeretsedwa.
Njirayi imagwiritsidwa ntchito mobwerezabwereza kuchotsa zinthu zosafunikira pachithunzi kapena kubwezeretsa madera owonongeka a zithunzi zakale. Stable Diffusion Inpainting ndi njira yaposachedwa kwambiri yopenta yomwe ikupereka zotsatira zabwino.
Kutsatira malangizo omwe ali pansipa kudzakuthandizani kuti muyambe kuyang'ana zojambula ndikusintha zithunzi zomwe zilipo ngati mukufuna kuyesa kupaka ndi kufalikira kokhazikika:
- Pitani ku Huggingface Kusakhazikika kwa Diffusion
- Kwezani chithunzi chanu
- Fufutani gawo lachithunzi chanu lomwe likufunika kusinthidwa.
- Lowetsani chidziwitso chanu apa (zomwe mukufuna kuwonjezera m'malo mwa zomwe mukuchotsa)
- Sankhani "run"
Mu kanema pamwamba, timayika chithunzi ndi mandimu atatu ndikusintha maapulo. Inemwini ndikupangira kuti muyesere ndi zithunzi zanu ndi zomwe mukufuna.
Kutsiliza
Nthawi zambiri, kupaka utoto kosasunthika ndi njira yabwino kwambiri yopangira zithunzi kapena makanema abodza omwe amawoneka ngati enieni. Pamene tikuyandikira kupita patsogolo kwaukadaulo watsopano, zidzakhala zovuta kusiyanitsa pakati pa zowona ndi zachinyengo pamene ukadaulo ukupita patsogolo.
Swahir
Gawo loyamba silikugwirizana kwathunthu ndi theka lachiwiri. Zikadakhala zoziziritsa kukhosi ngati wolemba akanatha kufotokoza momwe inpaint imagwirira ntchito mu chimango chachitsanzo chomwe adafotokoza kale, akanapereka zidziwitso. Koma ayi! Izi zikanafuna kumvetsetsa kwenikweni, m'malo mosonkhanitsa ndi kukonza zolemba mwachisawawa.