Umbhalo ukuya kuSpeech Abathunywa be-AI I-Music Ukuthetha- uthethana I-Voice Cloning Uyilo lwesandi I-Marketplace I-More
Ingxelo ye Bug / Isicelo se Feature

Umenzi Wevidiyo We-AI Lip Sync

Guqula umfanekiso we-face kunye ne-audio clip kwividiyo ye-voice-head ethetha nge-lip sync, i-head pose kunye nokutyhila. Ngoku ayifumaneki ngelixa sikhangela imodeli enelayisensi evumela oku.

Ubhaliso simahla
Asikho nasiphi na isandi se-TTS kwisiNgesi sakho. Nceda uncedo lwethu ukongeza isandi sakho! Intengiso yelizwi lakho
Uthelekiso lweliphu alufumanekanga ngoku. Imodeli yeSadTalker esetyenziswa yayiqeqeshwe kwi-Basel Face Model, elayisensiwe kuvavanyo olungarhwebiyo kuphela, ngoko ke asikwazi ukunika kwinkonzo ehlawulweyo. Akukho tshintsho ngelayisensi efanelekileyo efakwe ngoku.

Layisha phezulu i Face + Audio

1, 000 iimpawu ngomzuzwana

Rhweba ngaphandle amanqaku encwadi ye Mozilla Khangela

JPG, PNG, or short MP4/WebM. Max 10MB. One clear, well-lit face works best.

ifayili.mp3

0 MB

Rhweba ngaphandle amanqaku encwadi ye Mozilla Khangela

MP3, WAV, M4A, or FLAC. Max 10MB. Free: up to 30 sec. Pro: up to 5 min.

ifayili.mp3

0 MB

Ibonisa ividiyo yakho. Oku kuthathelwa ingqalelo ukuba kuthatha imizuzwana engama-30 ukuya kwemizuzwana emibini.

Ividiyo yakho ethetha-i-ngqwalasela

Layishela phantsi egronjiweyo

Malunga ne SadTalker

I-SadTalker (CVPR 2023, Tencent ARC) yimodeli ye-open-source ye-talk-head eyenza umfanekiso we-face ofanayo usebenze ukuthetha nayiphi na i-audio. Ngokungafaniyo ne-Wav2Lip, i-SadTalker iyenza i-head pose, i-blinks, kunye ne-expression isebenze ukubonelela nge-outcome eninzi ebonakalayo.

Ikhowudi yeSadTalker yi-Apache-2.0, kodwa i-3D yobuso bokwakha kwakhona isisindo saqeqeshwa kwi-Basel Face Model, ilayisensi yayo ivumela ukukhangela okungarhwebi kuphela. TTS.ai yinkonzo yorhwebo, ngoko isixhobo savalwa ngo-Septemba 15, 2026.

Iingcebiso zeziphumo ezilungileyo

  • Sebenzisa umfanekiso ophezulu womgangatho, okhanyayo — amehlo abonakala, umlomo uvale
  • Ubuso obuphakathi, isikwere okanye 4:5 uthelekiso lwe-aspect lusebenza kakuhle kakhulu
  • Ukuthetha okucocekileyo (akukho mculo) kunika ukulungelelaniswa kweliphu okuqinileyo
  • Yenza i-GFPGAN isebenze kwi-hero shots - iphindaphindwe ixesha lokuveza kodwa ikhawuleza inkcukacha
  • Sebenzisa i-Still preset xa ufuna umfanekiso okhawulezayo okhawulezayo

Iinkqubo zevidiyo ze-Lip Sync

Qala ngokukhululekileyo, uphucule xa ufuna okuninzi

Iinketho zelizwe
  • Umda wesandi wemizuzu engama-30
  • 256 px imveliso
  • "Isilele" kuphela
  • Akukho mfanekiso okhawulezayo
Ethandwa Kakhulu
I-akhawunti Ekhululekileyo
  • Umda wesandi wemizuzu engama-30
  • Zonke ii-"full" kunye ne-"still" ezimiselweyo
  • 256 / 512 px imveliso
  • GFPGAN ukuphucula i-face
Ubhaliso
I-Pro
  • Umda wesandi wemizuzu emi-5
  • Ufolo lwe-GPU oluphambili
  • Ufikelelo lwe-API (ukukhuphela iinxalenye ezininzi)
  • I-Webhook igqiba ukubiza kwakhona
  • Ifumanekanga ngoku (ilebhile yemodeli engarhwebiyo)
Yenza phezulu

Imibuzo ebuzwa rhoqo

Layisha phezulu umfanekiso we-face kunye ne-audio clip, kwaye i-AI ivelisa ividiyo ye-face ethetha i-audio ngemithambo ye-lip, i-head pose kunye nokutyhila. Isixhobo sexeshana asifumanekanga: iqhube i-SadTalker (CVPR 2023), eyona 3D i-face reconstruction weights iqeqeshwe kwi-Basel Face Model, elayisensiwe ukukhangela okungakorhwebo kuphela.

Ungeniso lwesiphelo sendlela lunokuba umfanekiso we-JPG okanye we-PNG (ukufikelela kwi-10 MB) okanye ividiyo efutshane ye-MP4/WebM yokuqhuba (sisebenzisa isakhelo sokuqala). Isandi sokuqhuba singaba yi-MP3, WAV, M4A, okanye i-FLAC ukuya kwi-10 MB. Sibuyisela isandi kwi-16 kHz ngaphakathi.

Ii-akhawunti ezikhululekileyo: ukuya kuthi ga kwimizuzu engama-30 nganye. Abasebenzisi abahlawulayo: ukuya kuthi ga kwimizuzu emihlanu ngesicelo ngasinye. Isandi eside sithetha ixesha elide lokuvelisa kunye nexabiso eliphezulu lophawu.

Ividiyo yokusebenza ngokuhambelanayo kweliphu isebenzisa iimpawu ezili-1,000 ngesekondi yevidiyo eyenziweyo. Iclip yesekondi ezili-30 = iimpawu ezili-30,000. Ixabiso lihlawulwe ngaphambili kwi-akhawunti yakho yophawu kwaye libuyiselwe ngokuzenzekelayo ukuba ukwenziwa akuphumelelanga.

Hayi. Isixhobo sitshixiwe kuba ilayisensi yemodeli ayivumelanga. Ikhowudi yeSadTalker yi-Apache-2.0, kodwa umjelo wayo wokubuyisela ubuso obudityanisiweyo waqeqeshwa kwi-Basel Face Model 2009, ilayisensi yayo ivumela ukukhangela okungaphakathi, okungarhwebi kuphela. Iividiyo eziveliswe ngayo phambi komhla we-15 kuSepthemba, 2026 azisebenzisi kurhwebo, iinkqubo ezihlawulwayo ziquka. Ufanele uthathe inxaxheba ekubeni nelungelo lomthombo womfanekiso wobuso kunye nesandi okhuphela phezulu.

Xa isixhobo saqhuba, i-clip yemizuzu emi-5 yathatha malunga nemizuzu emi-30, iphakama ngokuthe nkqo ngobukhulu besandi. Ngoku ayifumanekanga ngelixa sikhangela imodeli ye-voice-head enelayisensi evumela loo nto.

Inkqubo emiselweyo epheleleyo (emiselweyo) ibonisa ukubonakala kwengcambu, imilenze, kunye nokubonakala kunye nemilebe, ivelisa ividiyo ethetha-thethana ebonakalayo. Inkqubo emiselweyo igcina ingcambu kwindawo yayo kwaye ibonisa ukubonakala komlomo kuphela - isebenza xa ufuna umfanekiso obonisa ibali oqinileyo.

I-GFPGAN yimodeli yokubuyisa i-face eyenza i-face ibonakale icacile emva kokubonisa. Ayinikezelwanga: i-StyleGAN2 yayo engaphambili iphantsi kwelayisensi ye-NVIDIA engathengiswanga kwaye imodeli yokwahlula i-face ibe zii-parses yi-CC BY-NC-SA.

I-SadTalker ibonisa nge-256 px ngokumiselweyo, nge-512 px njengokhetho olucothayo. Isixhobo ngoku asikho; umfanekiso okhanyayo, ophezulu womgangatho unika isiphumo esilungileyo nakweyiphi na imodeli ye-voice-head.

Ewe. Layisha phezulu i MP4 okanye i WebM njengengxelo yobuso kwaye siza kusebenzisa iframe yokuqala njengenkangeleko yokuhamba. Ukuphinda uphinde u

Ewe. thumela isicelo senxalenye ezininzi ku /api/v1/lipsync/ nge-face kunye neendawo zesandi, emva koko ujonge /api/v1/lipsync/result/?uuid= de i-status ibe "igqityiwe". Impendulo iqulethe i-URL ye-MP4 eyenziweyo. Ukufikelela kwi-API kudinga inkqubo ehlawulweyo.

I-SadTalker isebenzisa ulungelelaniso lwesiphelo sobuso ukuchonga nokusika isiphelo esiphambili sobuso. Ukufumana iziphumo ezilungileyo, ulayishe umfanekiso obonisa umntu omnye obekwe phezulu, amehlo abonakalayo, kunye nokuqhekeka okuncinci. Iifoto zeqela zingavelisa iziphumo ezingalindelekanga.
5.0/5 (1)

Yintoni esinokuyilungisa? Ulwazi lwakho olufunyenweyo lunceda silungise iingxaki.

Ilungile ukuqalisa?

Ubhaliso simahla kwaye ufumane 15,000 iimpawu. Akukho khadi letyala lifunekayo.

Ubhaliso simahla Bonisa ixabiso