Umbhalo usuka kumazwi Ama-AI Agents Umculo Ukukhuluma kuMbhalo Ukulungiswa kwezwi Uhlelo lwezwi Imakethe Okuningi
Umbiko wephutha / Umbuzo wezici

I-AI Lip Sync Video Generator

Gcina isithombe sesithombe kanye nevidiyo yevidiyo ekhulumayo nge-lip sync, head pose ne-blinks. Ngokungasekho ayitholakalanga uma sibheka imodeli enelayisense evumela lokhu.

Ubhalise
Asikho isikhulumi se-TTS ezweni lakho. Sicela usize ukungeza isandla sakho! Uhlu lwamagama
Ukuxhuma okufanayo kwe-lip akukhona manje. Imodeli ye-SadTalker esetshenziswa iqeqeshiwe ku-Basel Face Model, elayisenselwe ucwaningo olungabizi kuphela, ngakho-ke asikwazi ukunikela ngayo ku-service ekhokhelwayo. Akukho kuguqulwa ngelayisense elifanele elihlolwe.

Layisha phezulu isithombe

1,000 amaphawu ngomzuzu

Thwebula bese ushiya ihele lakho lapha, noma bheka

JPG, PNG, or short MP4/WebM. Max 10MB. One clear, well-lit face works best.

ifayela.mp3

0 MB

Thwebula bese ushiya ihele lakho lapha, noma bheka

MP3, WAV, M4A, or FLAC. Max 10MB. Free: up to 30 sec. Pro: up to 5 min.

ifayela.mp3

0 MB

Ibonisa ividiyo yakho. Le nqubo ithatha imizuzwana engu-30 kuya kumaminithi angu-2.

Ividiyo yakho ekhuluma-ikhanda

Layisha phezulu

Malunga ne-SadTalker

SadTalker (CVPR 2023, Tencent ARC) yimodeli yomthombo ovulekile okhulumayo owenza isithombe sobuso sisebenze ukukhuluma noma yikuphi umsindo. Ngokuhlukile kuzinhlobo ezahlukahlukene ze-Wav2Lip, iSadTalker ikwenza futhi isebenze isithombe sobuso, izithonjana, nokuveza ukuze kube nemiphumela eminingi ejwayelekile.

Ikhodi yeSadTalker yi-Apache-2.0, kodwa isisindo sayo sokwakha kabusha isithombe se-3D siqeqeshiwe ku-Basel Face Model, ilayisense yalo ivumela ucwaningo olungaba khona kuphela. TTS.ai yinkonzo yokuthengiswa, ngakho-ke ithuluzi lavalwa ngoSepthemba 15, 2026.

Izincomo zemiphumela engcono kakhulu

  • Sebenzisa isithombe esisezingeni eliphakeme, esikhanya kahle — amazinyo abonakala, umlomo uvalelekile
  • Ubuso obuphakathi, isikwere noma i-4:5 aspect ratio isebenza kahle kakhulu
  • Uhlu oluhlanzekile lwezwi (akukho mculo) lunikeza ukuhambisana okuqinile kwemilenze
  • Vumela i-GFPGAN isebenziseke izikhali ezinamandla — iphinda isikhathi sokubonisa kodwa iqinisa imingwane
  • Sebenzisa i-Still preset uma ufuna isithombe esiqinile se-avatar

Izinhlelo zevidiyo ze-Lip Sync

Qala ngokukhululekile, uthuthukise uma ufuna okuningi

Ikhululekile
  • Umkhawulo womsindo wemizuzu engu-30
  • 256 px kuphuma
  • "Still" preset only
  • Akukho buso obuthuthukisiwe
Okuthandwa kakhulu
I-akhawunti Ekhululekile
  • Umkhawulo womsindo wemizuzu engu-30
  • "full" kanye "still" izilungiselelo ezingaphambili
  • 256 / 512 px okuqukethwe
  • GFPGAN face enhancer
Bhala
I-Pro
  • Umkhawulo womsindo wemizuzu emihlanu
  • Iphutha le-GPU
  • Ukungena kwe-API (ukulayisha okuningi)
  • I-Webhook iqedela ukubiza emuva
  • Ngokungatholakala (ilayisense yemodeli engabizi)
Ukulungiswa

Imibuzo ebuzwa kaningi

Layisha phezulu isithombe sesikhumba kanye nevidiyo yevidiyo, futhi i-AI ikhiqiza ividiyo yesikhumba esikhuluma i-audio ngemijikelezo yemilenze, i-head pose ne-blinks. Ithuluzi lingekho manje: liqhuba i-SadTalker (CVPR 2023), esebenzisa isisindo sokwakha kabusha isikhumba se-3D esiqeqeshiwe ku-Basel Face Model, elimakiwe ucwaningo olungaba khona lwebhizinisi kuphela.

Isingeniso sesithombe singaba yisithombe se-JPG noma se-PNG (sifinyelela ku-10 MB) noma ividiyo encane ye-MP4/WebM ehamba phambili (sisebenzisa ifreyimu yokuqala). Umsindo ohamba phambili ungaba yi-MP3, WAV, M4A, noma i-FLAC kuze kube yi-10 MB. Sibuyisela umsindo ku-16 kHz ngaphakathi.

Ama-akhawunti amahhala: kuze kube yimizuzu engu-30 nge-clip ngayinye. Abasebenzisi abakhokhelwayo: kuze kube yimizuzu engu-5 ngesicelo ngasinye. Umsindo omde kusho isikhathi sokubonisa eside kanye nezindleko eziphezulu zophawu.

Ividiyo ye-lip sync isebenzisa amaphawu angama-1,000 ngesekondi yevidiyo ekhiqizwe. I-clip yesekondi engu-30 = amaphawu angama-30,000. Izindleko zikhokhwa ngaphambili kusuka ku-character balance yakho futhi zibuyiselwa ngokuzenzakalela uma ukukhiqizwa kuphumelela.

Akukho. Ithuluzi likhubazekile ngoba ilayisense lemodeli ayivumelanga. Ikhodi yeSadTalker yi-Apache-2.0, kodwa inethiwekhi yayo yokuvuselela isithombe sesithombe yaqeqeshwa ku-Basel Face Model 2009, ilayisense yalo ivumela ucwaningo lwangaphakathi, olungaba khona kuphela. Amavidiyo akhiqizwe ngalo ngaphambi kukaSepthemba 15, 2026 asetshenziswanga ngokuhweba, ama-plans akhokhelwayo abandakanyiwe. Uzothatha isinqumo sokuba nelungelo lomthombo wesithombe sesithombe kanye nesandi esikhuphukayo.

Xa ithuluzi lihamba, i-clip yesekondi eziyi-5 ithatha cishe i-sekondi eziyi-30, ilinganiselwa ngokuqondile ngesikhathi sokudlalwa kwesandi. Ngoku ayikho ngesikhathi sibheka imodeli yekhanda elikhulumayo ilayisense evumela lokhu.

Isilungiselelo esiphelele (isimiso) sibonisa isikhala sekhanda, izikhashana, kanye nesimo kanye nemilomo, sikhiqiza ividiyo ekhuluma kakhulu yekhanda. Isilungiselelo esiphelele sivala ikhanda endaweni futhi sibonisa isikhala kuphela somlomo — kubaluleke uma ufuna isithombe esiqinile se-avatar.

I-GFPGAN iyimodeli yokubuyisela isithombe esibhekene nesithombe esicacile ngemuva kokulungiswa. Ayinikezwa: iStyleGAN2 yayo ingaphambili ingaphansi kwelayisense ye-NVIDIA engabizi futhi imodeli yokulungisa isithombe i-CC BY-NC-SA.

I-SadTalker ibonisa ku-256 px ngokuzenzakalela, ne-512 px njengenketho ehamba kancane. Ithuluzi alikho manje; isithombe esikhanyayo, esisezingeni eliphakeme sinikeza imiphumela engcono kakhulu nganoma iyiphi imodeli yekhanda elikhulumayo.

Yebo. Layisha phezulu i-MP4 noma i-WebM njenge-input yesithombe futhi sizosebenzisa ifreyimu yokuqala njenge-identity yokushayela. Ukuthola i-video egcwele yokudubula kabusha (ukuguqulwa kwe-mouth-per-frame), bona i-Dubbing Studio video pipeline ezayo.

Yebo. POST isicelo esiningi sengxenye ku /api/v1/lipsync/ ngesithombe kanye nemikhakha yomsindo, bese ukhetha /api/v1/lipsync/result/?uuid= kuze kube yilapho isimo siyi "kuqediwe". Uphendulo luqukethe i-URL ye-MP4 eyenziwe. Ukufinyelela kwe-API kuthatha i-plan ekhokhelwayo.

I-SadTalker isebenzisa ukulinganisa kwesithombe ukuze ithole futhi ikhulise isithombe esiphawulekayo. Ukuthola imiphumela engcono, thumela isithombe esigcwele umuntu oyedwa obekwe phezulu, amehlo abonakala, nokuvalwa okuncane. Izithombe zeqembu zingadala imiphumela engalindelekile.
5.0/5 (1)

Yini esingayithuthukisa? Umbono wakho usiza ukuxazulula izinkinga.

Ukulungele ukuqala?

Bhala ngokumahhala futhi uthole amaphawu angama-15,000. Akukho khadi le-credit elidingekayo.

Ubhalise Bonisa ukuthengwa