Ko te AI Lip Sync Video Generator

Ka huri i tētahi whakaahua mata me tētahi tātari oro ki roto i tētahi ataata ā-ringa kōrero me te whakawhāititanga o te mata, te āhua o te uaua me te tītaha. Kāore i te wātea ināianei i te wā e rapu ana tātau i tētahi tauira e whakaaetia ana e te raina.

Kua mahia e tātau Whakapā atu i tō tou reo
Kāore te whakawhanaketanga o te mata i te wā tēnei. I whakaakona te tauira SadTalker i whakamahia e ia i runga i te tauira āhua o te Pākehā, i whakawhiwhia ki te rangahau ā-wāhanga anake, nā reira kāore e taea e tātau te whakarato i tēnei i runga i tētahi ratonga utu. Kāore anō kia whakahōutia tētahi whakahōutanga me tētahi whakawhiwhinga tika.

Whakarewa i te āhua + oro

1,000 ngā tohu i ia wa

Kātaki me te tuku i tātou pūranga ki konei, Ka tirohia

JPG, PNG, or short MP4/WebM. Max 10MB. One clear, well-lit face works best.

file.mp3

0 MB

Kātaki me te tuku i tātou pūranga ki konei, Ka tirohia

MP3, WAV, M4A, or FLAC. Max 10MB. Free: up to 30 sec. Pro: up to 5 min.

file.mp3

0 MB

Ka tukatuka...

E whakarārangi ana i tōna ataata. Ko te tikanga e mau ana tēnei i te 30 waeine ki te 2 minu.

Ko tōtou Video Talking-Head

Waihoki

Mo te SadTalker

Ko te SadTalker (CVPR 2023, Tencent ARC) he tauira pūtake-whakawhitiwhiti e whakaata ana i tētahi whakaahua mata kotahi hei kōrero i tētahi oro. Kāore i te ōrite ki ngā tāupetanga Wav2Lip, ko te SadTalker e whakaata ana hoki i te āhua o te ulu, i ngā kōruru, me te kīanga mō tētahi hua nui ake.

Ko te waehere o te SadTalker ko te Apache-2.0, engari i whakaakona ōna taumahatanga whakahōu 3D i runga i te tauira āhua o te Pākehā, ā, ko te whakaaetanga e whakaae ana ki te rangahau tāngata kāore i te hokohoko anake. he ratonga hokohoko te TTS.ai, nō reira i whakakorehia te utauta i te 15 o Hānuere 2026.

Whakapānga mō ngā hua pai rawa

  • Ka whakamahia tētahi whakaahua pai, mārama, mārama - e kitea ana ngā mata, ka kati te mīti.
  • Ko te mata pūtahi, tapawhā, 4:5 rānei te ōwehenga aronga pai rawa
  • Ko te oro kōrero mārama (kore pūoro) e tuku ana i te whakahoahoa mata ā-ringa
  • Mā te whakahohe i te GFPGAN mō ngā tākaro kaiārahi - e rua nga wā whakairo engari e whakamātau ana i ngā taipitopito
  • Ka whakamahia te Still preset ina hiahia koe ki tētahi tākaro avatar pūmau

Ka whakatata te Papatono Vitio

Ka tīmata wātea, whakapiki ina hiahiatia he nui ake

Waihoki
  • 30-waeine te tepe oro
  • 256 px te huaputa
  • "I te mea tonu" anake te whakaritenga tuatahi
  • Kāore he whakarei ake mata
Ko te tino rongonui
Kāreti
  • 30-waeine te tepe oro
  • Ko ngā "whāiti" me ngā "kore" i te wā i whakaritea
  • 256 / 512 px te huaputa
  • Ka whakarei ake te kanohi GFPGAN
Ka tāuru i te wātea
Ka taea
  • Te tepe oro 5-rohe
  • GPU whakahau tuatahi
  • Ka uru mai te API (whakahauhau-maha)
  • Ko ngā whakahau whakaotitanga Webhook
  • Kāore i te wātea ināianei (whakahaeretanga tauira kāore i te hokohoko)
Whakahauhau

E pā ana ngā pātai

Whakarewa i tētahi whakaahua mata me tētahi tātari oro, ā, ka whakaputaina e te AI he ataata o taua mata e kōrero ana i te oro me ngā nekeneketanga mata, te āhua o te pūmatua me te tīpako. Kāore anō kia wātea tēnei utauta: i haere te SadTalker (CVPR 2023), i whakaakona ngā taumahatanga o te whakahōutanga 3D o te mata i runga i te tauira mata o Basel, e whakaaetia ana mō te rangahau ā-wāhanga anake.

Ka taea e te tāuru mata te whakaahua JPG, PNG rānei (tata ki te 10 MB), he pikitia MP4/WebM poto rānei (ka whakamahia e tātau te tāurunga tuatahi). Ka taea e te orooro te MP3, WAV, M4A, FLAC rānei tae atu ki te 10 MB. Ka tāurunga anō tātau i te orooro ki te 16 kHz i roto.

Ko ngā kāwanatanga wātea: tae atu ki te 30 ngā takiwā i ia tā. Ko ngā kaiwhakamaori e utu ana: tae atu ki te 5 ngā minu i ia tono. Ko te tikanga o te oro whakarārangi roa ake me te utu āhuahira nui ake.

Ka whakamahia e te video Lip sync ngā tohu 1,000 i ia wa o te whakaaturanga o te whakaaturanga. He tāpiri 30-wae = 30,000 ngā tohu. Ka whakatūnga te utu i mua mai i tō tātou taumahatanga, ā, ka whakawhiwhia i te whakanaotanga mēnā kāore i angitu te whakanaotanga.

Kāore. Kua whakakoretia te utauta nā te mea kāore e whakaaetia e te raina tauira. Ko te waehere SadTalker ko Apache-2.0, engari i whakaakona tōna whatunga whakahōu mata i runga i te Tauira Mata 2009, e whakaae ana tana raina kia taea te rangahau ā-roto, kāore i te hokohoko atu anake. Kāore ngā pouaka whakaata i hangaia ki mua i te 15 o Hānuere 2026 mō te whakamahi hokohoko, ko ngā mahere e utu ana. E whai mana ana koe ki te whai mana ki te whakaahua mata pūtake me te oro e whakataki ana.

I te wā i haere te utauta, e tata ana ki te 30 sekona te roa o tētahi tātari 5-rua, e whakarea ana i te roanga o te oro. Kāore i te wātea ināianei i te wā e rapu ana tātau i tētahi tauira whāinga-whāinga e whakaaetia ana e te whakaaetanga.

Ka whakaatatia e te whakatūtū tōpū (whakatūtū) te āhua o te kōauau, te whakatūtū, me te kīanga tae atu ki ngā mata, e whakaputa ana i tētahi ataata ā-ringa-whakawhiti. Ka kati tonu te whakatūtū i te kōauau i te wāhi, ā, ka whakaatatia anake te mīti — he whai hua ina hiahiatia e koe tētahi tākaro āhuahira.

Ko te GFPGAN he tauira whakaora mata i whakamātauria ai ngā taipitopito o te mata i muri i te whakarārangitanga. Kāore i tukuna: ko tōna StyleGAN2 o mua i raro i tētahi whakaaetanga NVIDIA kāore i te hokohoko, ā, ko tōna tauira whakawāteatanga mata ko te CC BY-NC-SA.

I whakawāteatia te SadTalker i te 256 px mā te pūmau, me te 512 px hei kōwhiringa pōturi ake. Kāore te utauta i te wāteatanga i tēnei wā; he tino mārama, he whakaahua o te āhua pai rawa e tuku ana i te hua pai rawa me tētahi tauira whāinga kōrero.

He. Whakahauhau i tētahi MP4, WebM rānei hei tāuru mata, ā, ka whakamahia e tātau te tāurunga tuatahi hei tuakiri whakatere. Mō te tāurunga ā-whitiāhua katoa (whakatauira i te mīhini), tirohia te kawenga ā-whitiāhua o Dubbing Studio e whai ake nei.

He. POST he tono maha ki te /api/v1/lipsync/ me ngā āpure mata me te oro, kātahi ka pātai /api/v1/lipsync/result/?uuid= tae noa ki te tūnga "hōmu". Kei roto i te urupare he URL ki te MP4 i whakawāteatia. E hiahiatia ana e te āheitanga API tētahi mahere utu.

Ka whakamahia e te SadTalker te whakatūtū mata hei kite me te whakapōtu i te mata tino mōhio. Mō ngā hua pai rawa, tuku i tētahi whakaahua me tētahi tangata i waenganui, ngā kanohi e kitea ana, me te whakawhāititanga iti rawa. Ka puta pea ngā hua kāore i te taea te whakamōhio i ngā whakaahua rōpū.
5.0/5 (1)

He aha ka taea e tātau te whakapai ake? Ka āwhina tātau ki te whakaoti i ngā raruraru.

E whakaritea ana hei tīmata?

Ka tāuru wātea, ka whiwhi pūtea 50. Kāore he kāri pūtea e hiahiatia ana.