AI lip-sync with Sync — voice-over and dubbing for video

What Sync is

Sync (sync.so) is a company that specialises in one thing and is among the very best at it — lip-sync. Its technology re-animates a person's mouth in an existing video so that it speaks a given audio recording, while preserving the face, the expression and the quality of the frame. The goal is for speech and lip movement to match naturally, with no artificial or “lagging” look.

Because Sync is focused entirely on this one job, the result is especially accurate and clean — right for cases where the lips are in close-up and any mismatch would show. In genkiki.com this technology is available as a voice-over and dubbing tool that starts from your video with a face and your audio.

Versions and capabilities in generiram

In generiram, Sync is available in one powerful variant, working in the Lip-sync mode.

VariantModesWhat it is for
Sync 2.0 Pro Lip-syncLip-syncHigh-quality re-animation of the lips of a face in a video so they speak a given audio

You supply a video with a face and an audio recording (speech, singing, a dub), and Sync reshapes the person's lips so they say exactly that. There is control over what happens when the video and the audio differ in length — you can have the footage trimmed, looped, padded with silence, or the speech spread out over the whole length, so the ending comes out the way you want.

What it is good for

  • Voice-over and dubbing with accurate lip-sync — the speech matches the movement of the mouth.
  • Changing the language of a speaker in a video: you supply the translated audio and the lips adapt to it.
  • Replacing a line or a voice in finished footage, without a new shoot.
  • Talking faces, avatars and ads where the lips are in close-up and accuracy matters.

The Sync models — in detail

Which one is good for what, where it falls short and what it shouldn't be used for.

Sync 2.0 Pro Lip-sync

referencevideo
Aspect ratios: 1:1, 9:16, 16:9 Lengths: 5 sec, 10 sec Price: 168 credits

Strong at

  • The MOST ACCURATE lip sync onto FILMED video — studio grade
  • It picks up the speaker's style from the video itself, with no separate training — it watches the input and builds its own idea of the person in motion
  • It works up to 4K and clears the face with diffusion upscaling rather than the old way — the chin and the mouth come out clean
  • It copes with a larger face in the frame — up to around 350 pixels, without the quality dropping
  • It works for live action, for animation and for generated video alike

Weak at

  • It wants ACTIVE speech in the input: if the person is silent in the shot, the lips may not start moving at all
  • A strong profile or a partly covered face gives a weak result
  • Slow — about twice as slow as the lightweight version
  • Expensive

Don't use it for

  • Don't feed it a shot in which the person is silent or just looking
  • Don't feed it a strong profile or a face behind a hand, a microphone, hair
  • Don't use it when all you have is a photo — that's what the other model is for

Typical tasks

  • Make a person from a clip say a different text
  • Change the speaker's language while keeping the face
  • Fix a line without shooting again
  • Dubbing a live-action or an advertising shot

Frequently asked questions about Sync

How much does one generation with Sync cost?

You pay with credits and the price depends on the model: Sync 2.0 Pro Lip-sync — 168 credits. The exact price is shown before you start the generation.

What are the limitations of Sync?

Here is what each model supports: Sync 2.0 Pro Lip-sync — aspect ratios 1:1, 9:16, 16:9, lengths 5 sec, 10 sec.

What is Sync best for?

Strengths by model: Sync 2.0 Pro Lip-sync — The MOST ACCURATE lip sync onto FILMED video — studio grade, It picks up the speaker's style from the video itself, with no separate training — it watches the input and builds its own idea of the person in motion, It works up to 4K and clears the face with diffusion upscaling rather than the old way — the chin and the mouth come out clean.

Sync vs the other models

All model comparisons

Try Sync now

Generate your own video with Sync right in the browser — no installation, in English.