ElevenLabs’ New Dubbing v2 Brings Emotion-Preserving AI Translation to Video

ElevenLabs has introduced Dubbing v2, a new AI dubbing model designed to preserve a speaker’s original tone, pacing, and emotional delivery when translating speech into more than 90 languages. The company says the system moves beyond traditional transcript-based dubbing by conditioning directly on the source performance, allowing translated audio to retain the characteristics that make speech feel natural and personal.

The release targets a longstanding challenge in automated localization. While AI translation systems have become increasingly accurate, dubbed audio often loses the timing, emphasis, energy, and emotional cues present in the original recording. ElevenLabs says Dubbing v2 addresses that gap by transferring elements of the speaker’s performance across languages rather than generating audio solely from translated text.

The model is also designed to adapt translations for spoken delivery. According to the company, its sync-aware translation system adjusts phrasing and pacing to better match the rhythm of the source content, helping translated speech align with the original timing without extensive manual editing. The goal is to produce audio that feels closer to professionally dubbed content while reducing the amount of post-production work required.

The technology arrives as demand for multilingual content continues to expand across creator, marketing, and media industries. Traditional dubbing workflows often involve translators, voice actors, editors, and audio engineers, creating significant costs and production complexity. ElevenLabs positions Dubbing v2 as a way to automate much of that process while maintaining a higher level of performance quality.

For content creators, the company has integrated Dubbing v2 into ElevenCreative, allowing users to localize videos for different audiences through a single workflow. ElevenLabs says the system is designed to preserve the personality and delivery style of the original speaker, helping creators reach viewers in additional markets without producing separate versions of their content.

Marketing teams are another target audience. The company says brands can use the technology to localize advertisements, product videos, and other campaign assets while maintaining consistent delivery and emotional tone across languages. ElevenCreative supports the broader localization process, enabling teams to adapt content for multiple regions without rebuilding campaigns from the ground up.

For larger media organizations, ElevenLabs is pairing Dubbing v2 with its ElevenProductions offering. The service combines the new dubbing model with professional localization support, including human translation, voice casting, and audio mixing. In that workflow, Dubbing v2 handles speech generation and synchronization while human specialists oversee other production elements.

Alongside the launch, ElevenLabs announced a Creator Dubbing Partner Program that will provide eligible creators with discounted access to the technology. Dubbing v2 is available immediately through ElevenCreative and ElevenProductions. The company is also offering a limited free usage allocation across several subscription tiers during the launch period, while API access remains in development and is expected to arrive later.

This analysis is based on reporting from ElevenLabs.

Image courtesy of ElevenLabs.

This article was generated with AI assistance and reviewed for accuracy and quality.