D-ID, a trailblazer in the AI video creation landscape, has just launched an innovative tool that pushes the boundaries of video translation technology. This new offering not only translates video content into multiple languages but also seamlessly clones the speaker’s voice and synchronizes their lip movements to match the translated speech—setting a new standard for AI-powered video editing.
A Legacy of Innovation: From Animated Photos to AI Video Translation
D-ID’s latest breakthrough builds on its history of pioneering AI technologies. The company first made waves with its viral tool that animated old family photos, bringing them to life in a way that captivated millions. This success propelled D-ID to close a $25 million Series B funding round in 2022, enabling the company to expand its reach, particularly among enterprise customers in the U.S. who leverage its technology for creating AI-driven videos.
The Power of AI Video Translate
Now, with the launch of AI Video Translate, D-ID is offering creators an unprecedented tool that empowers them to automatically translate their videos into 30 different languages. This includes widely spoken languages such as Arabic, Mandarin, Japanese, Hindi, Spanish, and French, among others. This tool is currently available to D-ID subscribers at no additional cost, making it an attractive option for those looking to expand their content’s global reach. The company offers a range of subscription plans, starting from $56 per year for the most basic package, with the highest non-enterprise plan costing $1,293 per year.
Revolutionizing Global Content Creation
D-ID’s AI Video Translate is poised to be a game-changer for creators and businesses aiming to scale their content for a global audience. Traditionally, localization efforts, particularly dubbing, have been both costly and time-consuming, often out of reach for smaller creators. D-ID’s new technology offers a solution that significantly reduces these barriers, allowing creators in marketing, entertainment, social media, and beyond to localize their content more efficiently and affordably.
This launch comes at a time when AI-driven voice cloning and translation technologies are becoming increasingly accessible. For instance, YouTube’s multi-language audio feature has enabled creators like MrBeast (Jimmy Donaldson) to translate content into numerous languages, significantly broadening their audience. Similarly, Vimeo’s recent introduction of tools for translating audio and captions, including voice replication using AI, is another sign of the industry’s rapid evolution.
The Broader AI Landscape: Competitors and Collaborators
D-ID’s new tool enters a competitive market filled with other AI translation and dubbing technologies. Companies like Microsoft have introduced AI tools to translate and dub YouTube videos in real time, while other players like Descript, ElevenLabs, Speechify, and Veed have also been innovating in voice cloning and translation. Additionally, platforms like HeyGen and Deepbrain AI are leveraging AI avatars that can speak dozens of languages, further underscoring the growing demand for such technologies.
D-ID’s AI Video Translate is powered by the company’s proprietary model, Rosetta-1, and benefits from advancements in dubbing and lip sync AI libraries like Wav2lip, which have paved the way for more sophisticated and accessible tools.
Seamless Integration and Accessibility
The AI Video Translation feature is available through D-ID Studio and its API, making it versatile and easy to integrate into various workflows. D-ID is offering a one-month free trial, allowing users to experience the technology firsthand. Demos are also available on the company’s website.
To ensure the best results, videos should be between 10 seconds and 5 minutes long and should not exceed 2GB in size. The tool is designed to work optimally with a single person in the frame who is facing the camera with their face clearly visible at all times.
Conclusion: A New Era in AI-Driven Video Translation
D-ID’s AI Video Translation tool marks a significant leap forward in the field of video localization, offering creators a powerful, accessible, and affordable way to reach a global audience. As AI technology continues to evolve, tools like these will likely become essential in the content creator’s toolkit, enabling more personalized and engaging experiences for viewers around the world.
