Whispering Dubverse, Powered by OpenAI

Generate English Subtitles for videos in any langaue!

5.0•2 reviews•

246 followers

Generate English Subtitles for videos in any langaue!

5.0•2 reviews•

246 followers

Visit website

Whisper by OpenAI is an open-source speech recognition system trained on thousands of hours of data. It provides English subtitles with 95%+ accuracy, for videos in any language in real-time. Dubverse is bringing this technology to you as a product!

Whispering Dubverse, Powered by OpenAI gallery image

Free Options

Launch tags:Productivity•Languages•Artificial Intelligence

Launch Team

Render Sandboxes: a computer for every agentIsolated compute, persistent state and a real filesystem

Promoted

Whispering Dubverse, Powered by OpenAI

Maker

Hello Hunters, Makers, and product Geeks 👋 Anuja here, co-founder of Dubverse.ai I am super excited to announce our new subtitling tool, powered by OpenAI’s Whisper! Whisper is an open-source speech recognition system trained on thousands of hours of data, and it’s able to provide accurate English subtitles for videos in any language. For those new to Dubverse, a quick intro - we are a team of ex-founders who believe in the power of connection through languages. We are a deep-tech SaaS with a focus on building translation and VoiceOver engines. One of our products is the Dubverse Webapp which takes in a video and instantly dubs it into other languages at scale. We’re proud to be able to offer this innovative tool to our users. Let us know your thoughts in the comments!

Report

4yr ago

@anuja_dhawan2 This is amazing! Do you also have the feature to burn the subtitles in the video? We do a lot of Spanish/French Shorts type content. It would be a great add.

Report

4yr ago

@anuja_dhawan2 Sounds good, results are preety good I tried it for some of my videos

Report

4yr ago

@anuja_dhawan2 being an early adopter I can't stop raving about the product and the company. All the best

Report

4yr ago

@anuja_dhawan2 Congrats on the launch 🚀

Report

4yr ago

Whispering Dubverse, Powered by OpenAI

Maker

Hi Hunters! I’m Varshul, Cofounder of Dubverse 🙋‍♂️ Whisper was open sourced on 21st Sept. We always keep talking about “breaking the language barrier,” and it was a no-brainer for us to jump onto this right away. Our experiments with different types of video files gave outputs that required almost negligible editing. The Dubverse Webapp already had capability of generating translated subtitles, but it required heavy editing as proper nouns were not identified correctly. We hacked Whisper into our product by pulling an all-nighter the very same day. After a day’s internal testing, we invited some of our users to try it out. To our [excitement?], we saw them subtitling ~30 videos a day for their YouTube channels. As of the launch, 15 alpha users have subbed ~20+ hours of YouTube videos in English. The most common feedback : THIS IS DAMN ACCURATE! 🤯 Adding on @anuja_dhawan2 's comment above, I wanted to share with you the some major features you’ll enjoy: ✨ Project Management — organize your subs into folders and share them with your team 🎥 YouTube Picture-in-Picture — play the video side by side to make the reviews easier 📝 Transcripts Editor — Edit the English output, down to the timestamps with basic utilities like find and replace You’ll discover tone of other features and improvements that will make your content creation journey super easy. 🌟 What do you think we can improve upon it? Got additional feature requests? Comment below!

Report

4yr ago14 Answers

Whispering Dubverse, Powered by OpenAI

Maker

Hello, fellow tech geeks! 🙋‍♂️ Myself Jaskaran and I am an AI engineer at Dubverse. Here to highlight what fascinates me about the OpenAI Whisper tech Whisper is trained on 680,000 hours 🤯 of labeled audio, which makes the dataset one of the largest ever created in supervised speech recognition. In addition to that, the model is also trained on the translation task that is [x language] -> English (125,739 hours of data). The amount of huge data whisper is trained on allows it to be accurate in transcription and translation part directly from speech. Had we used a transcription + google translate pipeline, the error would propagate which would need a human in the loop. Whisper solves it in a one-shot style that is directly from speech and thus does not have cascaded errors. It is also amazingly good at transcribing/translating Songs 🤯. Excited to see the mass adoption of the tech.

Report

4yr ago

Whispering Dubverse, Powered by OpenAI

Maker

@jaskaran_singh11 "Excited to see the mass adoption of the tech." 🔥

Report

4yr ago

I am an early user of the product, I have a small YT channel and subtitles is something that everyone wants but it's a lot of manual effort, took me 2 hours for one video. I am a content/ marketing guy, and have never been in favour of AI replacing content. But I was surprised to see 99.9% accuracy, after just 1 video I had the trust and I stopped looking at most of the subtitles and just uploaded them (you can check them on my YT channel). This is a game changer, and there is no turning back. Thank you Dubverse.

Report

4yr ago

Whispering Dubverse, Powered by OpenAI

Maker

@gaurav_gdg Wow, would love to have the link to your YT channel!

Report

4yr ago

Looks great! I can totally see all the use cases where we can use it for at NimbleBox. Congrats Dubverse team 🎉

Report

4yr ago

Whispering Dubverse, Powered by OpenAI

Maker

@anshuman_pandey3 Now all your videos can have subtitles :)

Report

4yr ago

Dubverse.AI is breaking the barriers of language in an innovative way. Would definitely keep myself updated on this product as it seems to be becoming the talk of the town very soon. Kudos to the team!!

Report

4yr ago

Whispering Dubverse, Powered by OpenAI

Maker

@anu_priya_srivastava Thank you so much for your support. With a lot more features dropping soon we will keep making it easier for creators to move faster.

Report

4yr ago

Incredible product, incredible team and very incredible service. The new age in the tecno-solution and human-atention

Report

4yr ago

Whispering Dubverse, Powered by OpenAI

Maker

@pastry_campus Thank you so much for your kind words! We try our best to cater to our users' needs ((:

Report

4yr ago

1 2 3 4

5.0

Based on 2 reviews

Review Whispering Dubverse, Powered by OpenAI?

Reviews

Most Informative