VideoPoet is a simple modeling method that can convert any autoregressive language model or large language model (LLM) into a high-quality video generator.
Google announced VideoPoet:
VideoPoet is an impressive modeling approach that effortlessly converts autoregressive language models into top-notch video generators. It harmoniously blends various modalities like images, video, and audio, using a unified vocabulary.
The inclusion of multimodal generative learning objectives enhances its capabilities, covering tasks like text-to-video, image-to-video, and more. The model's zero-shot prowess, demonstrated in tasks like text-to-audio, adds an exciting dimension. In essence, VideoPoet breaks traditional boundaries, offering a powerful tool for innovative multimodal content generation.
@saaswarrior This looks like it would be a great story-telling tool for kids. I am going to try it out with my daughter.
We just launched fnchart on here too. Would love to get your thoughts on it.
Report
@saaswarrior the multi-modal models are getting better and better. Great to see more video generation availability
Report
Hunter
@watr yeh I was also considering teaching children; it will be beneficial, and certainly, it will now be possible for non-professionals to create animated videos. 😍
Report
Hunter
@koconder How far this technology will come in the next two or three years is something we can imagine.
Why is this a Product Hunt listing? You cannot use this. This is just another closed research paper.
Report
Yep, @bilater. Even as a former Googler and still-Google-fan, I find it incredibly annoying how things like this are trumpeted as "launches" here on PH and elsewhere. Even years later, for instance, the broader public doesn't have access to Imagen which was "launched" years ago.
I'd love for PH to adopt a rule that limits posts here to products and features that are open -- even gradually -- to the public (e.g., okay if it's an invite-only thing if members from the public are being AT THAT MOMENT gradually let in to try the app)
Report
@bilater@thatadamguy Hear, hear! I had the same thought. This is really interesting scientific research, but it's not a product until it is available to the public. And thus it shouldn't be listed or promoted here until then.
Report
I am sorry, I don't understand. This product is from Google, can one launch their product here on PH under their own name or do you officially represent Google here?
@kritarthmittal ProductHunt allows users to hunt for any product; nevertheless, we do need to add makers. It is unlikely that Google, Meta, and other industry titans will quickly join PH.
Report
@saaswarrior I understand now. Just started exploring PH and still figuring out how this all works. Interesting to know that we can also hunt products if we come across any cool ones.
Report
I'm going to try it out, hope i will love it.
Report
Hunter
@abtraill It is not yet ready for testing; I will notify you when it becomes accessible.
fnchart
Tiny LLMs
Realtime crypto investment tracker
Edily
PixelFree Studio