1. Home
  2. Ā ā†’Ā Newsletter
  3. Ā ā†’Ā šŸ˜ŗ NEW from OpenAI

Product Hunt Daily Digest
February 15th, 2024

PRODUCT HIGHLIGHT
OpenAIā€™s latest model takes video generation to the next level

OpenAI has dipped its toes, or should I say its whole body, into the world of video generation. Following in the footsteps of startups like RunwayML, the titular AI company announced Sora, a text-to-video AI model thatā€™s capable of producing some stunning ā€” almost concerning results.Ā 

It was announced yesterday, out of the blue, and it quickly took social media by storm. OpenAI CEO Sam Altman generated a number of videos based on peopleā€™s suggested prompts, including dogs recording a podcast, a drone race on Mars, and a variety of sea creatures riding bikes.Ā 

Sora works like the rest of OpenAIā€™s offerings ā€” enter a prompt as simple or as detailed as you like, and it will generate a minute-long 1080p video in whatever style you want, populated with things, people, animals, and different environments. You can also craft your blockbuster movie just by dropping in a still image which the AI will then go on to animate, or a video that can be extended by Sora.Ā 

According to OpenAI, Sora was trained on around 10,000 hours of ā€œhigh quality videoā€ and is built upon a transformer architecture, which apparently gives the model a superior scaling performance. It also uses the same ā€œrecaptioning technique from DALLĀ·E 3, which involves generating highly descriptive captions for the visual training data.ā€

Safety was a big concern for the team as well, so itā€™s not open to the public yet. Rather, the company is working with ā€œred-teamersā€ ā€” experts in things like misinformation, hate content, and bias ā€” who will be testing the model thoroughly before any release to the wider public.Ā 

Sora ā€” with all of its mind-blowing capabilities isnā€™t perfect though, and the team recognizes its weaknesses, particularly when it comes to physics, saying ā€œIt may struggle with accurately simulating the physics of a complex scene, and may not understand specific instances of cause and effect.ā€

As mentioned, Sora isnā€™t currently available to the wider public, and thereā€™s no release date yet. However, you can continue to reply to Sam Altman and maybe he will generate your prompt, or you can take a look at this curated gallery of examples made by a maker.

Check out Sora
Sponsored By
Newsletter Sp-onsor

Tired of explaining the same thing over and over again to your colleagues? Itā€™s time to delegate that work to AI. guidde is a GPT-powered tool that helps you explain the most complex tasks in seconds with AI generated documentation.

  • Turn boring documentation into stunning visual guides
  • Save valuable time by creating video documentation 11x faster
  • Share or embed your guide anywhere for your team to see

    Simply click capture on our browser extension and the app will automatically generate step-by-step video guides complete with visuals, voiceover and call to actions.

    The best part? Our extension is 100% free.