From Gizmodo:
OpenAI introduced Sora, its premier text-to-video generator, on Thursday with beautiful, shockingly realistic videos showcasing the AI model’s capabilities. Sora is now available to a small number of researchers and creatives who will test the model before a broader public release, which could spell disaster for the film industry and our collective deepfake problem.
“Sora is able to generate complex scenes with multiple characters, specific types of motion, and accurate details of the subject and background,” said OpenAI in a blog post. “The model understands not only what the user has asked for in the prompt, but also how those things exist in the physical world.”
OpenAI didn’t say when Sora will be released to the public.
Sora is OpenAI’s first venture into AI video generation, adding to the company’s AI-powered text and image generators, ChatGPT and Dall-E. It’s unique because it’s less of a creative tool, and more of a “data-driven physics engine,” as pointed out by Senior Nvidia Researcher Dr. Jim Fan. Sora is not just generating an image, but it’s determining the physics of an object in its environment and renders a video based on these calculations.
To generate videos with Sora, users can simply type in a few sentences as a prompt, much like AI-image generators. You can choose between a photorealistic or an animated style, producing shocking results in just a few minutes.
Sora is a diffusion model, meaning it generates video by starting with a blurry, static-filled video and slowly smoothes it into the polished versions you see below. Midjourney and Stable Diffusion’s image and video generators are also diffusion models.
However, I must note that OpenAI’s Sora is much better. The videos Sora produces are longer, more dynamic, and flow together better than competitors. Sora feels like it creates real videos, whereas competitor models feel like a stop motion of AI images. OpenAI has once again erupted yet another field of AI with a video generator that puts the competition to shame.
Link to the rest at Gizmodo
Pearl clutching at its finest.
“Could.”
Right.
It could also bring animated videos to the Indie world.
Something as simple as book trailers.
Video ads.
Animated adaptations?
Video as a cottage industry is a bad thing?
Only for the Hollywood establishment.
Having been far too pessimistic on how soon this capability would exist, I’m not going to make any prediction as to when it comes to local machines. Except that it will almost certainly be sooner than I can imagine, considering that AI hardware is already showing up on the high end.
I’m definitely not buying any stock in media companies, though.
Their stock wasn’t investment grade before this, though.
If anything, this might make their crappy SFX cheap enough to swallow.
(Some of the recent Marvel SFX are actually worse than early CW. Which itself has come down a bit.)