Skip to main content

Forget Dall-E, you can sign up to create AI-generated videos now

Dall-E, ChatGPT, and other AI-generation technologies continue to amaze us. Still, AI image-generation tools like Midjourney might seem boring once you see the new, AI-powered video-generation abilities that will soon be available to us all.

Runway provides an advanced online video editor that offers many of the same features as a desktop app. The company has distinguished its service from others, however, by pioneering the use of AI tools that help with various time-consuming video chores, such as masking out the background.

A frame from an AI-generated video in claymation style.
Image used with permission by copyright holder

Now Runway has pushed its video magic to a new level, announcing on Twitter a new AI video-generation offering that exceeds anything that’s been shown before, even by leading AI companies like Google and Meta. Known as Gen-1, this AI model uses a video that you supply, along with a prompt, to generate a remarkably stable and high-quality rendering that matches the structure of the original, but with a very different style.

Runway is a new face in the world of AI-generated content, but it comes from the co-creators of Stable Diffusion, which is a popular text-to-image AI tool available on Mac.

The prompt can be text-based, or you can supply an image to use as a style to process the video. There are five modes of operation currently. Stylization mode captures the look of an image and applies that to the video. Storyboard mode replaces more of the original video. The idea is that you are only supplying placeholders for the AI to replace.

For more precision, Mask mode lets you specify which portion or subject in the video should be affected by the AI process. Render mode is similar to Storyboard, adding plenty of extra details to the supplied video. Runway also has a Customization mode that provides many more options to dial in what you want.

Even in this nascent form, it’s far better than videos that have been painstakingly assembled from hundreds of AI-generated images. Instead of a chaotic roiling, the sample videos are cohesive and flow much more naturally.

Early access to Gen-1 started today. And the results are already blowing us away. h/t @MatthewPaquette

Join the waitlist today. Share with friends to get in sooner. #Gen1 https://t.co/a41n97xl1u https://t.co/eWHLkeMqWx pic.twitter.com/U2nF3z3DZ7

— Runway (@runwayml) February 8, 2023

Runway’s Gen-1 video generation is already available in early access, and the tweet above details how you can join the waiting list. In the meantime, check out the YouTube video from Runway, which has better resolution than the Twitter video. The good part is about 40 seconds in.

Gen-1: The Next Step Forward for Generative AI

Editors' Recommendations

Alan Truly
Computing Writer
Alan is a Computing Writer living in Nova Scotia, Canada. A tech-enthusiast since his youth, Alan stays current on what is…
DALL-E 3 could take AI image generation to the next level
DALL-E 2DALL-E 2 Image on OpenAI.

OpenAI might be preparing the next version of its DALL-E AI text-to-image generator with a series of alpha tests that have now been leaked to the public, according to the Decoder.

An anonymous leaker on Discord shared details about his experience, having access to the upcoming OpenAI image model being referred to as DALL-E 3. He first appeared in May, telling the interest-based Discord channel that he was part of an alpha test for OpenAI, trying out a new AI image model. He shared the images he generated at the time.

Read more
Hackers are using AI to create vicious malware, says FBI
A hacker typing on an Apple MacBook laptop while holding a phone. Both devices show code on their screens.

The FBI has warned that hackers are running wild with generative artificial intelligence (AI) tools like ChatGPT, quickly creating malicious code and launching cybercrime sprees that would have taken far more effort in the past.

The FBI detailed its concerns on a call with journalists and explained that AI chatbots have fuelled all kinds of illicit activity, from scammers and fraudsters perfecting their techniques to terrorists consulting the tools on how to launch more damaging chemical attacks.

Read more
Even OpenAI has given up trying to detect ChatGPT plagiarism
A laptop screen shows the home page for ChatGPT, OpenAI's artificial intelligence chatbot.

OpenAI, the creator of the wildly popular artificial intelligence (AI) chatbot ChatGPT, has shut down the tool it developed to detect content created by AI rather than humans. The tool, dubbed AI Classifier, has been shuttered just six months after it was launched due to its “low rate of accuracy,” OpenAI said.

Since ChatGPT and rival services have skyrocketed in popularity, there has been a concerted pushback from various groups concerned about the consequences of unchecked AI usage. For one thing, educators have been particularly troubled by the potential for students to use ChatGPT to write their essays and assignments, then pass them off as their own.

Read more