Skip to main content

Get ready: AI generated-GIFs might be coming soon

With chatbots and text-to-image generators taking the internet by storm, the next frontier of AI might be text-to-video generators.

Nvidia recently published a research paper called “High-Resolution Video Synthesis with Latent Diffusion Models” on its experiments at its Toronto AI Lab that details how it uses Stable Diffusion to create a tool that can make moving art results from text prompts.

The tech company showcased demos of the Latent Diffusion Models (LDMs), which use text to generate video clips without large amounts of computer processing, TechRadar noted.

The tool is able to generate GIF-style moving images that are approximately 4.7-second long videos at a 1,280 x 2,048 resolution. It is also capable of creating longer videos at a lower resolution of 512 x 1024, according to the research paper.

Having viewed a demo of the technology, TechRadar said the tool is likely ideal as a text-to-GIF generator at this point. The publication noted it could easily handle simple prompts such as a stormtrooper vacuuming on the beach or teddy bear is playing the electric guitar, high definition, 4K. Even so, the result still produced random artifacts and smudging in the GIFs, as are common on other regularly used AI tools such as Midjourney.

The publication believes longer videos still need a little more development before they hit prime time, but feels Nvidia will work quickly to get the technology ready. They might work well for stock libraries and similar purposes.

There are other companies experimenting with AI text-to-video generators. Google demoed its Phenaki generator, which allows longer prompts that produce 20-second clips. Another startup called Runway announced its second-generation video model last month, which is also based on Stable Diffusion. Its demo of the prompt the late afternoon sun peeking through the window of a New York City loft shows how you can add slight moving effects to still images.

Users also stand to benefit from the addition of AI in other programs, such as Adobe Firefly and Adobe Premiere Rush, according to TechRadar.

Some other companies, such as Narakeet and Lume5, market themselves as having text-to-video generators. However, many of these tools work more like PowerPoint presentations, putting together text, audio, images, and perhaps some already produced clips of video with prompts, as opposed to generating a unique work.

Editors' Recommendations

Fionna Agomuoh
Fionna Agomuoh is a technology journalist with over a decade of experience writing about various consumer electronics topics…
Elon Musk setting up generative-AI project at Twitter, report claims
A digital image of Elon Musk in front of a stylized background with the Twitter logo repeating.

Elon Musk is embarking on his own artificial intelligence (AI) project within Twitter, Business Insider reported on Tuesday.

With so much attention currently lavished upon generative AI tools such as OpenAI’s ChatGPT and Google’s Bard chatbots, it’s perhaps little wonder that Musk -- a man who appears to love technology and attention in equal measure -- wants a piece of the action.

Read more
The best AI image generators to create art from text
Théâtre D’opéra Spatial AI artwork developed by Jason Allen.

AI image generators are becoming a hot topic online, but they are far from new. The technology for these tools has been around for some time. It is just reaching a point where they are more accessible to the everyday user.

Some of these text-to-art generators are free, while some are behind paywalls, and others allow for a trial. There are also many styles of art you can create from different generators. Take a look at our roundup of some of the best AI image generators below to see which ones might match your artistic style.
What is an AI image generator?
An AI image generator is essentially a tool that uses machine learning to create art. In its simplest form, it will use text prompts to describe the type of art you want to create, and then it'll do its best job to make it for you. Some tools include additional styles and parameters to their generators to make the results more unique.

Read more
6 examples of how creepy and realistic AI-generated voices have become
An audio editing tool is shown distorted and with binary code overlaid.

In the ongoing AI revolution, images and text are yesterday's news, leaving audio as a new frontier to explore, and incredible progress has already been made. Here are six examples of AI audio generation that will leave you speechless.

Twitter is a hub of AI excitement, and notable artificial intelligence curator Barsee collected 13 examples of computer audio that create music, vocals, and speech, and we're highlighting six of those. Musicians and voice actors might be the next to face the challenge of AI encroachment.

Read more