Skip to main content

5 things AI image generators still struggle with

AI image generators like Dall-E, Stable Diffusion, Midjourney, and Bing Image Creator produce amazing results, but sometimes they can be incredibly frustrating. With simple prompts containing just a few words, an AI can output impressive images that appear to be professional photographs and convincing art in various styles. However, the same prompt will occasionally create some horrific creature or hilariously flawed rendering.

Negative prompts might help reduce the likelihood of these errors, but complexity can’t always save you. Even AI experts struggle with misshapen creatures and unworldly scenes, requiring long hours of refining prompts or touching-up images with a traditional photo editor. For the time being, if you look carefully in the right areas of an image, there’s a good chance you’ll be able to identify if it was made by a machine.

Recommended Videos

Hand salad and balls of fingers

AI developers have made progress in the struggle to teach artificial intelligence tools how human hands should look, but there’s plenty of room for improvement. If fingers aren’t featured prominently, it’s easy to miss errors, but it’s an ongoing problem.

Dall-E was an early AI leader but hands are not its thing.
Dall-E was an early AI leader, but hands are not its thing. Dall-E prompted by Alan Truly / Digital Trends

One of the first and best AI image generators available to the public, OpenAI’s Dall-E, created these pictures of people holding hands. At first glance, it might look fine. On closer inspection, some problems become apparent. Beware of extra fingers, weird fingernails, and merged digits.

Complicated grips and interlaced fingers are even more challenging. Don’t be surprised if your AI images come back with classic glitches referred to as “hand salad” or “balls of fingers.”

Dall-E's interlaced hands are disturbing.
Dall-E’s interlaced hands are disturbing. Dall-E prompted by Alan Truly

Troubling text and writing

You might expect that text would be easy for a computer to generate. You see evidence of words on screens daily when you pick up the phone or open a browser. Early computers, unlike the top gaming PCs of today, couldn’t display graphics of any kind. Everything was text or numbers.

Leonardo AI knows styles but printed text is challenging.
Leonardo AI knows styles, but printed text is challenging. Leonardo AI prompted by Alan Truly

Yet displaying actual letters and symbols as printed or written words is surprisingly tricky for an AI image generator. It might sound like an easy problem to solve, but it isn’t. An app can’t just overlay plain text. To be convincing, the text style, shading, angle, and perspective must match the rest of the scene.

In the example, a relatively new AI image generator, Leonardo AI, made a valiant effort with a vintage billboard for Jack Rabbit Slim’s diner. After multiple tries, the AI managed to spell out “Jack Rabbit’s,” which is quite close to the request. The vintage photograph style was spot-on in each image, but the letters and words were mostly flawed.

Leonardo AI came close to getting text right in one of these renders.
Leonardo AI came close to getting text correct in the render on the left. Leonardo AI renders prompted by Alan Truly

The eyes don’t have it

Bing Image Creator struggles with eyes.
Bing Image Creator prompted by Alan Truly

It’s often said that the eyes are the windows to the soul. We rely so much on eye contact that it could be the most critical detail in creating a realistic portrait. But many AI tools have difficulty rendering human eyes.

Bing Image Creator did a decent job with the studio background and posing a multigenerational family photo. However, almost every person has bizarre eyes that look like they’ve been inserted by aliens, or perhaps these smiling people are in the process of transforming into unearthly creatures.

Two closer examples of Bing Image Creator's eye issues.
Two closer examples of Bing Image Creator’s disturbing eye issues. Bing Image Creator prompted by Alan Truly / Digital Trends

Troublesome tools

Humans are great with tools and not only the digital variety like AI. We quickly master any physical tool within our grasp. An AI, on the other hand, struggles to understand what they are and how they’re used.

Midjourney understands hands but is puzzled by wrenches.
Midjourney understands hands, but is puzzled by wrenches. Is that a light bulb at the bottom left? Midjourney prompted by Alan Truly

Midjourney is an AI image generator that’s making fantastic progress in solving problems with human faces and hands. However, when prompted to show a mechanic tightening a bolt with a wrench, the tool is entirely absent. Fingernails are added to gloves in one case, and a light bulb somehow appears in another.

Scissors are too complicated for Bing Image Creator in this closeup render of hair being cut. They are only open in one image and never appear to be in the act of cutting.

Bing Image Creator can't figure out scissors.
Bing Image Creator can’t figure out how scissors work. Bing Image Creator prompted by Alan Truly

Nightmare teeth

Stable Diffusion renders of smiles sometimes have too many teeth.
Stable Diffusion via Leonardo AI, prompted by Alan Truly

When people smile and laugh, that usually improves a picture, making it pleasant and fun. When given a simple prompt like two students smiling and laughing, an AI can turn this into nightmare fuel with multiple rows of teeth and other strange distortions.

Leonardo AI allows you to choose between several models, and some handle teeth well. The popular Stable Diffusion 2.1 model needed some help to get teeth right. With some negative prompting, the issue was resolved. There are solutions to these AI image problems, but it still takes work to get good results.

Stable Diffusion smiles benefit from negative prompts.
Stable Diffusion smiles benefit from negative prompts to remove “weird teeth” and “distorted mouth.” Stable Diffusion via Leonardo AI, prompted by Alan Truly

AI art is improving rapidly

In the early days of AI art, the results were weird and wonderful, creating beauty and horror with equal abandon. The errors are becoming less noticeable with each new update, and many problems can be overcome with some refinement.

With so many AI tools available, it’s easy to try another system. Many AI image generators allow negative prompts or other options to adjust the algorithm and get better results.

You may need to run through several attempts to get a usable picture, particularly if there’s a focus on faces or hands. When you want to include print or written words, be prepared to spend time in an image editor erasing the AI’s nonsense letters and blending in the correct text.

The good news is that many AI image generators are free, and subscription models are relatively inexpensive. Within a year, these lingering problems could be resolved, allowing you to use an AI render as a finished art piece or a replacement for a photograph.

Alan Truly
Alan Truly is a Writer at Digital Trends, covering computers, laptops, hardware, software, and accessories that stand out as…
New ‘poisoning’ tool spells trouble for AI text-to-image tech
Profile of head on computer chip artificial intelligence.

Professional artists and photographers annoyed at generative AI firms using their work to train their technology may soon have an effective way to respond that doesn't involve going to the courts.

Generative AI burst onto the scene with the launch of OpenAI’s ChatGPT chatbot almost a year ago. The tool is extremely adept at conversing in a very natural, human-like way, but to gain that ability it had to be trained on masses of data scraped from the web.

Read more
OpenAI’s new tool can spot fake AI images, but there’s a catch
OpenAI Dall-E 3 alpha test version image.

Images generated by artificial intelligence (AI) have been causing plenty of consternation in recent months, with people understandably worried that they could be used to spread misinformation and deceive the public. Now, ChatGPT maker OpenAI is apparently working on a tool that can detect AI-generated images with 99% accuracy.

According to Bloomberg, OpenAI’s tool is designed to root out user-made pictures created by its own Dall-E 3 image generator. Speaking at the Wall Street Journal’s Tech Live event, Mira Murati, chief technology officer at OpenAI, claimed the tool is “99% reliable.” While the tech is being tested internally, there’s no release date yet.

Read more
DALL-E 3 could take AI image generation to the next level
DALL-E 2DALL-E 2 Image on OpenAI.

OpenAI might be preparing the next version of its DALL-E AI text-to-image generator with a series of alpha tests that have now been leaked to the public, according to the Decoder.

An anonymous leaker on Discord shared details about his experience, having access to the upcoming OpenAI image model being referred to as DALL-E 3. He first appeared in May, telling the interest-based Discord channel that he was part of an alpha test for OpenAI, trying out a new AI image model. He shared the images he generated at the time.

Read more