Skip to main content

Forget painting-style transfers, this A.I. creates realistic portraits of fake people

A Style-Based Generator Architecture for Generative Adversarial Networks

After selling the first artificial intelligence generated artwork earlier this year, deep learning algorithms are now tackling portraits — of made-up people that don’t exist. In a research paper, Nvidia recently shared the results of a generative adversarial network (GAN) trained to generate images of people while unsupervised.

The concept is based in part on style transfer technology, which transfers the style of one image onto another in order to do anything from building a photo app like Prisma to creating realistic deep fakes. Nvidia researchers redesigned the GAN to use a style transfer, while adjusting that style on each layer of code. The change, the researchers say, allows the software to generate high-level attributes like subtle differences in poses as well as random variation in features.

The researchers mixed the adjusted algorithms with a wider training dataset, one of which is the faces on Flickr instead of a database of celebrity faces, and adjusted the way the generator embeds the code for more realistic results that aren’t simply re-creating an existing person in a new photo. The researchers also switched between two different randomized codes for more variation in features.

While the GAN can randomly create images of people, the researchers also managed to control the results by using a style transfer to mix qualities from two different portraits. A “style” image mixed with a “source” image uses features like skin, eye, and hair color from the style image and applies it to the source image, which keeps the original’s gender, age and pose. The lighting styles and background of the style image also transfer to the source image.

The results show dramatic improvement over similar Nvidia research from four years ago, where the resulting images were black and white images with few details. The program’s not perfect — the system, for example, created some portraits with two different colored eyes and in others didn’t maintain facial symmetry.

While the paper shows impressive progress, the researchers didn’t detail the real-world use of such algorithms. Like the technology used for deep fakes, the ability to create an image of a fake person — though not a process that’s easy to replicate — raises concerns about misuse of the technology.

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
DJI’s 2022 drone contest offers record prize pool
A photo taken from a drone.

Leading drone maker DJI has teamed up with the SkyPixel online community for its eighth annual photo and video contest.

Whether you’re an experienced drone pilot or an absolute beginner still finding your way, the contest is the perfect opportunity to send your machine skyward in a test of your creative skills.

Read more
How $80 of photo processing software magically saved me thousands
photo editing topaz labs denoise ai phil camera

It's a good time to be a photographer, whether you're just starting out and really don't have any idea what you're doing, or if you're a seasoned pro looking to try something new.

The gear is better than ever, making even entry-level bodies better than what the previous generation started out with. Software options make cataloging and processing your photos faster and less destructive, so you can revisit things for years and give old pics new life.

Read more
Sony A7 III mirorless camera is $300 off for Black Friday
Sony Alpha a7 III Mirrorless front view.

There are a lot of great Best Buy Black Friday deals going on right now, and whether you're looking for TVs, laptops, or even headphones, there's a little something for everybody. Of course, many folks may not realize that Best Buy has some fantastic deals on high-end photography gear, such as this Sony Alpha a7 III mirrorless camera. While it usually goes for a whopping $2,200, Best Buy had brought it down to $1,900, and while that relatively doesn't seem like much, you could always spend the $300 savings on a new lens.

Why you should buy the Sony Alpha a7 III
The Sony Alpha a7 III is a camera with so much tech that it might as well be three different cameras. It has excellent dynamic range, low-light performance, and high-speed performance, and the full-frame sensors make the images look absolutely stunning. Interestingly, the a7 III manages to do an excellent job at both low and high ISOs, the latter of which can go as high as 51,200 non-boosted, which, granted, adds a lot of noise, but noise reduction helps with that. As for the video, well, sadly, it's not as impressive, at least in terms of advancements in image quality, and while it can do 8-bit 4K at 30 frames per second, it's no longer ahead of the pack in that regard, like the Panasonic Lumix GH5 is with its 400Mbps 10-bit codec and 60-fps 4K.

Read more