Skip to main content

The incredible underlying technology of Snapchat’s selfie lenses

Snapchat’s selfie lenses, more commonly referred to as filters, are fun, ridiculous, and good for a cheap laugh. Thanks to facial recognition, selfie lenses can do things like transmogrify your boring ol’ mug into a cute puppy or shoot rainbows out of your mouth. It’s a novelty that wears off quickly, so Snapchat continually introduces new lenses to keep the experience fresh.

But for a feature that exists as little more than a gimmick, there’s a surprising amount of underlying technology powering it.

Recommended Videos

As reported by PetaPixel, the facial recognition engine that makes Snapchat lenses possible was acquired by the company when it purchased Looksery, a Ukrainian computer vision startup. Computer vision is a buzzy phrase these days, with wide ranging applications from depositing a check with your phone to, well, facial recognition. But, as the video below from Vox explains, Snapchat’s lenses have to do much more than simply recognize a face; they also have to model it in 3D space, taking into account rotation and even occlusion so that overlaid props and effects can animate correctly in video.

How Snapchat's filters work

While the technology itself isn’t new, the ability to apply it in real-time from a mobile device is. As smartphones continue to gain processing power, Snapchat will be able to introduce increasingly complex lenses — and the company has a lot of money riding on them.

Snapchat purchased Looksery for a staggering $150 million in 2015 and just this year bought another computer vision startup, Seene. Snapchat clearly sees an advertising opportunity with its selfie lenses, and began introducing sponsored lenses last year, for which it apparently charges no small fee, according to TechCrunch.

As impressive as the technology is, the Vox video ends on a note of caution when it comes to facial recognition and privacy. Currently, both government agencies and private companies like Facebook are storing huge databases of faces linked to real names, and there’s nothing to legally prevent them from doing so.

Making yourself look like a pirate in a Snapchat selfie is probably harmless, though.

Daven Mathies
Daven is a contributing writer to the photography section. He has been with Digital Trends since 2016 and has been writing…
A breakthrough technology could make CPUs 100x faster
The PPU, as imagined by Flow Computing.

There are bold claims, and then, there are bold claims -- Flow Computing just made the latter. According to the startup, its proprietary tech, which it refers to as a parallel processing unit (PPU), can boost the performance of any CPU by up to 100 times.

It doesn't even have to be one of the best CPUs -- Flow Computing claims that all devices in need of high-performance CPUs will find massive benefits in using the company's PPU. There's more to it that sounds pretty amazing, but what are the odds that it'll actually make it to market? Let's take a closer look.

Read more
A major era in Intel chip technology may be coming to an end
An Intel processor over a dark blue background.

Intel's next-generation Arrow Lake chips are said to be coming out later this year, but we don't know much about them just yet. However, a new leak shows us that two crucial features may be missing from the next-gen CPU lineup: hyperthreading and support for the AVX-512 extension. If Intel is ditching hyperthreading, it's not entirely unexpected, but it might make it trickier for even its best processors to beat AMD.

Hyperthreading allows physical cores in Intel processors to perform two tasks simultaneously, improving efficiency and performance in multi-threaded applications. Intel first introduced it in 2002, but it hasn't used the technology in every generation of its CPUs between then and now. The tech was all but gone from client processors for many years following its launch, although it was still present in certain models. Since then, Intel has selectively implemented HT across its product stack. In the last few years, it became a staple, especially in midrange and high-end chips.

Read more
How to go live on TikTok (and can you with under 1,000 followers?)
Tik Tok

 

It only takes a few steps to go live on TikTok and broadcast yourself to the world:

Read more