Skip to main content

What’s next for Snapchat? Patents suggest 3D models and mapping of emotions

US Patent 2018/0075651 / Snap, Inc.
US Patent 2018/0075651 / Snap, Inc.

Snapchat is moving forward after a redesign drew some negative reactions. So, what’s next for the social network? Two patents published in mid-March suggest the company is researching the possibility of creating 3D models with a smartphone and reading emotion in a video chat. Both patents were filed in November, but only became public recently.

The first patent suggests a method for simplifying the process of creating a 3D model, to the point where anyone with a smartphone can create one. Rather than using a complex camera or a wearable device to create a 3D rendering, the patent instead suggests using a smartphone camera and motion to help detect depth. The idea is that, after mapping out points from one view of an object or a face, tracking movement between points will allow the program to construct depth maps for 3D rendering.

Snap isn’t just looking to make 3D modeling simple by using a smartphone camera, however. The patent also details a user interface that would instruct the user on how to move the camera around an object or, for facial renditions, how to angle the face. According to the patent, the program would also warn users if the conditions aren’t ideal, such as limited lighting, and what to do to correct the problem. On-screen instructions would also assist with proper alignment and moving the camera, while alerts would warn of problems, such as moving too fast.

The patent doesn’t detail what the technology would be used for, but it’s easy to imagine how easy-to-create 3D models could be used in an augmented reality platform like Snapchat’s Lenses, potentially adding those models to an AR world. The Snapchat-owned Bitmoji could be another application for the 3D face mapping.

The patent suggests that the technology could be used on a device with a built-in camera like a smartphone, tablet or computer — or it could even be a stand-alone device.

The second patent also creates a facial map — but this time, to detect emotions during a video chat. The person in the video would first have to approve a request for the emotion mapping. Then, the program would use object recognition to find the face, then create a “face mesh” — essentially a map of the face’s various features. The program would then measure changes in that facial map in order to look for emotions.

Interestingly enough, the patent doesn’t recommend using the feature for suggesting emojis on a video chat between friends, but for using it during a chat between a customer and a customer service representative. Because, as the patent says, “customer anger is not always easy to spot.”  Snap Inc. isn’t the only network looking into tracking emotions — published patents last year suggested Facebook researched the possibility of tracking emotions through a camera, keyboard movement, and touchpad.

Many patents never turn into anything besides a bunch of legal paperwork, so there’s no guarantee that a future Snapchat could allow you to create 3D models with a phone — or really let that customer service agent see how angry you are. The patents, however, do offer a look at what Snap Inc. researchers are dreaming up.

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Super Mario 3D World + Bowser’s Fury trailer reveals wild new game mode
Super Mario 3D World + Bowser's Fury

Nintendo released a new trailer for Super Mario 3D World + Bowser's Fury, which finally reveals information on the re-release's new mode. Bowser's Fury is an entirely new adventure that features a gigantic Bowser.

Super Mario 3D World + Bowser's Fury is a Nintendo Switch version of the 2013 Wii U game Super Mario 3D World. Nintendo previously revealed that the new edition would feature something called Bowser's Fury, but this is the first time the mode has been shown in any form.

Read more
Qualcomm’s long-awaited second-gen 3D Sonic fingerprint sensor is 50% faster
qualcomm 3d sonic sensor second generation ces 2021 2nd gen

Qualcomm wants to make its in-display fingerprint sensor a little bit more seamless. Its first-generation Sonic Sensor was introduced a few years ago, and at the time offered a decent experience -- but since then, has been overtaken in terms of speed and performance by competing optical sensors. Now, Qualcomm has finally launched a new, second-generation 3D Sonic sensor with big improvements.

The new sensor is 77% larger than Qualcomm's original 3D Sonic Sensor, measuring in at 8mm square, compared to the original's 4mm by 9mm. In other words, you'll be able to place your finger on a larger portion of the screen, making the overall experience a little more seamless.

Read more
3D scanning sheds light on newly discovered 2-million-year-old fossilized skull
3D scanned skull

3D scanning dire wolves, ground sloths, and mammoths in California with Artec Space Spider

Sometimes it takes the very latest technology to answer some of the oldest questions. This week, researchers announced the discovery of an incredibly rare, 2-million-year-old skull in South Africa that is a cousin species to “Homo erectus,” the famous extinct archaic human from the Pleistocene era.

Read more