What’s next for Snapchat? Patents suggest 3D models and mapping of emotions

snap inc latest patents 3d mapping emotion recognition snapchatpatent
US Patent 2018/0075651 / Snap, Inc.
US Patent 2018/0075651 / Snap, Inc.

Snapchat is moving forward after a redesign drew some negative reactions. So, what’s next for the social network? Two patents published in mid-March suggest the company is researching the possibility of creating 3D models with a smartphone and reading emotion in a video chat. Both patents were filed in November, but only became public recently.

The first patent suggests a method for simplifying the process of creating a 3D model, to the point where anyone with a smartphone can create one. Rather than using a complex camera or a wearable device to create a 3D rendering, the patent instead suggests using a smartphone camera and motion to help detect depth. The idea is that, after mapping out points from one view of an object or a face, tracking movement between points will allow the program to construct depth maps for 3D rendering.

Snap isn’t just looking to make 3D modeling simple by using a smartphone camera, however. The patent also details a user interface that would instruct the user on how to move the camera around an object or, for facial renditions, how to angle the face. According to the patent, the program would also warn users if the conditions aren’t ideal, such as limited lighting, and what to do to correct the problem. On-screen instructions would also assist with proper alignment and moving the camera, while alerts would warn of problems, such as moving too fast.

The patent doesn’t detail what the technology would be used for, but it’s easy to imagine how easy-to-create 3D models could be used in an augmented reality platform like Snapchat’s Lenses, potentially adding those models to an AR world. The Snapchat-owned Bitmoji could be another application for the 3D face mapping.

The patent suggests that the technology could be used on a device with a built-in camera like a smartphone, tablet or computer — or it could even be a stand-alone device.

The second patent also creates a facial map — but this time, to detect emotions during a video chat. The person in the video would first have to approve a request for the emotion mapping. Then, the program would use object recognition to find the face, then create a “face mesh” — essentially a map of the face’s various features. The program would then measure changes in that facial map in order to look for emotions.

Interestingly enough, the patent doesn’t recommend using the feature for suggesting emojis on a video chat between friends, but for using it during a chat between a customer and a customer service representative. Because, as the patent says, “customer anger is not always easy to spot.”  Snap Inc. isn’t the only network looking into tracking emotions — published patents last year suggested Facebook researched the possibility of tracking emotions through a camera, keyboard movement, and touchpad.

Many patents never turn into anything besides a bunch of legal paperwork, so there’s no guarantee that a future Snapchat could allow you to create 3D models with a phone — or really let that customer service agent see how angry you are. The patents, however, do offer a look at what Snap Inc. researchers are dreaming up.

Product Review

Gate’s Smart Lock is locked and loaded but ultimately lacks important basics

In a world of video cameras and doorbells comes the Gate Smart Lock, a lock with a video camera embedded. It’s a great idea, but lacks some crucial functionality to make it a top-notch product.

Here are 8 GoPro tips to get the most out of your action cam

There's more to your GoPro camera than just mounting it to your skateboard. Whether it's finding the best accessories or understanding the settings more thoroughly, learn to shoot video like a pro with these simple GoPro tips and tricks.

Apple banned from distributing some iPhone models in Germany

Apple is following the FTC's lead and has sued Qualcomm for a massive $1 billion in the U.S., $145 million in China, and also in the U.K., claiming the company charged onerous royalties for its patented tech.

From 4K powerhouses to tiny action cams, here are the best video cameras

Although not as popular as they once were, dedicated video cameras still have their benefits. From travel vlogging to home movies to recording your kid's little league game, here are the best video cameras you can buy right now.
Social Media

No yolk! A photo of an egg has become the most-liked post on Instagram

Until this weekend, the most-liked post on Instagram was of Kylie Jenner's baby daughter, which has around 18 million likes. It's now been knocked off the top spot not by a stunning sunset or even a cute cat, but by an egg.
Social Media

Invite your friends — Facebook Events can now be shared to Stories

Facebook is testing a way to make plans with friends to attend an event -- through Stories. By sharing an event in Facebook Stories, users can message other friends interested in the event to make plans to attend together.
Social Media

A quick swipe will soon let you keep bingeing YouTube on mobile devices

The YouTube mobile app has a new, faster way to browse: Swiping. Once the update rolls out, users can swipe to go to the next (or previous) video in the recommended list, even while viewing in full screen.

Starting your very own vlog? Here are the best cameras to buy

Any camera that shoots video can be used to vlog, but a few models stand out from the crowd thanks to superior image quality, ergonomics, and usability. When it comes to putting your life on YouTube, here are the best cameras for the job.
Social Media

Twitter extends its new timeline feature to Android users

Twitter users with an Android device can now quickly switch between an algorithm-generated timeline and one that shows the most recent tweets first. The new feature landed for iPhone users last month.
Social Media

YouTube to crack down on dangerous stunts like the ‘Bird Box’ challenge

YouTube already bans content showing dangerous activities, but new rules published by the site go into greater detail regarding potentially harmful challenges and pranks, including certain blindfold- or laundry detergent-based stunts.
Social Media

Nearly 75 percent of U.S. users don’t realize Facebook tracks their interests

Did you know Facebook tracks your interests, including political and multicultural affiliations? According to a recent Pew study, 74 percent of adult users in the U.S. have no idea Facebook keeps a running list of your interests.

It’s back! Here’s how to switch to Twitter’s reverse chronological feed

Twitter has finally brought back the reverse chronological feed, allowing you to see your feed based on the newest tweets, rather than using Twitter's algorithm that shows what it thinks you want to see. It's easy to switch.
Social Media

Nearly a million Facebook users followed these fake Russian accounts

Facebook purged two separate groups behind more than 500 fake accounts with Russian ties. One group had ties to Russian news agency Sputnik, while the other had behavior similar to the Internet Research Agency's midterm actions.