Calm down! Like dogs, the first Intel RealSense games can sense your fear

intel realsense coming of age games
“Just breathe,” Erin tells me as static fills the screen. Maybe it’s the cup of coffee I just downed, or perhaps it’s a touch of performance anxiety to be trying out this game in front of the developer, but my heart is apparently racing. And the game I’m playing knows it.

By tracking my pulse with Intel’s RealSense camera, Nevermind isn’t just responding to my hand gestures, it’s responding to my emotions. This is not what I expected when I came to try out gaming applications of Intel’s new 3D camera, but it has me immediately more interested than the expected motion controls. I take a deep breath, the static clears from the screen, and I continue.

If you’re not already familiar, Intel RealSense is effectively a Kinect, but with shorter range and higher resolution, and fitted in the bezel of a laptop or tablet, like a conventional webcam. Where the Kinect takes in the entire living room, RealSense has an effective range of about a meter, but a much greater resolution and responsiveness within that limited range.

Game developers can use RealSense for features like facial detection and gesture tracking, but also for subtler, more intriguing interpretations like emotion tracking. And those are just the built-in options. Inventive game makers could use the raw data for just about anything, potentially opening some exciting doors for gamers.

Related: Hands on: Intel RealSense 3D

I recently had a chance to try the very first RealSense-enabled games at an event sponsored by Intel. While some merely ape the Microsoft Kinect and Nintendo Wii, some truly push the boundaries of what games are capable of. Here’s what they’re like.

All you need is a body

Lego Portal Racers is an endless runner game in the vein of Temple Run or Subway Surfers. You speed through endless tracks across various, Lego-themed universes, collecting points and power-ups for as long as possible before crashing. Tilting your head side-to-side moves yoru character side-to-side, which makes it intuitive enough that anyone could sit down and get going with little to no instruction. That was the developer’s goal here, and the team nailed it.

Madagascar: Move it! is similarly accessible and targeted at children. It features the lemur from DreamWorks’ animated Madagascar films, dancing with simple, rhythmic gestures for the player to repeat, increasing in speed and complexity as you move up difficulty levels. It’s very similar to the Let’s Dance series of rhythm games.

The appeal of these games is the same appeal that made the original Wii so popular with people outside of traditional “gamer” demographics: They don’t need to learn an intimidating controller or keyboard and mouse controls. The Wii-mote and Wii Sports provided an intuitive interface that anyone could pick up and play with relative ease. RealSense takes that one step further by cutting out the input device entirely and replacing it with gesture controls, plus it’s totally portable. Lego Portal Racer developer Metaio’s Jack Dashwood told me that, in testing, parents really liked being able to set their kid up with a laptop in the back seat of a car or in an airplane.

The future means lasers

Laserlife reaches for slightly older gamers, but still focusing on accessibility. It comes from developer Choice Provisions (formerly Gaijin Games), a studio best known for its Bit.Trip series of rhythm games.

You play as a mysterious, alien entity, represented by a laser beam, that stumbles upon the corpse of a human astronaut drifting through the void. Using your advanced technology, you collect the astronaut’s fragmentary memories to get some sense of who or what they were. Each memory is a level, divided into multiple phases as you collect, reform, and then return the memory. The different phases require different gesture controls, such as grabbing glowing shards as they pass by, or subtly raising and lowering your fingers to guide the laser through glowing gates, all in time with the music.

The level I played was an eerie, underwater environment, culminating in finding a boat. As you complete levels, the objects accrue in the space surrounding the astronaut, adding up to a symbolic tableau of their life. While the developers have an elaborate and specific backstory for the astronaut, they have left it intentionally vague within the game, encouraging players to fill in the details with their imagination.

Controls have also been kept intentionally minimal. Each section requires basically a single gesture that is easy to pick up. Studio co-founder Alex Neuse explained that the levels have been cleverly divided into different sections with different movements in order to alleviate the fatigue from doing the same thing for too long. Although they initially experimented with subtler and more complex gesture controls, Neuse said that they ultimately skewed towards bare minimalism because the technology is so new: “We wanted to make sure we could walk before trying to run.”

Once more, with feeling

The most interesting demonstration of the day, though, was first-time developer Flying Mollusk’s Nevermind, a psychological horror adventure game that uses your fear against you. As you explore the game, it uses the RealSense camera to register your pulse as a measure of anxiety. As players get more anxious, the screen fills with static and the environment changes contextually. For instance, in a weird meat locker/dairy in the demo, the floor would flood with milk, slowing you down as your anxiety rose. If things get out of control, then the game teleports you back to a soothing hub area for you to cool off.

While it’s difficult to achieve the kind of immersive anxiety that horror games thrive on while standing in a busy hotel event room for a demonstration, the effect was nevertheless really interesting. Designer Erin Reynolds first created Nevermind as an MFA project with a focus on how games could be used to help people. By providing direct, immediate feedback, players can improve their awareness of how their body responds to anxiety, and intuitively learn strategies to help mitigate it. “If we can help get people a little more in touch with themselves, I already count that as a win,” explained Reynolds. Although the game was developed just reading pulse, Reynolds hopes to experiment with the additional biometric measures and emotion recognition included with the RealSense SDK. Reynolds also saw the possibilities this opens up for more conventional action games as well. Imagine, for instance, a game that adds more enemies if you’re getting too relaxed.

While not the most polished demonstration of the day, Nevermind was the most interesting because it pointed toward mechanics that were heretofore impossible. Other games merely used motion controls as input for otherwise conventional games. Steering a spaceship by waving your hand around rather than moving a mouse is more gimmick than real innovation, and can be fatiguing in a way that using a conventional gamepad is not. However, a game that responds to your emotions opens up wholly new and exciting design spaces. The Wii and Kinect have already shown that motion-controlled gaming is feasible, but not as sexy as the developers had hoped. The killer gaming app for RealSense will have to show us gameplay that we could not have imagined otherwise.

Product Review

Chris is the virtual co-pilot phone-obsessives need in their car

Driving while using your phone is dangerous, and often illegal. Meet Chris, the digital assistant for your car that wants to help keep your hands off your phone, and your eyes on the road.
Home Theater

Cheer for your favorite NCAA team and Xfinity will respond with matching lights

Screaming at your favorite team just became a lot more rewarding thanks to Comcast's Xfinity voice remote and some special NCAA commands that set your smart lightbulbs to your favorite team's colors.
Movies & TV

No TV? No problem. Here's how to watch the Final Four online

Whether you want to watch the Big Dance on your phone or on your smart TV, we have the lowdown on all the ways to watch March Madness you can handle. Grab your foam finger and some nachos.

Your PlayStation 4 game library isn't complete without these games

Looking for the best PS4 games out there? Out of the massive crop of titles available, we selected the best you should buy. No matter what your genre of choice may be, there's something here for you.

Here's what we know about the Dark Souls developer's next game

Sekiro: Shadows Die Twice is the latest game from Dark Souls and Bloodborne developer From Software. Here is everything we know about the new game, including its setting and combat changes.

Xbox One X vs. PS4 Pro: Which console is more powerful?

Far from cooling down, the console wars are only getting more intense. We compare Microsoft's Xbox One X to Sony's PlayStation 4 Pro to help you decide which premium console is right for you.

Intel Command Center lays foundation for next year’s ‘Arctic Sound’ GPU

Intel revealed its new Command Center driver software at GDC 2019. The updated interface will control current Intel integrated graphics and also lays the groundwork for next year's Intel video card.

Apex Legends

The latest news, guides, tips and tricks, updates, patch notes, and more so you can learn how to level up your game in Apex Legends. Related Categories: Apex Legends News | Guides | Features

G-Sync and FreeSync can make your games look better, but which is best?

There are some subtle differences between the two adaptive refresh technology offerings, and they affect cost, performance, and compatibility. Nvidia may have released it's feature first, but in recent years AMD has stepped up to the plate…

How to play the Mortal Kombat 11 closed beta and practice your fatalities

Mortal Kombat 11's closed beta begins on March 27. Here's everything you need to know about gaining access, as well as the content you can expect to play before the game releases April 23.

Get in the Dark Zone and blow away the competition with our The Division 2 guide

The Division 2 has three Dark Zones, specialized areas for PvE and PvP combat. Our Dark Zone guide teaches you the ropes, from the recon missions to the leveling system to the dangers and benefits of going Rogue.

Here are all the awesome award-winning indie games from IGF

Indie games are now offering experiences capable of matching -- and often surpassing -- that of big-budget blockbuster titles. The Independent Games Festival recognized the best of them on March 20.

The Division 2

The latest news, guides, tips and tricks, updates, patch notes, and more so you can learn how to level up your game in The Division 2. Related Categories: The Division 2 News | Guides | Features
Product Review

Acer Predator Triton 500 review

Nvidia’s new RTX 2080 Max-Q is the fastest GPU you’ll find in any laptop, but it usually comes at a steep price. Acer’s Predator Triton 500, starting at $2,500, makes it a little more affordable. But what must you sacrifice in the…