Skip to main content

Calm down! Like dogs, the first Intel RealSense games can sense your fear

intel realsense coming of age games
“Just breathe,” Erin tells me as static fills the screen. Maybe it’s the cup of coffee I just downed, or perhaps it’s a touch of performance anxiety to be trying out this game in front of the developer, but my heart is apparently racing. And the game I’m playing knows it.

By tracking my pulse with Intel’s RealSense camera, Nevermind isn’t just responding to my hand gestures, it’s responding to my emotions. This is not what I expected when I came to try out gaming applications of Intel’s new 3D camera, but it has me immediately more interested than the expected motion controls. I take a deep breath, the static clears from the screen, and I continue.

If you’re not already familiar, Intel RealSense is effectively a Kinect, but with shorter range and higher resolution, and fitted in the bezel of a laptop or tablet, like a conventional webcam. Where the Kinect takes in the entire living room, RealSense has an effective range of about a meter, but a much greater resolution and responsiveness within that limited range.

Game developers can use RealSense for features like facial detection and gesture tracking, but also for subtler, more intriguing interpretations like emotion tracking. And those are just the built-in options. Inventive game makers could use the raw data for just about anything, potentially opening some exciting doors for gamers.

Related: Hands on: Intel RealSense 3D

I recently had a chance to try the very first RealSense-enabled games at an event sponsored by Intel. While some merely ape the Microsoft Kinect and Nintendo Wii, some truly push the boundaries of what games are capable of. Here’s what they’re like.

All you need is a body

Lego Portal Racers is an endless runner game in the vein of Temple Run or Subway Surfers. You speed through endless tracks across various, Lego-themed universes, collecting points and power-ups for as long as possible before crashing. Tilting your head side-to-side moves yoru character side-to-side, which makes it intuitive enough that anyone could sit down and get going with little to no instruction. That was the developer’s goal here, and the team nailed it.

Madagascar: Move it! is similarly accessible and targeted at children. It features the lemur from DreamWorks’ animated Madagascar films, dancing with simple, rhythmic gestures for the player to repeat, increasing in speed and complexity as you move up difficulty levels. It’s very similar to the Let’s Dance series of rhythm games.

MoveIt Gameplay 1

The appeal of these games is the same appeal that made the original Wii so popular with people outside of traditional “gamer” demographics: They don’t need to learn an intimidating controller or keyboard and mouse controls. The Wii-mote and Wii Sports provided an intuitive interface that anyone could pick up and play with relative ease. RealSense takes that one step further by cutting out the input device entirely and replacing it with gesture controls, plus it’s totally portable. Lego Portal Racer developer Metaio’s Jack Dashwood told me that, in testing, parents really liked being able to set their kid up with a laptop in the back seat of a car or in an airplane.

The future means lasers

Laserlife reaches for slightly older gamers, but still focusing on accessibility. It comes from developer Choice Provisions (formerly Gaijin Games), a studio best known for its Bit.Trip series of rhythm games.

You play as a mysterious, alien entity, represented by a laser beam, that stumbles upon the corpse of a human astronaut drifting through the void. Using your advanced technology, you collect the astronaut’s fragmentary memories to get some sense of who or what they were. Each memory is a level, divided into multiple phases as you collect, reform, and then return the memory. The different phases require different gesture controls, such as grabbing glowing shards as they pass by, or subtly raising and lowering your fingers to guide the laser through glowing gates, all in time with the music.

The level I played was an eerie, underwater environment, culminating in finding a boat. As you complete levels, the objects accrue in the space surrounding the astronaut, adding up to a symbolic tableau of their life. While the developers have an elaborate and specific backstory for the astronaut, they have left it intentionally vague within the game, encouraging players to fill in the details with their imagination.

Laserlife for Intel® RealSense™ Teaser

Controls have also been kept intentionally minimal. Each section requires basically a single gesture that is easy to pick up. Studio co-founder Alex Neuse explained that the levels have been cleverly divided into different sections with different movements in order to alleviate the fatigue from doing the same thing for too long. Although they initially experimented with subtler and more complex gesture controls, Neuse said that they ultimately skewed towards bare minimalism because the technology is so new: “We wanted to make sure we could walk before trying to run.”

Once more, with feeling

The most interesting demonstration of the day, though, was first-time developer Flying Mollusk’s Nevermind, a psychological horror adventure game that uses your fear against you. As you explore the game, it uses the RealSense camera to register your pulse as a measure of anxiety. As players get more anxious, the screen fills with static and the environment changes contextually. For instance, in a weird meat locker/dairy in the demo, the floor would flood with milk, slowing you down as your anxiety rose. If things get out of control, then the game teleports you back to a soothing hub area for you to cool off.

While it’s difficult to achieve the kind of immersive anxiety that horror games thrive on while standing in a busy hotel event room for a demonstration, the effect was nevertheless really interesting. Designer Erin Reynolds first created Nevermind as an MFA project with a focus on how games could be used to help people. By providing direct, immediate feedback, players can improve their awareness of how their body responds to anxiety, and intuitively learn strategies to help mitigate it. “If we can help get people a little more in touch with themselves, I already count that as a win,” explained Reynolds. Although the game was developed just reading pulse, Reynolds hopes to experiment with the additional biometric measures and emotion recognition included with the RealSense SDK. Reynolds also saw the possibilities this opens up for more conventional action games as well. Imagine, for instance, a game that adds more enemies if you’re getting too relaxed.

Nevermind Teaser March 2015

While not the most polished demonstration of the day, Nevermind was the most interesting because it pointed toward mechanics that were heretofore impossible. Other games merely used motion controls as input for otherwise conventional games. Steering a spaceship by waving your hand around rather than moving a mouse is more gimmick than real innovation, and can be fatiguing in a way that using a conventional gamepad is not. However, a game that responds to your emotions opens up wholly new and exciting design spaces. The Wii and Kinect have already shown that motion-controlled gaming is feasible, but not as sexy as the developers had hoped. The killer gaming app for RealSense will have to show us gameplay that we could not have imagined otherwise.

Editors' Recommendations

Xbox Series X vs. Series S
Xbox Series X Stylized Graphic

The Xbox Series X and Xbox Series S represent Microsoft's fourth-generation home video game consoles designed around AMD's 8-Core Zen 2 CPU and Radeon RDNA 2 graphics architecture. The two consoles succeed the Xbox One X and Xbox One S, offering better performance and more power across the board. New features include display resolutions up to 8K, built-in solid-state drives for faster access times, and support for real-time ray tracing.

With two powerful consoles available, it's important to be aware of how they stack up against one another so you can make the most informed buying decision. Here's our Xbox Series X and Series S comparison.

Read more
Over 100 PlayStation VR2 games are in development, Sony says
Playstation VR2 headset on a PlayStation-themed wallpaper.

Sony has released a massive FAQ about the PlayStation VR2 on the PlayStation Blog ahead of the headset's February 22 launch. It reveals some key new details about games for the platform, namely that over 100 PS VR2 titles are in development, and that Sony doesn't plan on giving its games physical releases for now. 
For the most part, the FAQ is full of basic information about the PlayStation VR2's specs, how to set it up, and what's required to use it. But the Games section of this FAQ reveals quite a few illuminating details about the future of the system. It reiterates that there will be around 30 launch titles for the system, but also reveals just how much is in the works for the headset. In response to the question, "How many games are in development for PS VR 2?" Sony writes, "There are currently more than 100 titles in development for PS VR2."

That's a good sign, as a new, expensive VR headset like this lives or dies on its game lineup. PSVR2's early days might be a bit odd as Horizon Call of the Mountain is one of its only true exclusives -- and it's not backward compatible with PlayStation VR titles (something this FAQ reiterates. However, those picking one up can still know that lots of games are in the works for it.
Another FAQ question asks, "Will PS VR2 games be digital only or will there be physical disc releases?" -- which is sensible to clarify as this headset's predecessor had physical games. "Initially at launch, PS VR2 games will be digital," Sony says. "Physical disc releases for select titles may be available at a future date." So don't hold on to the idea of picking up a physical copy of Horizon Call of the Mountain; you'll be getting PS VR2 games through the PlayStation Store for the time being.
Check out the full FAQ if you have any technical questions about PS VR2's setup and which games it supports. PlayStation VR will be released on February 22. 

Read more
AMD vs. Intel: which wins in 2023?
Pads on the bottom of the Ryzen 9 7950X.

Picking between AMD and Intel is one of the main considerations whenever you build a new PC. Like macOS versus Windows, the AMD versus Intel rivalry is one of the greatest debates for PC enthusiasts, and right now, we are in the middle of a neck-and-neck race that's bound to get even more heated.

Now that AMD has launched its Ryzen 7000 CPUs and Intel its 13th-generation Raptor Lake processors, it's time to revisit the dynamic between AMD and Intel in 2023. Forget the head-to-heads of yesteryear. This is the AMD versus Intel battle as it exists today.
AMD versus Intel: a brief history

Read more