Hands On: Sulon Cortex

Donning this VR headset turns any room into a Holodeck. So we fought a hydra

In Star Trek’s Holodeck, lifelike simulations interacted with real people. With the Sulon Cortex, it’s HD graphics that wrap around you, with objects inside that you can interact with.

You don’t have to strap on a headset to recognize that virtual reality is an exciting emerging technology. What’s out there is still mostly conceptual, offering a peek into the possibilities of what virtual interaction can do. So while we’re conceiving, how about the idea of merging the virtual world with the real one?

Toronto-based startup Sulon Technologies is looking to do just that with its Cortex VR headset, which can detect the physical constructs of your surroundings while transporting you into a virtual one.

And I got to take it for a test drive.

It can add virtual objects to real space, objects that are aware of the size and scale around them.

In effect, the Cortex augments virtual reality into a real space, which is a key difference from other VR headsets like the Oculus Rift, where real objects placed in a virtual world have no contextual awareness. Sulon does this using what it calls a “spatial scanner” to quickly map the environment around you — in 360 degrees and in real-time, with built-in sensors that constantly assess the physical dimensions of the space you’re inhabiting.

With this understanding of the meatspace our bodies live in, it can add virtual objects that are aware of the size and scale of stuff around them. For example, if you’re in a room, and there are virtual zombies trying to get to you as you close a real-life door behind you, they will be outside the door trying to get through. Or think of a large animal like a giraffe, ducking down if the actual ceiling is too low.

This isn’t unlike the Holodeck in Star Trek, where lifelike holographic simulations could interact with real people. Except, in this case, it’s HD graphics essentially wrapped all around you, including objects that you can interact with.

“It’s hard to quantify it in terms of a screen size, but it’s not about field of view, it’s about how immersed you feel,” Dhan Balachand, Sulon’s CEO and founder, told Digital Trends. “There’s a need — not a demand — for the display industry to move faster and to keep doubling and quadrupling resolutions, but it’s less about the resolution itself, and more about how crisp the image is and how it engulfs your senses.”

Balachand’s inspiration for the Cortex was the concept of providing users with information about scalable objects that are otherwise hard to get in hand. One of the examples he cites is a diesel engine that can be put together or separated into its various parts. The device is able to render experiences like this locally through the built-in CPU and graphics processor.

He considers the technology to be “huge” in the scope of what it could truly become, envisioning scenarios where it could help. The most important of them, he believes, is situation awareness.

“Firefighters going into a blazing building fitted with the Cortex can have it reconstruct the environment, augment their path in and out of the building, and even triangulate where someone is in a room under thick smoke,” he says. “It dynamically maps as it goes through, seeing so far ahead, how everything is built and where the sound of someone screaming for help is coming from. Imagine feeding that information back to another person wearing a Cortex who can augment the map in 3D on a car hood, knowing where firefighters are in the building in real-time.”

Wearing the Cortex

I didn’t get the chance to save anyone from a virtual burning building, but I was treated to two demos of what it’s like to step into this hybrid world.

Sulon’s current headquarters are in a suburb just north of Toronto, though a move downtown is coming soon, says Balachand. The semi-finished prototype I tried on felt comfortable, despite its notable size (Balachand says it will be a tad smaller when finalized). It felt substantial without feeling too heavy or clunky, but it’s hard to say how long one can wear it without feeling a little dazed.

Sulon Cortex back angle

Ted Kritsonis/Digital Trends

The room outfitted for testing the headset in their offices wasn’t large, yet it was still spacious enough to move around several paces in any direction. I got to stand in on a cinematic battle set in a space that looked like the entrance to a subway station in the exact dimensions of the room. I could feel the physical walls if I moved close enough to touch them (an audible beep warned me when I got close), except they looked like ceramic tiles. The characters fighting paid no attention to me because they weren’t programmed to, but I could literally position myself at any angle in the room to watch the action. It was no more than a few minutes long, but it was a fascinating viewpoint.

“It dynamically maps as it goes through, seeing so far ahead and how everything is built, where the sound of someone screaming for help is coming from.”

The second demo was interactive: I was required to walk to certain points to trigger responses in a short game where I had to defeat a big Hydra emerging from a pit of lava. Despite hiccups getting it to work, I eventually managed to walk and shoot bursts of plasma and ice from my virtual hands at the beast. It would rise up right in front, and then to my left, and then over to the right. Clearly, the game itself needed some work to reduce latency and improve the graphics, but it was still immersive and fun to try out.

Where is content this immersive going to come from? Movies and games are the main ones, while 360-degree photos and video could just as easily be done too. Balachand says computer-generated images (CGI) are much easier to design for walking around a scene, whereas doing it with live action sequences “will take a lot of work and innovation.”

Conclusion

This highlights some of the other challenges Sulon still faces with its technology. Putting together an engine this way is intriguing for any engineer or car enthusiast, but there is no sense of touch for the individual parts. Sense of smell is another that seems like a bridge too far for VR, in general. The company is looking to simulate touch but couldn’t reveal the “top secret” ways in which it aims to actually achieve that. And finally, it was hard to feel entirely secure walking around a barren room without having a true sense of the space around me once I started moving.

The device’s form factor is also undergoing some tweaks before it’s made available to developers this fall for $500. Indeed, the developer community is the first target, with businesses and enterprises to follow until it’s finally ready for consumers when there’s sufficient content available. Like other VR headsets, there is an HDMI input for “sit-down experiences” that won’t require moving around.

“The goal is to get it to mass consumer adoption and every person’s living space because it’s a tool and a platform that can solve a lot of real-world problems,” Balachand says. “And we’re thinking everything from entertainment to engineering. Want to buy a car? Drop different ones on your driveway, change the color, and then share it with friends or family. You’ve got real estate where you can see a new kitchen to scale or even retail spaces, which we’ll have something on later this year.”

Highs

  • Blends virtual and augmented reality together
  • Real-world physical objects can stand in for virtual ones
  • Virtual objects can be scaled to their real-life sizes
  • Gaming can truly be immersive and interactive

Lows

  • Bulky headset; unfinished form factor
  • Live action scenes will present challenges
  • Long-term prospects depend on content availability
Emerging Tech

The U.S. Army is building a giant VR battlefield to train soldiers virtually

Imagine if the U.S. Army was able to rehearse battlezone scenarios dozens, or even hundreds, or times before settling foot on actual terrain. Thanks to virtual reality, that's now a possibility.
Product Review

The Division 2 brings the most fun we've ever had to Washington, D.C.

After 55 hours with The Division 2, it’s clear that Ubisoft has improved on the original in almost every way. The world is richly detailed, the story missions are wonderful, gunplay and enemy design are great, and the endgame content is…
Gaming

Your PlayStation 4 game library isn't complete without these games

Looking for the best PS4 games out there? Out of the massive crop of titles available, we selected the best you should buy. No matter what your genre of choice may be, there's something here for you.
Gaming

For the Gamechanger charity, comforting sick kids with games isn’t child’s play

Gamechanger is a worldwide charity that helps thousands of children each year, bringing them gifts and video games to keep them entertained during their hospital stay. Yet all started in a garage during a family’s darkest hour.
Emerging Tech

Take a dip in the Lagoon Nebula in first image from SPECULOOS instrument

The European Southern Observatory has released the first image collected by their new SPECULOOS instrument, and it's a stunning portrait of the Lagoon Nebula, a swirling cloud of dust and gas where new stars are born.
Emerging Tech

Robot assistants from Toyota and Panasonic gear up for the Tokyo Olympics

Japan plans to use the 2020 Olympics to showcase a range of its advanced technologies. Toyota and Panasonic are already getting in on the act, recently unveiling several robotic designs that they intend to deploy at the event.
Emerging Tech

A.I.-generated text is supercharging fake news. This is how we fight back

A new A.I. tool is reportedly able to spot passages of text written by algorithm. Here's why similar systems might prove essential in a world of fake news created by smart machines.
Emerging Tech

Racing to catch a flight? Robot valet at French airport will park your car

Hate searching for parking at the airport when you need to catch a plane? Startup Stanley Robotics recently unveiled a new outdoor automated robotic valet system. Here's how it works.
Business

Bags with brains: Smart luggage and gadgets are making travel smoother

The bag you use to tote your stuff can affect the experience of any trip. In response, suitcases are wising up, and there are now options for smart luggage with scales, tracking, and more. Here are our favorite pieces.
Computing

At $99, Nvidia’s Jetson Nano minicomputer seeks to bring robotics to the masses

Nvidia announced a new A.I. computer, the Jetson Nano. This computer comes with an 128-core GPU that Nvidia claims can handle pretty much any A.I. framework you could imagine. At $99, it's an affordable way for A.I. newbies to get involved.
Computing

Nvidia’s A.I. Playground lets you edit photos, experience deep learning research

Nvidia is making it easier to access information on deep learning research. It has launched an online space with three demos for image editing, styling, as well as photorealistic image synthesis. 
Business

British Airways’ new Club Suite for business class comes with a door

British Airways is going after a bigger slice of the business class market with the imminent launch of the Club Suite. The plush seating option offers a more private space as well as an easier route to the bathroom.
Smart Home

Sony’s Aibo robot dog can now patrol your home for persons of interest

Sony released the all-new Aibo in the U.S. around nine months ago, and since then the robot dog has (hopefully) been melting owners' hearts with its cute looks and clever tricks. Now it has a new one up its sleeve.
Emerging Tech

Inflating smart pills could be a painless alternative to injections

Could an inflating pill containing hidden microneedles replace painful injections? The creators of the RaniPill robotic capsule think so — and they have the human trials to prove it.