Skip to main content

Hands On: Sulon Cortex

Donning this VR headset turns any room into a Holodeck. So we fought a hydra

In Star Trek’s Holodeck, lifelike simulations interacted with real people. With the Sulon Cortex, it’s HD graphics that wrap around you, with objects inside that you can interact with.

You don’t have to strap on a headset to recognize that virtual reality is an exciting emerging technology. What’s out there is still mostly conceptual, offering a peek into the possibilities of what virtual interaction can do. So while we’re conceiving, how about the idea of merging the virtual world with the real one?

Toronto-based startup Sulon Technologies is looking to do just that with its Cortex VR headset, which can detect the physical constructs of your surroundings while transporting you into a virtual one.

And I got to take it for a test drive.

It can add virtual objects to real space, objects that are aware of the size and scale around them.

In effect, the Cortex augments virtual reality into a real space, which is a key difference from other VR headsets like the Oculus Rift, where real objects placed in a virtual world have no contextual awareness. Sulon does this using what it calls a “spatial scanner” to quickly map the environment around you — in 360 degrees and in real-time, with built-in sensors that constantly assess the physical dimensions of the space you’re inhabiting.

With this understanding of the meatspace our bodies live in, it can add virtual objects that are aware of the size and scale of stuff around them. For example, if you’re in a room, and there are virtual zombies trying to get to you as you close a real-life door behind you, they will be outside the door trying to get through. Or think of a large animal like a giraffe, ducking down if the actual ceiling is too low.

This isn’t unlike the Holodeck in Star Trek, where lifelike holographic simulations could interact with real people. Except, in this case, it’s HD graphics essentially wrapped all around you, including objects that you can interact with.

“It’s hard to quantify it in terms of a screen size, but it’s not about field of view, it’s about how immersed you feel,” Dhan Balachand, Sulon’s CEO and founder, told Digital Trends. “There’s a need — not a demand — for the display industry to move faster and to keep doubling and quadrupling resolutions, but it’s less about the resolution itself, and more about how crisp the image is and how it engulfs your senses.”

Balachand’s inspiration for the Cortex was the concept of providing users with information about scalable objects that are otherwise hard to get in hand. One of the examples he cites is a diesel engine that can be put together or separated into its various parts. The device is able to render experiences like this locally through the built-in CPU and graphics processor.

He considers the technology to be “huge” in the scope of what it could truly become, envisioning scenarios where it could help. The most important of them, he believes, is situation awareness.

“Firefighters going into a blazing building fitted with the Cortex can have it reconstruct the environment, augment their path in and out of the building, and even triangulate where someone is in a room under thick smoke,” he says. “It dynamically maps as it goes through, seeing so far ahead, how everything is built and where the sound of someone screaming for help is coming from. Imagine feeding that information back to another person wearing a Cortex who can augment the map in 3D on a car hood, knowing where firefighters are in the building in real-time.”

Wearing the Cortex

I didn’t get the chance to save anyone from a virtual burning building, but I was treated to two demos of what it’s like to step into this hybrid world.

Sulon’s current headquarters are in a suburb just north of Toronto, though a move downtown is coming soon, says Balachand. The semi-finished prototype I tried on felt comfortable, despite its notable size (Balachand says it will be a tad smaller when finalized). It felt substantial without feeling too heavy or clunky, but it’s hard to say how long one can wear it without feeling a little dazed.

Sulon Cortex back angle

Ted Kritsonis/Digital Trends

The room outfitted for testing the headset in their offices wasn’t large, yet it was still spacious enough to move around several paces in any direction. I got to stand in on a cinematic battle set in a space that looked like the entrance to a subway station in the exact dimensions of the room. I could feel the physical walls if I moved close enough to touch them (an audible beep warned me when I got close), except they looked like ceramic tiles. The characters fighting paid no attention to me because they weren’t programmed to, but I could literally position myself at any angle in the room to watch the action. It was no more than a few minutes long, but it was a fascinating viewpoint.

“It dynamically maps as it goes through, seeing so far ahead and how everything is built, where the sound of someone screaming for help is coming from.”

The second demo was interactive: I was required to walk to certain points to trigger responses in a short game where I had to defeat a big Hydra emerging from a pit of lava. Despite hiccups getting it to work, I eventually managed to walk and shoot bursts of plasma and ice from my virtual hands at the beast. It would rise up right in front, and then to my left, and then over to the right. Clearly, the game itself needed some work to reduce latency and improve the graphics, but it was still immersive and fun to try out.

Where is content this immersive going to come from? Movies and games are the main ones, while 360-degree photos and video could just as easily be done too. Balachand says computer-generated images (CGI) are much easier to design for walking around a scene, whereas doing it with live action sequences “will take a lot of work and innovation.”

Conclusion

This highlights some of the other challenges Sulon still faces with its technology. Putting together an engine this way is intriguing for any engineer or car enthusiast, but there is no sense of touch for the individual parts. Sense of smell is another that seems like a bridge too far for VR, in general. The company is looking to simulate touch but couldn’t reveal the “top secret” ways in which it aims to actually achieve that. And finally, it was hard to feel entirely secure walking around a barren room without having a true sense of the space around me once I started moving.

The device’s form factor is also undergoing some tweaks before it’s made available to developers this fall for $500. Indeed, the developer community is the first target, with businesses and enterprises to follow until it’s finally ready for consumers when there’s sufficient content available. Like other VR headsets, there is an HDMI input for “sit-down experiences” that won’t require moving around.

“The goal is to get it to mass consumer adoption and every person’s living space because it’s a tool and a platform that can solve a lot of real-world problems,” Balachand says. “And we’re thinking everything from entertainment to engineering. Want to buy a car? Drop different ones on your driveway, change the color, and then share it with friends or family. You’ve got real estate where you can see a new kitchen to scale or even retail spaces, which we’ll have something on later this year.”

Highs

  • Blends virtual and augmented reality together
  • Real-world physical objects can stand in for virtual ones
  • Virtual objects can be scaled to their real-life sizes
  • Gaming can truly be immersive and interactive

Lows

  • Bulky headset; unfinished form factor
  • Live action scenes will present challenges
  • Long-term prospects depend on content availability
Ted Kritsonis
A tech journalism vet, Ted covers has written for a number of publications in Canada and the U.S. Ted loves hockey, history…
FDA approves augmented reality surgery tool that gives surgeons ‘X-ray vision’
Xray vision AR surgery

xvision introduction

Right now, augmented reality technology is most commonly associated with gaming or, perhaps, pick and placing your virtual Ikea furniture. But soon it will be used to give surgeons a type of “X-ray vision” when they carry out procedures -- and the U.S. Food and Drug Administration (FDA) has just given it the green light.

Read more
Robot bartending company is handing out cash to the people it is replacing
robot bartending company automation stipend makr shakr ph credit avocado studio

There’s no doubt that automation is going to have a massive impact on employment over the coming decades. Whether you think it’s going to result in mass unemployment or wind up creating whole classes of new job types, A.I. and robotics are still going to be enormous workplace disruptors. And tech companies know it.

One startup taking a welcome proactive step is Makr Shakr, the company behind Toni, which describes itself as “the world’s leading robotic bartending system.” Makr Shakr just announced that it is launching the world’s first automatic stipend. For every robot bartender that it sells, the company is going to be handing over a $1,000 monthly stipend to a select person in a field likely to be affected by automation. The pilot program will kick off in December, before arriving in Europe later in 2020.

Read more
Magic Leap in trouble? Report says only 6,000 AR headsets sold in first 6 months
seedling magic leap experience display

Magic Leap, the much-hyped augmented reality startup that has raised about $2.6 billion in funding, is reportedly in trouble after sales of its first AR headset fell way short of the company's target.

According to The Information, only about 6,000 units of the $2,295 Magic Leap One Creator Edition were sold in the first six months after its April 1 launch. The modest sales figures for the mixed-reality headset indicate it will badly miss the startup's target of 100,000 headsets sold in the first year.

Read more