Sony’s long-standing interest in virtual reality gives Project Morpheus an edge

sony sees facebook purchase oculus validation vr efforts project morpheus

The most impressive thing that Sony’s Project Morpheus could possibly do in its 2014 Game Developer’s Conference reveal is work, and work well. The virtual reality headset immediately carries all of the same promise evident in the most recent iterations of Oculus VR’s Rift offering, and we’ve only just seen it for the first time. Of course, Sony’s been working on Morpheus in secret, compared to Oculus’ much more public crowd-funded development.

“We’ve been doing VR for this project for about three years, so we definitely started before Oculus was even funded,” Sony U.S. R&D senior software engineer Anton Mikhailov tells Digital Trends in a GDC interview. “Certainly, they brought a lot of steam to the whole VR ecosystem, so that’s been a great help for us as well as them. We’re not ignoring their contributions. We think they’re a fantastic group of people who are very excited about VR, but we started our project quite awhile ago.”


Sony has a history with head-mounted displays that extends all the way back to 1997’s Glasstron, of which multiple models were released. That was later succeeded by the HMZ-T1 in late 2011, with T2 and T3 models following in 2012 and 2013, respectively. The Glasstron actually featured some limited game support, but all of these earlier Sony devices amounted to little more than floating screens inside a headset, with a projected image looming large in an otherwise blacked out space. Hardware and software support for head-tracking got its biggest boost in years with the success of Oculus on Kickstarter, though that’s largely a product of great timing. As some form of tech is more widely embraced, expensive supply lines that drive up the cost to consumers become less of an issue.

Sony's Glasstron
Sony’s Glasstron

“This is similar to what we saw with motion control, where you get some big market like cellphones bringing down the cost of something like motions sensors significantly,” Mikhailov says. “So basically, you have this cross-section right now where display panels have gotten small, high-resolution, and affordable, whereas before to get such a panel you’d need to go to military-grade VR simulations. Now you can buy them for a reasonable price. So at this point we can actually make a good quality VR system that is still affordable for people to purchase.”

“It just seemed like the right time. That’s why you’re seeing a lot of this kind of advancement happening very rapidly.”

Sony hasn’t yet assigned any sort of release date for Morpheus, as the hardware is still in development. The Sony-developed demos that we spent time with on the show floor at GDC are more proof-of-concept than sneak previews of future games. Sony’s research team is actively thinking about what a content-rich future in VR looks like, however. There’s nothing confirmed, of course, though we do know that CCP Games’ in-development space combat simulator EVE: Valkyrie is coming to Morpheus. Eidos Montreal’s Thief was also converted for demo purposes at the show, but it’s still undeniably early days for the software development side of Morpheus.

“At this point we can actually make a good quality VR system that is still affordable for people to purchase.”

“We really think that presence is the killer app for VR,” Mikhailov says. “The feeling that you get that you are surrounded by a real world. So I think just feeling that you’re in a fantastical environment is already worth the price of admission. Now how you design games in that environment is fairly open-ended. We don’t have much to draw upon. Not many people have done virtual reality games.”

“It’s a little too early to say what is sort of the main genre or whatever, it’s all very up in the air. That’s why we’re revealing this at the Game Developer’s Conference, because we want all the developers to come along and learn with us. We want to be very open with people about our learnings and hope that they’ll be very open with us as well so we can bring this industry up.”

Even input methods remain a massive question mark. It’s one that Oculus continues to wrestle with as well. Is a standard gamepad right? Motion sensing wands? Some sort of elaborate hybrid, like Sixense’s STEM system? It’s here that Sony actually has something of a leg up. It remains to be seen if VR content demands don’t call for revisions on the controller hardware side, but both the PlayStation 4’s DualShock 4 gamepad and the Move motion-sensing wand are effectively VR-ready when paired with a PlayStation 4 Eye.


“We designed the DualShock 4 so that it can be tracked by the camera because we really believe that VR input is a huge deal. When we designed the PlayStation Move, we actually designed it to be a VR input controller,” Mikhailov explains. “It launched alongside the Wii and the Kinect, which were more focused on party[-friendly] casual titles, whereas the Move was always very much focused on precision input. That might’ve gotten lost in the messaging, but it was always designed to be a virtual reality controller. So when we started doing Project Morpheus, it was quite nice because we already had a leg up on that.”

Oculus rift crystal cove full angle
Oculus VR’s latest Rift development kit

The tricky thing with VR inputs is that, when you get right down to it, there’s no one input solution that qualifies as the “right” one. Just as in real life, different activities require different modes of interaction. Steering a car is not like swinging a sword is not firing a gun… and so on. Again, it goes back to what Mikhailov said about presence. It’s about selling the user on the illusion in any way that you can, which further heightens the sensation that the virtual reality in your headset is actually a physical space you inhabit.

“In the EVE: Valkyrie demo that [CCP Games] put together for Morpheus, the controls that the pilot has when you look down look remarkably similar to a DualShock,” Mikhailov says. “They did that on purpose because when you’re holding a DualShock and you see your hands holding something like a DualShock, it increases your sense of presence. The next step is to track the DualShock; they haven’t gotten around to that, but when you track the DualShock [so it has 1:1 movements in the virtual space] and use it as a sort of 3D flight input, it can work as that kind of device. I think the most intense presence experiences are going to be lined up with whatever object using the VR matching with the real-world objects that you’re using.”

“We really think that presence is the killer app for VR.”

Sony’s R&D team is also looking at a few other possibilities for enhancing the capabilities of Morpheus. The company’s GDC booth tour included an in-development project involving eye-tracking. It’s not something that’s being formally integrated, for the VR headset or anything else (according to Sony, at least);  it’s simply a nifty toy with promising future applications. The short version is, you sit down in front of an eye-tracking camera and, once you’ve calibrated it (a quick process), your eyes effectively double as a DualShock 4’s right analog stick. The booth demo paired this technology with Infamous: Second Son, and it works extremely well.

“We’ve been using [eye-tracking] for a long time actually,” Mikhailov says. “My personal opinion, the most exciting thing about it is it gives you this feeling like it’s reading your mind. A lot of people talk about mind control interface, they talk about thing that you stick on your brain and then it reads your thoughts, but what’s funny is that your eyes are super correlated with whatever you’re thinking about.”


He goes on to describe a demo in which the participant is asked to look at a map and think about just one of the countries they see on it. The person conducting the demo then lights up the country on the map and, nearly every time, it’s the one the demo participant was thinking of. This isn’t mind-reading; it’s simply a process of understanding expected physiological responses. In this case, the eyes are naturally drawn to the location on the map that’s being thought of, and the technology has advanced to the point where reading their movement with that sort of precision is possible. It’s evident in Second Son; your eyes don’t just control the camera, they also pinpoint targets, even distant ones.

Anton Mikhailov, senior software engineer at Sony U.S. R&D
Anton Mikhailov, senior software engineer at Sony U.S. R&D

“There’s a lot of really exciting possibilities [with eye-tracking] because it’s much more reliable than anything mind control-related,” Mikhailov continues. “You can imagine cases … I look at a gun in a first-person shooter game and the enemy dives for that weapon. Stuff where the game really knows how you’re interacting with it beyond the button input. I think that’s the most exciting for me, orthogonal to the advantages of an HMD space.”

The idea of combining something like Morpheus with eye-tracking is a definite possibility. “It’s kind of a natural combination. How we mesh that or whether we put that in the devkit is still open, but it’s definitely something– I believe Valve has talked about it, I think Oculus has talked about it somewhat. Basically, a lot of people have suggested it as a natural pairing for VR, so it’s something we’re interested in looking into as well.”

One thing that isn’t a consideration – at least at the present time – is evolving the Move controller. It was originally designed with VR applications in mind, and the current model already works with Morpheus. Sony’s so-called Castle demo, in which you swing fists and swords at a training dummy in a castle courtyard, involves holding one Move controller in each hand. With Morpheus wrapped around your eyes, those two Move controllers appear as your in-game hands and arms. The controllers replicate your real-world movements with 1:1 precision.

“Move already got a boost from PS4’s new camera, it got some accuracy improvements there. We were able to implement some improvements for free, effectively, because we can support the same hardware [that we originally launched for the PlayStation 3],” Mikhailov explains. “Move 2 is a longer-term discussion. If we come up with enough features to create something like that then that’s something we might consider, but at this time we don’t have anything to announce on that.”

Sony Smart Glasses patent image

Mikhailov pleads the fifth when asked how Move could possibly evolve beyond its current form, though he does dangle some tantalizing possibilities. “When we did Move, we published a whole slew of patent work around the various other things that we considered doing for Move but didn’t quite make it in,” he says.

“If you look through some of those, you’ll see some of the crazier ideas that we’ve done. I don’t know if I’ll comment further on exactly which of those we think are the most viable, but we have a lot of patents in the area of what might make sense for a virtual reality device. The core of it already works; it’s more about the finer tweaks, if anything, but [Move is] definitely a VR-ready controller as it is now.”


‘Gears of War’ designer Cliff Bleszinski says he’ll never make another game

Cliff Bleszinski, the game designer best known for his work on the Gears of War series, says he will never make another video game. His studio, Boss Key Productions, shut its doors earlier this year.

Every rumor about the PS5, including a new game from Luminous Productions

PlayStation 5 rumors have been circulating for over a year now but there's still plenty we don't know. Here's everything you need to know about the PS5, including rumors about its release, specs, and games.
Virtual Reality

Think virtual reality is just for games? These awesome apps will change your mind

Virtual reality isn't all about gaming. Swim with turtles, paint in 3D, and immerse yourself in some unique experiences the platform has to offer with our curated list of the best VR apps.

The best HTC Vive games available today

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.
Virtual Reality

Is the Vive Pro better than the original Vive? Our answer might surprise you

HTC Vive vs. Vive Pro, which comes out on top? That's the subject of our latest comparison, which looks at everything from tracking solutions, to controllers, and the brand new headset that could set a new standard for VR.

Nintendo and Microsoft say they’re all-in on E3 after Sony bows out of 2019 event

Shortly after Sony announced it will not participate in E3 2019 for the first time, Microsoft and Sony announced the show will go on as usual for each software giant. E3 2019 now presents a unique opportunity for Sony's major competitors.
Product Review

Make friends. To survive the wasteland of 'Fallout 76,' you're gonna need 'em

Fallout 76 brings the nuclear wasteland online and invites you to hop in with your friends. It’s fun, and a new direction for the Fallout franchise, but it’s not without its faults.

The best PS3 games of all time

Choosing the right PlayStation 3 game can be a conundrum, especially when there are nearly 1,500 titles to choose from. Thankfully, we've rounded up the best games to have ever made it to the platform.

Here's where Xur is and what he has for wares this week in 'Destiny 2: Forsaken'

The weekly vendor in Destiny 2: Forsaken always brings Exotic weapons and armor, some of the toughest loot to find in the game. Here's everything you need to know to track down Xur: Where he is, when he shows up, and what he's stocking.

Microsoft is reportedly planning an Xbox One without a disc drive for 2019

Microsoft is reportedly planning to release a new Xbox One model without a disc drive in 2019. The console will be significantly cheaper than other Xbox One systems, including the Xbox One S.

15 tips for keeping your vault-dwellers alive in ‘Fallout Shelter’

The wasteland can be an unfriendly place, if you don't know what you're doing. Here are 15 tips that will help your vault thrive in Fallout Shelter, including information on questing.

Stock up on Switch accessories this week with these awesome Black Friday deals

Black Friday is right around the corner, and it's the perfect time to stock up on accessories for your Nintendo Switch. Here are the best Switch accessory deals on Black Friday, from controllers to cases and more.

‘Spyro Reignited Trilogy’ proves nostalgia only goes so far

Spyro Reignited Trilogy is a faithful and beatiful remaster of the PlayStation classics, but its dedication to retaining the original experience ultimately hinders the experience. Spyro was great in the late-'90s, but it hasn't aged well.

‘Final Fantasy VII Remake’ director sets record straight on game’s progress

Final Fantasy VII Remake director Tetsuya Nomura clarified some information about the game's progress. There were earlier reports that the RPG was put on hold in favor of Kingdom Hearts III, but that is apparently not the case.