Skip to main content

3D evolved: Hands-on with Canon’s MREAL augmented reality system

Wowing us with its latest promotional video, Google’s Project Glass is a hot topic. Though they look like futuristic glasses, they’re actually an augmented reality head-mounted display that can perform many of the same functions as a smartphone, such as texting, taking and sending photos and video, and “Googling,” naturally. But Google isn’t the only one making augmented reality gadgets you wear on your head. Today, Canon announced its Mixed Reality System, or MREAL, which, though very different from Project Glass, shares many of the same principles.

Imagine a world where instead of heading over to your local Best Buy to look at a potential new refrigerator, you could just put on a headset and see the fridge as if it were right in front of you – open it, walk around it, see what it looks like in different colors. No, we don’t mean just hopping on the Best Buy website and looking at photos, we want you to imagine a technology that combines the virtual world of computer-generated imagery with the real-world environment. Well, although you may not have your own personal shopping headset for some time – the product being sold is targeted toward enterprise – Canon’s new Mixed Reality System is a step in that direction, and we got to test it out last night.

Recommended Videos

Canon’s Mixed Reality system was originally demoed in 2010 as a prototype; better known for its cameras, MREAL was one of several new tech the company was exploring as possible new business. The system simultaneously merges virtual objects with the real world at full scale and in 3D, making it different from previous virtual reality systems. The three-part system includes a head-mounted display (HMD), MR Platform software, and third-party markers and sensors, all of which combine to, according to Canon, give the user “an almost life-like experience of ‘being there.’”

Canon_MREAL_Demo4
Image used with permission by copyright holder

As for the markers, we’ve seen similar ones in other augmented reality tech (most recently with the MultiTouch MultiTaction display at CES), so that part is nothing entirely new. Still, they’re crucial for rendering images in real space. For example, during our hands-on time with the head-mounted display, we were able to open a physical box covered in markers on the inside and outside. Through the HMD, we were able to see a bouquet of flowers pop up in the box when we opened it in real life. Then, we were able to “tap” each flower to make them change colors. (Check out the video below for a demo.)

Canon_MREAL_Demo2
Image used with permission by copyright holder

Similar markers were used in another demo that exemplified an alternative possibility for the MR System. The education sector can benefit greatly from MREAL technology, and museums are the perfect example. During our hands-on with the HMD, we were able to interact with a small dinosaur. As we moved around the “exhibit,” which was just a large box surrounded by markers, the dinosaur moved with us. Through the HMD, we no longer saw the room of journalists we were actually in, but, instead, saw a Jurassic Park-like setting. We thought that was pretty neat on its own, but the MR system can be used to enhance learning, serving as an interactive teaching tool that expresses information you wouldn’t normally be able to communicate through just text or a teacher’s voice.

Dino_4
Image used with permission by copyright holder

Curious about how the MR System works exactly? It’s actually pretty simple. The real world is captured with linked video cameras that are located on the right and left of the HMD worn by the user. A video is sent to a computer via the connected cable (the HMD isn’t wireless yet, but we have a feeling it will be in the not-too-distant future). The virtual CG video is combined with the video from the real world, and then the combined video is sent back to the user.

Canon_MREAL_Demo3
Image used with permission by copyright holder

During another hands-on demo, we sat in a car seat while wearing the HMD. Above us were multiple sensors that recorded our movement and worked with the extra antenna-like protrusions attached to the HMD. This demo was the most realistic-looking of the ones we experienced. The details of the car seemed extremely life-like. In fact, thanks to a built-in gyroscope, we were able to see minute details of the car – such as the texture of the interior leather – when we moved our head farther or closer away from the virtual vehicle.

Canon_MREAL_Car
Image used with permission by copyright holder

We were even able to physically bend down and check out the car’s rims, just like you would if you were looking at a real car in real life. We were able to walk around the entire vehicle while the person leading the demo changed details like the color and the placement of the included iPad accessory right before our eyes. You could literally be at a car dealership and say, “I want a red Lamborghini … no, make that purple … no, make that green,” and the salesperson would be able to instantly change what you’re seeing.

So besides being able to see cool museum exhibits and buy cars in a different way, what else can the MREAL System do for us? Although it doesn’t directly affect the Average Joe, we will reap the benefits of a new kind of efficiency in product creation. Mixed Reality will help speed up the process of bringing products to market, since manufacturers no longer have to travel from one continent to the other to view models, samples, and mockups. With Canon’s MR platform, a car manufacturer in Japan, for example, could view the models designed in the U.S. without ever having to get on a plane. Saving time and money, it’s likely that companies would be able to complete the research and development stages faster and get products out to consumers quicker than normal.

Canon_MREAL_HMD
Image used with permission by copyright holder

There’s a seemingly infinite amount of possible uses for the MREAL System. Imagine how much easier it would be to rent or buy a house. You’d no longer have to drive all over town looking at dozens of houses before you find one you like. Real estate agencies could literally “walk” you through houses without you ever leaving their office. This would make moving out of the state or country far less of a hassle.

Though it all sounds very exciting, the technology doesn’t come cheap. Available March 1, the starting price is $125,000, which will include the head-mount display and the platform software; annual maintenance will cost another $25,000.

How would you like to see the MREAL System used? We can only imagine what the adult video industry could do with this type of technology, but what do you think?

Jennifer Bergen
Former Computing Editor
Jennifer Bergen is the Computing Section Editor at Digital Trends and is in charge of all things laptops, desktops, and their…
Apple’s Vision Pro could get this incredible gaming upgrade
A person plays a game on the Apple Vision Pro.

Apple has touted its Vision Pro headset as a premier gaming device that works with many different controllers. But with extensive gesture control seemingly used everywhere on the product except for gaming, it feels like a missed opportunity.

Well, that could change in the future, as a newly published Apple patent (number 11709554) shows how future editions of the Vision Pro could transform your hands into gaming controllers, complete with fingertip controls and haptic feedback.

Read more
Apple’s next Vision Pro may send you on a mood-altering trip
The Apple Vision Pro reveals the wearer's eyes on a front-facing display.

It sounds like something out of a sci-fi novel, but Apple could be working on a way to let you alter your mood just by telling its Vision Pro headset how you want to feel. That’s according to a recently granted patent (number 11703944) that outlines the whole futuristic idea.

It’s a strange concept and one that sounds woven right out of a Philip K. Dick story. In fact, in the author’s Do Androids Dream of Electric Sheep? there is a machine that puts users into whatever mood they desire. It sounds as though Apple’s inventors have been reading a little sci-fi in their spare time.

Read more
There’s a bunch of bad news about Apple’s Vision Pro headset
A person tries on an Apple Vision Pro mixed reality headset in an Apple Store, with an Apple employee alongside them.

Apple’s Vision Pro headset is probably one of the most complex products the company has ever launched, but a new report has highlighted just how much Apple is struggling with the device. It suggests people are finding the headset uncomfortable and that it could take even longer to become widely available than we previously thought.

The news has come to light thanks to a new report from journalist Mark Gurman, a reporter who has an accurate track record when it comes to Apple leaks and rumors. According to Gurman, the Vision Pro “will be Apple’s most complex debut to date and will require sorting out tricky supply chain logistics, training salespeople how to set up the device and teaching customers how to use it.”

Read more