3D evolved: Hands-on with Canon’s MREAL augmented reality system

hands on with canons new mreal system for mixed reality canon hmd bgwht
Wowing us with its latest promotional video, Google’s Project Glass is a hot topic. Though they look like futuristic glasses, they’re actually an augmented reality head-mounted display that can perform many of the same functions as a smartphone, such as texting, taking and sending photos and video, and “Googling,” naturally. But Google isn’t the only one making augmented reality gadgets you wear on your head. Today, Canon announced its Mixed Reality System, or MREAL, which, though very different from Project Glass, shares many of the same principles.

Imagine a world where instead of heading over to your local Best Buy to look at a potential new refrigerator, you could just put on a headset and see the fridge as if it were right in front of you – open it, walk around it, see what it looks like in different colors. No, we don’t mean just hopping on the Best Buy website and looking at photos, we want you to imagine a technology that combines the virtual world of computer-generated imagery with the real-world environment. Well, although you may not have your own personal shopping headset for some time – the product being sold is targeted toward enterprise – Canon’s new Mixed Reality System is a step in that direction, and we got to test it out last night.

Canon’s Mixed Reality system was originally demoed in 2010 as a prototype; better known for its cameras, MREAL was one of several new tech the company was exploring as possible new business. The system simultaneously merges virtual objects with the real world at full scale and in 3D, making it different from previous virtual reality systems. The three-part system includes a head-mounted display (HMD), MR Platform software, and third-party markers and sensors, all of which combine to, according to Canon, give the user “an almost life-like experience of ‘being there.’”


As for the markers, we’ve seen similar ones in other augmented reality tech (most recently with the MultiTouch MultiTaction display at CES), so that part is nothing entirely new. Still, they’re crucial for rendering images in real space. For example, during our hands-on time with the head-mounted display, we were able to open a physical box covered in markers on the inside and outside. Through the HMD, we were able to see a bouquet of flowers pop up in the box when we opened it in real life. Then, we were able to “tap” each flower to make them change colors. (Check out the video below for a demo.)


Similar markers were used in another demo that exemplified an alternative possibility for the MR System. The education sector can benefit greatly from MREAL technology, and museums are the perfect example. During our hands-on with the HMD, we were able to interact with a small dinosaur. As we moved around the “exhibit,” which was just a large box surrounded by markers, the dinosaur moved with us. Through the HMD, we no longer saw the room of journalists we were actually in, but, instead, saw a Jurassic Park-like setting. We thought that was pretty neat on its own, but the MR system can be used to enhance learning, serving as an interactive teaching tool that expresses information you wouldn’t normally be able to communicate through just text or a teacher’s voice.


Curious about how the MR System works exactly? It’s actually pretty simple. The real world is captured with linked video cameras that are located on the right and left of the HMD worn by the user. A video is sent to a computer via the connected cable (the HMD isn’t wireless yet, but we have a feeling it will be in the not-too-distant future). The virtual CG video is combined with the video from the real world, and then the combined video is sent back to the user.


During another hands-on demo, we sat in a car seat while wearing the HMD. Above us were multiple sensors that recorded our movement and worked with the extra antenna-like protrusions attached to the HMD. This demo was the most realistic-looking of the ones we experienced. The details of the car seemed extremely life-like. In fact, thanks to a built-in gyroscope, we were able to see minute details of the car – such as the texture of the interior leather – when we moved our head farther or closer away from the virtual vehicle.


We were even able to physically bend down and check out the car’s rims, just like you would if you were looking at a real car in real life. We were able to walk around the entire vehicle while the person leading the demo changed details like the color and the placement of the included iPad accessory right before our eyes. You could literally be at a car dealership and say, “I want a red Lamborghini … no, make that purple … no, make that green,” and the salesperson would be able to instantly change what you’re seeing.

So besides being able to see cool museum exhibits and buy cars in a different way, what else can the MREAL System do for us? Although it doesn’t directly affect the Average Joe, we will reap the benefits of a new kind of efficiency in product creation. Mixed Reality will help speed up the process of bringing products to market, since manufacturers no longer have to travel from one continent to the other to view models, samples, and mockups. With Canon’s MR platform, a car manufacturer in Japan, for example, could view the models designed in the U.S. without ever having to get on a plane. Saving time and money, it’s likely that companies would be able to complete the research and development stages faster and get products out to consumers quicker than normal.


There’s a seemingly infinite amount of possible uses for the MREAL System. Imagine how much easier it would be to rent or buy a house. You’d no longer have to drive all over town looking at dozens of houses before you find one you like. Real estate agencies could literally “walk” you through houses without you ever leaving their office. This would make moving out of the state or country far less of a hassle.

Though it all sounds very exciting, the technology doesn’t come cheap. Available March 1, the starting price is $125,000, which will include the head-mount display and the platform software; annual maintenance will cost another $25,000.

How would you like to see the MREAL System used? We can only imagine what the adult video industry could do with this type of technology, but what do you think?

Emerging Tech

Awesome Tech You Can’t Buy Yet: camera with A.I. director, robot arm assistant

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!

Here are 8 GoPro tips to get the most out of your action cam

There's more to your GoPro camera than just mounting it to your skateboard. Whether it's finding the best accessories or understanding the settings more thoroughly, learn to shoot video like a pro with these simple GoPro tips and tricks.
Home Theater

What are HDMI ARC and eARC? Here’s how they can simplify your home theater

HDMI ARC is one of the coolest TV features at your disposal. But if you're like most folks, you have no idea how it works, if you even know what it is at all. Here's our primer on HDMI ARC, as well as the next generation technology, eARC.

Benchmark results show Snapdragon 855 destroys previous-generation chip

Almost exactly a year after the launch of the Snapdragon 845, Qualcomm took the wraps off of its next-generation mobile platform, the new Snapdragon 855. The new chip puts an emphasis on A.I. performance.

You could be gaming on AMD’s Navi graphics card before the end of the summer

If you're waiting for a new graphics card from AMD that doesn't cost $700, you may have to wait for Navi. But that card may not be far away, with new rumors suggesting we could see a July launch.

Is AMD's Navi back on track for 2019? Here's everything you need to know

With a reported launch in 2019, AMD is focusing on the mid-range market with its next-generation Navi GPU. Billed as a successor to Polaris, Navi promises to deliver better performance to consoles, like Sony's PlayStation 5.

Cortana wants to be friends with Alexa and Google Assistant

Microsoft no longer wants to compete against Amazon's Alexa and Google's Assistant in the digital assistant space. Instead, it wants to transform Cortana into a skill that can be integrated into other digital assistants.

Microsoft leans on A.I. to resume safe delivery of Windows 10 Update

Microsoft is leaning on artificial intelligence as it resumes the automatic rollout of the Windows 10 October 2018 Update. You should start seeing the update soon now that Microsoft has resolved problems with the initial software.

Stop dragging windows on your Mac. Here's how to use Split View to multitask

The latest iterations of MacOS offer a native Split View feature that can automatically divide screen space between two applications. Here's how to use Split View on a Mac, adjust it as needed, and how it can help out.

It's not all free money. Here's what to know before you try to mine Bitcoin

Mining Bitcoin today is harder than it used to be, but if you have enough time, money, and cheap electricity, you can still turn a profit. Here's how to get started mining Bitcoin at home and in the cloud.

Need a free alternative to Adobe Illustrator? Here are our favorites

Photoshop and other commercial tools can be expensive, but drawing software doesn't need to be. This list of the best free drawing software is just as powerful as some of the more expensive offerings.

What is fixed wireless 5G? Here’s everything you need to know

Here's fixed wireless 5G explained! Learn what you need to know about this effective new wireless technology, when it's available, how much it costs, and more. If you're thinking about 5G, this guide can help!

Fix those internet dead zones by turning an old router into a Wi-Fi repeater

Is there a Wi-Fi dead zone in your home or office? A Wi-Fi repeater can help. Don't buy a new one, though. Here is how to extend Wi-Fi range with another router you have lying around.

Heal your wrist aches and pains with one of these top ergonomic mice

If you have a growing ache in your wrist, it might be worth considering ergonomic mice alternatives. But which is the best ergonomic mouse for you? One of these could be the ticket to the right purchase for you.