Skip to main content

Microsoft patents augmented reality tech to help us keep track of almost anything

microsoft
drserg/123rf
Augmented reality systems are tasked not only with projecting their own virtual information, but also with being aware of the physical space in which they’re functioning. In the real world, that physical space is unlikely to be entirely static, but rather will include both animate and inanimate objects that might not remain in the same place.

The fact that objects might be moved and thus might need to be tracked requires additional capabilities on the part of the AR system — and preferably that process of tracking would be automatic. All of this becomes even more important and complicated when our AR systems aren’t limited to just one physical space but rather are free to follow us wherever we might go. That’s precisely the problem Microsoft is working to solve in a recent patent application, as MSPU reports.

According to patent application 20160373570, Microsoft is working on technology to identify inanimate objects and allow them to be selected as tracked objects. The system would then keep its eye on that object and react when it’s moved, as well as track objects that leave the field of view and then return in some other location or at a different time.

Image used with permission by copyright holder

Microsoft provides some real-world examples of where this capability would be valuable: “The tracking of the location or other state of objects may occupy a significant amount of effort in everyday life. Further, much time may be spent in trying to locate misplaced objects. For example, searching for misplaced car keys, wallets, mobile devices, and the like may cause people to lose productive time. Likewise, forgetting that the milk carton in the home refrigerator is almost empty may lead to an extra trip to the store that could have been avoided had the shopper remembered the state of the milk carton. In some instances, such objects may be moved, emptied, etc., by a person other than the owner, thereby complicating the task of tracking.”

Image used with permission by copyright holder

The patent outlines a slew of scenarios where such object-tracking intelligence would be valuable. And the patent accounts for the connected state of our world — it’s not just our own point of view that can provide information on that status of a tracked object, but also that of other people and systems that might catch sight of the object. Thus, Microsoft is also considering the social aspects of tracked objects, where we might be able to share data on objects of importance with other people.

In other words, the patent is aimed at helping us mere humans keep up with things that that we have a hard time keeping up with by ourselves. As such systems become more integrated in our lives, the applications are numerous, and the ability to tell the system what’s important to us and then let the system worry about its status and location would certainly remove some serious complication from our lives.

Editors' Recommendations

Mark Coppock
Mark has been a geek since MS-DOS gave way to Windows and the PalmPilot was a thing. He’s translated his love for…
Adobe Aero let me walk through my own photos in augmented reality
adobe aero hands on impressions 7445

The best views make the camera slung around my neck seem insufficient to capture the breadth of the scene. A flat image is simply insufficient to capture the full awe of walking through a jungle dotted with capuchin monkeys, gator spotting on an airboat through the Everglades, or seeing my baby’s first smile.

That’s why I was intrigued by Adobe Aero, the new app in the Creative Cloud family that turns Photoshop files into augmented reality. The free iOS app aims to allow creatives to build AR experiences without any coding. Essentially, Aero brings Photoshop files into a 3D space, placing them in the world around you using your device's camera. With a few intuitive tools to animate and add depth, it makes for a whole new way to enjoy your photographs or build new scenes from scratch.
Aero planes
Lacking the graphic design savvy to actually create my own 3D objects, I decided to use Adobe Aero to take a walk through my own photographs, reliving moments of my travels from my snow-encrusted backyard.

Read more
The Qualcomm XR2 augmented reality chipset will power next-gen headsets with 5G
qualcomm snapdragon xr2 augmented reality news

There's a new AR in town: Qualcomm unveiled the Snapdragon XR2 chipset for a new generation of augmented reality devices at its annual Snapdragon Summit -- promising to marry the power of AR with the promise of 5G. The  XR2 is a follow-up to Qualcomm's Snapdragon XR1 and brings a range of new features to next-gen AR headsets. The announcement came alongside news of the new Snapdragon 865 platform, which is set to power the majority of flagship Android phones in 2020.

Perhaps the most notable new feature on offer by the XR2 platform is the fact that it’s the first AR chipset to support 5G connectivity. That means it will be perfect for things like streaming video or accessing large amounts of data on the go.

Read more
Oppo steps into augmented reality with its HoloLens-like AR Glass headset
oppo ar glass headset news

Microsoft’s HoloLens 2 may have a new challenger next year. Smartphone maker Oppo has announced a pair of augmented reality glasses, and stated they will be released during the first three months of 2020. Oppo’s AR Glass headset is part of an effort to expand beyond only making smartphones, and was revealed alongside plans for a smartwatch and an Oppo-produced mobile processor.

Oppo's AR Glass is similar in design to HoloLens. A visor stretches across the front of the headset, attached to a band which holds it on your head, plus there is a forehead rest to keep it in position. This is not something designed for everyday wear, but more for home and industrial use. At home, Oppo says the AR Glass will be used for augmented reality content and games, while in the workplace, and somewhat less specifically, Oppo sees it being used for augmented reality services. These could include 3D modeling, planning, and design.

Read more