Skip to main content

Cosy, a robotics startup, can track your position in 3D space with a camera

Three-dimensional depth tracking is a complicated problem without an easy solution. Solutions like Microsoft’s Kinect, Google’s Tango platform, and Leap Motion’s peripheral can pick out walls and other obstacles with the help of custom sensor arrays, but they aren’t exactly plug-and-play — short of some duct tape and a lot of coding, getting them to talk to a robot, smartphone, or other device is an ordeal.

But Cosy, a startup founded by University of Pennsylvania graduate Jonas Cleveland, might have the solution — a software framework that combines neural networking and indoor positioning to pinpoint the location of robots, smartphones, and more in three-dimensional space.

Recommended Videos

And unlike most positional tracking technologies, which rely on infrared sensors to orient objects in rooms and hallways, Cosy’s platform works on any device with a camera. “It doesn’t matter the platform — it works on fixed cameras” Cleveland said. “A lot of folks claim you’re not able to achieve [3D mapping] without using lidar, but we’ve done it. It’s all post processing.”

The robot generates a “point cloud” as it runs through the store doing inventory. Image used with permission by copyright holder

It’s a little like Snapchat’s Lenses, which use computer vision and augmented reality to lay digital objects on top of real-world environments. Cleveland wouldn’t spill the beans on Cosy’s tech, some of which is patent-pending. But if it’s anything like Lenses, it takes into account factors like rotation, occlusion, and more in real time.

Cosy is applying it to retail — specifically inventory management. Robots that are four-and-a-half feet tall robots (“about the size of a fourth grader,” Cleveland said) equipped with the startup’s software navigate the store aisles autonomously, taking note of the products on shelves. They relay that data to a central server, which updates the store’s inventory database.

Cosy sees it lightening human workloads. “We’re empowering humans to do other things,” Cleveland said. “People are not very good at tedious and mundane tasks. Inventory is incredibly labor intensive, and very inaccurate — humans hate doing inventory. We’re checking stock and seeing where items are located in the store through software, without human assistance.”

It might not be long before you see a Cosy-powered ‘bot at your local department store. The startup is in talks with three of the top twenty U.S. retailers to deploy the inventory-checking robots in the next year. And in the future, Cosy hopes to adapt the tech to smartphones — Cleveland envisions an app that directs customers to a particular section of a store, for example, or even an exact shelf.

“When you can map indoor space and all the objects, that solves a lot of problems,” said Cleveland.

Kyle Wiggers
Kyle Wiggers is a writer, Web designer, and podcaster with an acute interest in all things tech. When not reviewing gadgets…
How to disable 3D and Haptic Touch in iOS
An example of 3D Touch on an iPhone.

In 2015, when Apple launched the iPhone 6S, it also debuted a new iOS interface called 3D Touch. This feature uses the iPhone's pressure-sensitive surface to help you view, navigate, and control some aspects of the device's apps and features. You could use it to call up an app's Quick Actions, preview notifications, operate actions from the Control Center, and "peek and pop" with certain apps without having to launch them.

3D Touch was used in the iPhone 6S, 7, 8, X, and XS models before being replaced by Haptic Touch, which responds only to a finger press's length. While some people could use 3D Touch to their advantage and profoundly miss it, others found it unintuitive at best and annoying at worst. This article explains how to disable 3D Touch on iPhones that have it and disable Haptic Touch.
How to disable 3D Touch and Haptic Touch

Read more
Ceramic ink could let doctors 3D print bones directly into a patient’s body
ceramic ink 3d printed bones bioprinting australia 2

Scientists use a novel ink to 3D print ‘bone’ with living cells

The term 3D bioprinting refers to the use of 3D printing technology to fabricate biomedical parts that, eventually, could be used to create replacement organs or other body parts as required. While we’re not at that point just yet, a number of big advances have been made toward this dream over the past couple of decades.

Read more
Super Mario 3D World + Bowser’s Fury trailer reveals wild new game mode
Super Mario 3D World + Bowser's Fury

Nintendo released a new trailer for Super Mario 3D World + Bowser's Fury, which finally reveals information on the re-release's new mode. Bowser's Fury is an entirely new adventure that features a gigantic Bowser.

Super Mario 3D World + Bowser's Fury is a Nintendo Switch version of the 2013 Wii U game Super Mario 3D World. Nintendo previously revealed that the new edition would feature something called Bowser's Fury, but this is the first time the mode has been shown in any form.

Read more