Skip to main content

Itseez3D app turns iPad into ultra-realistic ‘game changing’ 3D scanner

itseez3d app puts ultra realistic 3d scanning ipad cow model 2
Image used with permission by copyright holder
There’s a lot of buzz surrounding 3D printing, which is seen as the next big thing. Why? One reason is because the tools that allow people to create their own 3D objects are coming down to the consumer level. That means devices and software that are not only easy to use, but also affordable. (We recently saw a small 3D printer that the manufacturer plans to sell for around $200!)

One example is the Occipital Structure Sensor, a Kickstarter success story that raised nearly $1.3 million and received the backing of more than 3,500 people. On sale now for $499, the device is the first 3D sensor that works with the iPad. Using any iPad fourth-generation of higher, you can scan objects and people and turn them into a 3D figure (click here to read more about the device). But to use the sensor requires software, and one of the first is the free Itseez3D app from Itseez, a company that specializes in computer vision technology and one of the early supporters of the Structure Sensor.

“We are creating the first 3D scanner for consumers.”

Itseez was one of the first companies to utilize Occipital’s Structure SDK, and the result is the easy to use 3D scanning app that lets you capture an object or subject, simply by moving around it. Unlike previous scanning methods, this sensor-and-app combo makes 3D scanning more accessible and affordable for both professional and recreational users.

“We are creating the first 3D scanner for consumers,” says Victor Erukhimov, CEO and cofounder of Itseez.

Here’s how it works. The Itseez3D uses both the Structure Sensor and iPad’s camera to capture the mesh structure of an object or subject with high-resolution RGB color, using augmented reality technology. Because the SDK is open to all developers, Itseez3D won’t be the only app to utilize the Structure Sensor, but what makes Itseez3D unique is the coloring. You see, using the Structure Sensor alone isn’t enough to create printable product. The same goes for taking high-resolution RGB images. But it is possible to create a product when you combine the data from both sources.

“Our secret sauce is how we create very high quality color models,” says Erukhimov. “The SDK provides you with the possibility to get a pretty good shape of an object without color, but what we do is merge that with data from the iPad camera – the images from the camera – and we synthesize that…it’s a really hard job to make this all work together so that your resulting models are realistic.”

Besides cost and accessibility, Erukhimov says another one of its app’s strengths is the ability accurately render human faces.

The Structure Sensor is different “because it’s intended to be used by consumers,” Erukhimov says. “Other scanners are created for specific industrial applications, and they cost more because their industry can afford to buy them. Other scanners have their own restrictions: For example, Makerbot has a laser scanner that can scan objects of a certain size, but it’s extremely difficult to scan a face with a Makerbot scanner.”

Besides actually printing out an object, objects could be scanned and placed inside a virtual environment.

Because the iPad doesn’t have enough power to process all the information, the structure and color data are sent to the cloud instead; Itseez says its cloud technology can create more accurate 3D renderings too. Within 10 minutes, the data is sent back to the app as a .ply or .obj file, which can be shared via email or published on as an interactive 3D model. Companies can utilize the device and software to quickly create a 3D object of a product they’re developing, while home users can create life-like 3D sculptures of family members, which was one of the first things Erukhimov did when he got his hands on the Structure Sensor (the 3D models look so realistic, it’s kind of creepy). Besides actually printing out an object, objects could be scanned and placed inside a virtual environment, which would benefit those working in the entertainment industry like video game developers.

As you probably figured out, the app requires the Structure Sensor in order to perform the 3D scanning, but anyone can download it to view sample 3D objects. (Itseez3D says they plan to add support for other new iPad-based sensors down the road). Yes, unless you have the Structure Sensor, the app is kind of useless for the general consumer, but it does give you a good idea of how well the sensor and Itseez’s color technology works.

We tried out the app (without a sensor, so we weren’t creating any 3D objects), and what you’ll see is that it is a fairly barebones app that’s easy to use. What we noticed right away is how smooth and fast the app is, and the sample 3D objects themselves have an amazing level of detail, which you can spin and rotate 360 degrees, or pinch and zoom to view all the scanned areas; on objects like a stuffed animal and sneaker or subjects like people, you can see detailed things like hair, beard stubble, fabric, or artificial fur. You can even make out the patterns and prints in the clothing subjects are wearing. Erukhimov told us that the app will add native support for 3D printers and 3D printing services in future updates (the app can now export the information, but it’s a longer process to get it printed) but the early results are pretty impressive.

Image used with permission by copyright holder

As for the future of 3D printing, Erukhimov calls the Structure Sensor a game changer. Erukhimov would know: As one of the developers of the OpenCV open source computer vision language, Erukhimov has been working in the industry for more than 15 years – seven of them with company, Itseez. He says that, for the first time, we are able to create realistic 3D products by using both 3D data and computer vision technologies, and the fact that it’s being created with a consumer mobile device is incredible. And, because you need a lot of pixels to create gorgeous 3D models, Erukhimov says 3D scanning will only improve, as the high-resolution cameras in mobile devices get better.

“This is the thing that we liked about the Structure Sensor, because suddenly mobile devices with 3D sensing capabilities are able to do much more,” Erukhimov says. “The industry is growing pretty fast. I think [more] hardware vendors will eventually create mobile 3D devices with 3D sensors, like [Google’s] Project Tango, so a lot of consumers will be scanning things.”

Editors' Recommendations

Les Shu
Former Digital Trends Contributor
I am formerly a senior editor at Digital Trends. I bring with me more than a decade of tech and lifestyle journalism…
DJI Mini Pro 4 leak appears to reveal the drone’s specs
A retail box apparently showing DJI's upcoming Mini Pro 4 drone.

DJI appears close to unveiling the Mini 4 Pro, the successor to the Mini 3 Pro that launched in May last year.

First, as a reminder, DJI’s smallest and lightest “Pro” drone tips the scales at just 249 grams, a carefully considered move as it’s just 1 gram below the drone weight category that involves having to register it with the authorities. Sure, that’s no great hardship for most folks, but the fewer hoops you have to jump through to get your bird in the sky, the better.

Read more
GoPro unveils its latest action camera, the Hero 12 Black
GoPro's Hero 12 Black action camera.

GoPro: Introducing HERO12 Black | Everything You Need to Know

GoPro is back with the latest iteration of its popular action camera. The new GoPro Hero 12 Black is the kind of solid piece of kit we’ve come to expect from a company that’s been in the game for years. That’s actually created a bit of a problem for GoPro, with many customers happy to hang onto their current model rather than upgrade. So it'll be hoping the latest version will be attractive enough to prompt a wave of purchases among current owners, while at the same time attracting a bunch of first-time buyers, too.

Read more
How to hide photos on your Android phone or tablet
Google Photos

While modern smartphones are quite secure as long as they remain locked with a passcode or biometrics like a fingerprint, by default those features only protect the front door. If someone picks up your phone while it's unlocked, there aren't typically any barriers that will keep them out of exploring everything from your contacts and emails to your photos.

This can be particularly challenging when it comes to photos, since those are the things we like to show off the most from our phones. We've likely all had those moments when we want to show a friend or co-worker a funny cat meme, so we hand over our phone and trust that they won't swipe right and see the photo of the hairy mole that we sent to our doctor that morning.

Read more