Skip to main content

Itseez3D app turns iPad into ultra-realistic ‘game changing’ 3D scanner

itseez3d app puts ultra realistic 3d scanning ipad cow model 2
Image used with permission by copyright holder
There’s a lot of buzz surrounding 3D printing, which is seen as the next big thing. Why? One reason is because the tools that allow people to create their own 3D objects are coming down to the consumer level. That means devices and software that are not only easy to use, but also affordable. (We recently saw a small 3D printer that the manufacturer plans to sell for around $200!)

One example is the Occipital Structure Sensor, a Kickstarter success story that raised nearly $1.3 million and received the backing of more than 3,500 people. On sale now for $499, the device is the first 3D sensor that works with the iPad. Using any iPad fourth-generation of higher, you can scan objects and people and turn them into a 3D figure (click here to read more about the device). But to use the sensor requires software, and one of the first is the free Itseez3D app from Itseez, a company that specializes in computer vision technology and one of the early supporters of the Structure Sensor.

“We are creating the first 3D scanner for consumers.”

Itseez was one of the first companies to utilize Occipital’s Structure SDK, and the result is the easy to use 3D scanning app that lets you capture an object or subject, simply by moving around it. Unlike previous scanning methods, this sensor-and-app combo makes 3D scanning more accessible and affordable for both professional and recreational users.

“We are creating the first 3D scanner for consumers,” says Victor Erukhimov, CEO and cofounder of Itseez.

Here’s how it works. The Itseez3D uses both the Structure Sensor and iPad’s camera to capture the mesh structure of an object or subject with high-resolution RGB color, using augmented reality technology. Because the SDK is open to all developers, Itseez3D won’t be the only app to utilize the Structure Sensor, but what makes Itseez3D unique is the coloring. You see, using the Structure Sensor alone isn’t enough to create printable product. The same goes for taking high-resolution RGB images. But it is possible to create a product when you combine the data from both sources.

“Our secret sauce is how we create very high quality color models,” says Erukhimov. “The SDK provides you with the possibility to get a pretty good shape of an object without color, but what we do is merge that with data from the iPad camera – the images from the camera – and we synthesize that…it’s a really hard job to make this all work together so that your resulting models are realistic.”

Besides cost and accessibility, Erukhimov says another one of its app’s strengths is the ability accurately render human faces.

The Structure Sensor is different “because it’s intended to be used by consumers,” Erukhimov says. “Other scanners are created for specific industrial applications, and they cost more because their industry can afford to buy them. Other scanners have their own restrictions: For example, Makerbot has a laser scanner that can scan objects of a certain size, but it’s extremely difficult to scan a face with a Makerbot scanner.”

Besides actually printing out an object, objects could be scanned and placed inside a virtual environment.

Because the iPad doesn’t have enough power to process all the information, the structure and color data are sent to the cloud instead; Itseez says its cloud technology can create more accurate 3D renderings too. Within 10 minutes, the data is sent back to the app as a .ply or .obj file, which can be shared via email or published on Sketchfab.com as an interactive 3D model. Companies can utilize the device and software to quickly create a 3D object of a product they’re developing, while home users can create life-like 3D sculptures of family members, which was one of the first things Erukhimov did when he got his hands on the Structure Sensor (the 3D models look so realistic, it’s kind of creepy). Besides actually printing out an object, objects could be scanned and placed inside a virtual environment, which would benefit those working in the entertainment industry like video game developers.

As you probably figured out, the app requires the Structure Sensor in order to perform the 3D scanning, but anyone can download it to view sample 3D objects. (Itseez3D says they plan to add support for other new iPad-based sensors down the road). Yes, unless you have the Structure Sensor, the app is kind of useless for the general consumer, but it does give you a good idea of how well the sensor and Itseez’s color technology works.

We tried out the app (without a sensor, so we weren’t creating any 3D objects), and what you’ll see is that it is a fairly barebones app that’s easy to use. What we noticed right away is how smooth and fast the app is, and the sample 3D objects themselves have an amazing level of detail, which you can spin and rotate 360 degrees, or pinch and zoom to view all the scanned areas; on objects like a stuffed animal and sneaker or subjects like people, you can see detailed things like hair, beard stubble, fabric, or artificial fur. You can even make out the patterns and prints in the clothing subjects are wearing. Erukhimov told us that the app will add native support for 3D printers and 3D printing services in future updates (the app can now export the information, but it’s a longer process to get it printed) but the early results are pretty impressive.

body_scan_
Image used with permission by copyright holder

As for the future of 3D printing, Erukhimov calls the Structure Sensor a game changer. Erukhimov would know: As one of the developers of the OpenCV open source computer vision language, Erukhimov has been working in the industry for more than 15 years – seven of them with company, Itseez. He says that, for the first time, we are able to create realistic 3D products by using both 3D data and computer vision technologies, and the fact that it’s being created with a consumer mobile device is incredible. And, because you need a lot of pixels to create gorgeous 3D models, Erukhimov says 3D scanning will only improve, as the high-resolution cameras in mobile devices get better.

“This is the thing that we liked about the Structure Sensor, because suddenly mobile devices with 3D sensing capabilities are able to do much more,” Erukhimov says. “The industry is growing pretty fast. I think [more] hardware vendors will eventually create mobile 3D devices with 3D sensors, like [Google’s] Project Tango, so a lot of consumers will be scanning things.”

Editors' Recommendations

Les Shu
Former Digital Trends Contributor
I am formerly a senior editor at Digital Trends. I bring with me more than a decade of tech and lifestyle journalism…
How to hide photos on an Android phone or tablet
Google Photos

While today's best Android phones are quite secure as long as they remain locked with a passcode or biometrics like a fingerprint, by default those features only protect the front door. If someone picks up your phone while it's unlocked, there aren't typically any barriers that will keep them out of exploring everything from your contacts and emails to your photos.

This can be particularly challenging when it comes to photos, since those are the things we like to show off the most from our phones. We've likely all had those moments when we want to show a friend or co-worker a funny cat meme, so we hand over our phone and trust that they won't swipe right and see the photo of the hairy mole that we sent to our doctor that morning.

Read more
Best Sony A7 III deals: Save $300 on the full frame mirrorless camera
Sony A7 III

Sony A7 III Daven Mathies/Digital Trends / .

Even if you have one of the best camera phones at the moment, if you're a photography fanatic, you're probably feeling the burn for something new and exciting. For example, the Sony A7 III line is like none other in the world of handheld cameras and you can find several cameras in that line on sale right now at Best Buy. Here, we round up the best deals in the sale, then analyze how buying a Sony Alpha A7 III looks at the moment.
Today's best Sony A7 III deals

Read more
How to use (almost) any camera as a webcam for Zoom and more
how to use any camera as a web cam v2 00 58 01 still007

Cameras, even those in phones, brag about megapixels and lens specifications -- but laptops? Not so much. There’s a reason computer companies don’t say much about the webcams that come built into the bezels of their screens. Most of these cameras are low-quality, with tiny sensors and cheap lenses. Sure, they work for basic videoconferencing, but they aren’t very impressive and certainly leave us wanting something more.

While you could just buy a stand-alone webcam that connects over USB, to really take production value up a notch, you can opt for a DSLR or mirrorless camera. You’ll need a few workarounds to get this type of camera to be recognized as a webcam by your computer, but the trouble is worth it for the higher resolution, much better low-light performance, and cinematic background blur.

Read more