Skip to main content

Itseez3D app turns iPad into ultra-realistic ‘game changing’ 3D scanner

itseez3d app puts ultra realistic 3d scanning ipad cow model 2
Image used with permission by copyright holder
There’s a lot of buzz surrounding 3D printing, which is seen as the next big thing. Why? One reason is because the tools that allow people to create their own 3D objects are coming down to the consumer level. That means devices and software that are not only easy to use, but also affordable. (We recently saw a small 3D printer that the manufacturer plans to sell for around $200!)

One example is the Occipital Structure Sensor, a Kickstarter success story that raised nearly $1.3 million and received the backing of more than 3,500 people. On sale now for $499, the device is the first 3D sensor that works with the iPad. Using any iPad fourth-generation of higher, you can scan objects and people and turn them into a 3D figure (click here to read more about the device). But to use the sensor requires software, and one of the first is the free Itseez3D app from Itseez, a company that specializes in computer vision technology and one of the early supporters of the Structure Sensor.

“We are creating the first 3D scanner for consumers.”

Itseez was one of the first companies to utilize Occipital’s Structure SDK, and the result is the easy to use 3D scanning app that lets you capture an object or subject, simply by moving around it. Unlike previous scanning methods, this sensor-and-app combo makes 3D scanning more accessible and affordable for both professional and recreational users.

“We are creating the first 3D scanner for consumers,” says Victor Erukhimov, CEO and cofounder of Itseez.

Here’s how it works. The Itseez3D uses both the Structure Sensor and iPad’s camera to capture the mesh structure of an object or subject with high-resolution RGB color, using augmented reality technology. Because the SDK is open to all developers, Itseez3D won’t be the only app to utilize the Structure Sensor, but what makes Itseez3D unique is the coloring. You see, using the Structure Sensor alone isn’t enough to create printable product. The same goes for taking high-resolution RGB images. But it is possible to create a product when you combine the data from both sources.

“Our secret sauce is how we create very high quality color models,” says Erukhimov. “The SDK provides you with the possibility to get a pretty good shape of an object without color, but what we do is merge that with data from the iPad camera – the images from the camera – and we synthesize that…it’s a really hard job to make this all work together so that your resulting models are realistic.”

Besides cost and accessibility, Erukhimov says another one of its app’s strengths is the ability accurately render human faces.

The Structure Sensor is different “because it’s intended to be used by consumers,” Erukhimov says. “Other scanners are created for specific industrial applications, and they cost more because their industry can afford to buy them. Other scanners have their own restrictions: For example, Makerbot has a laser scanner that can scan objects of a certain size, but it’s extremely difficult to scan a face with a Makerbot scanner.”

Besides actually printing out an object, objects could be scanned and placed inside a virtual environment.

Because the iPad doesn’t have enough power to process all the information, the structure and color data are sent to the cloud instead; Itseez says its cloud technology can create more accurate 3D renderings too. Within 10 minutes, the data is sent back to the app as a .ply or .obj file, which can be shared via email or published on Sketchfab.com as an interactive 3D model. Companies can utilize the device and software to quickly create a 3D object of a product they’re developing, while home users can create life-like 3D sculptures of family members, which was one of the first things Erukhimov did when he got his hands on the Structure Sensor (the 3D models look so realistic, it’s kind of creepy). Besides actually printing out an object, objects could be scanned and placed inside a virtual environment, which would benefit those working in the entertainment industry like video game developers.

As you probably figured out, the app requires the Structure Sensor in order to perform the 3D scanning, but anyone can download it to view sample 3D objects. (Itseez3D says they plan to add support for other new iPad-based sensors down the road). Yes, unless you have the Structure Sensor, the app is kind of useless for the general consumer, but it does give you a good idea of how well the sensor and Itseez’s color technology works.

We tried out the app (without a sensor, so we weren’t creating any 3D objects), and what you’ll see is that it is a fairly barebones app that’s easy to use. What we noticed right away is how smooth and fast the app is, and the sample 3D objects themselves have an amazing level of detail, which you can spin and rotate 360 degrees, or pinch and zoom to view all the scanned areas; on objects like a stuffed animal and sneaker or subjects like people, you can see detailed things like hair, beard stubble, fabric, or artificial fur. You can even make out the patterns and prints in the clothing subjects are wearing. Erukhimov told us that the app will add native support for 3D printers and 3D printing services in future updates (the app can now export the information, but it’s a longer process to get it printed) but the early results are pretty impressive.

body_scan_
Image used with permission by copyright holder

As for the future of 3D printing, Erukhimov calls the Structure Sensor a game changer. Erukhimov would know: As one of the developers of the OpenCV open source computer vision language, Erukhimov has been working in the industry for more than 15 years – seven of them with company, Itseez. He says that, for the first time, we are able to create realistic 3D products by using both 3D data and computer vision technologies, and the fact that it’s being created with a consumer mobile device is incredible. And, because you need a lot of pixels to create gorgeous 3D models, Erukhimov says 3D scanning will only improve, as the high-resolution cameras in mobile devices get better.

“This is the thing that we liked about the Structure Sensor, because suddenly mobile devices with 3D sensing capabilities are able to do much more,” Erukhimov says. “The industry is growing pretty fast. I think [more] hardware vendors will eventually create mobile 3D devices with 3D sensors, like [Google’s] Project Tango, so a lot of consumers will be scanning things.”

Les Shu
Former Digital Trends Contributor
I am formerly a senior editor at Digital Trends. I bring with me more than a decade of tech and lifestyle journalism…
The best photo printers you can buy in 2024
Alan compares draft, standard, and high-quality photos from Epson's EcoTank ET-8500.

If you love sharing photo prints or building physical photo albums, you might want to upgrade to a photo printer. When manufacturers optimize printers for pictures, the results often exceed the image quality of the best printers available.

Compared to sending photos to a lab or printing at a local office store, you have faster feedback and more control when you create pictures on your own photo printer. If you decide a print would benefit from a color or exposure adjustment, you can quickly make that change and print again with minimal delay. A printer that handles photos well offers instant gratification and convenience, while saving you money on print costs from a photo lab.

Read more
Adobe Photoshop or Adobe Lightroom: Which should you choose to edit your photos?
project felix lighting tool adobe beta

Within Adobe's Creative Cloud Suite, there are two programs designed specifically with photographers in mind: Adobe Photoshop and Adobe Lightroom.

At first glance, these two programs might appear redundant, as they're both made with the goal of editing photographs of all kinds. But the truth is, each program is designed with a different purpose in mind, and each offers a distinct post-production photography workflow.
Photoshop vs. Lightroom
In the most simple terms, Adobe Photoshop is effectively a digital darkroom, where you can make detailed adjustments and alterations to any kind of image. Adobe Lightroom, on the other hand, is closer to an entire photography studio, as it imports, organizes, edits, and exports photographs.

Read more
Time-lapse from ISS shows lightning and mysterious red light
Earth in a time-lapse captured from the ISS.

In his final weeks aboard the space station after six months in orbit, NASA astronaut Matthew Dominick has shared a gorgeous time-lapse of Earth.

It shows a large part of Asia as the International Space Station (ISS) passed over it at night at an altitude of about 250 miles. The footage, which you can watch below, shows numerous flashes of lightning over a wide area, bright clusters of city lights, and colored lights from fishing boats, which Dominick describes as “one of my favorite things to see at night from the ISS.” But it also shows a bright red light, the source of which Dominick is unsure about.

Read more