Itseez3D app turns iPad into ultra-realistic ‘game changing’ 3D scanner

itseez3d app puts ultra realistic 3d scanning ipad cow model 2
There’s a lot of buzz surrounding 3D printing, which is seen as the next big thing. Why? One reason is because the tools that allow people to create their own 3D objects are coming down to the consumer level. That means devices and software that are not only easy to use, but also affordable. (We recently saw a small 3D printer that the manufacturer plans to sell for around $200!)

One example is the Occipital Structure Sensor, a Kickstarter success story that raised nearly $1.3 million and received the backing of more than 3,500 people. On sale now for $499, the device is the first 3D sensor that works with the iPad. Using any iPad fourth-generation of higher, you can scan objects and people and turn them into a 3D figure (click here to read more about the device). But to use the sensor requires software, and one of the first is the free Itseez3D app from Itseez, a company that specializes in computer vision technology and one of the early supporters of the Structure Sensor.

“We are creating the first 3D scanner for consumers.”

Itseez was one of the first companies to utilize Occipital’s Structure SDK, and the result is the easy to use 3D scanning app that lets you capture an object or subject, simply by moving around it. Unlike previous scanning methods, this sensor-and-app combo makes 3D scanning more accessible and affordable for both professional and recreational users.

“We are creating the first 3D scanner for consumers,” says Victor Erukhimov, CEO and cofounder of Itseez.

Here’s how it works. The Itseez3D uses both the Structure Sensor and iPad’s camera to capture the mesh structure of an object or subject with high-resolution RGB color, using augmented reality technology. Because the SDK is open to all developers, Itseez3D won’t be the only app to utilize the Structure Sensor, but what makes Itseez3D unique is the coloring. You see, using the Structure Sensor alone isn’t enough to create printable product. The same goes for taking high-resolution RGB images. But it is possible to create a product when you combine the data from both sources.

“Our secret sauce is how we create very high quality color models,” says Erukhimov. “The SDK provides you with the possibility to get a pretty good shape of an object without color, but what we do is merge that with data from the iPad camera – the images from the camera – and we synthesize that…it’s a really hard job to make this all work together so that your resulting models are realistic.”

Besides cost and accessibility, Erukhimov says another one of its app’s strengths is the ability accurately render human faces.

The Structure Sensor is different “because it’s intended to be used by consumers,” Erukhimov says. “Other scanners are created for specific industrial applications, and they cost more because their industry can afford to buy them. Other scanners have their own restrictions: For example, Makerbot has a laser scanner that can scan objects of a certain size, but it’s extremely difficult to scan a face with a Makerbot scanner.”

Besides actually printing out an object, objects could be scanned and placed inside a virtual environment.

Because the iPad doesn’t have enough power to process all the information, the structure and color data are sent to the cloud instead; Itseez says its cloud technology can create more accurate 3D renderings too. Within 10 minutes, the data is sent back to the app as a .ply or .obj file, which can be shared via email or published on Sketchfab.com as an interactive 3D model. Companies can utilize the device and software to quickly create a 3D object of a product they’re developing, while home users can create life-like 3D sculptures of family members, which was one of the first things Erukhimov did when he got his hands on the Structure Sensor (the 3D models look so realistic, it’s kind of creepy). Besides actually printing out an object, objects could be scanned and placed inside a virtual environment, which would benefit those working in the entertainment industry like video game developers.

As you probably figured out, the app requires the Structure Sensor in order to perform the 3D scanning, but anyone can download it to view sample 3D objects. (Itseez3D says they plan to add support for other new iPad-based sensors down the road). Yes, unless you have the Structure Sensor, the app is kind of useless for the general consumer, but it does give you a good idea of how well the sensor and Itseez’s color technology works.

We tried out the app (without a sensor, so we weren’t creating any 3D objects), and what you’ll see is that it is a fairly barebones app that’s easy to use. What we noticed right away is how smooth and fast the app is, and the sample 3D objects themselves have an amazing level of detail, which you can spin and rotate 360 degrees, or pinch and zoom to view all the scanned areas; on objects like a stuffed animal and sneaker or subjects like people, you can see detailed things like hair, beard stubble, fabric, or artificial fur. You can even make out the patterns and prints in the clothing subjects are wearing. Erukhimov told us that the app will add native support for 3D printers and 3D printing services in future updates (the app can now export the information, but it’s a longer process to get it printed) but the early results are pretty impressive.

body_scan_

As for the future of 3D printing, Erukhimov calls the Structure Sensor a game changer. Erukhimov would know: As one of the developers of the OpenCV open source computer vision language, Erukhimov has been working in the industry for more than 15 years – seven of them with company, Itseez. He says that, for the first time, we are able to create realistic 3D products by using both 3D data and computer vision technologies, and the fact that it’s being created with a consumer mobile device is incredible. And, because you need a lot of pixels to create gorgeous 3D models, Erukhimov says 3D scanning will only improve, as the high-resolution cameras in mobile devices get better.

“This is the thing that we liked about the Structure Sensor, because suddenly mobile devices with 3D sensing capabilities are able to do much more,” Erukhimov says. “The industry is growing pretty fast. I think [more] hardware vendors will eventually create mobile 3D devices with 3D sensors, like [Google’s] Project Tango, so a lot of consumers will be scanning things.”

Giveaways

Print your heart’s desire: Enter our giveaway to win a free Monoprice 3D printer

We’re giving away a $400 Monoprice MP Voxel 3D Printer. It's easy to use, especially for beginners, with its simple menu system and touchscreen display. It comes fully assembled so you can spend more time printing instead of setting up.
Emerging Tech

Makerbot is back with a new 3D printer that’s faster and more precise than ever

MakerBot's new Method 3D printer aims to bridge the gap between home 3D printers and more industrial 3D printing tech. Here are a few of the tantalizing things you can expect from it.
Product Review

The iPad Pro is the best tablet ever. But don't sell your laptop just yet

Apple has unveiled a big redesign for the iPad Pro, slimming down the bezels, adding Face ID, and the ability to attach and charge the Apple Pencil. All of this comes at a high cost however, as the iPad Pro starts at $799.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Folding canoes and ultra-fast water filters

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Social Media

Ride the rails and share your stories with Amtrak’s new social media residency

Amtrak is looking for travel fans with a knack for telling stories on social media. The new Amtrak social media residency program wants amateur travelers to share photos, video, and written content from aboard long-distance trips.
Photography

Full-frame mirrorless cameras just made their Hollywood debut with this thriller

The Possession of Hannah Grace isn't just a thriller -- it's also the first Hollywood feature film to be shot completely with a full-frame mirrorless camera. The film was shot with several Sony a7S II bodies and anamorphic lenses.
Photography

MIT science photographer isn’t an artist, but her work could fill galleries

Felice Frankel is an award-winning photographer, but she doesn't consider herself an artist. As a science photographer, she has been helping researchers better communicate their ideas for nearly three decades with eye-catching imagery.
Photography

Lens Rentals zooms in on the most popular cameras of the year

As 2018 comes to a close, Lens Rentals is taking a look at most popular cameras of the year, based on rental data. While Sony and Panasonic saw more rentals than the previous year, Canon is still the most-rented brand on the platform.
Photography

Luminar’s new libraries don’t even need you to manually import images

Luminar 3's new libraries feature doesn't require importing -- images are automatically added after clicking on a folder. The long-promised libraries feature gives editors a Lightroom alternative with organization tools as well as syncing…
Emerging Tech

The best drone photos from around the world

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.
Photography

The best mirrorless cameras pack all the power of a DSLR, minus the bulk

Mirrorless cameras offer a lot of photography firepower, inside a compact body. Explore the best mirrorless cameras, from the pro-level to the beginner-friendly shooters, in this guide.
Photography

Photography News: Startup redesigns tripod heads ‘inside out’ for more flexibility

Well, this doesn't look like the ball heads that we've seen before. Instead of designing a tripod ball head with a small cutout, the Colorado Tripod Company created one with most of the ball exposed, allowing for more possible angles.
Photography

Leica targets street photographers with a pricey camera bundle

Described by the camera company as "your perfect companion in the city," Leica's Street Kit comprises a Leica CL camera body, a 23mm (35mm full-frame equivalent) F2 lens, batteries, a handgrip, and a black leather carrying strap.
Product Review

Meet Z6, the breakout star in Nikon's new mirrorless lineup

The Nikon Z6 is the sibling to the new mirrorless Z7 -- but for some photographers, the cheaper Z6 may be the better option. Read where the $2,000 camera beats the $3,400 one (and where it doesn’t) in our Nikon Z6 review.