Skip to main content

Apple acquisition points to possibility of easy background removal in photos

SPEKTRAL

A recent Apple investment could make it possible for iPhones to easily separate the background and the subject from photos and video. A recent report by a Danish newspaper suggests that Apple acquired Spektral, a company focusing on green screen-like effects without the green screen, back in December 2017. Apple has not yet confirmed or commented on the report (the company rarely comments on acquisitions).

Recommended Videos

According to Fortune, Spektral gots its start working on software to digitally swap out backgrounds using a technique similar to the popular green screen. A few years later, however, and the company’s engineers moved on to machine learning that could cut out people without requiring that green screen.

Spektral, which originally started as CloudCutout allowing for background swaps in school photos, eventually moved onto to removing the background from product photos, and then, in 2016, cutting out video without requiring extra gear like that green screen. The company says the algorithms can cut out video in real time.

Spektral’s website suggests that smartphones are next. “In the beginning of 2017 we have been working fiercely without algorithms on getting this cool technology available on a smartphone and thereby enabling anyone and anywhere to create mixed reality content.”

The report suggests the acquisition happened for more than $30 million. Without a confirmation from Apple, exactly what the integration of Spektral technology means is speculation. Looking at the company’s statements on the website in bringing mixed reality to smartphones makes the integration easy to imagine as expansion for Apple’s augmented reality, however. 

If Apple has the technology to cut out a person from any scene in real time, it’s easy to imagine importing yourself into an augmented reality world instead of bringing imaginary objects into yours. Spektral’s products also cut out the background from product photos, which could serve useful for further development of AR shopping experiences that allow you to place the object in your own home, as Fortune suggests.

Spectral isn’t the first exploring background removal from a mobile device. Google announced testing for a tool to remove backgrounds for video earlier this year. The Massachusetts Institute of Technology , Adobe, and Microsoft also recently worked together to separate the background in images around fine edges using machine learning.

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Apple’s AR glasses ‘now appear many years away,’ report says
A pair of spectacles.

Apple has suspended work on a pair of lightweight augmented reality (AR) glasses due to technical challenges, Bloomberg's Mark Gurman claimed on Tuesday.

Gurman went so far as to say that the company’s “dream of offering a lightweight pair of AR glasses that people could wear all day now appears many years away -- if it happens at all.”

Read more
Why I hope Apple makes iOS 17 as boring as possible
iPhone 14 Pro with Widgy and Siri Suggested apps widget on a home screen

It’s a new year, which means Apple’s Worldwide Developers Conference will commence in just a few months now. At that time, we’re definitely going to see the next round of software updates for iOS, iPadOS, watchOS, macOS, and possibly, tvOS. On the iPhone and iPad front, this means we’ll be getting iOS 17 and iPadOS 17.

But according to recent reports, this may be a quieter year for software updates for current devices. That’s because it seems Apple is putting most of its attention on the long-rumored mixed-reality headset, which may finally be announced this year.

Read more
If iOS 17 is a letdown, you can blame this one Apple device
iOS 16 Work Focus with a Fantastical widget and two rows of work-related apps

Apple is going all out on developing the operating system for its secret mixed-reality headset. In fact, that ongoing effort could mean Apple’s other systems miss out on exciting new features this year, including iOS 17 and macOS 14.

According to a new report from journalist Mark Gurman, Apple has reassigned engineers to the headset’s operating system, dubbed xrOS, and away from other projects. That might be bad news if you were hoping for major software updates to the next iPhone, iPad, and Mac models.

Read more