Lily isn’t just a quadcopter, it’s an autonomous personal cameraman in the sky

Looking at the new Lily Camera, you’ll spot an immediate resemblance to various consumer quadcopter drones that are already available. But its creator, Antoine Balaresque, purposely avoids calling it a quadcopter or a drone, because those terms, he says, are used to describe something that requires an operator to control and meant to be dispatched far away. Lily, however, is the world’s first autonomous, smart “flying camera” that doesn’t rely on any human intervention, as it uses computer vision technology and GPS to track its user.

“We designed it as a camera, and never thought of it as a drone or quadcopter,” Balaresque says. “Think of it as your own personal cameraman.”

“Think of it as your own personal cameraman.”

And it’s that idea of a “personal cameraman” that initiated the creation for this robot. After reviewing photos from a vacation he took with his family, Balaresque noticed that his mother was missing from many of them, as she was behind the camera. What if he could create a flying camera that would hover around them, capturing photos and videos at the same time?

It sounds like science fiction, but that’s what he and cofounder Henry Bradlow did. Using their computer science background from the University of California, Berkeley, as well as their experience in the U.C. Berkley Robotics Laboratory and participation in “hackathon” events, the two created Lily, a five-man robotics company based in Menlo Park, California. The Lily Camera, a project that started two years ago, will be its first flagship product.

Rugged and waterproof, the Lily Camera is constructed using mainly off-the-shelf parts. It uses Sony’s IMX117 1/2.3-inch image sensor – the same as the one in GoPro’s Hero3+ Black – to shoot 12-megapixel stills and Full HD 1080p videos at 60 frames per second, with digital image stabilization. At nearly 3 pounds, the Lily Camera feels heavy, but that’s due in part to the rugged design and the internal sensors needed for autonomous operation, which includes an accelerometer, three-axis gyro, barometer, GPS, and front- and bottom-facing cameras. Balaresque says it’s normally difficult for startups to acquire the high-end parts like those in the Lily Camera, but it helps when the company’s advisers include a former GoPro brand manager and Dropcam exec.

The Lily Camera is an early example of what’s to come: Autonomous flying cameras will get smaller.

But it’s the technology that controls the Lily Camera that’s fascinating. Although the user never has to control the robot, he or she does need to hold or wear a small tracking device that relays the user’s position, distance, and speed (via Wi-Fi). In conjunction with its onboard sensors and computer-vision algorithms, the tracker determines how close or high to fly, as well as where to follow and circle the user. And because it knows the user’s exact positioning, the Lily Camera can take off and land on the user’s hand.

For safety, the Lily Camera has a maximum speed of 25 miles per hour, won’t fly higher than 50 feet or more than 100 feet away from the user, and, using its camera sensors, it won’t ever get too close to objects or subjects (there’s a 5-foot minimum distance). While it operates autonomously, the user can tell it where to be exactly (to the side, or circle 360 degrees) and zoom in or out, using the tracking device. In case it goes out of range or the battery gets low, it has a failsafe-landing feature. There’s also a kill-switch on the remote, if that ever becomes necessary.

The Lily Camera will also come with companion apps for either iOS or Android. Using a smartphone gives the user a live view of what Lily is recording, as well as other basic adjustments and the ability to create flight paths (you still can’t fly the Lily Camera, as that would defeat its purpose). Balaresque says the firmware upgradeable, which could give the robot new features in the future.

Using the Lily Camera is simple. Blue lights, which resemble a smiley face (too cute!), indicate it’s on. You can throw the unit into the air and it would take off, but during a demo Balaresque gave us, using a very early, crude prototype that’s completely 3D-printed, you can have Lily Camera take off and land from your hand. Now, it does seem a bit dangerous to have those fast-whirling propellers spinning near your hand, but we are happy to report that we escaped unscathed. With the tracker device in-hand, the prototype Lily Camera circled around Balaresque and never drifted away.

There were a few hiccups during the demonstration, but it’s still early days: the production unit won’t be available until February 2016. But Balaresque wants to show off Lily Camera’s autonomous capabilities, and from what we saw, it works.

Lily Camera will come completely set up, and is ready to use out of the box. Balaresque says he wanted the Lily Camera to be ready to fly and shoot when you want it to, without spending time putting it together. The whole thing fits inside a standard backpack, which is how Balaresque hauls it around.

As for shooting videos, the Lily Camera will have some interesting features. The tracking device also doubles as an audio recorder. This allows it to shoot a video while simultaneously recording your audio, even if it’s several feet away from you. With the sensors, the Lily Camera also knows when there’s a sudden change in activity. Say, for example, you’re riding on a skateboard, and along the way you perform a trick. The camera will detect that change and record the info, which you can use later when you’re editing and looking for highlights (it’s similar to a feature in the new Sony 4K Action Cam). And because it’s tracking GPS data, you can overlay the information over a recorded video too.

Photos and videos can be recording onto the 4GB internal memory, or a removable SD card. Unfortunately, like most quadcopters, the Lily Camera only has a flying time of 20 minutes.

lily-camera-central-park

Drones like DJI’s Phantom 2 Vision incorporate some sort of autonomous feature, but Balaresque says those still require some type of human activity and GPS waypoints. His device is designed to be completely autonomous. Over time, it can learn more about the user, like recognizing the colors of clothing. But the Lily Camera is also an early example of what’s to come: With miniaturization, Balaresque says flying cameras will get smaller and the cameras will get better, and the computer vision technology will get even smarter.

If you want to be one of the first to experience the Lily Camera, the company is taking preorders for $499; when it starts shipping, it will have a retail price of $999. Balaresque says this isn’t fundraiser, but more of an awareness campaign, as it has already lined up production. It’s too early for us to say how well the Lily Camera will work, as we’ve only seen a prototype with a low-quality VGA camera, but the final product should have a camera comparable to higher-end action cams. If it flies better than what Balaresque showed us, the Lily Camera could bring in a new way for consumers to shoot their photos and videos.

Emerging Tech

Autonomous ships are coming, and we’re not ready for them

Cars may dominate today’s discussion about the future of autonomous transportation, but some of the world’s largest maritime companies are betting big on autonomous shipping.
Cars

Awesome Tech You Can’t Buy Yet: Drone lens, laser synth, and more

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Photography

Under 1 pound, Sigma Fp is the world’s smallest full-frame camera

Built around the Leica L mount and using a 24-megapixel sensor, the Sigma Fp is Sigma's first full-frame mirrorless camera and the smallest such camera in existence. It can shoot 18 fps bursts and offers 12-bit RAW video output.
Emerging Tech

Move over, Spot. Anymal is a four-legged dog robot with all kinds of new tricks

Boston Dynamics isn’t the only company building robotic dogs. Swiss robotics company Anybotics has one of its own design -- and it's pretty darn impressive. We spoke with Anybotics co-founder Péter Fankhauser to find out just what it's…
Emerging Tech

See a gargantuan dust storm covering the north pole of Mars

A dust storm around Mars' north pole has been imaged by the Mars Express orbiter. Localized dust storms are common on Mars, but occasionally one expands into a planet-wide event like the one which caused the demise of the Opportunity rover.
Emerging Tech

The Very Large Telescope captures the beautiful remnants of a dying star

The VLT has captured a beautiful cosmic object, the planetary nebula named Abell 24. Located in constellation of Canis Minor (The Lesser Dog), it is a swirl of dust and gas which is illuminated by the core of a dead star.
Emerging Tech

Stallone in Terminator 2? How one deepfake prankster is changing cinema history

Ever wanted to see The Shining with Jim Carrey instead of Jack Nicholson? How about Stallone in Terminator 2: Judgement Day instead of everyone's favorite governator? Thanks to deepfakes, it's now possible -- just ask YouTuber Ctrl Shift…
Emerging Tech

Astronomers have spotted a moon forming around a proto-Jupiter

Astronomers have spotted a young planet with a disk of gas and dust around it which is similar to the one from which the moons of Jupiter were born. The planet PDS 70 b is in the process of forming and is located 370 light-years away.
Emerging Tech

NASA thinks 3D-printing spacecraft parts in orbit will help Moon to Mars mission

NASA funded the demonstration by a small spacecraft named Archinaut One to manufacture and assemble parts while in space. NASA believes that the technology will change future space exploration, including its Moon to Mars initiative.
Emerging Tech

Flyboard Air soars over Paris during France’s national day celebrations

Franky Zapata, the inventor of the jet-powered Flyboard Air, showed off his machine during France's Bastille Day celebrations on Sunday. The impressive display was even given a nod of approval by French President Emmanuel Macron.
Deals

Save with Prime Day deals on DNA kits from Ancestry, 23andme, and Living DNA

Prime Day is a great time to order a DNA kit. Over the years, kits from various providers have been deeply discounted -- and this year's no exception. Kits from AncestryDNA, 23andMe, and Living DNA are on sale for as much as half off…
Emerging Tech

Airport hotel builds a full-sized flight simulator into one of its guest rooms

Aviation enthusiasts flying out of Tokyo's Haneda Airport, there's a new hotel room designed just for you. It features a full-sized Boeing 737-800 flight simulator, though you'll have to pay extra to use it.
Emerging Tech

Like the real thing, this robot ant colony is more than the sum of its parts

Researchers have built a robot ant colony, consisting of tiny 10-gram robots which are able to communicate with one another, assign roles among themselves, and work together to complete tasks.
Emerging Tech

Watch live: Buzz Aldrin and Michael Collins reflect on the moon landing

To celebrate the 50th anniversary of the famous Apollo 11 mission, NASA will hold a live broadcast featuring a retrospective and presentations by the astronauts involved. You can watch the event live on July 16 at 6:15 a.m. PT.