Lily isn’t just a quadcopter, it’s an autonomous personal cameraman in the sky

Looking at the new Lily Camera, you’ll spot an immediate resemblance to various consumer quadcopter drones that are already available. But its creator, Antoine Balaresque, purposely avoids calling it a quadcopter or a drone, because those terms, he says, are used to describe something that requires an operator to control and meant to be dispatched far away. Lily, however, is the world’s first autonomous, smart “flying camera” that doesn’t rely on any human intervention, as it uses computer vision technology and GPS to track its user.

“We designed it as a camera, and never thought of it as a drone or quadcopter,” Balaresque says. “Think of it as your own personal cameraman.”

“Think of it as your own personal cameraman.”

And it’s that idea of a “personal cameraman” that initiated the creation for this robot. After reviewing photos from a vacation he took with his family, Balaresque noticed that his mother was missing from many of them, as she was behind the camera. What if he could create a flying camera that would hover around them, capturing photos and videos at the same time?

It sounds like science fiction, but that’s what he and cofounder Henry Bradlow did. Using their computer science background from the University of California, Berkeley, as well as their experience in the U.C. Berkley Robotics Laboratory and participation in “hackathon” events, the two created Lily, a five-man robotics company based in Menlo Park, California. The Lily Camera, a project that started two years ago, will be its first flagship product.

Rugged and waterproof, the Lily Camera is constructed using mainly off-the-shelf parts. It uses Sony’s IMX117 1/2.3-inch image sensor – the same as the one in GoPro’s Hero3+ Black – to shoot 12-megapixel stills and Full HD 1080p videos at 60 frames per second, with digital image stabilization. At nearly 3 pounds, the Lily Camera feels heavy, but that’s due in part to the rugged design and the internal sensors needed for autonomous operation, which includes an accelerometer, three-axis gyro, barometer, GPS, and front- and bottom-facing cameras. Balaresque says it’s normally difficult for startups to acquire the high-end parts like those in the Lily Camera, but it helps when the company’s advisers include a former GoPro brand manager and Dropcam exec.

The Lily Camera is an early example of what’s to come: Autonomous flying cameras will get smaller.

But it’s the technology that controls the Lily Camera that’s fascinating. Although the user never has to control the robot, he or she does need to hold or wear a small tracking device that relays the user’s position, distance, and speed (via Wi-Fi). In conjunction with its onboard sensors and computer-vision algorithms, the tracker determines how close or high to fly, as well as where to follow and circle the user. And because it knows the user’s exact positioning, the Lily Camera can take off and land on the user’s hand.

For safety, the Lily Camera has a maximum speed of 25 miles per hour, won’t fly higher than 50 feet or more than 100 feet away from the user, and, using its camera sensors, it won’t ever get too close to objects or subjects (there’s a 5-foot minimum distance). While it operates autonomously, the user can tell it where to be exactly (to the side, or circle 360 degrees) and zoom in or out, using the tracking device. In case it goes out of range or the battery gets low, it has a failsafe-landing feature. There’s also a kill-switch on the remote, if that ever becomes necessary.

The Lily Camera will also come with companion apps for either iOS or Android. Using a smartphone gives the user a live view of what Lily is recording, as well as other basic adjustments and the ability to create flight paths (you still can’t fly the Lily Camera, as that would defeat its purpose). Balaresque says the firmware upgradeable, which could give the robot new features in the future.

Using the Lily Camera is simple. Blue lights, which resemble a smiley face (too cute!), indicate it’s on. You can throw the unit into the air and it would take off, but during a demo Balaresque gave us, using a very early, crude prototype that’s completely 3D-printed, you can have Lily Camera take off and land from your hand. Now, it does seem a bit dangerous to have those fast-whirling propellers spinning near your hand, but we are happy to report that we escaped unscathed. With the tracker device in-hand, the prototype Lily Camera circled around Balaresque and never drifted away.

There were a few hiccups during the demonstration, but it’s still early days: the production unit won’t be available until February 2016. But Balaresque wants to show off Lily Camera’s autonomous capabilities, and from what we saw, it works.

Lily Camera will come completely set up, and is ready to use out of the box. Balaresque says he wanted the Lily Camera to be ready to fly and shoot when you want it to, without spending time putting it together. The whole thing fits inside a standard backpack, which is how Balaresque hauls it around.

As for shooting videos, the Lily Camera will have some interesting features. The tracking device also doubles as an audio recorder. This allows it to shoot a video while simultaneously recording your audio, even if it’s several feet away from you. With the sensors, the Lily Camera also knows when there’s a sudden change in activity. Say, for example, you’re riding on a skateboard, and along the way you perform a trick. The camera will detect that change and record the info, which you can use later when you’re editing and looking for highlights (it’s similar to a feature in the new Sony 4K Action Cam). And because it’s tracking GPS data, you can overlay the information over a recorded video too.

Photos and videos can be recording onto the 4GB internal memory, or a removable SD card. Unfortunately, like most quadcopters, the Lily Camera only has a flying time of 20 minutes.

lily-camera-central-park

Drones like DJI’s Phantom 2 Vision incorporate some sort of autonomous feature, but Balaresque says those still require some type of human activity and GPS waypoints. His device is designed to be completely autonomous. Over time, it can learn more about the user, like recognizing the colors of clothing. But the Lily Camera is also an early example of what’s to come: With miniaturization, Balaresque says flying cameras will get smaller and the cameras will get better, and the computer vision technology will get even smarter.

If you want to be one of the first to experience the Lily Camera, the company is taking preorders for $499; when it starts shipping, it will have a retail price of $999. Balaresque says this isn’t fundraiser, but more of an awareness campaign, as it has already lined up production. It’s too early for us to say how well the Lily Camera will work, as we’ve only seen a prototype with a low-quality VGA camera, but the final product should have a camera comparable to higher-end action cams. If it flies better than what Balaresque showed us, the Lily Camera could bring in a new way for consumers to shoot their photos and videos.

Features

Has Columbus, Ohio raised its IQ yet? A progress report from the mayor

Two years ago, the city of Columbus in Ohio received $40 million to pursue smart city initiatives. So, what’s happened since then? We spoke with its mayor, Andrew Ginther, to discuss progress and what’s ahead.
Mobile

New Galaxy S10 leaks showcase display sizes, confirm headphone jack return

While we still may be months away from an announcement, there's no doubt about it: Samsung is working hard on its successor to the Galaxy S9. Here's everything we know about the upcoming Samsung Galaxy S10.
Emerging Tech

Alphabet’s ‘Wing’ delivery drones are on their way to Europe

Google-parent Alphabet is taking its "Wing" drone delivery project to Helsinki in Finland. The move follows 18 months of trials in Australia, and gives the team the chance to test its technology in a harsh winter climate.
Emerging Tech

Scoot your commute! Here are the 9 best electric scooters on the market

Electric scooters are an affordable, convenient way to minimize your carbon footprint and zip around town. Check out 8 of our current favorites, whether you're working with a budget or have some cash to spare.
Emerging Tech

Sick of walking everywhere? Here are the best electric skateboards you can buy

Thanks for Kickstarter and Indiegogo, electric skateboards are carving a bigger niche than you might think. Whether you're into speed, mileage, or something a bit more stylish, here are the best electric skateboards on the market.
Emerging Tech

Hear the sounds of wind on Mars from InSight’s latest audio recording

NASA's InSight craft has captured the sound of the wind blowing on the surface of Mars. The audio file was picked up by the air pressure sensor and the seismometer which detected vibrations from the 10 to 15 mph winds in the area.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Folding canoes and ultra-fast water filters

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

New experiment casts doubt on claims to have identified dark matter

A South Korean experiment called COSINE-100 has attempted to replicate the claims of dark matter observed by the Italian DAMA/LIBRA experiment, but has failed to replicate the observations.
Emerging Tech

White dwarf star unexpectedly emitting bright ‘supersoft’ X-rays

NASA's Chandra Observatory has discovered a white dwarf star which is emitting supersoft X-rays, calling into question the conventional wisdom about how X-rays are produced by dying stars.
Business

Amazon scouted airport locations for its cashier-free Amazon Go stores

Representatives of Amazon Go checkout-free retail stores connected with officials at Los Angeles and San Jose airports in June to discuss the possibility of cashier-free grab-and-go locations in busy terminals.
Emerging Tech

Full-fledged drone delivery service set to land in remote Canadian community

Some drone delivery operations seem rather crude in their execution, but Drone Delivery Canada is building a comprehensive platform that's aiming to take drone delivery to the next level.
Emerging Tech

It’s no flying car, but the e-scooter had a huge impact on city streets in 2018

Within just a year, electric scooters have fundamentally changed how we navigate cities. From San Francisco to Paris, commuters have a new option that’s more fun than mass transit, easier than a bike, and definitely not a car.
Emerging Tech

Intel wants its fleet of drones to monitor America’s aging, unsafe bridges

Intel has signed a deal to use its Falcon 8+ drones to carry out bridge inspections. The hope is that these drones will be useful in spotting potential problems before they become serious.
Emerging Tech

Transplanted pig hearts show promise in baboon trials. Are humans next?

Researchers in Germany have successfully transplanted modified pig hearts into baboons. The results take us one step closer to ending organ transplant waiting lists for good. Here's why.