Shrimp eyes inspire new camera focused on helping self-driving cars see better

Have you ever looked into an animal’s eyes and thought, ‘I wonder how they see the world?’ We have. We do it all the time. We wonder, for example, what our cat sees as she’s stalking through the woods and how the colorful world appears to a colorblind dog. And when a cockroach scurries across the kitchen counter late at night, we wonder if it can sense the disgust in our hazy gaze.

We know we’re not the only ones that think these things. Viktor Gruev, an electrical and computer engineer at the University of Illinois at Urbana-Champaign, shares our intrigue — albeit, from a more technical standpoint.

Gruev and his colleagues recently developed a camera prototype inspired by the mantis shrimp, which have one of the most complex visual systems in the animal kingdom. By mimicking the marine crustacean’s vision, the researchers were able to make significant improvement on today’s commercial cameras and may help mitigate accidents by letting self-driving vehicles see more clearly.

“We have demonstrated a new camera prototype inspired by the visual system of the mantis shrimp, which has enabled us to capture polarization information under high dynamic range,” Gruev told Digital Trends. “This is important because polarization of light is a fundamental property of light that we [as humans] are blind to. It provides key information about the imaged environment, such as material properties of the objects and their geometric shape. It is also useful to capture this information when driving through hazy or foggy conditions, where polarization information can improve detection visibility of objects on the road.”

As for dynamic range, this is a measurement of the brightest and darkest regions that a camera can capture in a given instant. Imagine driving through a dark tunnel and exiting into a bright and sunny day. For a few seconds, that sunlight is practically blinding. An increased dynamic range allows cameras to adjust to that transition more smoothly.

Inspired by recent self-driving car crashes, Gruev decided to address the problem of pedestrian detection through biomimicry. He and his team adopted traits from the mantis shrimp, which are capable of seeing bright and dark images simultaneously.

“There are two innovations in this work,” Gruev said. “The pixel and nanomaterials that we use for polarization sensing. The pixel is novel because it operates very differently than regular cameras, which enables a logarithmic response to the light intensity. This change enabled us to extend the dynamic range of the camera from around 60 dB, which is typical for regular cameras, to around 140 dB. … Then we added aluminum nanowires on each pixel in the imager to be able to sense polarization properties of light.”

Gruev envisions his camera being used to support self-driving cars and underwater GPS. He said they’re currently working with car manufacturers to commercialize the technology.

A paper detailing the research was recently published in the journal Optica.

Emerging Tech

Awesome Tech You Can’t Buy Yet: heat-powered watches, phone cases with reflexes

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!

The most expensive Galaxy S10 could be the priciest Galaxy phone we've seen

Not long now; with 2019 underway, the Samsung Galaxy S10 is almost here. Before it arrives, here's absolutely everything you need to know about all three of Samsung's next flagships.

Muscle cars, trucks, and EVs roared into the subdued 2019 Detroit Auto Show

The 2019 Detroit Auto Show was the quietest edition of the event in recent memory, but that doesn't mean nothing significant happened inside the Cobo Center. Here are the new cars and concepts we saw at the show.

What to look for and what to avoid when buying a camera

Looking to buy a new camera? Our comprehensive camera guide for 2016 has answers to any camera or photography questions you might ask, whether in regards to pricing, image quality, or weatherproofing.
Emerging Tech

The enormous ‘Flying Bum’ moves toward a commercial design

A prototype of the world's largest aircraft is being retired as the company behind it prepares to build a production model. The new Airlander 10, also known as the "Flying Bum," could be ready for commercial use by 2025.
Emerging Tech

Face-scanning A.I. can help doctors spot unusual genetic disorders

Facial recognition can unlock your phone. Could it also be used to identify whether a person has a rare genetic disorder, based on their facial features? New research suggests it can.
Emerging Tech

Yamaha’s new app lets you tune your motorcycle with a smartphone

It used to be that if you wanted to tune your motorcycle’s engine and tweak its performance, you needed specialized tools and even more specialized knowledge. Yamaha’s new Power Tuner app changes that.
Emerging Tech

Lasers and bovine breathalyzer help determine how much methane cows produce

Cow farts and belches don't sound like catastrophic threats, but they contribute to the massive amounts of methane in the atmosphere. Recently, scientists set out to establish the numbers.
Emerging Tech

Researchers discover a way to make 3D printing 100 times faster using light

Researchers at the University of Michigan have invented a new method of 3D printing which is up to 100 times faster than conventional 3D-printing processes. Here's how it works and why it could prove a game-changer for 3D printing.
Emerging Tech

Why wait? Here are some CES 2019 gadgets you can buy right now

Companies come to CES to wow us with their cutting edge technology, but only a few products are slated to hit the market right away. Here is our list of the best CES 2019 tech you can buy right now.
Emerging Tech

Drones: New rules could soon allow flights over people and at night

With commercial operators in mind, the U.S. government is looking to loosen restrictions on drone flights with a set of proposals that would allow the machines greater freedom to fly over populated areas and also at night.
Emerging Tech

Short film celebrates New Yorker’s amazing robot costumes

New York City resident Peter Kokis creates stunning robot costumes out of household trash. His designs are huge, heavy, and extremely intricate, and never fail to turn heads when he's out and about.
Emerging Tech

In a first for humankind, China is growing plants on the moon

Having recently landed a probe on the far side of the moon, China announced that it managed to grow the first plant on the moon, too. Here's why that matters for deep space travel.
Emerging Tech

Ford’s sweaty robot bottom can simulate 10 years of seat use in mere days

Ford has developed 'Robutt,' a sweaty robot bottom that's designed to simulate the effects of having a pair of human buttocks sitting on its car seats for thousands of hours. Check it out.