Skip to main content

The key to next-gen 3D vision for autonomous cars is … praying mantis goggles?

New 3D vision discovered in praying mantises
Researchers at the U.K.’s Newcastle University may have discovered a new way to more efficiently model computer vision systems — and it’s all thanks to a multi-year project that involves putting tiny 3D goggles on praying mantises.

“The 3D glasses we use are similar to the old-school 3D glasses we used to use in the cinema,” Dr. Vivek Nityananda, part of Newcastle’s Institute of Neuroscience, told Digital Trends. “The idea behind these is that having different color filters on each eye allows each eye to see a different set of images that the other eye can’t see. By manipulating the geometry of the images the eyes see we could create the 3D illusions, exactly like you see in the cinema. For our glasses, we cut out teardrop shapes from the color filters and fitted them onto the mantis using beeswax. They were then allowed to recover overnight, and we could try them in experiments the next day. Since we used beeswax, we could melt the wax and remove the glasses once the experiment was over.”

The glasses allowed the researchers to demonstrate that mantises have a way of computing stereoscopic distance to objects that differs from that of any other animal, including humans. Instead of comparing the stationary luminance patterns across the two eyes, as other vision systems do, mantises rely on matching motion or other kinds of change in each eyes’ view of the world.

Newcastle University
Newcastle University

This could be exciting because detecting change simultaneously in both eyes is a simpler computational problem than figuring out which details of each eye’s view matches those of the other. It suggests that mantis stereo vision could be easier to model in computer vision applications and robotics, especially in situations where less computational power is available.

“So far we’ve been designing these systems to see and react to the world in the same way we do, but our brains are immensely complex and power hungry machines that may not be the ideal biological model to inspire efficient design,” Dr. Ghaith Tarawneh, another researcher on the project, told Digital Trends. “Mantis 3D vision uses the exact sort of computational trickery that challenges our way of seeing things: A view of the world radically different from ours, but evidently more fit for purpose. Adapting autonomous cars and drones after insect vision can give them the same capabilities: A superior ability to see the details that matter with shorter reaction times and longer battery life.”

A paper describing the work was recently published in the journal Current Biology.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Bosch wants to give your car’s instrument cluster a full 3D makeover
bosch bringing 3d technology to in car information and infotainment screens display 2

Previous

Next

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more
AI turned Breaking Bad into an anime — and it’s terrifying
Split image of Breaking Bad anime characters.

These days, it seems like there's nothing AI programs can't do. Thanks to advancements in artificial intelligence, deepfakes have done digital "face-offs" with Hollywood celebrities in films and TV shows, VFX artists can de-age actors almost instantly, and ChatGPT has learned how to write big-budget screenplays in the blink of an eye. Pretty soon, AI will probably decide who wins at the Oscars.

Within the past year, AI has also been used to generate beautiful works of art in seconds, creating a viral new trend and causing a boon for fan artists everywhere. TikTok user @cyborgism recently broke the internet by posting a clip featuring many AI-generated pictures of Breaking Bad. The theme here is that the characters are depicted as anime characters straight out of the 1980s, and the result is concerning to say the least. Depending on your viewpoint, Breaking Bad AI (my unofficial name for it) shows how technology can either threaten the integrity of original works of art or nurture artistic expression.
What if AI created Breaking Bad as a 1980s anime?
Playing over Metro Boomin's rap remix of the famous "I am the one who knocks" monologue, the video features images of the cast that range from shockingly realistic to full-on exaggerated. The clip currently has over 65,000 likes on TikTok alone, and many other users have shared their thoughts on the art. One user wrote, "Regardless of the repercussions on the entertainment industry, I can't wait for AI to be advanced enough to animate the whole show like this."

Read more