Skip to main content

MIT research may revolutionize structural engineering with a camera that ‘sees’ sound

Last summer, a team of researchers from MIT, Microsoft and Adobe discovered a way to reproduce audio by analyzing microscopic vibrations in recorded video footage. In the past few months, MIT Ph.D. candidate Abe Davis and his team took this video algorithm to another level: predicting how objects will move, according to Mashable.

Article updated by Chris Palermino 3/20/15: MIT technology has new implications

Recommended Videos

In a TED Talk on Monday in Vancouver, Davis demonstrated how the new algorithm works with a silent video of a bush moving gently in the breeze. After converting the file with this new software into a photo-video file, he clicked and prodded at a ‘still’ image of the bush with his cursor. His mouse created a realistic, virtual ‘wind,’ showing how the bush would move when it was blown.

While still in beta, this technology has a myriad of applications in fields like engineering, transportation and gaming. One example that has been suggested is using the algorithm to help pinpoint stress points in a bridge’s design. Imagine if this could help predict potential rail issues on trains, structural issues in buildings, or the ramifications of that last punch you threw in Tekken?

Original article from 8/5/14 by Drew Prindle

No audio? No problem. A team of researchers from MIT, Microsoft, and Adobe has developed an algorithm that allows them to reconstruct an audio signal even when only visual information is available. Using nothing more than a high speed camera and a special processing algorithm, the team was able to extract the audio signals in a room from 15 feet away through soundproof glass.

The Visual Microphone: Passive Recovery of Sound from Video

How? Well when you get down to it, sound waves are really just tiny disturbances in the air. Therefore, when sound waves strike something delicate –say, a piece of tin foil, a bag of chips, or the leaves of a house plant– they cause the object to vibrate ever so slightly. It’s just like how the rear-view mirror vibrates when your buddy turns cranks the subwoofer on his car stereo, just on a much more minute scale. The waves that occur when you’re just having a conversation are much weaker, and tend to cause more minute vibrations. To the naked eye, these disturbances are practically imperceptible — but with the help of high-speed photography, the team was able to capture movements as small as a tenth of a micrometer, and then use that information to guesstimate and rebuild the audio signal. Check out the video to see it in action:

As if that wasn’t incredible enough, the team also a demonstrated variation on the algorithm that allows them to extract sound from ordinary 60 frame per second video footage. Generally speaking, the sensors on most digital cameras are designed to scan images horizontally, one row at a time. Normally, that’s not a problem, but when you’re shooting fast-moving objects, this can sometimes leads to odd visual artifacts. The team was able to exploit this technological quirk to tease out information about the objects’ high-frequency vibration and, once again, use that info to reconstruct a usable (albeit murky) audio signal. It’s not quite as clear as the audio signal ripped from the high-speed camera, but even so, the fact that this kind of reconstruction is possible is mind blowing.

The researchers are presenting their work at the computer graphics conference Siggraph this month. Find out more here.

Please enable Javascript to view this content

Drew Prindle
Former Digital Trends Contributor
Drew Prindle is an award-winning writer, editor, and storyteller who currently serves as Senior Features Editor for Digital…
EVs top gas cars in German reliability report — but one weak spot won’t quit
future electric cars 2021 volkswagen id4 official 32

Electric vehicles are quietly crushing old stereotypes about being delicate or unreliable, and the data now backs it up in a big way. According to Germany’s ADAC — Europe’s largest roadside assistance provider — EVs are actually more reliable than their internal combustion engine (ICE) counterparts. And this isn’t just a small study — it’s based on a staggering 3.6 million breakdowns in 2024 alone.
For cars registered between 2020 and 2022, EVs averaged just 4.2 breakdowns per 1,000 vehicles, while ICE cars saw more than double that, at 10.4 per 1,000. Even with more EVs hitting the road, they only accounted for 1.2% of total breakdowns — a big win for the battery-powered crowd.
Among standout performers, some cars delivered exceptionally low breakdown rates. The Audi A4 clocked in at just 0.4 breakdowns per 1,000 vehicles for 2022 models, with Tesla’s Model 3 right behind at 0.5. The Volkswagen ID.4, another popular EV, also impressed with a rate of 1.0 – as did the Mitsubishi Eclipse Cross at 1.3. On the flip side, there were some major outliers: the Hyundai Ioniq 5 showed a surprisingly high 22.4 breakdowns per 1,000 vehicles for its 2022 models, while the hybrid Toyota RAV4 posted 18.4.
Interestingly, the most common issue for both EVs and ICE vehicles was exactly the same: the humble 12-volt battery. Despite all the futuristic tech in EVs, it’s this old-school component that causes 50% of all EV breakdowns, and 45% for gas-powered cars. Meanwhile, EVs shine in categories like engine management and electrical systems — areas where traditional engines are more complex and failure-prone.
But EVs aren’t completely flawless. They had a slightly higher rate of tire-related issues — 1.3 breakdowns per 1,000 vehicles compared to 0.9 for ICE cars. That could be due to their heavier weight and high torque, which can accelerate tire wear. Still, this trend is fading in newer EVs as tire tech and vehicle calibration improve.
Now, zooming out beyond Germany: a 2024 Consumer Reports study in the U.S. painted a different picture. It found that EVs, especially newer models, had more reliability issues than gas cars, citing tech glitches and inconsistent build quality. But it’s worth noting that the American data focused more on owner-reported problems, not just roadside breakdowns.
So, while the long-term story is still developing, especially for older EVs, Germany’s data suggests that when it comes to simply keeping you on the road, EVs are pulling ahead — quietly, efficiently, and with far fewer breakdowns than you might expect.

Read more
You can now lease a Hyundai EV on Amazon—and snag that $7,500 tax credit
amazon autos hyundai evs lease ioniq 6 n line seoul mobility show 2025 mk08

Amazon has changed how we shop for just about everything—from books to furniture to groceries. Now, it’s transforming the way we lease cars. Through Amazon Autos, you can now lease a brand-new Hyundai entirely online—and even better, you’ll qualify for the full $7,500 federal tax credit if you choose an electric model like the Ioniq 5, Ioniq 6, or Kona EV.
Here’s why that matters: As of January 2025, Hyundai’s EVs no longer qualify for the tax credit if you buy them outright, due to strict federal rules about battery sourcing and final assembly. But when you lease, the vehicle is technically owned by the leasing company (Hyundai Capital), which allows it to be classified as a “commercial vehicle” under U.S. tax law—making it eligible for the credit. That savings is typically passed on to you in the form of lower lease payments.
With Amazon’s new setup, you can browse Hyundai’s EV inventory, secure financing, trade in your current vehicle, and schedule a pickup—all without leaving the Amazon ecosystem.
It’s available in 68 markets across the U.S., and pricing is fully transparent—no hidden fees or haggling. While Hyundai is so far the only automaker fully participating, more are expected to join over time.
Pioneered by the likes of Tesla, purchasing or leasing vehicles online has been a growing trend since the Covid pandemic.
A 2024 study by iVendi found that 74% of car buyers expect to use some form of online process for their next purchase. In fact, 75% said online buying met or exceeded expectations, with convenience and access to information cited as top reasons. The 2024 EY Mobility Consumer Index echoed this trend, reporting that 25% of consumers now plan to buy their next vehicle online—up from 18% in 2021. Even among those who still prefer to finalize the purchase at a dealership, 87% use online tools for research beforehand.
Meanwhile, Deloitte’s 2025 Global Automotive Consumer Study reveals that while 86% of U.S. consumers still want to test-drive a vehicle in person, digital tools are now a critical part of the buying journey.
Bottom line? Amazon is making it easier than ever to lease an EV and claim that tax credit—without the dealership hassle. If you're ready to plug in, it might be time to add to cart.

Read more
Humanoid robots race against humans at unique half-marathon in China
A humanoid robot running in a half marathon.

You may have seen robots dancing like the music icon Mick Jagger, doing parkour, or even painting on a canvas. Tesla’s Optimus humanoid robot is eagerly anticipated, while Google and Meta are also planning to enter the field. The competition in the East, however, is on a different level altogether.

China just put humanoid robots to the test in the world’s first race of its kind, where they ran alongside humans in a half-marathon. A total of 21 robots lined up for the event in the Yizhuang half-marathon, following a long spell of supervised learning on roads. 

Read more