MIT’s latest A.I. is freakishly good at determining what’s going on in videos

Just a few frames of information telling a story are all we need to understand what is going on. This is, after all, the basis for comic books — which provide just enough of the important story beats for us to follow what has happened. Sadly, robots equipped with computer vision technology struggle to do this. Until now, at least.

Recently, the Massachusetts Institute of Technology (MIT) demonstrated a new type of artificial intelligence system which uses a neural network to fill in the blanks in video frames to work out what activity is taking place. The results make it astonishingly good at determining what is taking place in a video.

“The newly developed temporal relation modules enable the A.I. system to analyze a few key frames and estimate the temporal relation among them, in order to understand what’s going on in the video — such as a stack of objects [being] knocked down,” Bolei Zhou, a former Ph.D. student in MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), who is now an assistant professor of computer science at the Chinese University of Hong Kong, told Digital Trends. “Because the model works with key frames sparsely sampled from the incoming video, the processing efficiency is greatly improved, enabling real-time activity recognition.”

Another exciting property of the A.I. model is that it can anticipate and forecast what will happen early on by viewing frames of video. For instance, if it sees a person holding a bottle, the algorithm anticipates that they might take a drink or possibly squeeze it. Such anticipation abilities will be essential for artificial intelligence used in domains like autonomous driving, where it could proactively prevent accidents by guessing what will happen from moment to moment.

“It [could also] be used to monitor human behaviors, such as a home robot assistant which could anticipate your intention by delivering things beforehand,” Zhou continued. “It [could additionally be employed] to analyze the massive [number of] videos online, to do better video understanding and video retrieval.”

The next step of the project will involve increasing the A.I.’s ability to recognize a broader number of objects and activities. The team is also working with robotics researchers to deploy this activity recognition into robot systems. These could see enhanced perception and visual reasoning skills as a result.

Cars

How General Motors is preparing for an electric, autonomous, connected future

How does an established automaker like General Motors adapt to new tech trends? By looking for people and solutions outside the mainstream, says Ken Kelzer, GM VP of global vehicle components and subsystems.
Photography

Photography News: Raw edits on iPad and an A.I. research lab for PicsArt

In this week's photography news, Canon launched an iPad app that allows for RAW edits on the go. Popular mobile editing app PicsArt now has a research lab dedicated entirely to A.I.-powered tools.
Mobile

The Pixel 3 is just another phone. But the A.I. brains inside are unrivaled

The idea that artificial intelligence in smartphones will transform our lives has been heavily hyped, but the reality often disappoints. Google may not know how to make a beautiful phone, but its A.I. features are truly useful.
Emerging Tech

It’s alive! Scientists create ‘artificial life’ on a quantum computer

No, this isn't something from a Michael Crichton techno-thriller: Scientists really have created "artificial life" on a quantum computer for the first time ever. Here's why that matters.
Emerging Tech

New ‘parkour’ video shows Boston Dynamics robot training to overthrow humanity

Robots doing backflips? That's so 2017! In its latest jaw-dropping YouTube video, Boston Dynamics’ Atlas robot pulls off some frankly astonishing parkour stunts for our viewing pleasure.
Emerging Tech

With VR dinosaurs and ‘Minecraft,’ one hospital is making medicine less scary

From augmented reality rabbits on the wards to a Minecraft recreation of the hospital for kids to explore, one of the world's most renowned children's hospitals just got a major tech overhaul.
Emerging Tech

Will we ever fly supersonic again? Unraveling the concorde’s complex legacy

In a new book, Last Days of the Concorde, journalist and author Samme Chittum delves into the mindset that inspired engineers to design this marvel, the series of events that led to its fatal crash, and the possibility that commercial SSTs…
Emerging Tech

Check out the British Army’s beefy new bomb-disposal robot

The British Army is about to get an impressive new explosive ordnance disposal robot that is able to climb stairs, negotiate slopes, cut wires, and … oh, yes, dispose of bombs, too.
Emerging Tech

Kill it before it lays eggs! Crazy 32-leg robot moves like a cyborg sea urchin

We’ve seen one-legged, two-legged, four-legged and even six-legged robots, but researchers from Japan have gone way, way further with their latest project: A 32-legged robot. Check it out.
Emerging Tech

Leafy greens are grown by machines at new, automated Silicon Valley farm

Farming hasn't changed too much for hundreds of years. Now a new startup called Iron Ox has opened its first automated hydroponics farm, producing a variety of leafy greens tended by machines.
Emerging Tech

Awesome Tech You Can’t Buy Yet: DIY smartphones and zip-on bike tires

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Gaming

As deaf gamers speak up, game studios are finally listening to those who can’t

Using social media, personal blogs and Twitch, a small group of deaf and hard-of-hearing players have been working to make their voices heard and improve accessibility in the gaming industry.
Emerging Tech

From flying for fun to pro filmmaking, these are the best drones you can buy

In just the past few years, drones have transformed from a geeky hobbyist affair to a full-on cultural phenomenon. Here's a no-nonsense rundown of the best drones you can buy right now, no matter what kind of flying you plan to do.
Emerging Tech

Get your head in the clouds with the best vaporizers for flower and concentrates

Why combust dead plant matter when you could vaporize the good stuff and leave the leaves behind? Here's a rundown of the best vaporizers money can buy, no matter what your style is.