This algorithm turns World Cup games into 3D augmented reality

The men’s World Cup kicks off this week. As exciting as it promises to be, however, most of us will only get to watch it on flat television sets, as opposed to getting the three-dimensional experience of seeing it live and in person. Researchers from the University of Washington have come up with an augmented reality alternative, though. While it probably won’t be available to the masses in time for this year’s tournament, it does hint at one way in which fans at home may be able to enjoy sports games in the future.

What the researchers have developed is a machine learning algorithm capable of transforming 2D soccer clips into 3D reconstructions, which may be viewed using AR headsets like Microsoft’s HoloLens. The results allow viewers to turn flat surfaces like their desk or kitchen table into a virtual pitch, complete with three-dimensional action that you can circle around to view from different angles.

It’s not quite the equivalent of watching it in person, but it’s much closer than regular TV. And significantly cheaper, too!

“Our goal is to enhance the viewing experience of sports,” Konstantinos Rematas, one of the researchers on the project, told Digital Trends. “Instead of watching a soccer game or highlights on a flat 2D screen, we convert the original video into 3D and visualize it in augmented reality. Essentially the game becomes a hologram, where you can move around and look from different viewpoints, generating a more immersive experience.”

soccer augmented reality algorithm hologramsoccer
Konstantinos Rematas

As its input, the algorithm generating the AR experience requires just a single YouTube soccer video. Because this is not enough information to train an entire rendering system to “upconvert” 2D players into 3D, the neural network learned to estimate depth by playing the playing the EA video game FIFA 2018. Using the totality of this information, it can do a passable job of accurately gauging where players are on the pitch.

At present, the system is still a work in progress. For instance, the ball is not yet properly rendered (something which turns out to be pretty darn important in soccer) and the players remain two-dimensional cutouts. These are two improvements the researchers hope to make.

“The next steps are about increasing the quality of the game reconstruction,” Rematas continued. “In particular, we want to estimate precisely the location of the ball and reconstruct better the players — occlusions, full 3D shape estimation, [and more].” In addition, the researchers plan to extend the framework to also cover other sports such as basketball, hockey, and football.

A paper describing the work is available to read online.

Product Review

Brutal and emotional, 'God of War' is everything a blockbuster game should be

In a new land, on a new journey, God of War evolves beyond the button-mashing action of its youth into an action game with engaging combat and an engrossing story.
Movies & TV

The best movies on Netflix in August 2018, from ‘Her’ to ‘Jurassic Park’

Save yourself from hours wasted scrolling through Netflix's massive library by checking out our picks for the streamer's best movies available right now, whether you're into explosive action, subdued humor, or anything in between.
Movies & TV

How to watch NFL games online, with or without cable

The NFL's 2018 season is here, and we know you don't want to miss a moment of the action. Our comprehensive streaming guide will show you all the best options to watch the games online so you can make the right choice for you.
Gaming

‘Diablo III’ is bringing loot-filled goodness to the Nintendo Switch this year

Blizzard's acclaimed action-RPG Diablo III will be coming to Nintendo Switch later this year and it will include four-player cooperative play on the console, the legendary game studio announced.
Emerging Tech

Watch as a ‘lifeguard drone’ rescues a swimmer struggling at sea

These days, drones are finding a range of roles in a myriad of fields. Lifeguards, for example, are making use of the drone's ability to quickly deploy flotation devices while also offering an eye in the sky to survey the scene.
Emerging Tech

Wish you could fly? Here are the best drones on the market right now

To help you navigate the increasingly large and ever-changing landscape of consumer UAVs, here's a no-nonsense rundown of the best drones you can buy right now
Computing

Art-inspired face blurring can obscure identity without losing humanity

Researchers have developed an AI-generated anonymity system that “paints” over video frames, using inspiration from masters like Picasso and Van Gogh to reimagine a person’s appearance. The goal is to minimize outer resemblance but…
Emerging Tech

The best drone photos from around the world

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.
Emerging Tech

Experiment suggests that the best robot bosses could be jerks

Researchers have been investigating how future robot bosses can coax the most productivity out of us flesh-and-blood employees. The sad answer? Quite possibly by behaving like jerks.
Emerging Tech

VR experience shows caregivers what it’s like to live with Alzheimer’s disease

Los Angeles-based VR startup Embodied Labs has developed a virtual experience that puts users in the shoes of a person with Alzheimer’s disease, the most common type of dementia in the U.S.
Emerging Tech

Welcome to the uncanny valley: This robot head shows lifelike expressions

SEER is a robot head that is capable of recognizing the facial expressions of the people that it interacts with, and then mirroring their same expression back at them. Check it out.
Computing

Crypto-intrigued? Here's how to buy Bitcoin for the first time

Is it time to purchase your first Bitcoin investment? If you're ready to get involved in the cryptocurrency, we'll walk you through how to pick an exchange, how to choose the right wallet, and how to buy Bitcoin the safe way!
Emerging Tech

Awesome Tech You Can’t Buy Yet: inflatable backpacks and robotic submarines

Check out our roundup of the best new crowdfunding projects and product announcements that hit the Web this week. You can't buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

6 flying cars that you might actually be able to own (and fly) in your lifetime

Just like cellphones used to be only for the rich, soon taking a personal flying machine to work is going to be a part of everyday life. Here are six pieces of tech making that possible.