IBM’s Holodeck-style classroom tech makes language-learning apps look primitive

Whether it’s apps like Duolingo or the ease of travel, there are plenty of ways technology has made it more straightforward to learn a second (or third or fourth …) language. Now, IBM Research and New York’s Rensselaer Polytechnic Institute have come up with an entirely new high-tech approach — and it totally reminds us of the Vulcan school from 2009’s Star Trek movie.

Called the Cognitive Immersive Room (CIR), it pairs an A.I.-powered chatbot smart assistant with a 360-degree panoramic display system to place users into a variety of immersive locations to try out their language skills. Currently, it’s being used for Mandarin, which is widely considered to be among the more difficult languages for Westerners to learn. The CIR setup drops students into scenarios like a restaurant in China and a tai chi class, where they can put their Mandarin to the test.

“The Cognitive Immersive Classroom is a very important use case for us,” Hui Su, Director of the Cognitive and Immersive Systems Lab at IBM Research, told Digital Trends. “We are currently focusing on language learning, and are building the classroom for students who study Mandarin as a second language. In this classroom, students are immersed into a 360-degree [environment], surrounded by real-life scenes such as a restaurant, street market, and garden. They can talk to the avatars, such as the waiters and salesmen on the screens, and perform tasks like ordering drinks and food and buying products. These tasks are developed as games for students to complete. In these games, the students will be able to practice and learn Chinese languages in a culture-rich environment, and talk to the A.I. agents who can understand what they just said.”

ibm 360 immersive language learning ariel shot translation

To make the experience even more immersive, the room is kitted out with cameras, Kinect devices, and microphones. This makes it possible to, for instance, point at an object and say “what is that?” and have the question answered. The microphones, meanwhile, can pick up on every nuance of a speaker’s words.

“A pitch contour analysis function was developed to visualize the difference between the students’ pronunciations and those by native speakers, so that students could see easily where their tone pronunciations need to be improved,” Su said. “The classroom is a brand-new initiative to integrate A.I. technologies and human-scale immersive technologies together for Mandarin teaching. We are using IBM Watson speech recognition and natural language understanding for English and Chinese.”

Coming soon to a classroom near you. Or, at least, we really, really hope it is.

Emerging Tech

Awesome Tech You Can’t Buy Yet: Grow veggies indoors and shower more efficiently

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

DeepSqueak is a machine learning A.I. that reveals what rats are chatting about

Want to know what rats are squeaking about? You'd better check out DeepSqueak, the new deep learning artificial intelligence developed by researchers at the University of Washington.
Emerging Tech

Bees can do arithmetic, setting the scientific community abuzz

A new study has found something remarkable: Bees can do basic arithmetic. Researchers showed that bees could use colors as representations for numbers and then use those colors for addition and subtraction.
Movies & TV

The best shows on Netflix, from 'Haunting of Hill House’ to ‘Norsemen’

Looking for a new show to binge? Lucky for you, we've curated a list of the best shows on Netflix, whether you're a fan of outlandish anime, dramatic period pieces, or shows that leave you questioning what lies beyond.
Emerging Tech

The Great White Shark’s genome has been decoded, and it could help us end cancer

In a significant step for marine and genetic science, researchers have decoded the genome of the great white shark. The genetic code revealed a wealth of insight into what makes these creatures so successful from an evolutionary standpoint.
Emerging Tech

‘Guerrilla rainstorm’ warning system aims to prevent soakings, or worse

Japanese researchers have created a "guerrilla rainstorm" early-warning system aimed at preventing severe soakings, or worse. The team hopes to launch the system before the 2020 Tokyo Olympics.
Emerging Tech

We tried a $500 electronic dab rig, and now we can’t go back to normal vaporizers

Induction heating is the future of cannabis vaporizers. Loto Labs wowed us with what likely is the best concentrate vaporizer on the market today. With a $500 price tag, it's expensive, but it should definitely be your next dab rig.
Mobile

Barbie’s Corvette ain’t got nothing on Sphero’s fully programmable robot car

Sphero is known for devices like the Sphero Bolt and BB-8 Star Wars toy, but now the company is back with another addition to its lineup -- the Sphero RVR. The RVR is a fully programmable robot car that can be expanding with different…
Emerging Tech

Japanese spacecraft will collect a sample from asteroid Ryugu by shooting at it

The Japanese spacecraft Hayabusa 2 will soon touch down on the asteroid Ryugu, where it will collect a sample by shooting a bullet into the soil. The sample will be returned to Earth in 2020 to learn about the formation of asteroids.
Emerging Tech

Hong Kong’s vision for a smart prison is a full-blown Orwellian nightmare

Hong Kong wants to bring prisons up to date by introducing new location-tracking wristbands for inmates, and a robot arm whose job is to comb through poop on the lookout for contraband.
Emerging Tech

No faking! Doctors can now objectively measure how much pain you’re in

Researchers at Indiana University School of Medicine have discovered the blood biomarkers that can objectively reveal just how much pain a patient is in. Here's why that's so important.
Emerging Tech

SeaBubbles’ new electric hydrofoil boat is the aquatic equivalent of a Tesla

What do you get if you combine a Tesla, a flying car, and a sleek boat? Probably something a bit like SeaBubbles, the French "flying" boat startup which offers a fresh spin on the hydrofoil.
Emerging Tech

Israel will launch world’s first privately funded moon mission tomorrow

This week will see the world's first privately funded lunar mission launch. Israel's first mission to the moon will be launched aboard SpaceX's Falcon 9 rocket on Thursday, February 21.
Emerging Tech

FDA warns about the dangers of anti-aging blood transfusions

It turns out injecting old people with blood from healthy youngsters may not be the answer to health rejuvenation. That’s according to the FDA, which says such claims are dangerous junk science.