Skip to main content

Like a real-life mech, MIT engineers use VR to put you in the head of a robot

Operating Robots with Virtual Reality
Researchers from the Massachusetts Institute of Technology’s Computer Science and Artificial Intelligence Lab (CSAIL) have come up with a smart way to combine two of the most exciting emerging technologies — virtual reality (VR) and
Recommended Videos
robotics — by creating a smart new telepresence control system. Using one of Rethink Robotics’ Baxter robots, a VR headset, and maybe a page or two from mecha anime like the classic Mobile Suit Gundam Wing, they created a smart head-mounted “sensor display” system which puts human operators in the head of the robot they are controlling.

“A lot of jobs are difficult to do remotely, particularly in manufacturing and industry,” Jeffrey Lipton, one of the postdoctoral researchers who worked on the project, told Digital Trends. “A system like this could one day allow humans to supervise robots from a distance. This would enable employees to work from home, and could even open up manufacturing jobs to people with physical limitations, [such as those] who can’t lift heavy or bulky objects. Many industrial jobs are also terrible for human health — imagine servicing the inside of an airplane or working out on an oil rig. They can be dangerous, cramped and uncomfortable, but right now they need a human mind to understand, make decisions, and do movements. We think this model of teleoperation could allow us to keep humans safe and away from these sites while leveraging human mental capabilities.”

Jason Dorfman/MIT CSAIL
Jason Dorfman/MIT CSAIL

MIT’s smart system embeds the user in a virtual reality control room with multiple sensor displays, allowing the user to see everything the robot is seeing at any given moment. To execute tasks, the human then employs gestures — picked up courtesy of hand controllers — which are mirrored by the robot. Controls accessible by the human user appear virtually, rather than being physical controls. This allows them to change depending on what the robot has to carry out at any given time.

“We hope to extend this work to many different robots and scale up the trials to tasks beyond assembly,” Lipton continued, describing future research the CSAIL scientists hope to carry out. For more on the Baxter project, you can check out a research paper published earlier this year, titled “Baxter’s Homunculus: Virtual Reality Spaces for Teleoperation in Manufacturing.”

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Valve Index VR goes on sale again Monday in time for Half-Life: Alyx
Valve Index VR

Valve announced that the Index VR headset will be back in stock for a limited time this Monday, March 9. The Steam creator revealed the return of the anticipated headset on Twitter after weeks of it being out of stock due to Coronavirus related issues.

https://twitter.com/valvesoftware/status/1235311669045272577?s=21

Read more
Watch MIT’s Mini Cheetahs limber up for the robot apocalypse
watch mits mini cheetahs limber up for the robot apocalypse mit

Testing 9 New Mini Cheetahs

The Biomimetics Robotics team at the Massachusetts Institute of Technology (MIT) recently took a number of its talented Mini Cheetah robots for some fun in the park.

Read more
Juiced Bikes offers 20% off on all e-bikes amid signs of bankruptcy
Juiced Bikes Scrambler ebike

A “20% off sitewide” banner on top of a company’s website should normally be cause for glee among customers. Except if you’re a fan of that company’s products and its executives remain silent amid mounting signs that said company might be on the brink of bankruptcy.That’s what’s happening with Juiced Bikes, the San Diego-based maker of e-bikes.According to numerous customer reports, Juiced Bikes has completely stopped responding to customer inquiries for some time, while its website is out of stock on all products. There are also numerous testimonies of layoffs at the company.Even more worrying signs are also piling up: The company’s assets, including its existing inventory of products, is appearing as listed for sale on an auction website used by companies that go out of business.In addition, a court case has been filed in New York against parent company Juiced Inc. and Juiced Bike founder Tora Harris, according to Trellis, a state trial court legal research platform.Founded in 2009 by Harris, a U.S. high-jump Olympian, Juiced Bikes was one of the early pioneers of the direct-to-consumer e-bike brands in the U.S. market.The company’s e-bikes developed a loyal fandom through the years. Last year, Digital Trends named the Juiced Bikes Scorpion X2 as the best moped-style e-bike for 2023, citing its versatility, rich feature set, and performance.The company has so far stayed silent amid all the reports. But should its bankruptcy be confirmed, it could legitimately be attributed to the post-pandemic whiplash experienced by the e-bike industry over the past few years. The Covid-19 pandemic had led to a huge spike in demand for e-bikes just as supply chains became heavily constrained. This led to a ramp-up of e-bike production to match the high demand. But when consumer demand dropped after the pandemic, e-bike makers were left with large stock surpluses.The good news is that the downturn phase might soon be over just as the industry is experiencing a wave of mergers and acquisitions, according to a report by Houlihan Lokey.This may mean that even if Juiced Bikes is indeed going under, the brand and its products might find a buyer and show up again on streets and trails.

Read more