Microsoft is sending its HoloLens to the ISS so astronauts can use augmented reality

As if floating through space weren’t awesome enough, NASA just announced that it plans on sending Microsoft’s revolutionary HoloLens technology to the International Space Station later this week. Officially dubbed Project Sidekick, the partnership isn’t merely a test vehicle for the augmented reality unit, but rather an intuitive way for astronauts to work and communicate more efficiently. Set to launch this week as part of a commercial resupply mission, the HoloLens devices will travel aboard the rebuilt Cygnus spacecraft.

Though the project suffered a minor setback last June, NASA’s decision to move forward with its Microsoft collaboration was fueled by the incredible advantages the HoloLens could provide to astronauts. As mentioned above, the agency feels that augmented reality has huge potential to make working in space easier for astronauts. Whereas a device like the Oculus Rift actually produces an independently created environment, Microsoft’s tech would superimpose digital elements on top of what astronauts actually see.

NASA and Microsoft engineers test Project Sidekick in a weightless chamber
NASA and Microsoft engineers test Project Sidekick in a weightless chamber NASA

“As opposed to virtual reality which removes you from the real world, with HoloLens the real world plays just as much into the experience as the digital assets,” says Microsoft’s Alex Kipman. “We’re adding photons to the back of your eye. They feel anchored and pinned in the real world, but are see through.”

By making use of the tech’s different functions, astronauts aboard the ISS can actually work with those on the ground in real time. With the HoloLens switched into remote expert mode, teams on the ground have the ability to see what the astronaut sees, remotely draw notes or directions, and talk directly to the wearer through Skype. Moreover, this mode makes it easier for astronauts to consult numerous experts or scientists while conducting various research projects.

“HoloLens and other virtual and mixed reality devices are cutting edge technologies that could help drive future exploration and provide new capabilities to the men and women conducting critical science on the International Space Station,” said ISS program director Sam Sciemi last summer. “This new technology could also empower future explorers requiring greater autonomy on the journey to Mars.”

NASA and Microsoft's OnSight project
NASA and Microsoft’s OnSight project NASA

Becuase Project Sidekick possesses a massive amount of upside, NASA and Microsoft worked overtime to ensure that sending the tech to the ISS wouldn’t be for naught. Aside from extensive microgravity and processing unit testing, the two organizations spent many hours making sure the HoloLens wouldn’t cause any discomfort or disorientation to those wearing it.

As can be the case for some people using virtual or augmented reality devices, headaches and nausea are typical side effects from prolonged use. To fight this, a stabilizing product was manufactured which actively keeps holographs in space and time completely stable. What this does is allow the astronaut’s senses to react as if it were grounded in the real world, lessening the amount of flickering in the images and making it easier to wear for extended periods of time.

Moving forward, Project Sidekick is just the tip of the NASA and Microsoft partnership iceberg. Also under development between the two is a revolutionary software program called OnSight which would also make use of the HoloLens. Under the guidance of NASA’s Jet Propulsion Laboratory, OnSight would allow scientists on Earth to work alongside astronauts traveling to Mars, virtually taking them to the Red Planet while they physically remain on Earth.

Scheduled to broadcast on NASA’s online streaming client NASA TV, the commercial resupply mission will take off from the Cape Canaveral Air Force Base in Florida this Thursday.


Adobe’s craziest new tools animate photos, convert recordings to music in a click

Adobe shared a glimpse behind the scenes at what's next and the Creative Cloud future is filled with crazy A.I.-powered tools, moving stills, and animation reacting to real-time tweets.

These gloves will make virtual reality feel even more immersive

Scientists from EPFL and ETH Zurich have come up with a thin and light VR glove which makes it so that a touch of an object in the virtual world equates to the physical touch you would expect in real life.
Emerging Tech

Here’s how Microsoft’s Hololens is helping NASA build the new Orion spacecraft

Lockheed Martin is turning to Microsoft’s mixed reality Hololens smartglasses to help build NASA's Orion spacecraft, which could one day help rocket astronauts as far afield as Mars.
Movies & TV

The best movies on Amazon Prime right now (October 2018)

Prime Video provides subscribers with access to a host of fantastic films, but sorting through the catalog can be an undertaking. Luckily, we've done the work for you. Here are the best movies on Amazon Prime Video right now.

Skydio’s self-flying drone now has an Apple Watch app for flight prep

Skydio's clever R1 autonomous drone now has its own Apple Watch app, making flight preparations simpler than ever. The $2,000 flying machine is now also selling at its first retail outlet — Apple Stores in North America.
Emerging Tech

Light-swallowing room promises Call of Duty fans the blackest of ops

What's it like to be in a room fully painted with the world's darkest material, Vantablack? The makers of one of the year's top video games teamed up with Vantablack scientists to find out.
Emerging Tech

Scientists created a condom that self-lubricates during sex. You’re welcome

Researchers from Boston University have invented a special coating for condoms which make them respond to bodily fluids by becoming more slippery. Here's how their new breakthrough works.
Emerging Tech

Are e-cigarettes safe? Here’s what the most recent science says

Ecigarettes are widely regarded and advertised as a healthier alternative to cigarettes for people who are trying to kick the smoking habit. How safe are these cigarette alternatives? We went deep into the recent scientific literature to…
Emerging Tech

You’re so vein: Palm-based biometric system could help confirm your identity

Move over, Face ID! The next biometric security systems could rely on analyzing the unique vein patterns in your palm print. Here are some of the ways the technology could prove useful.
Emerging Tech

For only $4,950, you can get jetpack lessons from the world’s only instructor

Have you ever dreamed of flying using a jetpack? JetPack Aviation founder -- and the world's only qualified jetpack teacher -- David Mayman is now offering a day of flight instruction.
Emerging Tech

Biologists have found a hormone that could make space farming possible

Researchers have shown how space farming may be possible. By encouraging plants to excrete a certain hormone, they’ve demonstrated that crops can thrive despite challenging conditions, such as low-nutrient soil and microgravity.
Emerging Tech

Keep your holiday gift list high tech and under budget with these gadgets

Modern technology doesn't always come cheap, but there plenty of premium devices that don't carry a premium price. Whether you're looking for a streaming device or a means of capturing photos from above, our list of the best tech under $50…
Emerging Tech

When tech goes wrong: Banksy’s shredder was meant to totally destroy his artwork

Banksy's recent auction stunt was meant to totally destroy one of his most famous pieces of work, but a fault with the shredder has left the buyer with something almost certainly worth far more than the $1 million she bid for it.
Emerging Tech

The best drone photos from around the world

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.