Skip to main content
  1. Home
  2. Emerging Tech
  3. Computing
  4. News

Microsoft is sending its HoloLens to the ISS so astronauts can use augmented reality

Add as a preferred source on Google

As if floating through space weren’t awesome enough, NASA just announced that it plans on sending Microsoft’s revolutionary HoloLens technology to the International Space Station later this week. Officially dubbed Project Sidekick, the partnership isn’t merely a test vehicle for the augmented reality unit, but rather an intuitive way for astronauts to work and communicate more efficiently. Set to launch this week as part of a commercial resupply mission, the HoloLens devices will travel aboard the rebuilt Cygnus spacecraft.

Though the project suffered a minor setback last June, NASA’s decision to move forward with its Microsoft collaboration was fueled by the incredible advantages the HoloLens could provide to astronauts. As mentioned above, the agency feels that augmented reality has huge potential to make working in space easier for astronauts. Whereas a device like the Oculus Rift actually produces an independently created environment, Microsoft’s tech would superimpose digital elements on top of what astronauts actually see.

NASA and Microsoft engineers test Project Sidekick in a weightless chamber
NASA and Microsoft engineers test Project Sidekick in a weightless chamber NASA

“As opposed to virtual reality which removes you from the real world, with HoloLens the real world plays just as much into the experience as the digital assets,” says Microsoft’s Alex Kipman. “We’re adding photons to the back of your eye. They feel anchored and pinned in the real world, but are see through.”

Recommended Videos

By making use of the tech’s different functions, astronauts aboard the ISS can actually work with those on the ground in real time. With the HoloLens switched into remote expert mode, teams on the ground have the ability to see what the astronaut sees, remotely draw notes or directions, and talk directly to the wearer through Skype. Moreover, this mode makes it easier for astronauts to consult numerous experts or scientists while conducting various research projects.

“HoloLens and other virtual and mixed reality devices are cutting edge technologies that could help drive future exploration and provide new capabilities to the men and women conducting critical science on the International Space Station,” said ISS program director Sam Sciemi last summer. “This new technology could also empower future explorers requiring greater autonomy on the journey to Mars.”

NASA and Microsoft's OnSight project
NASA and Microsoft’s OnSight project NASA

Becuase Project Sidekick possesses a massive amount of upside, NASA and Microsoft worked overtime to ensure that sending the tech to the ISS wouldn’t be for naught. Aside from extensive microgravity and processing unit testing, the two organizations spent many hours making sure the HoloLens wouldn’t cause any discomfort or disorientation to those wearing it.

As can be the case for some people using virtual or augmented reality devices, headaches and nausea are typical side effects from prolonged use. To fight this, a stabilizing product was manufactured which actively keeps holographs in space and time completely stable. What this does is allow the astronaut’s senses to react as if it were grounded in the real world, lessening the amount of flickering in the images and making it easier to wear for extended periods of time.

Moving forward, Project Sidekick is just the tip of the NASA and Microsoft partnership iceberg. Also under development between the two is a revolutionary software program called OnSight which would also make use of the HoloLens. Under the guidance of NASA’s Jet Propulsion Laboratory, OnSight would allow scientists on Earth to work alongside astronauts traveling to Mars, virtually taking them to the Red Planet while they physically remain on Earth.

Scheduled to broadcast on NASA’s online streaming client NASA TV, the commercial resupply mission will take off from the Cape Canaveral Air Force Base in Florida this Thursday.

Rick Stella
Former Associate Editor, Outdoor
Rick became enamored with technology the moment his parents got him an original NES for Christmas in 1991. And as they say…
A new startup wants to fix the military’s working-dog shortage with cloning and gene editing
Promising pitch, plenty of unanswered questions about the dogs.
a new startup wants to fix the militarys working dog shortage with cloning and gene editing warhound featured image

Military working dogs charge into places the rest of us would flee. So, I understand why anyone would want to breed tougher, healthier dogs for the job.

Warhound, a new startup from Colossal Biosciences co-founder Ben Lamm and Anduril co-founder Palmer Luckey, has stepped out of stealth with $200 million to clone and gene-edit working dogs for American troops, police departments, and emergency services (via TechCrunch).

Read more
AI can describe a picture, but it still struggles to understand blind users
A University of Maryland study finds that Be My AI often buries useful answers in lengthy descriptions, leaving blind users to work harder to get the information they need.
Blind Man using walking stick

AI can describe a picture, identify objects, and answer questions about what a camera sees. But when a blind user needs a quick answer, getting an entire spoken essay about the scene isn't exactly helpful. Researchers at the University of Maryland (UMD) have found that AI-powered visual assistance can leave blind users doing too much work to get the information they actually need.

The study, titled Say It My Way: Exploring Control in Conversational Visual Question Answering with Blind Users, examined how people interact with Be My AI, an AI-powered feature of the Be My Eyes app. The researchers found that users often received lengthy descriptions that didn't adequately address their immediate goals, forcing them to ask follow-up questions or find ways to steer the AI towards a more useful answer.

Read more
Etsy cracks down on AI slop listings. Everyone else needs to take note.
Now every platform must decide what counts as handmade.
Etsy featured image

Platforms tend to shrug off AI clutter until it threatens what they sell. For Etsy, that thing is trust in the maker.

To protect that, Etsy has banned AI-generated how-to guides and listings made entirely by bots. Most sellers must show at least one unretouched photo of the item (via Etsy Seller Handbook).

Read more