Skip to main content

Google Glass meets Kinect in ARI, a gesture-recognition app for smartglasses

Google Glass took smartglasses from the realm of pony-tailed academics and Silicon Valley dreamers to mainstream reality. It has dozens of apps. It has new designs from Oakley and Ray-Ban. It has fans that include both runway models and basketball players.

And if you’re in a loud room, it’s almost as worthless as it is geeky. Because talking to your gadgets is nowhere near as smooth at David Hasselhoff made it look in Knight Rider.

Recommended Videos

Sure, you can bark “Glass, take a photo” in the comfort of your living room and snap Mr. Meowsers without setting down your tea. But trying the same thing in a bustling bar is a surefire way to annoy the people around you — and perhaps get a beatdown. Meanwhile, Glass’s touch-sensitive pad handles only a few basic functions.

Quickly evolving smartglass technology could also help put a spring in ARI’s rather lethargic step.

But what if Glass could read hand gestures like Microsoft’s Kinect? Soon, it will. A Portland, Ore., startup called On the Go Platforms is developing a way to control your smartglasses with a form of sign language, and on Wednesday, the company released its first public beta.

“The smartphone is moving up into your vision, and there needs to be a new interface to evolve with the new hardware,” says cofounder Ryan Fink. “That’s where ARI comes in.”

ARI, short for Augmented Reality Interface, requires no buttons, no touchpads, and no speaking. “ARI is the Siri of gesture recognition for smartglasses,” explains Fink.

Hold your fist up in front of your face (like an old-timey boxer looking for a fight) and a box appears superimposed over it in Google Glass. After recognizing it as a command, ARI counts down 3 seconds so you can get your hand out of the way, then snaps a photo. After collecting a few, you can use the wave of your hand to leaf through Glass’s library of photos as if turning invisible pages in a photo album.

That’s just one use. Ultimately, the team hopes ARI will be able to recognize an entire library of gestures, which outside developers can bake into their apps as controls. The Pandora app, for example, could someday interpret a literal thumbs up as your approval for that Whitesnake jam it just played on your 80s station.

A new way to control Google Glass

 

Besides simply being less irritating than talking to your glasses, Fink and cofounder Gary Peck see it as an essential way to control Glass in scenarios where it would otherwise never work, like a factory floor.

“It’s really loud, they sometimes have stuff in their hands and they want to be able to easily interact with the content or check things off as they go through,” Fink explains. With ARI, a worker could simply wave a hand to move the display in his glasses onto the next instruction in a list, or hold up a fist to mark it done.

The same goes for athletes. A snowboarder with thick gloves might have difficulty swiping the touchpad, and a biker might not want to lift his hands from the handlebars to start a timer.

“I think at first it will be a little weird, especially to people that aren’t familiar with the technology.”

ARI also has the potential to make Glass a platform for games. After all, no one wants to control a game by frantically drumming on their glasses or yelling “Flappy Bird, up!” But as Kinect has proven, gamers don’t seem to mind flailing their arms around.

In theory, ARI solves all these issues. In execution, there are still plenty of kinks to iron out. The early alpha version we tested took a while to recognize gestures, and it takes a purposeful execution to pull off a swipe or fist in just the way ARI is looking to see it.

But quickly evolving smartglass technology could also help put a spring in ARI’s rather lethargic step. Since it constantly analyzes images from the built-in Glass camera, ARI can’t run on your phone; it has to run on the anemic processor built into Glass. As those processors get faster, so will ARI.

Glass’s camera also remains a challenge — because there’s only one. Purpose-built gesture-control systems like Microsoft’s Kinect rely on a pair of cameras to generate stereo images, which lets the computer reading your manic motions determine depth. “With dual cameras, you really get a 3D model of the world in front of you. With a single camera it’s just a plain image,” Peck explains “You have no idea that this hand is a different object from the table, it’s all just different pixels.” Peck has had to work around that primitive input to detect objects based on the look of them alone.

Google Glass meets Kinect in ARI
Image used with permission by copyright holder

The challenge is made even more difficult by the need to preserve Google Glass’s limited battery life: The more accurate the gesture detection, the more it drains the battery. “That’s the tradeoff,” Peck said. “How can you get accuracy that’s good enough for the gestures you’re trying to do?” His code, for instance, uses low-res video from the onboard camera even though it can technically capture at 1080p — because he’s not trying to track every finger.

The geek factor here is also impossible to ignore: How do you get people to use a technology that makes you look like the world’s worst mime? “I think at first it will be a little weird, especially to people that aren’t familiar with the technology,” Fink acknowledges, but insists perceptions will change as the technology improves. “It will be much more like Iron Man or Minority Report, where it’s an immersive experience. So I think the stigmatism toward it being weird and awkward will melt away with that.”

The future of smartglasses and augmented reality remains smudgy.

One of the biggest steps forward will come from “waveguide lenses.” While Glass merely displays a small video feed in the corner of your vision, waveguide lenses can literally overlay information over your entire field of view, like true Terminator glasses. Vuzix has produced early prototypes of this technology and some expensive models meant for industrial environments, but they’ve yet to shrink to the size or price of Google Glass. Peck believes it could be at least another year before we see this level of display reach the mainstream.

The future of smartglasses and augmented reality remains smudgy, but the unknown next steps remain part of the appeal for Peck and Fink.

“It’s a new interaction paradigm. There’s a lot of figuring out — how do you present information in the most intuitive way? How do you interact with it? Peck explains. “But as an app developer, there’s no conventions. There’s no knowledge of the best way to present information that’s up here on your screen. Those are kind of interesting challenges.”

Nick Mokey
As Digital Trends’ Editor in Chief, Nick Mokey oversees an editorial team covering every gadget under the sun, along with…
Sebastian Stan lays out Bucky’s future after Thunderbolts
Sebastian Stan in Thunderbolts.

There are some spoilers ahead for the ending of Marvel's Thunderbolts. Stop reading now if you don't want to be spoiled.

Earlier this year, Captain America: Brave New World briefly introduced a new direction for James "Bucky" Barnes, a character Sebastian Stan has been playing since 2011 in Captain America: The First Avenger. In Brave New World, the former Winter Soldier apparently retired from being a reformed hero and went into politics by running for Congress. Thunderbolts reveals that Bucky won his election to the House of Representatives. But his stay in Congress was short.

Read more
Jeep Compass EV breaks cover—but will it come to the U.S.?
jeep compass ev us newjeepcompassfirsteditionhawaii  4

Jeep just pulled the wraps off the all-new Compass EV, and while it’s an exciting leap into the electric future, there's a catch—it might not make it to the U.S. anytime soon.
This is a brand new electric version of the Jeep Compass, and being built on Stellantis' STLA platform—the same architecture underpinning models like the Peugeot E-3008 and E-5008—it looks much slicker and packs a lot more inside than previous versions of the Compass.
Let’s start with what’s cool: the new Compass EV is packing up to 404 miles of range on a single charge, a 74 kWh battery, and fast-charging that gets you from 20% to 80% in about 30 minutes. Not bad for a compact SUV with Jeep's badge on the nose.
There are two versions: a front-wheel-drive model with 213 horsepower and a beefier all-wheel-drive version with 375 horsepower. That AWD setup isn’t just for looks—it can handle 20% inclines even without front traction, and comes with extra ground clearance and better off-road angles. In short, it’s still a Jeep.
The design's been refreshed too, and inside you’ll find the kind of tech and comfort you’d expect in a modern EV—sleek, smart, and ready for both city streets and dirt trails.
But here’s the thing: even though production starts soon in Italy, Jeep hasn’t said whether the Compass EV is coming to America. And the signs aren’t promising.
Plans to build it in Canada were recently put on hold, with production now delayed until at least early 2026. Some of that might have to do with possible U.S. tariffs on Canadian and Mexican vehicles—adding a layer of uncertainty to the whole rollout.
According to Kelley Blue Book, a Stellantis spokesperson confirmed that the company has “temporarily paused work on the next-generation Jeep Compass, including activities at” the Canadian plant that was originally meant to build the model. They added that Stellantis is “reassessing its product strategy in North America” to better match customer needs and demand for different powertrain options.
So while Europe and other markets are gearing up to get the Compass EV soon, American drivers might be left waiting—or miss out entirely.
That’s a shame, because on paper, this electric Jeep hits a lot of sweet spots. Let’s just hope it finds a way over here.

Read more
Charlie Cox singles out his least favorite Daredevil: Born Again episode
Charlie Cox in Daredevil: Born Again.

Daredevil: Born Again season 1 was largely reconceived after the 2023 actor and writer strikes. Dario Scardapane -- a veteran of The Punisher series on Netflix -- was brought in to be the new showrunner and he made a lot of changes to the series that were well-received. However, there's one episode that Scardapane didn't really change at all, and it happens to be the least favorite episode of Daredevil: Born Again's leading man, Charlie Cox.

During an appearance on The Playlist, Cox noted that he wasn't very fond of the season's fifth episode, "With Interest," which was a largely standalone episode that featured his character, Matt Murdock, in a bank during a hostage crisis.

Read more