Skip to main content

Google just reinvented motion control and the fabric in our clothes

Last Thursday, Google hinted at big things to come from its crack team of so-called “pirates” at the Advanced Technologies and Projects division. On Friday, it delivered with two ambitious technologies that move touch controls off of your screen and onto things you have around you every day: your clothes and hands.

Ivan Poupyrev, the Technical Program Lead for the project, took the stage at Google I/O on Friday to show off what his team was able to accomplish in less than a year since its creation.

Recommended Videos

Project Soli: Hands on with your hands

Project Soli uses radar to track your hand gestures in the air with extreme precision – it can detect movement of less than a millimeter, and do it through obstructions, like one finger in front of another. That opens a library of possible gestures that extend far beyond the swipes and pinches you may already know from the likes of the Leap Motion controller, which uses IR cameras that cannot see “through” your hands.

On stage, Poupyrev demonstrated the possibilities by rubbing his thumb against his index finger like a mime turning a dial, which moved a corresponding virtual dial moved on screen. He could also swipe against the finger and scroll exactly as you would on a touchscreen … without the screen. Since Soli can detect both the location of your hands and the gestures they make, different locations can also correspond to different effects. For instance, Poupyrev was able to “set the time” on his watch by placing his hand close to the sensor to adjust the hours with a virtual dial, and further away to set the minutes.

Welcome to Project Soli

The possibilities aren’t difficult to imagine on wearables, which exist on the fringe of screen sizes humans find usable. Apple dealt with this size issue on the Apple Watch by adding a physical dial, the “digital crown,” that can be used for motions like scrolling and zooming in Apple Maps. Google may address the same issue on future watches with a dial that’s entirely virtual.

Google’s hands-on demo stations made it difficult to ascertain how precise Soli can really get – probably because the machine learning necessary to translate raw data from its new toy into usable gestures isn’t really done yet. Demos merely turned waves and swipes of your hand into different abstract shapes on screen, or showed the raw data output from the radar on different graphs.

Perhaps not surprisingly, the first board designs are circular and would fit nicely in say, a watch. Google plans to release it to developers later this year.

Project Jacquard: Real wearables

Like motion sensing, wearable textiles are nothing new, but Google has advanced the ball by bringing them past the realm of prototypes and into the realm of commercial viability with Project Jacquard, which it has partnered with Levi’s to bring to real garments.

The new technology allows touch panels to be woven into conventional fabrics, using conventional textile manufacturing processes. As Poupyrev joked, “We cannot expect the international garment industry to change just for us, even though we’re Google.”

Welcome to Project Jacquard

Getting there required weaving custom yarn that withstand the pulling and heating of the weaving process, then developing a way to weave into small patches on a batch of fabric, rather than having conductive thread blanket the entire roll. Google’s yarn has a conductive metal core encased in a sheath of more conventional fibers, which can be dyed to any color.

The touch panels, which are formed from a grid of conductive threads, almost resemble a patch of rip-stop nylon – the type you might find on backpacks or military uniforms. The fabric around them remains soft and normal feeling, despite the fact that the touch panels are literally woven in on a loom, not stitched on later. To demonstrate how subtle the panels can be, Google brought the fabric to a tailor and had a functional suit jacket with touch panels in the sleeves custom made for Poupyrev.

Like the touch panel on a laptop, the panels track the location of your fingers and can even interpret multiple fingers at once, but they’re not designed to swipe pointers around on a screen. Rather, they read broad strokes, like swipes and taps. One demonstration station, for instance, allowed us to turn on LED light bulbs with a tap, increase or decrease their brightness with vertical swipes, and change their color with horizontal swipes. The earliest demonstration versions of Jacquard lacked the sensitivity we associate with modern touch devices – sometimes it took a few swipes to get it to respond, and the effect wasn’t always instant.

To deliver on its promise of integration into real clothes from regular manufacturers, Google has partnered with Levi’s. Neither partner has announced when touch-sensitive denim will show up at retailers near you, but considering ATAP’s promise to move fast – and the fact that it developed the technology in only 10 months – we wouldn’t be surprised to see it soon.

Nick Mokey
As Digital Trends’ Editor in Chief, Nick Mokey oversees an editorial team covering every gadget under the sun, along with…
‘Exploring fitness’ won’t get Google TV anywhere near Apple Fitness+
The Google TV remote in front of Apple TV Fitness.

Headlines are making the rounds about possible improvements to the Google TV platform. That's exciting, because Google TV is in and of itself an exciting, important platform.

Under the headline "What's next for Google TV," the notes package from Janko Roettgers puts new Google TV Director of Product Management Rob Caruso on the record about a few things. It starts out with a descripton of state of the platform -- some 250 device partners across the globe and seven of the top 10 TV manufacturers making TVs with Google TV baked inside. "If you really want some inside baseball, that's pretty much how every press call with any platform starts -- with numbers telling you just how big and important the company you're talking to is at the moment. It's good context, but...)."

Read more
Google’s Pixel 6 issues are causing a crisis of trust
Google Pixel 6 Pro in hand.

Google's Pixel 6 is an excellent smartphone, one of the best Google has ever made. It fixes up issues we've seen in older Pixels, from outdated and weak hardware to boring designs. All things considered, it's great -- and our reviews say so. At the same time, the Pixel 6 and Pixel 6 Pro have come under fire from both critics and fans alike since its release. Over on the r/GooglePixel subreddit, there are many who would chafe at the idea of someone having a good experience with the Pixel 6, while prominent reviewers like Marques Brownlee (MKBHD) back them up.

From where I sit, it's not that the Pixel 6 is a bad phone -- reviews say as much, my personal experience aligns, and my colleague Andy Boxall offers a more measured take on the issue from a user perspective. It's a very good phone, and it does what it says it is supposed to do, with little complaint on my end.

Read more
The Google Pixel 6 Pro doesn’t deserve its bad reputation
Pixel 6 Pro in the pocket

The Google Pixel 6 Pro is not having the best month, publicity-wise. A broken software update in December 2021 caused problems before it was halted, but this only compounded the issues owners were already apparently having with the phone. Check Twitter, Reddit, and other online spaces, and you’ll find what appears to be plenty of disgruntled Pixel 6 owners voicing their disappointment with the device, including several high-profile YouTubers.

Has Google’s darling Pixel fallen from grace? Are we ready to strip it of its “Editor’s Choice” badge in our review? No, not yet. While people clearly have legitimate gripes about the Pixel 6 and Pixel 6 Pro, there are also many who don’t have any issues with the phone at all. I know, because I’m one of them.
What’s the problem?
The Pixel 6 and Pixel 6 Pro’s Android 12 software seems to be the root of the now widely discussed problems, which were made worse by Google pausing the December software update due to reports of it causing calls to be dropped on some devices. A new software update with a fix has been promised for late January. But frustrations have started to push owners over the edge.

Read more