SweepSense makes your phone or laptop smarter by using its speaker and microphone

By Jason Hahn Published February 8, 2016

If you’re listening to music or a podcast on your smartphone and need to pause the audio to greet a friend you recognize on the train, you’ll have to remove your earbuds, and then tap the pause button on the phone’s screen. A project called SweepSense removes the need for the second step of that process, and its potential real-world applications are far-reaching.

Three researchers at Carnegie Mellon University are behind SweepSense, which aims to make devices smarter by giving them the ability to sense their surroundings using the speakers and microphones they already have. The project uses a smartphone or laptop’s speaker to send out ultrasonic frequencies, which will reflect off of nearby objects and be measured by the device’s microphone. The information relayed by the reflected sound can be used to trigger specific actions.

Recommended Videos

SweepSense already has two self-contained demos showing how this can be applied in the real world. In one scenario, a pair of earbuds is plugged into an iPhone. When both earbuds are inserted into the user’s ears, a certain ultrasonic frequency is received by the phone’s microphone. When one of the earbuds is removed, SweepSense makes it possible to determine which earbud was removed.

When an earbud is removed while the user is listening to music, the researchers used software to pause the audio on the device. Alternatively, when an incoming call is received on the phone, the user can simply remove an earbud to answer the call.

The researchers also show how SweepSense can be used on a laptop to determine the angle of the screen. This can be used to trigger certain actions. For instance, if the display is angled back, a MacBook’s dashboard screen will be shown.

SweepSense is far from a perfect approach to making devices smarter. The researchers admit, for example, that the low-frequency ultrasound may be audible to children, the elderly, and animals, which may cause annoyances, according to MIT Technology Review.

The researchers have plans to explore additional applications in public address systems in subway stations and supermarkets, sound systems at concert venues and stadiums, and cars.

Former Contributor

Jason Hahn is a part-time freelance writer based in New Jersey. He earned his master's degree in journalism at Northwestern…

Topics

Emerging Tech

Anti-surveillance clothing is getting cheaper, but don’t expect an invisibility cloak

Affordable shirts now claim to confuse facial recognition, although their protection depends heavily on the camera and software watching you

Chart, Plot, Adult

Anti-surveillance clothing is starting to look less like an art-school experiment and more like something you could actually wear outside. Shirts designed to confuse facial recognition systems now cost about as much as ordinary streetwear, although buying one won’t make you disappear.

The Guardian reports that designers are using face-like prints, unusual cuts and infrared lights to interfere with computer vision. These techniques target specific weaknesses, so their success depends on what happens to be watching you.

Emerging Tech

This spinning drone hides in plain sight using a visual illusion

This drone doesn't turn invisible. It tricks your brain into thinking it has.

Phantom Twist

For decades, engineers have chased the dream of an invisible drone. The usual approaches have involved transparent materials, camouflage coatings, or complex optical systems that bend light around an object. Researchers at Northwestern University decided to take a completely different route. Instead of hiding the drone itself, they chose to fool the human eye.

The result is Phantom Twist, an experimental drone that spins so rapidly it almost disappears into the background. It's not technically invisible, but to anyone watching, it looks more like a faint blur than a flying machine.

Emerging Tech

This smart knitted fabric can flip switches, count your steps, and even change shape

Grandma's knitting just entered its Iron Man era

Representative Image

For most of us, knitting brings to mind sweaters, scarves, and perhaps an ambitious grandmother determined to make winter more fashionable. Researchers at Harvard University, however, have a far more futuristic vision. They've transformed ordinary knitted fabric into a programmable material capable of changing shape, acting as an electrical switch, sensing movement, and potentially forming the foundation of tomorrow's wearable technology.

The research, published in Advanced Functional Materials by scientists at the Harvard John A. Paulson School of Engineering and Applied Sciences (SEAS), demonstrates how machine-knitted textiles can "snap" between multiple stable shapes without relying on motors or rigid mechanical parts.