Skip to main content

Zensors app uses your old smartphone and crowdsourcing for smart surveillance

Want to know how many times your cat jumps on the counter when you’re not around? Or, maybe you want to quantify the distraction you experience at work by counting the number of people who walk by your cubicle. Now there’s an app for that. Zensors, created by a research group at Carnegie Mellon University in participation with the Yahoo InMind Project, uses your smartphone’s camera to capture data, and then uses artificial intelligence and crowdsourced input to analyze it.

The app, currently in beta, uses your phone’s camera to monitor the action. You can set up an area on the phone’s touchscreen for the application to pay particular attention to. A Zensors demo used a parking lot as an example, where the user defined a certain parking space, or group of spaces, to watch for a period of time. Data is then analyzed by set parameters, such as how many cars park in a certain spot over a period of time.

Recommended Videos

You can use your current phone, though the group behind Zensors suggests that this is a practical use for an old smartphone that you no longer use. You can set it up to be a dedicated data collector; if you use your current device, you may interrupt your data collection activities when you receive a text, or have to walk away from the scene.

zensors
Image used with permission by copyright holder

The data is crowdsourced, because certain questions are not easily answered by the simple action of an object on the screen. One of the creators, Chris Harrison, assistant professor of human-computer interaction at Carnegie Mellon, writes on his profile page that certain sensors, such as a simple open/close door sensor, does not answer the question of whether someone’s children are home from school (although you might want pick who you want to crowdsource on that query). Another example is which patrons at a restaurant need their drinks refreshed. There are business and practical applications for the Zensors app.

For the crowdsourced monitoring, the job could be done by an outsourced staff that watches for activity. At the same time, the app’s algorithms are learning from the humans; over time, some of those human-based activities could become automated.

Crowdsourcing is sometimes necessary. Harrison notes that advances in sensing, computer vision, and machine learning are quite advanced, but not quite there yet to address the queries people might use the app for.

Zensors was built for use with unused smartphones, but will also work with a Wi-Fi camera such as a Dropcam. The site says users can set alerts by email or text, and adapt the app using the available API.

Enid Burns
Former Contributor
Enid Burns is a freelance writer who has covered consumer electronics, online advertising, mobile, technology electronic…
Ring’s new Smart Video Search uses AI to quickly scour your motion history
Ring Smart Video Search on the mobile app.

Ring has revealed a new AI-powered feature called Smart Video Search that’s currently being tested in public beta. The goal is to make it easier than ever to find specific moments in your video history by allowing you to enter a text description of an event, which will then be used to scour your motion events for a clip that matches your input.

Smart Video Search uses a combination of Ring AI and Visual Language Modeling (VLM) to quickly search your video history based on a text description. For example, if you search for “red bicycle in the driveway,” your Ring app will automatically pull up any clips that feature -- you guessed it -- a red bike in your driveway.

Read more
How one phone app uses your voice to detect high blood pressure
The Voice Memos app running on an iPhone 14 Pro.

The wearable segment is at a standstill right now because companies have apparently run out of sensor innovation. Microfluidics and stretchable electronics have recently emerged as hotbeds for cutting-edge wearable research, but those promising papers have yet to see commercial success.

Klick Labs, on the other hand, is looking at voice recordings as the next goldmine for biomarkers. Imagine using voice recordings from a smartphone as a monitoring tool for Type 2 diabetes or voice clips to assess glucose levels. It sounds rather factastical, but that’s what the team has been working on, and with encouraging results.

Read more
What is Microsoft Teams? How to use the collaboration app
A close-up of someone using Microsoft Teams on a laptop for a videoconference.

Online team collaboration is the new norm as companies spread their workforce across the globe. Gone are the days of primarily relying on group emails, as teams can now work together in real time using an instant chat-style interface, no matter where they are.

Using Microsoft Teams affords video conferencing, real-time discussions, document sharing and editing, and more for companies and corporations. It's one of many collaboration tools designed to bring company workers together in an online space. It’s not designed for communicating with family and friends, but for colleagues and clients.

Read more