Like a vice principal in the sky, this A.I. spots fights before they happen

We live in a surveillance society: A U.S. citizen is reportedly captured on CCTV around 75 times per day. And that figure is even higher elsewhere in the world. Your average Brit is likely to be caught on surveillance cameras up to 300 times in the same period.

But a lot of existing CCTV networks still rely on people to operate them. Depending on the circumstances, there might be a human being at the other end, watching multiple camera feeds on a bank of monitors. Alternatively, there may be no-one watching at all, with the footage only ever viewed in the event that it needs to be.

Two cutting edge technologies may shake up surveillance as we know it, however. Researchers from the U.K.’s University of Cambridge and India’s National Institute of Technology and Institute of Science, Bangalore have published a new paper describing a drone-based surveillance system that uses UAVs as flying security cameras to keep an eye (or several) on large gatherings of people.

“Our system is able to identify the violent individuals real-time.”

What’s more, these drones are equipped with deep learning artificial intelligence algorithms that allow them to identify troublemakers in crowds and take the proper precautions.

The “Eye in the Sky” real-time drone surveillance system could be deployed at events like music festivals, marathons or other large gatherings, where it would be utilized to identify violent individuals — based on their aggressive posture — using the latest pattern recognition technology. It then promises to alert the authorities. Welcome to the future of surveillance!

Identifying attackers in real time

“Our system is able to identify the violent individuals real-time,” Amarjot Singh, one of the researchers on the project, told Digital Trends. “This was quite challenging, and we had to develop unique ways to achieve [it]. The problem was that the standard deep learning algorithms require tens of thousands of annotated images to train these systems. This would normally be fine, if one was to assign just one label to an image — for example, assign ‘cat’ to an image of a cat. But in order to design a system which can detect the human pose from aerial images, the system needs to be trained with aerial images annotated with 14 key points on the human body. Since there is no dataset available for this type of application, we ourself annotated the points on the human body, which was extremely time-consuming and expensive.”

The ScatterNet Hybrid Deep Learning neural network analyzing body language via a complex motion-tracking algorithm inside a drone. University of Cambridge/National Institute of Technology/Indian Institute of Science

By breaking the human body down into 14 different points, the system is able to work out which violent action — if any — is being performed with an accuracy of around 85 percent (and all the way up to 94.1 percent) depending on how many people are being surveilled.

The algorithm was trained by analyzing 2,000 annotated images gathered from a group of 25 participants, who were asked to act out violent attacks such as punching, kicking, strangling, shooting, and stabbing. Accuracy levels drop the more people are being monitored and the further away the drone is, although this could be improved in the future. The finished algorithm, called the ScatterNet Hybrid Deep Learning neural network, can learn using a relatively small number of training examples, while robustly extracting the body’s posture with consistent accuracy.

“Once, the system can do well in the test runs, we will be bringing it to market.”

Just as important, it can do it very, very quickly — within just a few frames of video. This is especially important for security applications, since any potential system designed for this purpose needs to be able to alert authorities of an escalating situation before it has erupted into violence.

“The system detects the violent individuals by first extracting and sending the aerial frame recorded by the drone to the Amazon cloud,” Singh continued. “The human detection algorithm detects each human in the image frame. Next, the pose is estimated for each individual. The pose of the individuals involved in the violent activity are jointly analyzed to identify the violent individual.”

But all of this is still quite far away, right? Not necessarily. “We will be flying the drone at the technical festival at NIT Warangal in Andra Pradesh in India, in October of this year,” Singh said. “The second author is from NIT Warangal, and I am an alumnus. The festival is attended by around 3,000 – 4,000 people and is extremely packed.” The pair also hoped to use the drone at at another event in India called “spring spree.”

drones predict violent individuals from sky scatternet hybrid deep learning neural network v2
A figure from the research paper showcasing how the A.I.-equipped drone processes body language by looking at visual cues based on specific points around the body. University of Cambridge/National Institute of Technology/Indian Institute of Science

It won’t be used for alerting the police to violent action at these events, but rather to prove that the technology can accurately predict the outbreak of violence. “Once, the system can do well in the test runs, we will be bringing it to market,” Singh said. “We are also planning to extend this system to monitor the borders of India.”

Possible ethical concerns?

Technology like this will, of course, prompt polarizing responses. Police in the U.S. are already using drones on a regular basis — and this will only ramp up in the years to come — although right now that it done primarily for tasks like assessing crime scenes.

Like predictive policing, A.I.-equipped surveillance drones carry the ominous suggestion of possible “pre-crime.”

The idea of using A.I.-equipped drones for long-term surveillance of crowds runs the risk of verging on the Orwellian. Like predictive policing, it additionally carries the ominous suggestion of possible “pre-crime.” While this particular project focuses on actions carried out, there are examples of smart CCTV cameras with the goal of intervening before an act is carried out.

In the U.K., for instance, an A.I. algorithm is used for spotting potential jumpers on the London Underground train service. This system works by analyzing the behavior of people waiting on the platform, and then looking for those who miss several available trains during that time. This is because such actions have been shown to precede suicide attempts, thereby allowing intervention to be made.

Researcher Amarjot Singh
Researcher Amarjot Singh

It’s one thing to use A.I. more rapidly to stop a scuffle which has broken out; perhaps another to surveil someone on the basis of body language suggesting that they might do something. Such questions will need to be explored as technology such as this becomes mainstream. If it is able to avoid violent acts on the street, we may well consider the tradeoff to be worth it.

Ultimately, concepts such as this make us recall the dream of philosopher Jeremy Bentham’s Panopticon. This was a proposed prison idea in which the presence of a central guard tower makes the prisoners believe that they are being watched at all times. The result, writers like Michel Foucault have suggested, is that prisoners wind up behaving as though they are being watched at all times.

As drones increasingly take to the skies, the existence of tools like this could prompt us to act in a similar way. Is that a police drone or an Amazon delivery flying overhead? You’d better straighten up your posture and loosen your shoulders just in case!

Emerging Tech

We tried a $500 electronic dab rig, and now we can’t go back to normal vaporizers

Induction heating is the future of cannabis vaporizers. Loto Labs wowed us with what likely is the best concentrate vaporizer on the market today. With a $500 price tag, it's expensive, but it should definitely be your next dab rig.
Emerging Tech

Delivery drones: NASA to test advanced traffic control system for cities

Delivery drone services are edging closer as NASA prepares to demonstrate its advanced drone traffic management system, which it claims offers safe and effective control of autonomous aircraft in urban areas.
Emerging Tech

Hong Kong’s vision for a smart prison is a full-blown Orwellian nightmare

Hong Kong wants to bring prisons up to date by introducing new location-tracking wristbands for inmates, and a robot arm whose job is to comb through poop on the lookout for contraband.
Emerging Tech

Wish you could fly? You totally can with these top-of-the-line drones

In just the past few years, drones have transformed from a geeky hobbyist affair to a full-on cultural phenomenon. Here's a no-nonsense rundown of the best drones you can buy right now, no matter what kind of flying you plan to do.
Emerging Tech

The 10 most expensive drones that you (a civilian) can buy

OK, these drones may be a bit beyond your budget: Check out the most expensive drones in the world, from industrial giants to highest-end filming tools.
Emerging Tech

SeaBubbles’ new electric hydrofoil boat is the aquatic equivalent of a Tesla

What do you get if you combine a Tesla, a flying car, and a sleek boat? Probably something a bit like SeaBubbles, the French "flying" boat startup which offers a fresh spin on the hydrofoil.
Emerging Tech

Israel will launch world’s first privately funded moon mission tomorrow

This week will see the world's first privately funded lunar mission launch. Israel's first mission to the moon will be launched aboard SpaceX's Falcon 9 rocket on Thursday, February 21.
Emerging Tech

FDA warns about the dangers of anti-aging blood transfusions

It turns out injecting old people with blood from healthy youngsters may not be the answer to health rejuvenation. That’s according to the FDA, which says such claims are dangerous junk science.
Emerging Tech

Bees can do arithmetic, setting the scientific community abuzz

A new study has found something remarkable: Bees can do basic arithmetic. Researchers showed that bees could use colors as representations for numbers and then use those colors for addition and subtraction.
Emerging Tech

DeepSqueak is a machine learning A.I. that reveals what rats are chatting about

Want to know what rats are squeaking about? You'd better check out DeepSqueak, the new deep learning artificial intelligence developed by researchers at the University of Washington.
Health & Fitness

Immune cell discovery takes us one step closer to a universal flu vaccine

A group of international researchers have made a discovery which could take us one step closer to the universal, one-shot flu vaccine that people around the world have been dreaming of.

NASA celebrates Earth’s incredible natural beauty with free photo book

NASA has published a fabulous new book featuring stunning imagery captured by its satellites over the years. A hardback version is available for $53, though it can also be downloaded to ebook readers for free, and enjoyed online.

This new all-in-one flashlight is a power bank, lighter, and screwdriver

The Pyyros modular flashlight can perform numerous field tasks, from hammering to starting fires. If you back it on Kickstarter now, you can score some savings on this innovative flashlight and multi-tool, but act fast: This early-bird…
Movies & TV

Hilarious new Kickstarter aims to fix Scorcese’s last scene in The Departed

A fan of The Departed and apparent hater of rat-as-symbolism imagery has launched a Kickstarter campaign to digitally erase the rodent from the end of Martin Scorsese’s 2006 movie.