Skip to main content

Researchers teach self-driving cars to predict pedestrians’ next moves

Predicting pedestrian movement in 3d for driverless cars

Researchers at the University of Michigan are developing a system that teaches self-driving cars to predict pedestrian movement. When pedestrians and vehicles attempt to occupy the same space, pedestrians lose. Since pedestrians are easily distracted and can’t be counted on to act in their own best self-interest, autonomous cars will need to practice both defensive and protective driving.

In a study sponsored by a grant from Ford Motor Company and published in IEEE Robotics and Automation letters, Michigan engineers focused on pedestrians at complex urban intersections.

In what the study describes as a “biomechanically inspired recurrent neural network,” the system cataloged human movements. In more simple terms, vehicles in the study watched people walk near a busy street corner and recorded the data. The system used cameras, lidar, and GPS in a parked vehicle with Level 4 autonomous features to capture short video clips of human motion.

“Prior work in this area has typically only looked at still images. It wasn’t really concerned with how people move in three dimensions,” said Ram Vasudevan, University of Michigan assistant professor of mechanical engineering. “But if these vehicles are going to operate and interact in the real world, we need to make sure our predictions of where a pedestrian is going doesn’t coincide with where the vehicle is going next.”

The system analyzes people’s gait, body symmetry, and foot placement but takes into account many other factors to predict the next step, the one after that, and so on.

Vasudevan used a familiar factor as an example. “If a pedestrian is playing with their phone, you know they’re distracted,” he said. “Their pose and where they’re looking is telling you a lot about their level of attentiveness. It’s also telling you a lot about what they’re capable of doing next.”

No system will ever be 100 percent perfect, but according to the Michigan researchers, the neural network system they’ve developed already beats other predictive technology.

“The median translation error of our prediction was approximately 10cm after one second and less than 80cm after six seconds. All other comparison methods were up to 7 meters off,” said Matthew Johnson-Roberson, associate professor at the University of Michigan’s Department of Naval Architecture and Marine Engineering. “We’re better at figuring out where a person is going to be.”

Editors' Recommendations

Bruce Brown
Digital Trends Contributing Editor Bruce Brown is a member of the Smart Homes and Commerce teams. Bruce uses smart devices…
Uber gives up on developing its own self-driving car
Uber self-driving car

Uber has announced it's selling its self-driving car unit, although it isn’t entirely cutting its interest in autonomous vehicles.

The company will sell its autonomous-vehicle unit -- Advanced Technologies Group (ATG) -- to Aurora, a Silicon Valley-based company founded in 2017 by former contributors to self-driving-car projects operated by Google (now Waymo) and Uber.

Read more
New Tesla self-driving software could reduce driver interventions by one third
Tesla Model 3

Tesla only released the first version of its Full Self-Driving software beta just over a week ago, but it is already being updated with new improvements. The company has been collecting data from the early users and has made improvements that CEO Elon Musk says could reduce driver interventions by as much as one third.

The new software, version 2020.40.8.12, began rolling out on Friday, as reported by Electrek. Those who already have access to the Full Self-Driving beta software will receive the update which should make the use of the system smoother, with fewer requirements for the driver to intervene.

Read more
This self-driving racing car could have done with a driver
watch this self driving racing car slam straight into a wall roborace accident

No one ever said building an autonomous car would be easy.

While a number of companies have certainly made incredible progress with the technology over the last decade or so, some are clearly faring better than others.

Read more