Skip to main content

Caterpillar uses facial recognition software to identify sleepy equipment operators

caterpillar uses facial recognition to spot fatigue 795f
Creative Commons
When it comes to heavy equipment, Caterpillar is a household name. If it is big and moves earth and rocks, there’s a good chance it has “Caterpillar” stamped on its side. This is especially true when it comes to mining equipment, where dump trucks (known in this context as haul trucks), can sport 12-foot-tall tires. These are some of the largest vehicles on earth, and operators require built-in stairs and ladders to reach the cab.

Even with the most alert driver, incidents are scaled up along with vehicle size. These trucks can roll right over a normal sized passenger vehicle and flatten it, and operators would feel like they hit a small bump. In the past, these trucks have rolled down embankments that were not perceived from the height of the cab, killing the occupants. These rolling behemoths also pose a constant risk to the lives of others on the site, even from the slightest mistake. Absolute concentration and situational awareness is vital for the operators.

Mines operate around the clock, so they have employees who work long shifts through the night, running the risk of nodding off at the wheel. Operator fatigue is a potentially fatal problem, and Caterpillar recognized this and is working on a solution. Caterpillar Safety Services joined forces with tech company Seeing Machines to create and install fatigue detection software into thousands of mine trucks across the world, according to The Huffington Post.

The technology monitors head position and eye closure as signs of fatigue via a camera integrated with a speaker and light system. Rather than identifying a particular individual, facial recognition software looks for predetermined signs of exhaustion. If detected, an alarm goes off inside the truck, and a video clip of the driver is immediately sent to Caterpillar headquarters’ sleep fatigue center. A safety adviser then contacts the operator over radio and notifies the site supervisor. A sleep intervention may be recommended, requiring the driver to take a nap.

Caterpillar is at the early stages of implementation for this solution, and hopes to expand it further into its 38,000 trucks deployed across the globe.

Editors' Recommendations

Dave Palmer
Former Digital Trends Contributor
Dave’s technology geek-fest began with the classic Commodore 64 computer, which started a lifelong passion for all things…
Amazon bans police from using facial recognition tech Rekognition for 1 year
Amazon Logo

Amazon has barred police from using its facial recognition technology for one year.

In a company blog post Wednesday, Amazon said it will implement a one-year "moratorium on police use of Amazon’s facial recognition technology" -- known as Rekognition.

Read more
IBM will no longer develop or research facial recognition tech
IBM's Summit Supercomputer

IBM CEO Arvind Krishna says the company will no longer develop or offer general-purpose facial recognition or analysis software. In a June 8 letter addressed to Congress and written in support of the Justice in Policing Act of 2020, Krishna advocates for new reforms that support the responsible use of technology -- and combat systematic racial injustice and police misconduct.

“IBM firmly opposes and will not condone uses of any technology, including facial recognition technology offered by other vendors, for mass surveillance, racial profiling, violations of basic human rights and freedoms, or any purpose which is not consistent with our values and Principles of Trust and Transparency,” wrote Krishna in the letter.

Read more
‘Dazzle’ makeup won’t trick facial recognition. Here’s what experts say will
martymoment CV dazzle

As demonstrators protest against racism and police brutality, some have suggested that extravagant makeup can block facial recognition technology they worry have been deployed by authorities.

But the creator of this “CV Dazzle” makeup style said the patterns, which were designed to fool an older method of facial detection, won't trick more sophisticated algorithms — though he and other experts said protesters can take steps to evade detection.

Read more