Skip to main content
  1. Home
  2. Emerging Tech
  3. Cars
  4. News

New computer vision app helps travelers interpret foreign road signs on the fly

Add as a preferred source on Google

You know how Google hopes to “organize the world’s information and make it universally accessible and useful?” Swedish startup Mapillary wants to do the same thing with the world’s road signs.

As it turns out, from warnings about polar bears to alerts concerning “invisible cows,” there are some pretty darn unusual roadside messages you’ll come across as you travel the globe. But if you’re only used to the regular old boring signs found in your neighborhood, being expected to understand all of them from behind the wheel is a tall order.

Recommended Videos

Throw self-driving cars — which need to understand this stuff to get you safely from point A to point B — into the mix and things become even more confusing.

Computer vision company Mapillary has spent the past several years working on just this problem.

“Mapillary is a collaborative street-level imagery platform powered by computer vision,” CEO and co-founder told Digital Trends. “The mission is to understand the world’s places through images and make this understanding available to all. Mapillary provides apps and tools for everyone, enabling individuals, businesses, and governments worldwide to contribute with street-level imagery. All images are connected in 3D and objects recognized in images are automatically labeled and turned into geospatial data. Mapillary has a viewer, APIs, and developer tools for easy use of this imagery and geospatial data in a wide range of applications.”

Already, Mapillary has mapped more than 1.6 million miles of street-level imagery and thanks to its machine learning algorithms and convolutional neural network lays claim to one of the biggest such archives of its kind. On Monday, it announced the addition of 500 new signs to its image recognition system, along with an expansion beyond Europe and the U.S. to cover more than 60 countries — ranging from China to South Africa.

At present, the data is being used to help cities and road authorities do sign inventory, but there are plenty of other possible applications. For instance, how useful would it be to hire a car overseas and have your car spot signs up ahead and give you advance notice, or a quick explainer, on what they mean? While nothing has been announced yet, according to Solem, “[we] have no problems licensing this technology to fit in cars.”

In other words, keep your eyes on this space. But also on the road. Especially when there are polar bears crossing.

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
A new startup wants to fix the military’s working-dog shortage with cloning and gene editing
Promising pitch, plenty of unanswered questions about the dogs.
a new startup wants to fix the militarys working dog shortage with cloning and gene editing warhound featured image

Military working dogs charge into places the rest of us would flee. So, I understand why anyone would want to breed tougher, healthier dogs for the job.

Warhound, a new startup from Colossal Biosciences co-founder Ben Lamm and Anduril co-founder Palmer Luckey, has stepped out of stealth with $200 million to clone and gene-edit working dogs for American troops, police departments, and emergency services (via TechCrunch).

Read more
AI can describe a picture, but it still struggles to understand blind users
A University of Maryland study finds that Be My AI often buries useful answers in lengthy descriptions, leaving blind users to work harder to get the information they need.
Blind Man using walking stick

AI can describe a picture, identify objects, and answer questions about what a camera sees. But when a blind user needs a quick answer, getting an entire spoken essay about the scene isn't exactly helpful. Researchers at the University of Maryland (UMD) have found that AI-powered visual assistance can leave blind users doing too much work to get the information they actually need.

The study, titled Say It My Way: Exploring Control in Conversational Visual Question Answering with Blind Users, examined how people interact with Be My AI, an AI-powered feature of the Be My Eyes app. The researchers found that users often received lengthy descriptions that didn't adequately address their immediate goals, forcing them to ask follow-up questions or find ways to steer the AI towards a more useful answer.

Read more
Etsy cracks down on AI slop listings. Everyone else needs to take note.
Now every platform must decide what counts as handmade.
Etsy featured image

Platforms tend to shrug off AI clutter until it threatens what they sell. For Etsy, that thing is trust in the maker.

To protect that, Etsy has banned AI-generated how-to guides and listings made entirely by bots. Most sellers must show at least one unretouched photo of the item (via Etsy Seller Handbook).

Read more