Skip to main content

New computer vision app helps travelers interpret foreign road signs on the fly

mapillary road signs chinese 2
You know how Google hopes to “organize the world’s information and make it universally accessible and useful?” Swedish startup Mapillary wants to do the same thing with the world’s road signs.

As it turns out, from warnings about polar bears to alerts concerning “invisible cows,” there are some pretty darn unusual roadside messages you’ll come across as you travel the globe. But if you’re only used to the regular old boring signs found in your neighborhood, being expected to understand all of them from behind the wheel is a tall order.

Related Videos

Throw self-driving cars — which need to understand this stuff to get you safely from point A to point B — into the mix and things become even more confusing.

Computer vision company Mapillary has spent the past several years working on just this problem.

“Mapillary is a collaborative street-level imagery platform powered by computer vision,” CEO and co-founder told Digital Trends. “The mission is to understand the world’s places through images and make this understanding available to all. Mapillary provides apps and tools for everyone, enabling individuals, businesses, and governments worldwide to contribute with street-level imagery. All images are connected in 3D and objects recognized in images are automatically labeled and turned into geospatial data. Mapillary has a viewer, APIs, and developer tools for easy use of this imagery and geospatial data in a wide range of applications.”

Already, Mapillary has mapped more than 1.6 million miles of street-level imagery and thanks to its machine learning algorithms and convolutional neural network lays claim to one of the biggest such archives of its kind. On Monday, it announced the addition of 500 new signs to its image recognition system, along with an expansion beyond Europe and the U.S. to cover more than 60 countries — ranging from China to South Africa.

At present, the data is being used to help cities and road authorities do sign inventory, but there are plenty of other possible applications. For instance, how useful would it be to hire a car overseas and have your car spot signs up ahead and give you advance notice, or a quick explainer, on what they mean? While nothing has been announced yet, according to Solem, “[we] have no problems licensing this technology to fit in cars.”

In other words, keep your eyes on this space. But also on the road. Especially when there are polar bears crossing.

Editors' Recommendations

No mere EV, the sensor-stuffed EX90 is Volvo’s towering tech flagship
Front three quarter view of the 2024 Volvo EX90.

Volvo has reinvented its image over the past decade, taking its cars from stodgy to stylish, and keeping pace with tech developments. Now, it’s trying to do that once again.
The 2024 Volvo EX90 is the Swedish automaker’s new flagship — and it’s electric. This three-row, seven-seat SUV packs all of Volvo’s latest infotainment and safety tech, so its electric powertrain is an important statement of Volvo’s commitment to going all-electric in the future.
The EX90 isn’t a standalone EV. Its styling and tech will set the tone for future Volvos. The business case isn’t EV-specific either. The EX90 has the same form factor as Volvo’s popular XC90 SUV, which it one-ups in tech. Volvo isn’t trying to prove that it can make an EV; it’s already done that with the XC40 Recharge and C40 Recharge. It’s just trying to make a good car.
“There are no gimmicks in the EX90.” Volvo Cars CEO Jim Rowan said in a keynote at the EV’s reveal in Stockholm. “All the technology that’s there is there for a reason.” And boy, is there a lot of it.

Stylish and sustainable
The EX90 is a conventional SUV design with the sharp edges shaved away. There isn’t even a hint of a grille, the door handles sit flush with the bodywork, and the wheels have smooth inserts between the spokes. It’s all to help minimize aerodynamic drag — an important consideration for an EV, as it helps increase range.
The result is a coefficient of drag (Cd) of 0.29, compared to 0.33 for the current Volvo XC90 three-row SUV (lower numbers are better). The EX90 isn’t the slipperiest electric SUV around; the Mercedes-Benz EQS SUV has a 0.26 Cd. But Volvo’s designers retained a more traditional SUV shape, in line with the gasoline Volvo XC90, without resorting to the Jell-O mold shape of the Mercedes.
“The profile and a bit of the plan view is a bit rounder than maybe we’ve done in the past,” Volvo exterior design boss T. Jon Mayer told Digital Trends. “It’s not a jellybean blob by any means, but there are very minute details of how much roundness you put around the edges. This detail work, as well as a longer rear overhang, help keep air flowing smoothly around the car while following the minimalist ethos of Scandinavian design, keeping the bodywork visually clean.
The EX90 is a conventional SUV design with the sharp edges shaved away.

Read more
The Framework laptop is officially Thunderbolt 4 certified
A Framework laptop upside down with two hands holding it and the USB ports unscrewed

Framework laptops are officially Thunderbolt 4 certified after going through a rigorous Intel testing process. While you may have assumed they had Thunderbolt 4 before today, the truth is Framework did not have official certification despite having Thunderbolt-capable input/output (I/O).

There are four (yes, four) Thunderbolt 4-capable expansion bays on these laptops. Once you get the Framework firmware update, you’ll be cruising with dual 4K monitors, eGPUs, and other fun peripherals.

Read more
This creepy Mac app can record every moment of your online life
The Rewind app on an iMac with a pink background, showing a grid of faces from a Zoom call

A new app for your Mac claims it can record every moment of your online life and store it for retrieval. We're talking about every moment, from your emails to your chats to your FaceTime and Zoom calls.

Rewind is a work in progress from Brett Bejcek and Dan Siroker, two American entrepreneurs who between them have worked with Spotify and Optimizely. They claim Rewind is like a search engine for your life.

Read more