Machine learning algorithms re-create city in 3D using only image data

The city of Zurich, Switzerland has been reconstructed in 3D using millions of images and videos. Developed by researchers at ETH Zurich, the Varcity platform pulls from huge volumes of image data and uses algorithms to automatically stitch it all together.

There are millions of images of every major city in the world, many of which are shared openly online. The ETH Zurich team realized they could collect this image data — from standard photos captured by tourists to videos streamed through public webcams and use triangulation to replicate regions in detail.

“We combined all sources to provide a complete view of a city,” Hayko Riemenschneider, Varcity project manager, told Digital Trends. “The more data we have of an area, the more precise our models get.”

The team used machine-learning algorithms — developed over five years as a European Research Council project — that semi-automatically analyze the images and created a rough sketch of the city. “There is no manual 3D artist modeling work involved at all,” Riemenschneider said. “This makes the solution scalable to the whole city.”

They then augment the models with on-the-ground knowledge of the area in question. “Having knowledge — again, automatically deduced — about what part of a 3D model is a building, what part is a floor, and what part is a window or a balcony, allows to compress the data, or to abstract the data in a cartoon-like yet still 3D version,” Riemenschneider said. The idea behind abstraction is to help conceal faces and objects to maintain privacy. “Hence, even if data get lost in the wild, privacy is preserved,” he said.

The Zurich model is meant to demonstrate the algorithms that support Varcity. The researchers think their platform can help design smarter and more livable cities.

“There are a number of applications such as urban city planning, architectural design, traffic modeling, autonomous navigation and tourist guidance, as well as catastrophe response planning,” Riemenschneider said.

To showcase their model, the researchers have created a short video, which they will showcase in a Zurich cinema on Frida.

Emerging Tech

Awesome Tech You Can’t Buy Yet: Folding canoes and ultra-fast water filters

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

An A.I. cracks the internet’s squiggly letter bot test in 0.5 seconds

How do you prove that you’re a human when communicating on the internet? The answer used to be by solving a CAPTCHA puzzle. But maybe not for too much longer. Here is the reason why.
Emerging Tech

Intel wants its fleet of drones to monitor America’s aging, unsafe bridges

Intel has signed a deal to use its Falcon 8+ drones to carry out bridge inspections. The hope is that these drones will be useful in spotting potential problems before they become serious.

Calibrate your display to get it looking just the way you like it

Want to see images the way they're intended to be seen? Here is our quick guide on how to calibrate your monitor using your operating system or another tool, to make what's on the screen look as good as it can.

Give your eyes a break with these handy blue light filters

Filtering blue light from your monitor is a great way to make long days of work easier on your eyes, especially when it gets later in the day. You can use ones built into MacOS and Windows, or one of the third-party options.
Emerging Tech

New experiment casts doubt on claims to have identified dark matter

A South Korean experiment called COSINE-100 has attempted to replicate the claims of dark matter observed by the Italian DAMA/LIBRA experiment, but has failed to replicate the observations.
Emerging Tech

It’s no flying car, but the e-scooter had a huge impact on city streets in 2018

Within just a year, electric scooters have fundamentally changed how we navigate cities. From San Francisco to Paris, commuters have a new option that’s more fun than mass transit, easier than a bike, and definitely not a car.
Emerging Tech

White dwarf star unexpectedly emitting bright ‘supersoft’ X-rays

NASA's Chandra Observatory has discovered a white dwarf star which is emitting supersoft X-rays, calling into question the conventional wisdom about how X-rays are produced by dying stars.

Amazon scouted airport locations for its cashier-free Amazon Go stores

Representatives of Amazon Go checkout-free retail stores connected with officials at Los Angeles and San Jose airports in June to discuss the possibility of cashier-free grab-and-go locations in busy terminals.
Emerging Tech

Full-fledged drone delivery service set to land in remote Canadian community

Some drone delivery operations seem rather crude in their execution, but Drone Delivery Canada is building a comprehensive platform that's aiming to take drone delivery to the next level.
Emerging Tech

Transplanted pig hearts show promise in baboon trials. Are humans next?

Researchers in Germany have successfully transplanted modified pig hearts into baboons. The results take us one step closer to ending organ transplant waiting lists for good. Here's why.
Emerging Tech

Makerbot is back with a new 3D printer that’s faster and more precise than ever

MakerBot's new Method 3D printer aims to bridge the gap between home 3D printers and more industrial 3D printing tech. Here are a few of the tantalizing things you can expect from it.

Print your heart’s desire: Enter our giveaway to win a free Monoprice 3D printer

We’re giving away a $400 Monoprice MP Voxel 3D Printer. It's easy to use, especially for beginners, with its simple menu system and touchscreen display. It comes fully assembled so you can spend more time printing instead of setting up.
Emerging Tech

Warm ski beanie instantly hardens into a head-protecting helmet upon impact

Wool hats are way more comfortable than hard helmets. You know what they're not? Safer. That could soon change, thanks to an innovative new ski beanie which instantly hardens upon impact.