Skip to main content

Machine learning algorithms re-create city in 3D using only image data

VarCity: City model created from images alone
The city of Zurich, Switzerland has been reconstructed in 3D using millions of images and videos. Developed by researchers at ETH Zurich, the Varcity platform pulls from huge volumes of image data and uses algorithms to automatically stitch it all together.

There are millions of images of every major city in the world, many of which are shared openly online. The ETH Zurich team realized they could collect this image data — from standard photos captured by tourists to videos streamed through public webcams and use triangulation to replicate regions in detail.

“We combined all sources to provide a complete view of a city,” Hayko Riemenschneider, Varcity project manager, told Digital Trends. “The more data we have of an area, the more precise our models get.”

The team used machine-learning algorithms — developed over five years as a European Research Council project — that semi-automatically analyze the images and created a rough sketch of the city. “There is no manual 3D artist modeling work involved at all,” Riemenschneider said. “This makes the solution scalable to the whole city.”

They then augment the models with on-the-ground knowledge of the area in question. “Having knowledge — again, automatically deduced — about what part of a 3D model is a building, what part is a floor, and what part is a window or a balcony, allows to compress the data, or to abstract the data in a cartoon-like yet still 3D version,” Riemenschneider said. The idea behind abstraction is to help conceal faces and objects to maintain privacy. “Hence, even if data get lost in the wild, privacy is preserved,” he said.

The Zurich model is meant to demonstrate the algorithms that support Varcity. The researchers think their platform can help design smarter and more livable cities.

“There are a number of applications such as urban city planning, architectural design, traffic modeling, autonomous navigation and tourist guidance, as well as catastrophe response planning,” Riemenschneider said.

To showcase their model, the researchers have created a short video, which they will showcase in a Zurich cinema on Frida.

Editors' Recommendations

Dyllan Furness
Dyllan Furness is a freelance writer from Florida. He covers strange science and emerging tech for Digital Trends, focusing…
3D scanning sheds light on newly discovered 2-million-year-old fossilized skull
3D scanned skull

3D scanning dire wolves, ground sloths, and mammoths in California with Artec Space Spider

Sometimes it takes the very latest technology to answer some of the oldest questions. This week, researchers announced the discovery of an incredibly rare, 2-million-year-old skull in South Africa that is a cousin species to “Homo erectus,” the famous extinct archaic human from the Pleistocene era.

Read more
Wild new 3D printer makes parts by sending titanium particles supersonic
3D printing metal technique

Regular layer-by-layer 3D printing is old news compared to a new additive manufacturing technique developed by an international team of engineers. They recently demonstrated an innovative method for printing 3D metal objects by firing a powder that’s composed of tiny titanium particles, at supersonic speed, so that they fuse together in any interesting way.

This “cold spray” approach takes place below the melting temperature of the metal. When the particles hit the substrate at high enough velocity, they deform and adhere to it. The efficiency of this adhesion increases as the particle velocity increases. Without the high-speed impact, metal powders would simply not adhere well.

Read more
GPS-tracking, 3D-printed decoy eggs can help root out illegal poachers
Decoy turtle eggs

Poachers pose a major threat to sea turtle nests by stealing eggs to sell in what has become a rampant black market trade in certain parts of the world. Conservation efforts to stop this have, to date, included patrolling beaches for would-be poachers, as well as removing the eggs and placing them in a secure hatchery so that they can be incubated in safety.

Conservationists at the nonprofit organization Paso Pacifico in Nicaragua and researchers from the U.K.’s University of Kent have another idea, however -- and it involves 3D-printed decoy eggs, boasting built-in GPS trackers.

Read more