Flickr’s simple ‘Park or Bird’ tool is actually a demo of complex image recognition

flickrs simple park bird tool actually demo complex image recognition flickr
The reason for creating this new tool stems from this xkcd comic, which presented Flickr’s engineers with a challenge.

Flickr’s engineers have worked really hard in developing a new tool that can tell whether a photo was shot in a national park, and if it contains a bird. You simply upload an image, and within a couple seconds Flickr returns the results. You must be asking why Flickr would devote money, time, and resources to something our eyes can easily pick out? While the new “Flickr Park or Bird” feature seems pointless, it actually demonstrates complex image recognition software Flickr is employing in its search algorithms. What might seem easy for us humans to discern is slightly more complicated for computers, yet the feature shows how far software has come along and what the future of image search will be like.

Determining if an image was taken in a park is relatively easy, as long as GPS data is embedded. Flickr matches the GPS info with records in a database, and can tell you the exact name of the park where the photo was taken. If there is no info, results are returned as question marks; in one image we uploaded, Flickr had no GPS data to work off, but it was able to tell that it was taken indoors.

Related: Yahoo finally rolls out Flickr for iPad

Recognizing a bird (or anything else for that matter) in an image is more involved. Flickr says its Vision team “has been working for the last year or so to be able to recognize more than 1,000 things in images using deep convolutional neural nets,” and one of the things its software is good at is finding birds. The method is a bit technical to explain (you can read more about it here), but simply put, the software matches an input image (image of a bird) against layers and layers of images; one layer “might recognize the most basic image features, such as short straight lines, corners, and small circular arcs,” while another layer has more complex shapes, and “further layers might recognize higher-level concepts, like eyes and beaks.”

Flickr says its Vision team “is already applying this deep network to Flickr photos to help people more easily find what they’re looking for via Flickr search, and we plan to integrate it into Flickr in other cool ways in the future. We’re also working on other innovative computer vision and image recognition technologies that will make it easier for Flickr members to find and organize their photos.” By recognizing what’s in a photo, users in the future won’t have to manually tag what’s in them using text, as the software will be able to pick those things out automatically.

It's not perfect, as this image upload shows. Flickr couldn't determine where it was shot due to missing GPS info, but it also thought this famous Internet feline is a bird.
It’s not perfect, as this image upload shows. Flickr couldn’t determine where it was shot due to missing GPS info, but it also thought this famous Internet feline is a bird.
Mobile

5G phones make a lot of promises. Here’s what to really expect

There has been a lot of marketing copy expounding the potential benefits of 5G networks, but a lot less on the practical implications of 5G smartphones. There's a reason for that.
Emerging Tech

Saturn didn’t always have rings, according to new analysis of Cassini data

Saturn's rings are younger than previously believed, according to new data gathered from the Cassini mission. The rings are certainly less than 100 million years old and perhaps as young as 10 million years old.
Movies & TV

From premiere date to footage: Here's all we have on 'Game of Thrones' season 8

With the eighth and final season looming, Game of Thrones fever has officially become a pandemic. Our list of all the relevant news and rumors will help make the wait more bearable, if you don't mind spoilers.
Mobile

Rekindled yet again, Nokia’s next-gen phones offer more than just nostalgia

HMD Global, a startup that designs and builds Nokia Android smartphones, wants to put the Nokia brand name back “where it belongs.” It helps that it’s made up of ex-Nokia employees. We go behind the scenes to see how HMD formed.
Photography

The best mirrorless cameras pack all the power of a DSLR, minus the bulk

Mirrorless cameras offer a lot of photography firepower, inside a compact body. Explore the best mirrorless cameras, from the pro-level to the beginner-friendly shooters, in this guide.
Photography

This A.I.-powered camera follows the action to produce epic selfie videos

Want to capture more epic action selfies? The Obsbot Tail is a camera-gimbal combo that uses artificial intelligence to follow the action. Using a handful of different modes, the camera works to keep the action in the frame.
Photography

Sony crams its best camera tech into the new $900 A6400

Love Sony's autofocus, but can't stomach the full-frame price? The Sony A6400 mirrorless camera uses some of the same autofocus technology and the processor of the A9 in a compact, more affordable crop-sensor camera.
Photography

These point-and-shoot cameras make your smartphone pics look like cave paintings

If your smartphone camera just isn't giving you the results you're looking for, maybe it's time to step up your game. The latest and greatest point-and-shoot cameras offer large sensors, tough bodies, and long lenses -- something no phone…
Photography

GoPro bumps resolution on Fusion 360 cam to 5.6K with new firmware

Currently available in public beta, Fusion firmware version 2.0 offers a new 5.8K mode that results in 5.6K output when the 360 camera's two hemispheres are stitched together. It also adds support for 24 fps video and RAW time-lapse…
Photography

With 5-stop optical stabilization, Fujifilm GF 100-200mm is ready for adventure

Fujifilm revealed a new lens designed to deliver on the GFX system's promise of adventure-ready medium-format photography. The GF 100-200mm F5.6 R is a weather resistant, relatively lightweight, 2x telephoto with impressive stabilization.
Photography

Olympus teaser shares glimpse of OM-D camera that’s good for more than sports

Is Olympus about to release a new mirrorless camera geared toward sports photographers? The latest teaser offers a glimpse of an upcoming OM-D camera set to launch on January 24, and by the looks of the teasers, it's capable for landscapes…
Photography

Nikon A1000, B600 pack big zooms into compact, budget-friendly cameras

The new Nikon Coolpix A1000 packs in a 35x zoom lens, 4K video, and an optical viewfinder, while Nikon's B600 brings a 60x zoom lens to the table. The cameras are modest updates to Nikon's budget-friendly zoom models.
Social Media

Nearly a million Facebook users followed these fake Russian accounts

Facebook purged two separate groups behind more than 500 fake accounts with Russian ties. One group had ties to Russian news agency Sputnik, while the other had behavior similar to the Internet Research Agency's midterm actions.
Photography

From DIY to AAA, here's how to take a passport photo in 6 different ways

If you're applying for a passport or renewing one, you need to submit a photo in your official application. There are strict guidelines, but fortunately, it's something you can do at home. Here's how to take a passport photo.