Skip to main content

Not happy with Pinterest search results? Refine it with text and photo queries

pinterest lens adds text option
Break out the birthday candles. Pinterest’s visual search engine Lens is now a year old, and gaining new skills. On Feb. 8, Pinterest announced the addition of text searches that work within the visual search tool, allowing users to give Pinterest Lens a bit more direction on the intent of the search. According to Pinterest, users make an average of 600 million searches every month.

With the update, users can search with both text and photo, rather than choosing just one search method. Pinterest explains that, if you are looking to find an armchair that matches your couch, you can snap a photo of the couch, but also type in “armchair.” With the combination of photo and text, the search results will include armchairs that have a similar style, rather than more couches with the same style. The text option allows Lens users to refine their search for a number of different reasons, even jumping categories, like taking an image of a piece of art, but typing in “tattoo” in order to find similar ideas in body art.

Pinterest says that Lens now understands five-times more objects as when the visual search tool first launched, including recipes, home decor, and fashion. Searches on Lens are up 140 percent compared to a year ago, with twice as many users trying out the visual search when compared to six months ago.

Pinterest says the visual model that supports Lens is rebuilt on a nightly basis, a process that helps the tool improve accuracy, along with learning to recognize new objects.

So what are those 600 million Lens searches looking for? The top categories include fashion, home decor, art, food, products, animals, outfits, beauty, vehicles, and travel. Looking at more specific searches, Pinterest says the current trending Lens searches are for tattoos, nails, sunglasses, jeans, cats, wedding dresses, plants, quilts, brownies and natural hair.

The Pinterest Lens team is now lead by Chuck Rosenberg, a former Google Computer Vision researcher who now works as Pinterest’s Head of Computer Vision.

Since last year’s launch, Pinterest has released several updates for the AI-powered search tool, including browser extensions for Chrome and Firefox, the ability to recognize multiple objects at once, and a zoom-enabled search option.

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Google Assistant may not be disclosing search results as paid ads
A Sonos One with a Google Assistant chat bubble floating above.

When you ask Google Assistant a question, you expect that it is going to give you the best possible answer. What you might not expect is to be served up advertisements — especially ones that aren't disclosed as having been paid for. A recent report from Reuters found that Google may be dangerously close to violating its own disclosure rules by recommending search results that are effectively advertisements.

According to the report, the issue stems from some of the local recommendations provided by Google Assistant. When asked for information about plumbing services and other home repair providers, the voice assistant often offered up results that came from a curated database of companies that are part of a Google marketing program. While those results are clearly marked as advertisements when they come up on a desktop or mobile search, they are not identified as such when read off by Google Assistant.

Read more
Pinterest makeup searches can soon be customized by skin tone
pinterest make up skin tone search tool pinterestskintonesmobile

More than half of Pinterest’s biggest searches for skin-related topics like makeup include a descriptor for skin color -- so Pinterest is rolling out a tool to help users fine-tune their results. After testing the tool last year, on Thur January 24, Pinterest announced what it calls inclusive beauty searches on the mobile app, designed to refine results for makeup and hair.

Prompted by the users using terms like "dark skin," "pale skin," and "olive skin" to narrow down results for specific makeup looks, Pinterest launched testing of the tool on the desktop version of the platform in April. The tool only pops up for certain beauty searches related to hair and makeup, displaying a dropdown menu of different "palettes." Picking a palette allows users to choose a range of skin tones to narrow down the search results.

Read more
Snapchat’s visual search tool could take you shopping, but not on Amazon

Shopping and Snapchat could soon be synonymous. As originally reported by TechCrunch, the popular social media platform is experimenting with a new visual search feature called "Eagle." App researcher Ishan Agarwal was the first to notice the Snapchat code in the Android version of the app, and has previously been the tipster behind a number of other app features, including Instagram's video calling app, Focus portrait mode, and others.

With Eagle, if you take a photo of a product or its bar code, the Agarwal-discovered code initially suggested that you would be redirected to Amazon, where you'd have the option of purchasing said product. However, since that initial report, it would appear that all mentions of Amazon have been scrubbed from the code, so it's not entirely clear where you'll be redirected to make purchases (if at all).

Read more