Hands on with Google conversational search: Is it time to start talking to our browsers?

google conversation search

It’s almost like we’re living in the future with voice-activated search, now made far cooler with an artificially intelligent algorithm that talks back to you. 

Even before Google announced the update at Google I/O, the tiny microphone icon that sits on the far right corner of the search bar was there – has been for the past two years. It just wasn’t as sophisticated prior to the recent update, and not quite as fun to use as it is now.

We’ve seen natural language processing technology, the extremely complex building blocks that make up Google’s conversational search, in similar services like SIRI – developed by the SRI International Artificial Intelligence Center – and in other products like Google Now. It’ll be years before natural language processing is sophisticated enough to understand irony and sarcasm within context, and a lot of work and research will have to be done to reach that end, but the latest application of this technology in Google conversational search is exciting. 

Why? Well Google conversational search now talks back … and while that’s only the beginning, it’s a good place to start.

Google talks back

To get started on the vocal Google search, you’ll need the latest version of Chrome, version 27. Head to the menu tab and click on “About Google Chrome” to make sure. By this time, opening the tab will either let you know that you’ve got the latest version of Chrome, or it’ll automatically start the update.

Once all has been done, click on the microphone icon.

google voice search listening

That should open up a brand new splash page that asks you to “Speak Now.” What’s cool about this part is that as you speak your search query into your microphone, Google will display what you’re saying in real-time on that page and try to fill in the blanks on what it thinks you’re searching for using its Autocompete functionality. Word of advice: if your default mic doesn’t pick up on sound too well, use an external mic.

I asked Google, “Who is Alan Turing,” and normally you’d simply get the search results and that would be it, but this time a female voice – an option that’s set and unchangeable by default – ends up speaking back the Wikipedia excerpt describing the mathematician.

what does bill gates look like google

Conversation search also works if you’re searching for an image. Asking “What does Bill Gates look like?” gave me image results for Bill Gates and the spoken response, “Check out these images for Bill Gates.”

Conversational Search is spot-on … most of the time

While for the most part, I didn’t encounter too many incorrect searches using Google conversational search. However, I really tried to test the limits of the search engine’s natural language processing technology and encountered a couple of snags, particularly when it comes to proper nouns.

For instance, I asked, “Who is the creator of the GIF?” Now, everyone knows that GIF is pronounced “JIF,” (some of us are still dealing with that fact) but I figured I’d try both the hard and soft “G” pronunciations. Google ended up processing these as “Who is the founder of the gifts?” and “Who is the founder of the GS?” instead.

I relaxed a bit with my next test. I asked “Who is PSY?” Not surprisingly, Google thought I was asking “Who is sin?”

Still, unless you’re actively trying to confuse the technology, it will recognize nearly every word you say. In one instance Google even “corrected” my mispronunciation of “elephantitis” and was still able to understand what I was searching for.

A few warnings that need to be noted is that there’s a very slim margin of error that Google offers when it comes to speaking a search query. You only have a few seconds to speak, and stumbling over or repeating words will confused the search engine, or will provide an incomplete or double-worded search query. And don’t forget to enunciate your words.

Why Google call this search, “Conversational”

There’s a reason Google calls this “Conversational Search.”

Historically, search engines have been matching keywords to surface relevant URLs; implementing Knowledge Graph signaled Google’s evolution. In addition to link-based results, with Knowledge Graph Google serving specific-answers like the ones you see in the cards either on the right-side or top section of the search results page.

When it comes to conversational search, Google uses natural language processing capabilities to break each spoken word down to the semantics and relationship of these words within the context of the complete sentence.

google voice search who is alan turing

For example, when I asked “Who is Alan Turing?” Google was able to recognize that Alan Turing is a person, and because Alan Turing’s personal information has been indexed by its Knowledge Graph, Google was able to play back a rather specific answer (not just a link) courtesy of Wikipedia.

Now what makes Google’s spoken search “conversational” is in the ability to follow up a search with a completely different question about the same topic. But you don’t need to reference the topic by name. Think about it: If you were having a conversation with a person about Alan Turing, it might go something like this: 

Q: Who is Alan Turing?

A: Alan Turing was a famous and influential mathematician and computer scientist.

Q: When was he born? 

A: 1912.

When you got to your second question, you wouldn’t start over again – i.e., “When was Alan Turing born?” You’ve already introduced the subject of you conversation, with this person, you don’t need to go it again – same goes for Google conversational search. 

what alan turing became famous for google search

So after following up my first question, “Who is Alan Turing?” with “What did he become famous for?” Google recognized that the pronoun “he” in the second question was directly referencing Turing’s name. That’s how people would do it, so Google’s trying to do the same. You can go from here too – until you start a new query, Google will keep up with the subject. 

Don’t try the conversational way of searching if you’re planning on typing your queries. You’ll find that following up initial queries with pronouns just doesn’t work.

Knowledge Graph’s limitations affect conversation search

Not every answer can be read back. Movie listings may play back with the exact theater location, but finding places to eat, on the other hand, in most attempts simply listed search results, without being read back.

who are the children of alan turing

So while Google might be able to read me Alan Turing’s birthday and show me the Knowledge Graph card at the top of the screen with the answer, asking for the names of his children simply gave me the usual list of URLs that may point me in the right direction of an answer but nothing more.

One reason for this is that what ends up being read by Google heavily depends on whether the answer is indexed by Google’s Knowledge Graph. Alan Turing’s children might not be read back, but Lindsay Lohan’s sisters sure will. It just depends on what the Knowledge Graph has accumulated – which has a lot to do on what the world is most often searching for.

Personalized answers

what is today's weather google conversational search

If you’re lucky, you might see personalized responses – but it’s not a feature you can depend on yet. I tried asking Google about today’s weather without referencing my location, but it took a good eight seconds the first time around before the answer was displayed and read back. The second result was instant. The problem was that its algorithm was pulling from the wrong location. Despite being on a New York City IP address, Google ended up telling me today’s weather over 200 miles south in Washington D.C.

google flight schedule conversational search

Since I’ve opted into the Gmail Search Field Trial, which means my Google account data – flight tickets, calendar, emails – is synced with Google search results where it applies, the personalized results actually were quite handy. Asking aloud “what time is my flight in December?” and “Pull up my emails with Molly” surfaced the relevant info at the top of the page.

Fun, convenient (sometimes), but not practical … yet 

The novelty of voice-based search may attract users for a short time, and will surely be picked up by those with vision problems, but for everyday use it’s just not easier yet. Searching for one query takes several seconds longer than simply typing it out, and there’s the risk associated with misspeaking something. But we can’t hold it against the search engine; conversational search is in its early stages and the practical uses for an advanced version are endless.

Emerging Tech

How emotion-tracking A.I. will change computing as we know it

Affectiva is just one of the startups working to create emotion-tracking A.I. that can work out how you're feeling. Here's why this could change the face of computing as we know it.
Smart Home

From the kitchen to the bedroom, here are the best Alexa tips and tricks

Amazon's voice assistant Alexa has plenty of neat skills. So many, in fact, it seems like new ones appear every day. We've rounded up the top Echo tips and tricks to help you get the most out of your virtual assistant.
Product Review

Samsung's Galaxy Fold proves folding phones are the future

Samsung's Galaxy Fold is finally here -- it's the company's first foldable smartphone, with three screens, six cameras, and a dual-cell battery. What's it like to use? We spent some time with it to find out.
Movies & TV

The best movies on Netflix in March, from Buster Scruggs to Roma

Save yourself from hours wasted scrolling through Netflix's massive library by checking out our picks for the streamer's best movies available right now, whether you're into explosive action, witty humor, or anything else.

YouTube Music and YouTube Premium are now live in the U.S., 16 other nations

Google just announced a major revamp of YouTube Music, with an ad-free paid version called YouTube Music Premium. It's also changing YouTube Red to YouTube Premium. So what happens to Google Play Music? Here's what we know.

Skype doubles its group video chat limit to 50 participants

Skype now allows for up to 50 people in video and audio chats, double that of before. And instead of ringing everyone as a way to get a group call started, you can now send unobtrusive notifications to get everyone’s attention.
Health & Fitness

Microsoft says it’s closing its HealthVault patient records service

Microsoft has announced it is closing its HealthVault service, which offered a way for individuals to store and share their health records with medical professionals. Users are advised to act soon if they want to save their data.

From pranksters to pop stars, these are the 10 biggest YouTube channels

For better or worse, YouTube celebrities have had a profound impact on popular culture. From comedy channels, to gaming let's plays, and musicians, they all garner tens of millions of subscribers. These are the most popular.
Social Media

How a two-year-old Facebook post may lead to jail time for a visitor to Dubai

If you enjoy sounding off on social media, you might want to check through your posts prior to any trip to Dubai after a British woman was arrested there for comments made on Facebook two years ago.
Movies & TV

No TV? No problem. Here's how to watch the NCAA championship game online

Whether you want to watch the Big Dance on your phone or on your smart TV, we have the lowdown on all the ways to watch March Madness you can handle. Grab your foam finger and some nachos.

Back off, photo thieves: Flickr alerts photographers to image theft with Pixsy

Worried about someone swiping your photo off Flickr? The image sharing platform can now integrate with Pixsy accounts to alert photographers when a photo is used without permission by using artificial intelligence to scour the web.
Social Media

Facebook’s tributes section serves as an online memorial for deceased users

Death doesn't stop Facebook users from sharing memories, and now those memorialized posts have a dedicated spot on the network. Facebook Tribute is a section on memorialized profiles for users to write posts and share memories.
Social Media

How to protect yourself from GoFundMe scams before donating

Can you spot a GoFundMe scam? While the fundraising platform says scams make up less than a tenth of one percent of campaigns, some do try to take advantages of others' charity -- like a case last year that made national news.

House votes to restore net neutrality rules, but effort faces long odds

The U.S. House of Representatives has approved the Save the Internet Act, a measure intended to restore net neutrality rules that were repealed in 2017 by the Federal Communications Commission.