Skip to main content

Baidu’s TypeTalk app uses artificial intelligence to power voice transcription

baidu typetalk keyboard rsz img 0047
Image used with permission by copyright holder
Baidu may not have the brand recognition in the United States that it does in mainland China, where the Beijing-based juggernaut commands roughly 80 percent of the internet search market and amasses quarterly profits that regularly top the hundreds of millions. But it’s hoping to change that. In 2013, the Asian juggernaut stuck a Silicon Valley stake in the ground with the Institute of Deep Learning, a research center devoted to advancing the firm’s artificial intelligence efforts. Now, thanks in part to the burgeoning lab’s efforts, Baidu is debuting an app bound for the United States and beyond: TypeTalk, a third-party Android keyboard with AI-powered voice recognition.

TypeTalk, which launched on the Google Play Store a few months ago and received a major update on Monday, isn’t your typical keyboard. Unlike Swype, SwiftKey, or Google Keyboard, Baidu’s effort emphasizes voice over tapping: Selecting a text field surfaces a giant, white microphone icon beneath instructions to “Speak now.”

Recommended Videos

“In our view, we’ve taken a voice-centric approach,” Bijit Halder, TypeTalk’s product manager, told Digital Trends. “It’s in the design. Most keyboards have a little mic button on the side, but we’ve put voice first.”

Please enable Javascript to view this content

That may not sound all that novel — most Android devices ship with voice-to-text capabilities, after all. But there’s more to TypeTalk than meets the eye. At the keyboard’s core is machine intelligence: a voice transcription engine known as Deep Speech. “The special ingredient [is] highly accurate speech recognition, built on Baidu’s … deep learning-based technology,” Andrew Ng, chief scientist at Baidu and founder of Google research initiative Google Brain, said in a press release.

Optimization is to thank, too. TypeTalk personalizes transcription results, tailoring word and phrase suggestions to individual users. “The more data you have, the better algorithm you have,” Halder said. “You can learn. You can improve performance.” And it adapts to surroundings: TypeTalk undertakes voice-to-text near a noisy roadside differently than transcription in a quiet cubicle. “We’re looking at use cases and [continue] to make improvements,” he said.

talktype2png
Image used with permission by copyright holder

If you’ve used Android’s built-in voice transcription, Apple’s Siri on iOS, or Cortana on Windows Phone, TypeTalk’s transcription tech will feel familiar. Tapping the microphone icon begins transcription, during which the keyboard performs a number of labor-saving features on the fly: It capitalizes words at the beginning of sentences, stops listening during periods of silence, and supports voice commands for punctuation like periods, commas, and colons. When it encounters a word in which it’s not entirely confident, an underline appears beneath it — along with a pop-up box with a list of suggestions.

That last feature, error detection, is a component on which the TypeText team spent an outsized amount of development effort. The reason, Halder said, is the extent to which transcription errors can impact accuracy. “It takes time and focus [to correct an error],” he said. “Even finding the word in error is tricky, and correction takes a long time.” According to Baidu, TypeText’s transcription engine can reduce error rate by as much as 20.4 percent.

That’s not the only error-correcting feature TypeText sports. A two-finger gesture allows for the quick highlighting of parts of sentences — the vacant space above, below, and on either side of the microphone icon acts as a trackpad, a swipe along which highlights words and phrases in sentences.

talktype1png
Image used with permission by copyright holder

Baidu contends that TypeTalk’s features, taken together, have the potential to measurably speed up transcription. Halder pointed to a recent study published by Stanford, the University of Washington, and Baidu research that demonstrated Baidu’s voice recognition engine — the same in use with TypeTalk’s — could enable users to input text up to three times faster than, say, hunting and pecking for keys. “The average user can type about 40 to 50 words a minute on mobile, but up to 150 words a minute speaking,” Halder said.

Transcription may by TypeTalk’s headlining feature, but it’s not the only labor-saving one. Baidu’s keyboard sports a full QWERTY keyboard for situations in which transcription’s impossible — one with emojis, alphanumeric keys, symbols, and support for Swype-like gestures which generate AI-powered word suggestions.

And it packs what Baidu calls QuickShare, a tool that taps third-party services to supply images, search results, and other tools. Support for GIF database Giphy lets you browse and share animated movies; Yelp integration lets you search for restaurants and places; and location sharing, as you might expect, shares your current location.

Baidu has big plans for TypeTalk — it sees it as a “growing” product that’ll “evolve” over time. “On mobile, going forward, the focus will absolutely be speech interfaces,” Halder said. “That includes not only speech-to-text, but the whole language and AI behind it. And Baidu is committed to that as a company.”

More concretely, in the next few months, Halder sees intelligent integration with third-party services. “You may be able to say, ‘Come and pick me up,’ and it’ll share your location automatically and summon a car,” he said. “That’s the future of the keyboard.”

Support for Apple’s iOS, on the other hand, isn’t. That’s thanks to restrictions the latest version of the iPhone maker’s operating system, Halder said — third-party keyboards can’t access the iPhone’s microphone. “We’re interested in iOS and other means of getting that functionality, but until Apple changes its policy, support is impossible,” he said.

Here’s hoping that day arrives sooner than later.

Kyle Wiggers
Former Digital Trends Contributor
Kyle Wiggers is a writer, Web designer, and podcaster with an acute interest in all things tech. When not reviewing gadgets…
Samsung might return to all-Exynos for its Galaxy S26 lineup
A close up of the triple camera on the Samsung Galaxy S25 Plus

Samsung has seen a smoother development with its Exynos 2600 chip than it did with the 2500, according to a new report. Prior to the release of the Samsung Galaxy S25, rumors suggested the phone could use the Exynos 2500 or the Snapdragon 8 Elite, and leaks provided a lot of conflicting information. Now, a report from a Korean news outlet says the company has already achieved a 30% yield from its manufacturing process.

The company is using a 2 nanometer production process, and it's initial yields were higher than expected according to The Bell. Samsung plans to start mass production of this chip in the second half of the year and say it could improve performance by 12% and power efficiency by 25%.

Read more
Google Messages might let you unsend awkward messages in RCS chats
The Google Messages app on the Galaxy S25 Ultra.

Google Messages, the default messaging app on Android phones, could soon get new features that will let you unsend texts like third-party messengers. The unsend functionality is reportedly under testing and will be available for chats over RCS protocol, which succeeds traditional SMS with improved support for multimedia, emoji, reactions, etc.

Presently, when you delete a message, it is only removed from your device without impacting other participants in the chat. Now, Google appears to be testing a new "delete for everyone" functionality for conversations that will delete messages for all parties, similar to instant messaging apps such as WhatsApp and Telegram. 9to5Google spotted references to the under-development functionality, suggesting it might be available for a wider audience to benefit from -- though the exact timeline of remains unknown.

Read more
Another AI assistant for iPhone? This one’s different
Le Chat on iPhone.

Did we really need another AI assistant on the iPhone? Perhaps not, but a new one has arrived. Le Chat, developed by Mistral, is a French-based AI assistant that was previously only available online. It has now been launched on the App Store and Google Play Store.

Once called Europe’s great hope for AI, Le Chat uses Mistral’s native language models, such as Mistral Large and Pixtral Large. Thus, the app competes with other AI chatbots, such as OpenAI’s ChatGPT.

Read more