Skip to main content

Microsoft Copilot now has a voice and can ‘see what you see’ on the internet

The new Surface Laptop 13 on a white table.
Luke Larsen / Digital Trends

You might want to start treating your web browser like you’re always at work, at least if you want to use Microsoft’s new Copilot Vision feature. The feature, which is natively built into Microsoft Edge, is able to “see what you see, and hear what you hear” as you navigate your browser, according to Microsoft’s Executive Vice President Yusuf Mehdi.

All of this AI snooping isn’t for nothing. Copilot Vision looks at what you’re doing online to answer questions, provide recommendations, and summarize content. It can work with the new Copilot Voice feature, for example. Microsoft demoed the capabilities on Rotten Tomatoes, showing a user chatting with Copilot while browsing the website and looking for movie recommendations. Ultimately, Copilot settled on an Australian comedy for the Australian speaker, saying it made the choice because, “well, you’re Australian.” I guess that’s taking personal context into account.

Understandably, the idea of an AI looking at everything you do online might rub some people the wrong way. Microsoft says the feature is opt-in only, meaning you have to manually turn it on, and that there will be an indicator onscreen showing that Copilot is watching what you’re doing. Microsoft also says that data from your session is deleted after you close the session, and that the data won’t be used for training.

In addition, Microsoft says that Copilot Vision will only initially work with a limited number of websites. We don’t have the full list yet, but at the very least, the feature won’t work on “paywalled or sensitive content.” Microsoft also points out that the feature doesn’t process anything on a webpage — it just sees the text and images on a page and analyzes them.

Copilot Voice works in conjunction with Copilot Vision, but it also works on its own. Across desktop and mobile devices, Microsoft says you’ll now be able to hold a conversation with Copilot using just your voice.

Copilot Daily in the Microsoft Edge browser.
Microsoft

Building on the new voice capabilities, Microsoft is releasing Copilot Daily. It’s almost like a personalized morning news show, rounding up stories and giving you daily details like traffic and weather. This, too, is built with a generative AI voice that walks you through your morning news every day. It’s generated based around the content you interact with.

Copilot Voice and Copilot Daily are rolling out to Windows users now in the U.S. and UK. Voice is also available in Australia, Canada, and New Zealand, but only in English. Microsoft says it will bring the feature to more countries and languages soon.

Copilot Vision is starting to roll out “soon” in the U.S., but only for Copilot Pro subscribers. The feature is part of Microsoft’s new Copilot Labs program, which gives Copilot Pro subscribers early access to Microsoft’s latest AI features that are still being tested.

Jacob Roach
Lead Reporter, PC Hardware
Jacob Roach is the lead reporter for PC hardware at Digital Trends. In addition to covering the latest PC components, from…
Tandem OLED laptops are here, but they’re not what you think
Dell XPS 13 2024 front angled view showing display and keyboard.

Tandem OLED made quite a splash on the new M4 iPad Pro when it was announced. After all, it seemed to solve one of the major issues with OLED screens. Having used the display myself, I can say it's certainly impressive.

That's why I was excited to see that Windows laptops were quickly adopting the technology as well, with the first one announced being the new XPS 13 Copilot+ laptop.

Read more
These new chips could be good news for Copilot+ PCs
The Qualcomm Snapdragon X Plus

The first Copilot+ laptops are already out, powered by Qualcomm's impressive new Snapdragon X chip. The first batch of reviews were delayed, and early impressions have observed the hits and misses of the current chips. But a new leak tells us that Qualcomm might have another ace up its sleeve, and there may be hope for these Arm-based Copilot+ PCs yet. What's new? There might be more models of the chip than what we've been privy to so far.

So far, we've seen reviews of the Asus Vivobook S 15, but that's just one of several chips that fall under the Snapdragon X Elite umbrella. According to files for the Adreno GPU driver, there may be not just six, but 10 different models of the Snapdragon X -- and three of those are Plus chips, which we've previously only seen one of.

Read more
The best Copilot+ laptops that you can buy now
The two sizes of the Galaxy Book4 Edge on a table.

Copilot+ PCs represent a new era for Windows. Microsoft's implementation of AI is key to these new devices, of course, but so is the transition to Arm. Although Copilot+ isn't limited to Qualcomm's Arm chips, right now they have exclusivity because of the required 40 Tera Operations Per Second (TOPS) performance of the neutral processing unit (NPU) in these devices.

That means these new laptops are thin, powerful, and have fantastic battery life -- a fantastic antidote to the MacBook Air. Though we haven't reviewed any in-depth yet, here are our favorites from among the ones we've seen in person so far.
Microsoft Surface Laptop

Read more