Skip to main content

Will Windows AI Copilot be the ultimate PC accessibility tool?

A screenshot of Windows Copilot being used in the sidebar.
Microsoft

At Build 2023, Microsoft made quite a big deal about its headlining announcement, the Windows Copilot. The idea is simple: build AI right into the operating system. In the same way that the Edge browser (and soon the entire stack of Office apps) have their own AI copilots, now Windows will have one too.

Recommended Videos

But in talking to the leader of Microsoft’s Windows (and Surface) group, Panos Panay, I wanted to dig into a different possible use case for generative AI as a tool for accessibility. It wasn’t presented this way, in particular, but having access to a virtual assistant that’s actually smart built right into the operating system of computer certainly seems like it would have some serious value in terms of accessibility.

When I asked Panay about it, he was enthusiastic about the idea. “I have so much passion in this space. When Copilot starts to present itself, you start realizing, regardless of your mode of input, that works for you.”

Microsoft is not new to the world of accessibility — in fact, the company’s been ramping up its offering in all sorts of ways recently, whether it’s features in Windows like Live Captions or its modular Adaptive Accessories. But with Windows Copilot, there’s a new opportunity to bring everything together.

Panos Panay at Microsoft Build 2023.
AMD

Now, there’s always been a basic search function in Windows, but making it hyperintelligent does a lot to transform it into the ultimate accessibility tool. In particular, the Windows Copilot might help those who struggle to fully operate their computer in one way or another.

“When you think about accessibility, whether it’s a dexterity problem or if want to use voice or only write or only type — whatever the mode of input is — the Copilot will take it,” said Panay.

Being able to control your operating system entirely from the Windows Copilot via voice or text seems like an extremely beneficial feature for some. But the even broader benefit Windows Copilot has is as a discovery function.

“Imagine what you can do to enable every single accessibility feature in Windows,” Panay said. “There are things right in front of you for accessibility that we do, but there’s so much in there that’s unique to each person. Imagine if you’re able to just call for it.”

Panay mentioned the wealth of accessibility options that are already built right into Windows, whether that’s Magnifier, Color Filters, Narrator, Live Captions, Translation, or even Sticky Keys. But the problem is that many people who could likely benefit from any or some of these features might not know they exist. In theory, you could request that the Copilot help you with something, and it would automatically point you in the right direction. You wouldn’t have to go digging through settings to see if such a thing even exists.

We’ll have to wait until we’ve used Windows Copilot ourselves to see just how good it is at these things, but for now, it’s certainly promising.

Luke Larsen
Former Digital Trends Contributor
Luke Larsen is the Senior Editor of Computing, managing all content covering laptops, monitors, PC hardware, Macs, and more.
Copilot is Microsoft’s cue to redeem Windows and edge past macOS
The new Surface Laptop 13 on a white table.

There is always going to be a big divide between macOS and Windows. Much of it has to do with the functional disparities that are deeply ingrained at an OS-level. Or if you dive into the heated community debates, you will see it broadly as a battle between seamlessness and flexibility. 

Gaming remains the guiding star for Windows adherents. A handful of highly specialized niche industry tools also remain locked to the Microsoft platform. On the other hand, macOS fans swear by the fluid software, plenty of firepower options in the M-series silicon era, and fantastic hardware. 

Read more
AI can do a lot of things but it can’t make games — or even play them yet
Claude playing Pokemon on Twitch.

As AI tools improve, we keep getting encouraged to offload more and more complex tasks to them. LLMs can write our emails for us, create presentations, design apps, generate videos, search the internet and summarize the results, and so much more. One thing they're still really struggling with, however, is video games.

So far this year, two of the biggest names in AI (Microsoft and Anthropic) have tried to get their models to generate or play games, and the results are probably a lot more limited than many people expect.

Read more
Windows 11’s controversial AI Recall feature is coming to your Copilot+ PC very soon
The Surface Pro 11 on a white table in front of a window.

As AI strides on, it inevitably finds its way onto our personal devices, with tech giants announcing new features that rely on accessing our private information and media to serve us better. While some might find this useful, others are bound to find it creepy, and one such feature is Microsoft's controversial AI Recall, which takes screenshots of everything you do on a Copilot+ PC so it's easier to trace back your steps and find something specific later. After being announced last year, and then witnessing a few delays, Recall is finally rolling out to a broader group of Windows 11.

Microsoft recently announced Recall is coming to Windows 11 with the latest Release channel update with build 26100.3902 (KB5055627). The feature's availability in the Windows 11 Release Preview channel, which succeeds the Beta channel in the Windows Insider program, means it is in the initial phases of being available to a wider audience of folks who own Copilot+ PC. This category of PCs currently includes a whole wide range of laptops with specialized hardware in the form of a neural processing unit (NPU) dedicatedly for running AI tasks, though we might see desktops joining the club soon.

Read more