Skip to main content

Will Windows AI Copilot be the ultimate PC accessibility tool?

A screenshot of Windows Copilot being used in the sidebar.
Microsoft

At Build 2023, Microsoft made quite a big deal about its headlining announcement, the Windows Copilot. The idea is simple: build AI right into the operating system. In the same way that the Edge browser (and soon the entire stack of Office apps) have their own AI copilots, now Windows will have one too.

But in talking to the leader of Microsoft’s Windows (and Surface) group, Panos Panay, I wanted to dig into a different possible use case for generative AI as a tool for accessibility. It wasn’t presented this way, in particular, but having access to a virtual assistant that’s actually smart built right into the operating system of computer certainly seems like it would have some serious value in terms of accessibility.

When I asked Panay about it, he was enthusiastic about the idea. “I have so much passion in this space. When Copilot starts to present itself, you start realizing, regardless of your mode of input, that works for you.”

Microsoft is not new to the world of accessibility — in fact, the company’s been ramping up its offering in all sorts of ways recently, whether it’s features in Windows like Live Captions or its modular Adaptive Accessories. But with Windows Copilot, there’s a new opportunity to bring everything together.

Panos Panay at Microsoft Build 2023.
AMD

Now, there’s always been a basic search function in Windows, but making it hyperintelligent does a lot to transform it into the ultimate accessibility tool. In particular, the Windows Copilot might help those who struggle to fully operate their computer in one way or another.

“When you think about accessibility, whether it’s a dexterity problem or if want to use voice or only write or only type — whatever the mode of input is — the Copilot will take it,” said Panay.

Being able to control your operating system entirely from the Windows Copilot via voice or text seems like an extremely beneficial feature for some. But the even broader benefit Windows Copilot has is as a discovery function.

“Imagine what you can do to enable every single accessibility feature in Windows,” Panay said. “There are things right in front of you for accessibility that we do, but there’s so much in there that’s unique to each person. Imagine if you’re able to just call for it.”

Panay mentioned the wealth of accessibility options that are already built right into Windows, whether that’s Magnifier, Color Filters, Narrator, Live Captions, Translation, or even Sticky Keys. But the problem is that many people who could likely benefit from any or some of these features might not know they exist. In theory, you could request that the Copilot help you with something, and it would automatically point you in the right direction. You wouldn’t have to go digging through settings to see if such a thing even exists.

We’ll have to wait until we’ve used Windows Copilot ourselves to see just how good it is at these things, but for now, it’s certainly promising.

Editors' Recommendations

Luke Larsen
Senior Editor, Computing
Luke Larsen is the Senior editor of computing, managing all content covering laptops, monitors, PC hardware, Macs, and more.
Windows 11 vs. Windows 10: finally time to upgrade?
The screen of the Surface Pro 9.

Windows 11 is the newest version of Windows, and it's one of the best Windows versions released. At launch, the operating system was very similar to Windows 10, but it has morphed a lot over the past several years. Now, Windows 11 has several key differences compared to Windows 10.

If you've been holding out on upgrading, we have everything you need to know about Windows 11 and how it's different than Windows 10 in this article. We'll detail the differences, as well as show you the areas where Windows 11 is growing faster than Windows 10.
Windows 11 vs. Windows 10: what's new

Read more
Microsoft Copilot vs. Google Duet: battle of the next-gen AI smart assistants
Microsoft's AI Copilot being used in various Microsoft Office apps.

Microsoft Copilot and Google Duet are the two most prominent artificial intelligence assistants put out by the various tech giants since OpenAI debuted its ChatGPT chatbot in 2022. They're set to bring that powerful natural language assistance into the enterprise in ways that can enhance productivity, improve the digital fluency of workers, and leverage existing data in new and exciting ways.

But which one is best? Both offer comparable features at a comparable cost, but they aren't interchangeable and even getting access to either tool requires a bit of luck. Here's how these two awesome AI tools compare.

Read more
I hope Microsoft adds this rumored AI feature to Windows 11
A Windows 11 device sits on a table.

From smart speakers to ChatGPT and Bing Chat, AI has slowly crept into our lives, but not all instances of AI are as prominent as those three examples. Sometimes, the effect is subtle, but still pretty nice. It appears that Microsoft is working on one such instance of AI-enhanced tech that could make using Windows 11 just a little more pleasant. We're talking about AI-powered live wallpapers, and they might be coming soon.

First spotted by Windows Latest, Microsoft is readying an AI-powered desktop that could make the whole user experience feel a lot more interactive. The idea is to adjust depth perception and make some backgrounds appear more "alive" when moving your cursor or the entire device. The wallpaper might move or shift, depending on what you're doing on the desktop.

Read more