Skip to main content

I saw the AI future of Windows 11, and it blew me away

Microsoft Copilot allows you to ask an AI assistant questions within Office apps.
Microsoft

I don’t blame you if you’re fed up with all of the AI talk. It started with ChatGPT, it moved to Bing Chat, and now you can’t open up Apple News without a deluge of AI news. It’s overwhelming. And now, Microsoft wants you to use AI as an assistant throughout all of Windows 11. No thanks.

Call me a cynic, but I pushed back. Bing Chat following me around Windows 11 didn’t sound like a good time, but I swallowed my pride, decided to do my job as a tech journalist, and kindly asked what it could do at Microsoft’s September 2023 event. And Windows Copilot blew me away.

Copied text appearing in Windows Copilot.
Jacob Roach / Digital Trends

Let’s set the stage correctly here: Windows Copilot is Bing Chat on your desktop. That’s something Microsoft fully admitted when I asked, saying that it uses “the same backbone” as the AI chatbot in Edge. What’s special isn’t the AI model, but instead how it’s integrated into Windows.

The clipboard is the best place to start. With Windows Copilot open, it’s always aware of what you have copied to the clipboard. You can copy a section of text, and Copilot will automatically ask what you want to do with it. Microsoft demoed this by copying a list of tourist attractions close to the venue before asking Bing Chat (ahem, Copilot) to create a table with the distance of each from lowest to highest. The AI actually remembered a previous version of this demo, automatically calculating the walking distance instead of by car.

Windows Copilot taking an image as a prompt.
Jacob Roach / Digital Trends

That’s a neat party trick, but Copilot opens up a lot more with the various ways you can interact with it. There’s the clipboard, but you can also drag and drop a photo straight into Copilot. This can be any photo, not just one stored on your desktop. Find a picture of a dish and ask, “How do I make this?” and Copilot will get to work identifying what the photo is and generating a list of recipes.

This works with Snipping Tool — Windows 11’s screenshot utility — as well. Grab a photo from any section of your screen, and Copilot will automatically pick it up. You read that right. You don’t need to save the photo and drag it in. It’s just there.

Windows Copilot answering a math problem.
Jacob Roach / Digital Trends

Microsoft demonstrated this ability with a geometry problem. It used the Snipping Tool to grab a picture of a triangle and asked Copilot to calculate each angle. Not only did Copilot do the calculation, but it also explained the math behind it and linked to several YouTube explanations. This is all happening on your desktop, as well.

The important thing to keep in mind here is that all of these interactions are just context for Copilot. You still provide the prompt. The deep integration with Windows makes something that has been unnatural up to this point — with tools like ChatGPT and Bing Chat — feel like a natural extension of the OS.

That extension goes outside of the cherry-picked prompts that Microsoft has, too. If you’re having problems with your PC, you can ask Copilot about them and it will point you toward the troubleshooters built into Windows. With these suggestions, it isn’t pulling from the internet. It knows the OS, and it can direct you where you need to go in the event the Windows Search falls short (as it so often does).

Introducing Copilot in Windows 11, new AI tools, and more

And, Copilot remembers you. There’s a chat history in Copilot (which you’re free to delete if you wish) that brings additional context into the prompts you enter. It’s the same context Bing Chat can provide, except it spans all of your interactions, not just the singular conversation you’re having.

I already mentioned the example above about Copilot remembering the prompt to offer walking distance. It’s not far-fetched to imagine it will remember if you want to avoid highways when asking for directions, for example, or that you prefer baked recipes over fried ones. It breaks down the walls of Bing Chat.

With that said, Copilot is still something that we need to see over time. I already had my unhinged interaction with Bing Chat, and it’s possible there are problems lurking with Copilot, as well. Thankfully, we won’t have to wait long, as Copilot is set to launch as a feature update to Windows 11 on September 26.

Editors' Recommendations

Jacob Roach
Senior Staff Writer, Computing
Jacob Roach is a writer covering computing and gaming at Digital Trends. After realizing Crysis wouldn't run on a laptop, he…
I hope Microsoft adds this rumored AI feature to Windows 11
A Windows 11 device sits on a table.

From smart speakers to ChatGPT and Bing Chat, AI has slowly crept into our lives, but not all instances of AI are as prominent as those three examples. Sometimes, the effect is subtle, but still pretty nice. It appears that Microsoft is working on one such instance of AI-enhanced tech that could make using Windows 11 just a little more pleasant. We're talking about AI-powered live wallpapers, and they might be coming soon.

First spotted by Windows Latest, Microsoft is readying an AI-powered desktop that could make the whole user experience feel a lot more interactive. The idea is to adjust depth perception and make some backgrounds appear more "alive" when moving your cursor or the entire device. The wallpaper might move or shift, depending on what you're doing on the desktop.

Read more
Windows 11 will finally respect your default browser — in Europe
Microsoft Edge appears on a computer screen with plants and a window in the background.

Microsoft makes it easy to change the default browser in Windows 11. That's important if you require special features specific to one of the many web browsers that are available on a PC. Unfortunately, it's not as simple to be rid of Edge entirely.

Microsoft Edge will still load to open some other file types. When opening a link from Windows Settings or other system components, the webpage will load in Edge. That's now about to change, however, according to a recent Windows blog post.

Read more
This new Windows 11 feature is a great addition for PC gamers
HP Pavilion Gaming Desktop on a desk with two monitors nearby displaying games and a keyboard and headset to the side.

Microsoft is developing improved controls for Windows 11 users, aiming to change how the operating system manages high refresh rate monitors. The latest Windows 11 preview build includes the ability to automatically adjust the refresh rate on multiple monitors based on what content is being displayed.

“We have improved refresh rate logic to allow different refresh rates on different monitors, depending on the refresh rate for each monitor and content shown on the screen. This will help most with refresh rate-dependent multitasking, like playing a game and watching a video at the same time,” said Microsoft’s Amanda Langowski and Brandon LeBlanc in a blog post announcing the new preview build.

Read more