Skip to main content

I saw the AI future of Windows 11, and it blew me away

Microsoft Copilot allows you to ask an AI assistant questions within Office apps.
Microsoft
This story is part of our complete Microsoft Events coverage

I don’t blame you if you’re fed up with all of the AI talk. It started with ChatGPT, it moved to Bing Chat, and now you can’t open up Apple News without a deluge of AI news. It’s overwhelming. And now, Microsoft wants you to use AI as an assistant throughout all of Windows 11. No thanks.

Call me a cynic, but I pushed back. Bing Chat following me around Windows 11 didn’t sound like a good time, but I swallowed my pride, decided to do my job as a tech journalist, and kindly asked what it could do at Microsoft’s September 2023 event. And Windows Copilot blew me away.

Copied text appearing in Windows Copilot.
Jacob Roach / Digital Trends

Let’s set the stage correctly here: Windows Copilot is Bing Chat on your desktop. That’s something Microsoft fully admitted when I asked, saying that it uses “the same backbone” as the AI chatbot in Edge. What’s special isn’t the AI model, but instead how it’s integrated into Windows.

Recommended Videos

The clipboard is the best place to start. With Windows Copilot open, it’s always aware of what you have copied to the clipboard. You can copy a section of text, and Copilot will automatically ask what you want to do with it. Microsoft demoed this by copying a list of tourist attractions close to the venue before asking Bing Chat (ahem, Copilot) to create a table with the distance of each from lowest to highest. The AI actually remembered a previous version of this demo, automatically calculating the walking distance instead of by car.

Windows Copilot taking an image as a prompt.
Jacob Roach / Digital Trends

That’s a neat party trick, but Copilot opens up a lot more with the various ways you can interact with it. There’s the clipboard, but you can also drag and drop a photo straight into Copilot. This can be any photo, not just one stored on your desktop. Find a picture of a dish and ask, “How do I make this?” and Copilot will get to work identifying what the photo is and generating a list of recipes.

This works with Snipping Tool — Windows 11’s screenshot utility — as well. Grab a photo from any section of your screen, and Copilot will automatically pick it up. You read that right. You don’t need to save the photo and drag it in. It’s just there.

Windows Copilot answering a math problem.
Jacob Roach / Digital Trends

Microsoft demonstrated this ability with a geometry problem. It used the Snipping Tool to grab a picture of a triangle and asked Copilot to calculate each angle. Not only did Copilot do the calculation, but it also explained the math behind it and linked to several YouTube explanations. This is all happening on your desktop, as well.

The important thing to keep in mind here is that all of these interactions are just context for Copilot. You still provide the prompt. The deep integration with Windows makes something that has been unnatural up to this point — with tools like ChatGPT and Bing Chat — feel like a natural extension of the OS.

That extension goes outside of the cherry-picked prompts that Microsoft has, too. If you’re having problems with your PC, you can ask Copilot about them and it will point you toward the troubleshooters built into Windows. With these suggestions, it isn’t pulling from the internet. It knows the OS, and it can direct you where you need to go in the event the Windows Search falls short (as it so often does).

Introducing Copilot in Windows 11, new AI tools, and more

And, Copilot remembers you. There’s a chat history in Copilot (which you’re free to delete if you wish) that brings additional context into the prompts you enter. It’s the same context Bing Chat can provide, except it spans all of your interactions, not just the singular conversation you’re having.

I already mentioned the example above about Copilot remembering the prompt to offer walking distance. It’s not far-fetched to imagine it will remember if you want to avoid highways when asking for directions, for example, or that you prefer baked recipes over fried ones. It breaks down the walls of Bing Chat.

With that said, Copilot is still something that we need to see over time. I already had my unhinged interaction with Bing Chat, and it’s possible there are problems lurking with Copilot, as well. Thankfully, we won’t have to wait long, as Copilot is set to launch as a feature update to Windows 11 on September 26.

Jacob Roach
Former Lead Reporter, PC Hardware
Jacob Roach is the lead reporter for PC hardware at Digital Trends. In addition to covering the latest PC components, from…
I hope Microsoft adds these 6 things to the next major Windows Update
Windows 11 logo on a laptop.

Windows 11 updates have a bit of a reputation, from slowing Intel's newest desktop processors to breaking games. Despite the occasional hiccup, we still look forward with cautious optimism.

Despite the occasional rough patch, Microsoft continues to evolve the OS, and each update feels like a chance for a new beginning. While Microsoft hasn't confirmed anything yet, the rumor mill is buzzing with what comes next, and I'm starting to feel excited. The talk of new features suggests fixes for long-standing annoyances, productivity boosts, and quality-of-life improvements worth waiting for.
What's coming to Windows in 2025?

Read more
Microsoft could make account-free Windows 11 installs a thing of the past
Windows 11 logo on a laptop.

The offline Windows 11 install looks like it could officially be a thing of the past. 

Microsoft is officially shutting the door on local accounts during Windows 11 setup, confirming that all new installations, Home and Pro alike, will now require a Microsoft account. 

Read more
Copilot+ PC exclusive settings teased in Windows 11 preview
Windows 11 logo on a laptop.

Microsoft is testing out an interesting new aspect within the Settings of the latest Windows 11 preview build that allows users to expand the functions of various applications.

The app settings called "Actions," was hidden in the 26120.3576 build for the Dev Channel. However, enthusiasts uncovered the menu and shared details of its function on various Windows forums, noting the associated apps currently include Photos and Paint. When toggled on, it enables useful tasks that deepen the functions within apps.

Read more