Windows 11 AI Upgrades for Copilot+ PCs and a Controversial Change

Windows 11 is receiving two significant AI-powered upgrades specifically for Copilot+ PCs, in addition to a change that might not be welcomed by everyone. These updates are currently available in the latest Windows 11 Insider Preview (Build 26120.5790) on the Beta Channel.

What are Copilot+ PCs?

Definition of Copilot+ PCs: Copilot+ PCs are a new class of Windows 11 personal computers powered by artificial intelligence. These devices feature a super-fast Neural Processing Unit (NPU), a specialized chip designed for heavy AI tasks such as real-time translation and image generation. These units can perform over 40 trillion operations per second (TOPS), providing unprecedented performance in AI tasks. They are also designed to offer long battery life of up to 22 hours for local video playback and 15 hours for web browsing, along with advanced security features like Secured-core PC technology and the Microsoft Pluton security processor, which protect user data. Source: Microsoft Learn

Enhanced Smooth Voice Dictation

Smooth Dictation: The first of these upgrades is a significant improvement in voice dictation, called "Smooth Voice Dictation." Microsoft asserts that this enhancement will make the voice dictation experience in Windows 11 "smoother and smarter." This feature includes automatic correction of grammatical errors and punctuation, and the removal of filler words like "you know" or "like" that might be inadvertently added during voice dictation.

AI-Powered Windows Studio Effects

Windows Studio Effects: The second improvement is the expanded availability of AI-powered Windows Studio Effects. These effects include the ability to blur the background or simulate eye contact during video calls, and will now be available for a wider range of webcams, not just the built-in camera on Copilot+ PCs. Interestingly, this feature will first be available for Copilot+ PCs with AMD processors, then for Snapdragon (Arm) devices and Intel processors, a different order than usual, as Snapdragon devices often receive updates first.

New Options in File Explorer

New Options: On the other hand, Microsoft is introducing new options when hovering over files on the File Explorer homepage. These options include opening the file in its original location and an "Ask Copilot" option about the file. This functionality requires logging into a Microsoft account. Some users might find the addition of the "Ask Copilot" option to the list of available options when hovering over files on the File Explorer homepage unnecessary or contributing to clutter in the user interface.

Exclusive Features for Copilot+ PCs

Exclusive Features: It's worth noting that these key features, including enhanced voice dictation and expanded Windows Studio Effects, are exclusive to Copilot+ PCs and will not be available for regular Windows 11 devices. Microsoft confirmed that the AI processing for voice dictation occurs on the device itself using small language models (SLMs), ensuring privacy and no data is sent to Microsoft cloud servers. Voice dictation is also disabled in password input fields to maintain security. Additionally, users can turn off this feature if they do not wish to use it.