Technology

Microsoft Unveils Exciting New Copilot+ AI Features in Windows 11 2024 Update

2024-10-01

Author: Ken Lee

Microsoft has taken another significant leap in its ongoing quest to integrate AI into its operating systems, unveiling the highly anticipated Windows 11 2024 update (version 24H2). This time, the spotlight is on the enhanced Copilot+ AI capabilities designed to revolutionize how users interact with their PCs.

One of the standout new features is "Click to Do." This tool enables users to engage with Copilot effortlessly by merely holding down the Windows button and clicking on items on their screen. Whether you’re looking to eliminate an object from an image in the Photos app or need a swift summary of a lengthy article, Click to Do promises to deliver context-sensitive assistance that’s reminiscent of the infamous Clippy—only, hopefully, without the frustration.

In addition to Click to Do, Windows 11 now allows users to upscale images in the Photos app by up to eight times their original resolution. While similar features have been available in apps like Adobe Photoshop and Pixelmator, having this capability directly within the operating system is a significant convenience.

The update also introduces innovative generative AI tools in Paint, enabling users to remove elements from images or create new ones with remarkable ease. This aligns with the growing demand for more intuitive editing tools across the board.

Search functionality has also received an AI upgrade. With the new update, users can simply describe what they're looking for in natural language—no more cryptic search commands. For instance, if you want to find pictures of your dog frolicking on the beach, just type that phrase and watch as the results come to life.

However, not everything in this update can be hailed as seamless. One of the most controversial new features is Recall, which allows users to retrieve past activities on their computer. Initial reports raised serious concerns regarding the security of the Recall screenshots database, with researchers indicating that it could be accessed without needing administrative privileges. In response to this major oversight, Microsoft has paused the rollout of Recall to refine its security measures. Now, users must opt-in, and the feature will use Windows Hello for biometric authentication along with encryption protocols to safeguard data.

Microsoft’s VP of OS and enterprise security, David Weston, emphasized that users remain in control of their data and the experiences provided by Recall, even as the company acknowledges the security challenges that AI brings. Pavan Davuluri, head of Windows, also noted that constructive user feedback has helped improve the overall security of these features.

While all of the Copilot+ features will not be available to every user immediately, Windows Insiders will get early access followed by a phased rollout in November. The broader Windows 11 2024 update also introduces additional features such as Wi-Fi 7 support, HDR backgrounds, energy-saving enhancements to extend battery life, and improved Bluetooth LE hearing aid support.

As Microsoft continues to push the envelope with AI, one thing is clear: to fully embrace these groundbreaking capabilities, users may need to invest in new hardware—precisely what Microsoft and PC manufacturers are banking on. Stay tuned for more updates as this exciting evolution in Windows technology unfolds!