Android’s “Circle To Search” feature is one of the most marketed feature this year for the operating system, which allows AI to look at the content on screen and provide context or information based on what is circled on the screen. Microsoft is debuting a similar feature for Windows 11, dubbed “Click To Do“.
Windows 11 Click To Do
The Click To Do feature will be available to Copilot+ PCs, now available to Qualcomm-powered laptops (Intel and AMD models are expected to get the free update in this November). Microsoft’s implementation also provides “context-aware” suggestions based on what’s on screen, aside from the visual search capability.
Essentially, users will be given different actions based on the content selected: if the text is selected, the options include explaining, summarizing or rewriting the text; for images, users will given the option to do background blur, background removal or object removal. You also get access to a search bar and Windows Recall in the same interface. Users can trigger the feature by hitting the Windows key and left-click the mouse.
Naturally, this requires significant compute power to work, hence Copilot+ PCs with their more powerful NPUs are required to use this feature – which should mean Click To Do is processed on-device, a good news for privacy-conscious. Besides this feature, Microsoft also announced several improvements surrounding Copilot for Windows 11, including personalization, voice and vision capabilities.
Pokdepinion: If this is mapped to the Copilot key I can see the key being more useful than just opening a webapp though.