Microsoft has recently introduced the Copilot Vision feature for Windows users in the United States, allowing users to share their screens with AI. This innovative tool enhances Microsoft’s Copilot assistant by enabling the AI to see and interact with what’s displayed on the screen. Users can share their apps or entire screens, allowing Copilot to provide real-time assistance, whether it’s for learning a new software, gaming tips, or analyzing a webpage or photo. Activating Copilot Vision transforms it into a supportive companion that can offer insights and guidance while you work or navigate online.
Whether you’re involved in a project, browsing, or gaming, it facilitates a more seamless experience. Notably, this feature is available for free at the moment and does not require a Copilot Pro subscription, as it is still part of Microsoft’s experimental Copilot Labs. Users can access Copilot Vision through the Copilot app by clicking a glasses icon, which allows selection of the app or browser window to share, resembling screen sharing on a Microsoft Teams call. Importantly, this is an opt-in feature, requiring users to grant permission for the AI to see their applications, unlike Microsoft Recall, which automatically takes snapshots.
While this update significantly enhances Copilot’s assistance capabilities, it raises security concerns. Although the feature only activates when permitted and doesn’t interact without user consent, there are implications, especially for individuals handling sensitive information. As a precaution, users may want to avoid using it for confidential tasks, though it could be suitable for gaming or photo editing. Copilot Vision is compatible with both Windows 10 and Windows 11, but it’s essential to note that support for Windows 10 may diminish as Microsoft encourages users to transition to newer operating systems.