After recently announcing updates for its enterprise suite of Copilot AI-powered products, Microsoft is now rolling out new capabilities for all users on Windows. The updates include enhanced Copilot apps for iOS, Android, Windows, and the web, featuring a more “warm” and “distinct” chatbot style. Additionally, Copilot is being integrated into WhatsApp, allowing users to interact with it via direct messaging.
Copilot Vision
Copilot Vision provides insights into the content displayed on users’ screens, specifically through Microsoft Edge. This feature, currently in a limited beta under Copilot Labs, can analyze text and images on web pages and answer related questions. For instance, users can ask about recipes in photos they see online. While similar technology exists in Google’s Android and Chrome, Microsoft claims that Copilot Vision is designed with privacy in mind, ensuring that data is deleted after conversations.
However, there are limitations. Copilot Vision is restricted from analyzing paywalled and sensitive content, relying instead on a select list of “popular” web properties. Microsoft emphasizes its commitment to respecting website controls that prevent data scraping for AI training.
Think Deeper Feature
The new Think Deeper feature aims to enhance Copilot’s ability to handle complex problems. This capability employs advanced reasoning models, allowing Copilot to deliver more detailed, step-by-step answers. Though Microsoft is vague about the specific models used, they are likely customized versions of OpenAI’s latest models. Think Deeper will initially be available to select users in the U.S., Canada, U.K., Australia, and New Zealand.
Copilot Voice
Copilot Voice, now generally available, introduces four synthetic voices, enabling users to interact with Copilot verbally. The feature recognizes user tone and allows interruptions during responses. However, there are usage limits based on subscription type, with Pro subscribers receiving variable additional minutes.
Personalization
A new personalization setting will enable Copilot to tailor its suggestions based on users’ past interactions and preferences across Microsoft services. While this feature aims to enhance user experience, it is not yet available in the U.K. or EU due to regulatory concerns. Microsoft is currently evaluating options to implement personalization for users in the European Economic Area.
Conclusion
Microsoft’s Copilot updates demonstrate a significant push to enhance user interaction with AI across platforms while addressing privacy concerns. With features like Copilot Vision, Think Deeper, and Copilot Voice, Microsoft is positioning itself as a leader in the AI assistant space, even as it navigates regulatory challenges in various regions.
