- Microsoft introduces new AI-powered Copilot features, including the ability to analyze and interact with content on your screen through “Copilot Vision.”
- The “Think Deeper” feature enhances Copilot’s ability to solve complex problems with step-by-step reasoning, while “Copilot Voice” adds voice interaction capabilities.
- Copilot’s personalization feature tailors suggestions based on user history, although it is not yet available in the EU.
A week after revealing updates to its AI-driven enterprise suite, Microsoft is bringing several Copilot capabilities to Windows for all users. This includes a powerful new tool called Copilot Vision, which can analyze what’s on your screen, such as websites or images, and provide answers to questions in real-time. The company describes Copilot as being warmer and more distinct, with refreshed versions now available across iOS, Android, Windows, and the web. Notably, Copilot is also making its way to WhatsApp, enabling users to chat with it through direct messages, much like other bots on the platform.
One of the most exciting features, Copilot Vision, offers users a way to interact with what’s on their screens by simply typing “@copilot” in Microsoft Edge. It can analyze both text and images from web pages, answering detailed questions about them. Although similar technologies exist from competitors like Google, Microsoft claims that Copilot Vision is unique in how it handles privacy, promising that all data, including text, images, and audio, are deleted immediately after a session. Additionally, Microsoft is restricting Copilot Vision’s access to paywalled and sensitive websites to avoid legal challenges.
Another key update is the introduction of “Think Deeper,” a feature designed to enhance Copilot’s reasoning abilities. With this update, Copilot can now walk users through more complicated problems using step-by-step explanations. Microsoft has hinted that this new capability is built on an advanced reasoning model fine-tuned from OpenAI’s technology. While the company remains somewhat vague on specifics, the goal is to make Copilot a more versatile assistant for handling everything from complex math problems to everyday decision-making challenges.
For users who prefer voice interaction, Microsoft has launched “Copilot Voice,” a feature that lets users talk to the assistant and hear responses aloud. The feature also introduces four new synthetic voices capable of responding based on the user’s tone during conversations. Initially available in English-speaking regions like the U.S. and U.K., Copilot Voice has a usage limit based on time, with Copilot Pro subscribers enjoying extended minutes.
Finally, Microsoft is rolling out a personalization setting for Copilot, allowing it to offer more customized recommendations based on users’ previous interactions and activities within other Microsoft apps. However, the feature won’t be available to users in the EU for now due to ongoing regulatory concerns. Microsoft is continuing to evaluate its AI strategy for the European market, mindful of privacy regulations that could impact the widespread availability of these features.
