Shamraiz | December 8, 2024
Microsoft has invented the future of how browsing can be done using AI by integrating the newly rolled-out Copilot Vision directly into the Edge browser. Copilot Vision is meant to enhance web browsing with more advanced features—reading websites and knowing how to analyze them—in real-time—to help while navigating online content. This AI assistant answers questions, summarizes articles, and even helps you find discounts on products or tips on how to win games like Chess. Microsoft describes Copilot Vision as an assistant that reads the page you’re on and works with you to solve the problem at hand.
Key Copilot Vision Features
Copilot Vision can read and respond to questions you may ask regarding the content you are reading. For example, you might request a recipe from cooking sites or clarify points from an article. It can also make long text easier to read or translate the text into the language you prefer if it is difficult or foreign. While surfing through online store catalogs, Copilot Vision emphasizes discounts, thereby making shopping easier and assisting you in making better buying decisions. For gamers, Copilot Vision offers in-game assistance by providing tips and tricks during matches on platforms like Chess.com.
The company does, of course, understand the importance of privacy, especially when implementing AI technologies. The company has provided the following precautions to address these concerns: Session data cannot be stored: Text, images, as well as audio, is processed and then deleted in every session. Data not used in AI training: Microsoft tells customers their data will not be used in training the company’s AI models during the preview phase. But there are some restrictions as well. Copilot Vision currently does not work on paywalled or sensitive content, and it is confined to a curated list of pre-approved, popular websites.
Although Microsoft has not fully clarified the definition, sensitive content likely refers to explicit material or content involving graphic violence. Permissions for AI tools to access websites are decided on a case-by-case basis and are expected to evolve.
Microsoft’s cautious approach comes in response to legal challenges, such as a lawsuit from The New York Times. The lawsuit alleges that Microsoft allowed users to bypass the publication’s paywall through the Copilot chatbot on Bing. In response, Microsoft has promised to honor machine-readable controls to prevent AI tools from scraping content without consent. However, the specific controls that Copilot Vision will adhere to remain unclear, leaving some questions unanswered.
Collaboration with a Future in Mind
Microsoft is collaborating closely with third-party publishers to understand how AI tools such as Copilot Vision might improve users’ experiences while not violating publishers’ rights or multiplying server costs. The outcome of these collaborations will determine how the tool will interact with web pages and how to improve engagement and decision-making while taking into consideration the interest of content creators.
The Road for Copilot Vision
Copilot Vision does have its drawbacks: significant roadblocks include publishers with content that are fearful of the implications of allowing AI tools access to their websites. It would expand its list of websites if it were able to access them, but its development is ongoing with an interest in technical, legal, and ethical complexities that could surface. For now, Copilot Vision is a big step into the integration of AI in everyday web browsing. The future will prove the success in balancing user needs with publishers’ concerns and, above all, responsible implementation.
Subscription Requirements
Copilot Vision is accessed as part of the Copilot Pro Plan through Microsoft, with a $20/month fee. It thus makes the feature available on a reduced, curated list of users who voluntarily sign up for Microsoft’s experimental AI capabilities.
