Microsoft’s Copilot can now browse the web and perform tasks for you

Copilot now browses, analyzes video, and remembers user details.

: Microsoft's Copilot can now perform actions on most websites, booking tickets and reserving restaurants, enhancing user experience. It remembers user preferences to offer tailored solutions and can generate podcasts, similar to Audio Overviews. Copilot analyzes real-time video from phone cameras and desktop screens, organizing files and settings. New features like Deep Research and Pages aid in complex queries and project organization, with user control over memory retention.

Microsoft’s Copilot, a next-gen AI developed by integrating OpenAI technology with Microsoft’s own innovations, has seen major upgrades to celebrate its 50th birthday. These updates leverage its capability to perform tasks akin to those of competitors like ChatGPT and Google’s Gemini, extending its functionality to browsing most websites and executing intricate tasks such as booking tickets or making restaurant reservations. Microsoft’s collaboration with major platforms such as Booking.com, Expedia, and OpenTable allows Copilot to seamlessly manage actions initiated by prompts, streamlining the online interaction process for its users.

The recently enhanced Copilot also includes impressive new abilities that mimic Google’s Audio Overviews, wherein it can synthesize content into a dialogic podcast format. Users can now engage with these synthetic hosts by interrupting them with questions, leading to a more interactive and informative experience. Furthermore, the capability to analyze real-time video from smartphone cameras or desktop screens marks another significant stride, enabling users to receive context-aware responses to complex visual inquiries.

Supporting multi-platform functionality, Copilot can now visually interpret data from Android and iOS devices, as well as Windows desktops. This includes recognizing objects via a phone’s camera, reorganizing desktop files, and modifying system settings, all intended to enhance performance efficiency and user convenience. Notably, these upgrades are set to roll out to Windows Insider program users, heralding a broader public release in the ensuing weeks.

Memory and personalization have become focal points, with Microsoft ensuring Copilot can remember users’ preferences. This personalization extends to suggesting task solutions and reminders based on past interactions, with users retaining control over what memory data can be stored or deleted. Such memory-based features position Copilot as not just a task assistant but a personalized digital companion.

Despite these innovations, some ambiguities remain, especially concerning the machine's learning data integrity and user privacy. Microsoft has emphasized user control, allowing individuals to manage the types of personal data that Copilot can retain or to opt-out completely. There is potential concern over website blocking since competitor platforms, such as OpenAI’s Operator, face similar restrictions. Nonetheless, this feature-rich AI represents a step forward in facilitating automated, intelligent assistance for digital life navigation, showcasing Microsoft’s ambition within the technology and AI domains.

Sources: TechCrunch, Microsoft Blog, The Verge

technologyAISoftware