Microsoft announced improvements to Copilot in a blog post today, including a new Vision feature that allows the AI assistant to view and interact with users’ Windows screens in real time.
As part of Microsoft’s 50th anniversary, it announced a huge improvement to Copilot, making it more personalized and guiding users through tasks at every step. Microsoft introduced Vision in Copilot for the web last year, but the announcement is now for Windows and mobile. You can use the native Windows app to use Copilot when working across various apps, files, and browser tabs. Vision in Copilot will read your screen and interact with it.
You can use Copilot to search, organize files, change settings, and work together on projects without constantly switching apps or files. You can access the Copilot app by pressing Alt + Space or by pressing Alt + Space for two seconds for voice commands. Microsoft says the native Copilot app is available today, but the Vision feature will reach the Windows Insider program first next week for future testing. The software giant didn’t mention a specific general release date, so we can only wait.
During a demo, Microsoft showed how Copilot added a second cursor to guide users by highlighting the buttons they needed to click. For example, in Photoshop, Copilot Vision pointed out specific tools and the steps the user needed to follow next. The Vision feature used voice instructions and visual cues to provide a more interactive experience, which is a giant leap forward.
While Vision could make interacting with your Windows computer easier, giving an AI assistant access to everything on your screen could raise privacy concerns. But Microsoft did say that the sessions are entirely opt-in and ephemeral. Microsoft claims Copilot Vision does not save or use anything it interacts with. Microsoft also says that Copilot Vision can answer questions about what’s on your screen and provides an example by saying, “Imagine you’re trying to furnish a new apartment, Copilot Vision can help you search for furniture, find the right color palette, think through your options on everything from rugs to throws and even suggest ways of arranging what you’re looking at.”
It was just last month that OpenAI boss Sam Altman claimed that Meta had been trying to poach his top AI engineers by offering hiring bonuses of as mu
What’s happened? A supposed GPT-5 system prompt leaked via Reddit and GitHub this weekend. The prompt reveals the exact rules given to ChatGPT for int
With the launch of GPT-5, ChatGPT received more than just an upgrade — it appears to have gone through a personality overhaul. Comparing past chats wi
There is always going to be a big divide between macOS and Windows. Much of it has to do with the functional disparities that are deeply ingrained at
Microsoft is late to the party, but it is finally bringing a deep research tool of its own to the Microsoft 365 Copilot platform across the web, mobil
Update: Google has responded to Digital Trends’ queries. The story has been updated with company’s statement below.The rise of generative AI has been
We are a dynamic information platform dedicated to delivering timely, relevant, and reliable content across a broad spectrum of topics. From the latest in technology and business to lifestyle, health, and global affairs, we aim to keep our readers informed and inspired.
Our editorial team is committed to maintaining high standards of accuracy and clarity, ensuring that every article provides value and context in an ever-changing world. We believe in the importance of accessible knowledge and strive to make complex topics understandable for everyone.
Whether you're here to stay updated on current events, explore thought-provoking features, or simply learn something new, our goal is to offer a trustworthy source of information that meets the needs of a diverse and curious audience.