Microsoft is rolling out a new AI feature called Copilot Actions that can work on your Windows files without needing your constant input. This “experimental” tool is designed to do things like send emails, update documents, or organize your files all on its own. Microsoft promises they’re building in strong security and privacy controls so users don’t have to worry about unwanted actions.

How Copilot Actions Works

Right now, Copilot Actions is still in testing with Windows Insiders in the Copilot Labs program. The idea is simple: you upload files to the Copilot chat, pick “take action,” and then tell it what you want done. For example, you could upload a bunch of photos and ask Copilot to rotate them correctly and remove duplicates. Then, it will handle everything in the background, working with your desktop and web apps to finish the task.

Microsoft explains that Copilot Actions uses AI to “click, type, and scroll” just like a human. It can process the context of what’s on your PC to make smart decisions. Yusuf Mehdi, a Microsoft executive, said it can help with sorting vacation photos or pulling information from PDFs, making digital chores easier and faster.

Privacy, Security, and Trust in AI Automation

Since this feature interacts with your files automatically, Microsoft is taking security seriously. By default, Copilot Actions will be turned off and only have access to certain folders like Documents, Downloads, Desktop, and Pictures. Users will need to give explicit permission if the AI is to access other files outside these areas.

Microsoft also plans to give users full transparency. The tool will show each step it takes and ask for approval in some cases. Users can also stop the process at any time and take back control. These measures are meant to help build trust and ensure the AI isn’t making mistakes or acting unpredictably.

However, Microsoft admits that Copilot Actions isn’t perfect yet. Since it’s still in testing, it might stumble on complex interfaces or make errors. Mehdi highlighted that real-world testing will help improve its reliability. Microsoft is starting with a limited set of use cases and will refine the system based on feedback before a wider release.

Balancing Innovation with Security Concerns

There are valid concerns about how safe it is to let an AI access your files autonomously. Microsoft emphasizes that security features like permission controls and limited access are part of their plan. Dana Huang, a security executive, said the feature will only access your files with your approval and only from designated folders unless you give extra permission.

Microsoft acknowledges past issues with other AI features, like Recall, which took screenshots of users’ devices before making changes. The company is now focusing on making Copilot Actions secure and transparent. Experts like Tom Mainelli suggest that enterprise IT teams will need to thoroughly test the system before deploying it widely, to ensure it meets security standards.

It’s also important to note that Copilot Actions for Windows is different from another tool called Copilot for Microsoft 365. The latter is more about automating workflows within Office apps. Microsoft is also adding new AI features to Windows 11, like a text input option for Copilot Vision, which can see your screen and offer advice. Additionally, they announced “connectors” that let Copilot access files from Microsoft’s cloud services like OneDrive and Outlook, as well as Google Drive and Gmail.

These developments aim to make Windows smarter and more helpful, but Microsoft recognizes the importance of balancing innovation with user safety. As the AI continues to evolve, users and security teams will need to stay cautious and ensure controls are in place to protect data and privacy.

Inspired by

• https://www.computerworld.com/article/4073153/the-newest-windows-copilot-agent-can-send-emails-update-documents-on-its-own.html

Sources

• gmpg.org
• microsoft.com
• asbpe.org
• eddie-ozzie.com
• podigee.com