Microsoft has its own ‘computer use’ feature for AI agents to automatically use websites and apps.
In a major leap forward for enterprise automation, Microsoft has rolled out a powerful new capability for Copilot Studio that redefines how artificial intelligence interacts with software. The newly introduced “computer use” feature allows AI agents to directly engage with websites and desktop applications—performing tasks by mimicking human behavior, such as clicking buttons, typing into fields, and navigating menus.
This move places Microsoft firmly alongside OpenAI and Anthropic, whose similar features—also dubbed “computer use”—have already turned heads in the AI space. But Microsoft is now taking it a step further, aiming to integrate Copilot Studio more seamlessly into enterprise environments where APIs are either unavailable or impractical to implement.
“Computer use enables agents to interact with websites and desktop apps by clicking buttons, selecting menus, and typing into fields on the screen,” says Charles Lamanna, Corporate Vice President of Microsoft’s Business & Industry Copilot. “This allows agents to handle tasks even when there is no API available to connect to the system directly. If a person can use the app, the agent can too.”
What Can It Do?
With this new functionality, Copilot Studio becomes significantly more versatile. AI agents can now:
- Automate data entry processes in legacy systems
- Conduct real-time market research from web platforms
- Process invoices by navigating accounting software
- Interact with internal business tools without needing backend access
- Execute complex workflows across various apps—regardless of integration support
In essence, if a human can perform a task on a screen, the Copilot AI can now do the same.
Adaptive and Resilient AI
One of the standout features of Microsoft’s approach is the resilience and adaptability of these AI agents. According to Microsoft, the new system is designed to detect changes in application interfaces—like when a button moves or a screen layout shifts—and continue operating smoothly without crashing or requiring reprogramming. This means businesses can rely on Copilot Studio for robust, long-term automation solutions without constant manual updates.
A Parallel Push on the Consumer Side
This enterprise-focused announcement follows Microsoft’s recent update to its consumer Copilot, which added a similar automation toolset called “Actions.” These Actions can be performed quietly in the background, helping users complete tasks such as booking restaurant reservations, ordering event tickets, or purchasing products online—all without interrupting their workflow.
However, while Actions are currently limited to a handful of partner platforms, Copilot Studio’s computer use feature is expected to work across a broader range of applications and websites, making it a more versatile tool for businesses looking to supercharge productivity.
What This Means for Businesses
For organizations of all sizes, this update opens up new possibilities for digital transformation:
- Small businesses can automate time-consuming administrative tasks without investing in costly integrations.
- Large enterprises can rapidly deploy AI solutions across fragmented IT landscapes.
- IT teams can delegate repetitive processes to AI agents, freeing up developers for more strategic projects.
- Customer service and back-office operations can be streamlined using bots that now understand and interact with desktop UIs.
Microsoft’s Bigger Vision
This update is part of Microsoft’s broader push to embed intelligent automation into the fabric of work. With Copilot Studio at the forefront, the company is building a future where AI isn’t just reactive—it’s proactive, adaptable, and deeply embedded in everyday software usage.
As businesses continue to look for ways to drive efficiency, reduce manual work, and optimize workflows, Microsoft’s Copilot Studio offers a compelling solution that blends human-like interaction with machine precision.
Final Thoughts
The launch of the computer use feature in Microsoft Copilot Studio marks a major milestone in the evolution of AI-powered productivity tools. By enabling agents to navigate software interfaces just like a human user, Microsoft is lowering the barriers to automation and making advanced AI accessible to more organizations than ever before.
As this technology evolves, we can expect to see even deeper integration across industries—from finance and healthcare to logistics and education. And with Microsoft leading the charge, the future of intelligent automation looks brighter than ever.
