• 2 min read

Computer use is now in public preview in Microsoft Copilot Studio

A man sitting at a desk with his legs crossed, looking contentedly away from his screen
Starting today, customers with U.S.-based environments can add computer use to their agents directly as a tool - meaning agents can work directly with websites and applications.

Computer use, now in public preview, gives your Microsoft Copilot Studio agents the ability to work with websites and desktop applications. Want an agent to extract data from a dashboard or fill out forms in an app that doesn’t have an API? With computer use, you simply describe the task, and your agent uses its own computer to complete it. Built-in reasoning lets it understand and adapt in real time to changes in apps and websites.

Starting today, customers with U.S.-based environments can add computer use to their agents directly as a tool.

A screenshot of an agent filling out an invoice using the computer use tool

New enhancements to computer use

With this public preview release, we’re introducing several enhancements:

  • Hosted browser (powered by Windows 365) – Start automating web tasks right away, no machine setup required. Need to use custom desktop applications or access internal sites? You can always register your own machine.
  • Getting started templates – Quickly explore pre-built templates for common scenarios to spark inspiration.
  • Credentials – Securely store and use login credentials for websites and desktop applications that computer use needs to access.
  • Allow-list – Define exactly which websites and applications computer use is permitted to operate on. If there is an attempt to go outside this list, the run will automatically stop.

Unlock new automation scenarios

With computer use, you can enable your agents to perform even more tasks, such as:

  • Market research and data gathering – Build agents that can navigate across different websites, filter and read through dashboards, and collect the insights you need for analysis.
  • Inventory tracking – Let agents check supplier portals and e-commerce sites to monitor product availability, delivery estimates, or stock levels.
  • Automated data entry – Many processes require transferring information between systems that don’t expose APIs. Now your agents can navigate to those forms and enter the data for you.

Already using desktop flows in Microsoft Power Automate?

If you already use machines to run desktop flows, you can also use them for computer use in Copilot Studio. This allows you to build UI automations that go beyond the traditional limitations of robotic process automation (RPA), handling complex and dynamic interfaces with ease.

Computer use is especially valuable when:

  • UIs shift frequently – Apps and websites are dynamic by nature, with layouts that can vary across versions.
  • It’s easy to get started – Simply describe what you want in natural language, no coding required. You can test and refine with a side-by-side view of the computer and the reasoning chain.
  • Vision matters – The task depends on what’s visible on screen, such as interpreting charts and images.

Get started

You can try the public preview of computer use today in Copilot Studio:

  1. In any US-based environment, create or open an existing agent.
  2. Go to Tools → Add tool → New tool.
  3. Select computer use and start building by simply describing the task you’d like done.
A screenshot showing how to choose computer use in the Tools tab in Copilot Studio

We can’t wait to see what you’ll create with computer use! To learn more, check out the documentation. If you have questions or feedback, we’d love to hear from you at [email protected].

Joe Fernandez

Product Manager
Joe Fernandez is a Product Manager on the Copilot Studio team. He focuses on AI innovation that helps more people automate tasks.
See more articles from this author