This New Claude Feature Can Automate Basically Everything on Your Mac, but It’s a Huge Security Risk

Claude really wants to take over your computer for you. Anthropic has released a new feature called Computer Use, which can now take control of your Mac's keyboard and mouse to perform tasks on your behalf. This is finally rolling this out as a Research Preview for Claude Pro and Max subscribers, after first being teased back in 2024.

The Computer Use feature builds on recent additions like Claude Cowork and Dispatch. Claude Cowork is a tool that lets you accomplish tasks on your Mac (though, in the background, using native features and macOS integrations), and Dispatch is a new Remote Access feature that lets you control Claude Cowork from your iPhone or iPad (Claude's limited version of OpenClaw), as long as your Mac is online.

How Claude's new Computer Use feature works

As the name suggests, when the Computer Use feature is engaged, Claude takes over the screen completely. Computer Use works in both Claude Cowork and Claude Code, but I tested it only in Cowork (as I'm not a vibecoder, at least, not yet). It can move the cursor, use keyboard input, move and delete files, and, well, do anything it pleases. It can open files, read them, and take action based on the contents of the file. This, of course, is a huge security risk, as it creates the possibility for prompt injection, where a well-hidden malicious line of code can hijack the AI action, risking your personal data.

Anthropic says it has created guardrails to prevent prompt injection, but because AI models are so fast-moving and have a tendency to hallucinate, it's difficult to take Anthropic's word for it. Thankfully, Claude will always ask for permission before accessing new apps and before deleting files.

The good news is that Claude treats Computer Use as very much the last option. When you give a task in Claude Cowork or Claude Code, it will first try to tackle it using its MCP connectors. Say you ask Claude Cowork to write an email to your boss. It will first use the Gmail connector to draft the email. But the MCP connectors are limited; they can't do everything. For example, Gmail's integration can't actually send the email for you. You have to click the button.

Credit: Khamosh Pathak

This is where Claude's browser integration comes in. Claude will ask you if it can take things over in Chrome. If you have Claude for Chrome installed and enabled, it will automatically create relevant tab groups, open the right website, take over the tabs (you will see a glowing light around the tabs that are controlled by Claude), and it will press that Send button for you. When done, it can close those tabs for you as well.

Credit: Khamosh Pathak

I found Claude's Browser Use functionality to be the best use case scenario for me, and it will probably be the best for other heavy computer users, too. In another test, I asked Claude to visit Techmeme, create a summary of the top five news stories, turn it into a Markdown file, and save it locally. It did all this in the background in Chrome while I continued writing in Obsidian. It did a good job of summarizing all posts, and I could read the results and save the file for future reference.

Computer Use can be excruciatingly slow

The Computer Use feature, as I said earlier, is the last straw. Say you ask it to create a calendar appointment using Apple's own Calendar app. There's no MCP server here (though there is for Google Calendar). So instead, Claude will ask you if it can just take over the computer for you.

Credit: Khamosh Pathak

But first, you need to grant Claude access for mouse and keyboard control, and Screen Recording access so it can take screenshots of the screen as it progresses (it's the only way Claude really knows what to do). Next, it will ask you for full access for the particular app. A nice thing is that when this is happening, all other apps and windows are hidden, so there are fewer chances of Claude going rogue and messing up your Word documents, for example.

Then Claude will get to work. You'll see the familiar glowing edges and a small window showing all the steps Claude is trying to take.

Credit: Khamosh Pathak

Given what you're asking Claude to do, this can either be exciting or excruciating to watch. Unlike Claude's browser automation feature, there's nothing for you to do. Claude has taken over the entire screen. This is the biggest limitation of the feature, and perhaps will only get fixed if Claude sets up a virtual environment to perform local tasks.

When Claude takes over the computer, it really takes over. You are locked out, a sitting duck. When I asked it to create a new calendar appointment for me. It was quite exciting to see it happen in real time. It took just 30 seconds or so. Of course, a task as simple as that, I could have done it faster myself. In fact, Claude added the task to a random calendar, while I have a dedicated "F1" calendar right there (any self-respecting fan of the sport would). Once I asked Claude to move the event, it obliged, but it took another 30 seconds. Overall, a nice proof of concept, but it's not something that I'm going to use in my day-to-day life.

Credit: Khamosh Pathak

When I tried using Claude Cowork to move some recent screenshots to a different folder, things went into the excruciating territory. Even after giving full access to my Downloads folder and the Finder app, it just wasn't able to figure out how to actually navigate to the Desktop folder to find the latest screenshots. After a minute or two, it opened the Finder's Go to Folder feature to manually enter the Desktop folder path (at least someone is using this underrated yet useful feature). That is when my patience ran out, and I stopped the task.

And this is my core issue with Claude's Use Computer feature. For tasks that I regularly do on my Mac, like moving files, resizing images, converting documents, adding calendar appointments, compiling research, I'm still much faster at it than Claude, which is essentially using an AI model to make decisions by analyzing one screenshot after another. Not only is it resource intensive, it's slow as hell. Now, if I were a corporate employee who needed to analyze data from multiple files throughout the day, things might be different. Still, in that case, I might be using Claude inside Excel or a coding app to interact directly with the data instead of letting Claude play pretend on my Mac.

How to enable Computer Use in Claude

Credit: Khamosh Pathak

The feature is only available for Claude on macOS, and it's only for paying members of Claude Pro ($20/month) and Claude Max ($100/month and up). As mentioned above, it's in Research Preview, so it's very much still a beta feature. Which is why it's not enabled for everyone by default.

To enable it, go to Settings > General > Computer Use. To enable the browser-based automation features, enable the Browser Use feature (this will let Claude open and navigate to any website in Chrome without asking you first). While you're here, you can add apps to the Denied Apps list to make sure that Claude can never access them. Apps like 1Password and banking apps, would be a good place to start. You can also grant Accessibility and Screen Recording access from this section.

Computer Use is designed for the Mac mini I don't have

Using this feature a couple of times was enough to realize this feature isn't made for me. At least, not until I buy a Mac mini. The browser feature can still be handy because it can run in the background and perform tasks. But sitting around while Claude tries to figure out where to click in Finder is beyond my patience threshold.

This feature, then, is very much designed for people who are into spinning AI agents on their Mac minis using OpenClaw, ones that are online 24/7, processing files, and automating actions (a bad idea, from a security standpoint).

You can control what Claude is doing from your phone, or better yet, your other Mac, the one that you're using for work. From the security angle, this is better than OpenClaw because you can see exactly what Claude is doing, and you can stop or take over at any point. But boy, is it slow going.

View the full article