Let Claude open Notes and handle a simple chess task

A writer let Claude use a Mac for Notes and chess, and found that basic actions worked while a 3D chess board quickly consumed his quota.

Done with Claudeยท Beginner

What they did
Ben Patterson enabled computer use in Claude on a Mac mini, then granted the accessibility and screen recording permissions it needed. He also had to confirm each app one at a time. Claude successfully opened Notes and wrote an entry, and later added a lasagna shopping list when prompted from his iPhone through Dispatch. He then asked Claude to play Chess.
How it went
The Notes jobs were completed. Claude struggled when it tried to move one chess piece on the 3D board, and the repeated failures burned through nearly all of his five-hour Claude Pro limit in about 30 minutes. He shut it down after that.
Tips
Keep sensitive windows closed, since the feature shares screenshots of the whole screen. Use it for straightforward tasks and expect usage to disappear fast on a Pro plan.

Try it yourself with Claude

Take over my Mac and do two simple tasks: first, open [notes app] and create a note titled [title] with these points: [bullet list]; then open [chess app or website] and make the first move against the built-in [easy/medium] opponent. Before you click anything that would delete, submit, send, or buy something, stop and ask for my approval. If either task gets stuck, tell me what happened and wait for me to decide whether to continue.

Fill in the [brackets]. Agents can make mistakes, so review anything before it is sent, paid or deleted.

Get 3 agent uses like this every morning

With the day's top AI news. Free, and one click to unsubscribe.