Use Claude Code to spot macOS layout bugs
A developer let Claude Code compile a Mac app, open it, and click through screens to find visual problems.
- What they did
- They enabled the built-in computer-use server through /mcp, then granted macOS Accessibility and Screen Recording access. In each session, they approved the app first, and Claude ran xcodebuild, opened the app, moved through windows, changed window sizes, captured screenshots, and checked the code to point to likely fixes.
- How it went
- The workflow was described as a research preview, so the behavior may shift in later versions. No measured results were given.
- Tips
- Use it in an interactive macOS session with a Pro or Max plan and Claude Code v2.1.85 or newer. Since it works on your live desktop, review anything risky before it clicks, sends, or changes something.
Try it yourself with Claude Code
Open [project path] in Claude Code and build the macOS app. Then, in a live desktop session, ask me to approve the app for each run, click through [screens/flows], resize windows where needed, and look for layout issues such as cut-off text, overlapping elements, or broken alignment. After you inspect everything, give me a bug list with the screen name, what you saw, and a suggested fix. Do not edit code or trigger any irreversible action until I explicitly approve it.
Fill in the [brackets]. Agents can make mistakes, so review anything before it is sent, paid or deleted.
1 more report of this
Get 3 agent uses like this every morning
With the day's top AI news. Free, and one click to unsubscribe.
Related agent uses
Set up Claude Code to manage Tangled issues
They built a Tangled MCP server so Claude Code could check branches and handle issues for repos in owner/repo form.
Turn tracked tickets into pull requests
Use an agent to pick up issues or tickets, make the code change in an isolated pod, and open a PR for review.
Build Playwright tests from a live app with Claude Code
Claude Code inspected a working app, generated a Playwright test, and fixed a locator conflict before a person checked the result.
Use a browser agent to find and fix UI bugs
A frontend developer uses a browser agent and a coding agent together to spot UI issues, trace them in Chrome, and patch the code.
Test an iOS app and collect bugs automatically
Use Claude Code to drive an iOS app through its accessibility tree, visit screens, and return a structured bug report.
Use a browser agent for setup tasks that come up while coding
A developer keeps coding in Claude Code while Claude in Chrome handles related web settings changes in the browser.