Computer use
What it does
On macOS, Computer Use observes the screen via accessibility APIs and screenshots, then clicks, types, scrolls, drags, opens apps, and runs AppleScript. That GUI path is not the Linux 0.1 path.
Setup
Not available as a Linux 0.1 skill. Linux uses confirm-gated host_file_* and host_bash after you grant host computer access, plus the Browser skill for the web. Do not expect a silent full-disk grant at hatch.
Permissions
- macOS (not 0.1): Accessibility and Screen Recording. Each GUI action is prompted.
- Linux 0.1: host access is a separate grant. Sandbox bash is not host bash.
Common prompts
| You say | What happens |
|---|---|
| “List files in my home documents folder” (Linux) | host_file tools after you grant host access |
| “Run this build in the project directory” (Linux) | host_bash, confirm-gated |
| “Open the bank site and tell me the headline” (Linux) | Browser skill, not GUI computer use |
| “Click the Submit button” (macOS Computer Use) | Not Linux 0.1 |
Configuration
- macOS sessions cap at 50 steps with loop detection.
- Linux host tools follow the permissions model, not a 50-step GUI overlay.
Tips
- Linux-first honesty. If someone asks “can Cadence drive my desktop like a person?”, the 0.1 answer on Linux is: host files/shell with confirmation, and Browser for the web. Not Accessibility-tree clicking.
- Screenshots (when taken) go to the model. Mind what is on screen.
- See Permissions and Security best practices.
Related: Browser, Local hosting.