computer-use · git:20260705.5a5efb9 · 2026-07-05 · sha256 63df30eb5db8bfb1

computer-use git:20260705.5a5efb9A

Immutable. This exact content is served forever at /api/v1/blob/63df30eb5db8bfb1.

---
name: computer-use
description: "Drive native macOS apps: click, type, screenshot windows without stealing focus. Use for desktop apps (Slack, Notes, Xcode), macOS workflow automation, or native window screenshots. macOS-only."
allowed-tools: Bash
user-invocable: false
---

# Computer Use (Native Desktop Control)

## Repo Context Probe

If `.claude/skill-context/computer-use.md` exists, read it and honor its declarations; otherwise use the generic defaults described below.

The context file is where a repo declares the native-desktop-control CLI this skill drives: its commands (list apps/windows, click, type, press key, screenshot, selector resolution), how it is installed and opted into, and its error contract. When the file is absent (the common case in a foreign repo), follow the generic baseline below.

## Generic baseline — desktop control requires a repo-provided CLI

Driving native desktop applications (without moving the user's cursor or stealing focus) is not a capability the bare environment provides — it needs an Accessibility-API driver. This skill does not bundle one; it drives whatever native-control CLI the repo supplies and documents in its context file.

- **Context file present** → use the declared CLI's commands exactly as specified to discover apps/windows, inspect the accessibility tree, and drive the target window.
- **Context file absent** → the desktop-control dependency is unavailable in this repo. Tell the user that native desktop control requires a repo-provided CLI which this repo does not declare, and stop gracefully. Do **not** attempt to install a driver or simulate input through other means.

## When to use

- The agent should drive a native desktop app: Notes, Slack, Telegram Desktop, VS Code, Xcode, Finder, etc.
- Capturing screenshots of native (non-browser) app windows.
- Automating multi-step desktop workflows (open app, type text, click button).
- Inspecting accessibility-tree state of a visible window.

Do **not** use for:
- Browser automation — that's BYOB MCP tools (`mcp__byob__browser_*`) or the Chrome MCP. If the agent asks "click this button on a webpage", route to the browser surface, not here.
- Keyboard/mouse simulation that should move the user's actual cursor — native-control drivers act on windows headlessly via the platform Accessibility API, deliberately leaving the user's pointer alone.

## Platform note

Native desktop control is typically platform-specific (e.g. macOS-only via the Accessibility API). The repo-provided CLI is expected to enforce its own platform constraint and exit cleanly on unsupported hosts; honor whatever the context file declares.