'computer-use — Drive the user''s desktop in the background — clicking, typing,.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
# Computer Use (universal, any-model, cross-platform)
You have a `computer_use` tool that drives the user's desktop in the
**background** — your actions do NOT move the user's cursor, steal
keyboard focus, or switch virtual desktops / Spaces. The user can keep
typing in their editor while you click around in a browser in another
window. This is the opposite of pyautogui-style automation.
Everything here works with any tool-capable model — Claude, GPT, Gemini,
or an open model on a local OpenAI-compatible endpoint. There is no
Anthropic-native schema to learn.
Hermes drives [cua-driver](https://github.com/trycua/cua) under the hood
for the platform plumbing. The Hermes-side `computer_use` tool exposed
in this skill is a higher-level Hermes vocabulary; the raw cua-driver
MCP tools (which a different agent harness would see) are NOT what you
call — call the `computer_use` actions documented below.
## The canonical workflow
**Step 1 — Capture first.** Almost every task starts with:
```
computer_use(action="capture", mode="som", app="<the app you're driving>")
```
Returns a screenshot with numbered overlays on every interactable
element AND an AX-tree index like:
```
…
The line at the top of this page pins the label v2.0.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
GET https://markdownregistry.com/api/v1/artifacts/art_wnre53x4mpigfy4h
GET https://markdownregistry.com/api/v1/resolve?ref=atlasomnia/hermes-custom-pack/computer-use
GET https://markdownregistry.com/api/v1/blob/bb792db8128bcb6d8814cbbce15fcab4de36a6d898db872b7bbecac455c16ff1
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
atlasomnia/hermes-custom-pack · skills/browser-harness-authoring/SKILL.md · Use when mapping a repeatable website workflow into a verified Hermes skill so later runs can follow known steps…
atlasomnia/hermes-custom-pack · skills/coding-worktree-recovery/SKILL.md · coding-worktree-recovery — Safely recover and continue interrupted or overlapping coding-agent work in a dirty Git…
atlasomnia/hermes-custom-pack · skills/cross-browser-typography-qa/SKILL.md · cross-browser-typography-qa — Diagnose and verify web typography rendering defects across Chromium, WebKit, and native…
atlasomnia/hermes-custom-pack · skills/daily-note-wrapup/SKILL.md · daily-note-wrapup — Create, verify, and index daily wrap-up notes in an Obsidian vault.
atlasomnia/hermes-custom-pack · skills/destination-trip-planning/SKILL.md · destination-trip-planning — Research a specific destination/attraction, gather pricing/logistics, and build a themed…
qwenlm/qwen-code · packages/core/src/skills/bundled/computer-use/SKILL.md · Control local desktop applications through Computer Use for tasks that require reading or operating app UI. Prefer…
thinkinaixyz/deepchat · plugins/cua/skills/computer-use/SKILL.md · Drive native desktop apps through DeepChat's built-in Computer Use tools. Use when the user asks to operate, inspect…
clacky-ai/openclacky · lib/clacky/default_extensions/computer-use/skills/computer-use/SKILL.md · Drive the desktop — macOS, or the Windows desktop through WSL — when a task needs a native app, dialog, menu bar, file…
xuzhougeng/wisp-science · skills/computer-use/SKILL.md · Use Cua Driver through MCP to inspect and operate the user's native desktop apps on Windows, macOS, or Linux. Trigger…
autonomous-ai/lampos · skills/computer-use/SKILL.md · Operate apps/websites on the paired Mac via Buddy: Calendar, Notes, forms, screenshots, files. Never use the headless…
autonomous-ai/autonomous-os · skills/computer-use/SKILL.md · Operate apps/websites on the paired Mac via Buddy: Calendar, Notes, forms, screenshots, files. Never use the headless…
autonomous-ai/physical-ai-operating-system · skills/computer-use/SKILL.md · Operate apps/websites on the paired Mac via Buddy: Calendar, Notes, forms, screenshots, files. Never use the headless…
