Immutable. This exact content is served forever at /api/v1/blob/79a109107bca7a9a.
---
name: computer-use-bridge
description: >
Bridges desktop automation to agent tool calls. Use when tasks need GUI inte
raction, screen control, or user says computer use, desktop control. Trigger
s: computer use, desktop control, click on screen, GUI automation.
version: 1.1.0
author: Stijnman
license: MIT
metadata:
grok:
tags: [computer use, desktop control, click on screen, GUI automation]
related_skills: [desktop-subagent-connector, hitl-approver]
compatibility: Grok agent; optional MCP and shell access
---
# Computer Use Bridge
## When to Use
- User says **computer use** or task matches this capability
- User says **desktop control** or task matches this capability
- User says **click on screen** or task matches this capability
- User says **GUI automation** or task matches this capability
## Workflow
1. Confirm desktop environment and permissions.
2. Plan actions: click, type, navigate (minimal steps).
3. Execute via desktop-subagent-connector with screenshots.
4. Verify outcome visually; retry once on mismatch.
## Integrations
- `desktop-subagent-connector`
- `hitl-approver`
## Error Handling
| Failure | Response |
|---------|----------|
| Permission denied | Ask user to grant accessibility permissions. |
## Gotchas
- Destructive GUI actions require hitl-approver.
## Example
**Input:** User request matching triggers above.
**Output:** Structured result per workflow with integrations invoked as needed.