v1.60.0 to v1.60.0

---

name: baoyu-url-to-markdown

description: Fetch any URL and convert to markdown using baoyu-fetch CLI (Chrome CDP with site-specific adapters). Built-in adapters for X/Twitter, YouTube transcripts, Hacker News threads, and generic pages via Defuddle. Handles login/CAPTCHA via interaction wait modes. Use when user wants to save a webpage as markdown.

version: 1.60.0

metadata:

openclaw:

homepage: https://github.com/JimLiu/baoyu-skills#baoyu-url-to-markdown

requires:

anyBins:

- bun

- npx

---

# URL to Markdown

Fetches any URL via `baoyu-fetch` CLI (Chrome CDP + site-specific adapters) and converts it to clean markdown.

## CLI Setup

**Agent Execution Instructions**:

1. Determine this SKILL.md file's directory path as `{baseDir}`

2. Resolve `${BUN}` runtime: if `bun` installed → `bun`; else suggest installing Bun

3. If `{baseDir}/scripts/node_modules/.bin/baoyu-fetch` does not exist, run `${BUN} install --cwd {baseDir}/scripts`

4. `${READER}` = `{baseDir}/scripts/node_modules/.bin/baoyu-fetch`

5. Replace all `${READER}` in this document with the resolved value

## Preferences (EXTEND.md)

| Result | Action |

|--------|--------|

| Found | Read, parse, apply settings |

| Not found | **MUST** run first-time setup (see below) — do NOT silently create defaults |

### Supported Keys

| Key | Default | Values | Description |

|-----|---------|--------|-------------|

| `default_output_dir` | empty | path or empty | Default output directory (empty = `./url-to-markdown/`) |

**EXTEND.md → CLI mapping**:

| EXTEND.md key | CLI argument | Notes |

|---------------|-------------|-------|

| `download_media: 1` | `--download-media` | Requires `--output` to be set |

## Usage

```bash

# Default: headless capture, markdown to stdout

${READER} <url>

# Save to file

${READER} <url> --output article.md

# Save with media download

${READER} <url> --output article.md --download-media

# Wait for interaction (login/CAPTCHA) — auto-detect and continue

${READER} <url> --wait-for interaction --output article.md

# Wait for interaction — manual control (Enter to continue)

${READER} <url> --wait-for force --output article.md

# JSON output

${READER} <url> --format json --output article.json

# Force specific adapter

${READER} <url> --adapter youtube --output transcript.md

```

## Options

| Option | Description |

|--------|-------------|

| `<url>` | URL to fetch |

| `--output <path>` | Output file path (default: stdout) |

| `--format <type>` | Output format: `markdown` (default) or `json` |

| `--json` | Shorthand for `--format json` |

| `--adapter <name>` | Force adapter: `x`, `youtube`, `hn`, or `generic` (default: auto-detect) |

| `--headless` | Force headless Chrome (no visible window) |

| `--wait-for <mode>` | Interaction wait mode: `none` (default), `interaction`, or `force` |

| `--wait-for-interaction` | Alias for `--wait-for interaction` |

| `--wait-for-login` | Alias for `--wait-for interaction` |

| `--timeout <ms>` | Page load timeout (default: 30000) |

| `--interaction-timeout <ms>` | Login/CAPTCHA wait timeout (default: 600000 = 10 min) |

| `--interaction-poll-interval <ms>` | Poll interval for interaction checks (default: 1500) |

| `--download-media` | Download images/videos to local `imgs/` and `videos/`, rewrite markdown links. Requires `--output` |

| `--media-dir <dir>` | Base directory for downloaded media (default: same as `--output` directory) |

| `--cdp-url <url>` | Reuse existing Chrome DevTools Protocol endpoint |

| `--browser-path <path>` | Custom Chrome/Chromium binary path |

| `--chrome-profile-dir <path>` | Chrome user data directory (default: `BAOYU_CHROME_PROFILE_DIR` env or `./baoyu-skills/chrome-profile`) |

| `--debug-dir <dir>` | Write debug artifacts (document.json, markdown.md, page.html, network.json) |

## Agent Quality Gate

## Output Path Generation

**Algorithm**:

1. Determine base directory from EXTEND.md `default_output_dir` or default `./url-to-markdown/`

2. Extract domain from URL (e.g., `example.com`)

3. Generate slug from URL path or page title (kebab-case, 2-6 words)

4. Construct: `{base_dir}/{domain}/{slug}/{slug}.md` — each URL gets its own directory so media files stay isolated

5. Conflict resolution: append timestamp `{slug}-YYYYMMDD-HHMMSS/{slug}-YYYYMMDD-HHMMSS.md`

Pass the constructed path to `--output`. Media files (`--download-media`) are saved into subdirectories next to the markdown file, keeping each URL's assets self-contained.

## Environment Variables

| Variable | Description |

|----------|-------------|

| `BAOYU_CHROME_PROFILE_DIR` | Chrome user data directory (can also use `--chrome-profile-dir`) |

## Extension Support