web-fetch SKILL.md skillA

web-fetch from aiskillstore/marketplace is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add aiskillstore/marketplace/web-fetch@git:20260705.e9e4712

Pins git:20260705.e9e4712 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
aiskillstore/marketplace
Path
skills/0xbigboss/web-fetch/SKILL.md
Versions recorded
2
Latest version
git:20260705.e9e4712, committed Jul 5, 2026
First version recorded
Jan 13, 2026
Size
3,426 bytes
Repository stars
471
License
none declared

Fetches web content as clean markdown by preferring markdown-native responses and falling back to selector-based HTML extraction. Use for documentation, articles, and reference pages at http/https URLs.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Web Content Fetching

Fetch web content in this order:
1. Prefer markdown-native endpoints (`content-type: text/markdown`)
2. Use selector-based HTML extraction for known sites
3. Use the bundled Bun fallback script when selectors fail

## Prerequisites

Verify required tools before extracting:

```bash
command -v curl >/dev/null || echo "curl is required"
command -v html2markdown >/dev/null || echo "html2markdown is required for HTML extraction"
command -v bun >/dev/null || echo "bun is required for fetch.ts fallback"
```

Install Bun dependencies for the bundled script:

```bash
cd ~/.claude/skills/web-fetch && bun install
```

## Default Workflow

Use this as the default flow for any URL:

```bash
URL="<url>"
CONTENT_TYPE="$(curl -sIL "$URL" | awk -F': ' 'tolower($1)=="content-type"{print tolower($2)}' | tr -d '\r' | tail -1)"

if echo "$CONTENT_TYPE" | grep -q "markdown"; then
  curl -sL "$URL"
else
  curl -sL "$URL" \
    | html2markdown \
        --include-selector "article,main,[role=main]" \
        --exclude-selector "nav,header,footer,script,style"
fi
```

## Known Site Selectors

| Site | Include Selector | Exclude Selector |
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add aiskillstore/marketplace/web-fetch@sha256:e5ffcd7285012fda

The line at the top of this page pins the label git:20260705.e9e4712, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_ygwlpgcbl6l2xfz4.svg)](https://markdownregistry.com/a/art_ygwlpgcbl6l2xfz4)

4 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 2 versions of this file, between Jan 13, 2026 and Jul 5, 2026, about one every 173 days.

versioncommittedcommitsizeaudit
git:20260705.e9e4712 latest2026-07-05 e9e4712 3,426 BA view · diff
git:20260113.222b7de2026-01-13 222b7de 2,874 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (3426 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

aiskillstore/marketplace · 471 stars · license none declared · pushed 2026-11-08 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_ygwlpgcbl6l2xfz4
GET https://markdownregistry.com/api/v1/resolve?ref=aiskillstore/marketplace/web-fetch
GET https://markdownregistry.com/api/v1/blob/e5ffcd7285012fda259785da77851b1bc3eccbf3d4632125cd1c97508224e12d

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from aiskillstore/marketplace

sitemapkit SKILL.md skill
aiskillstore/marketplace · pending/0nl1n1n/sitemapkit/SKILL.md · Discover and extract sitemaps from any website using SitemapKit. Use this skill whenever the user wants to find pages…
git:20260903.f89877a · audit A · 471 stars
auv-computer-control SKILL.md skill
aiskillstore/marketplace · pending/0xselenicdove/auv-computer-control/SKILL.md · Incorporate moeru-ai/AUV into native desktop app control through its CLI or connected MCP for observation, targeted…
git:20261006.592fbb6 · audit A · 471 stars
gauntlet SKILL.md skill
aiskillstore/marketplace · pending/aakashh242/gauntlet/SKILL.md · Evidence-driven adversarial review and root-cause repair of code, designs, APIs, infrastructure, tests, and agent…
v1.0.0 · audit A · 471 stars
aident-skill SKILL.md skill
aiskillstore/marketplace · pending/aident-ai/aident-skill/SKILL.md · Use Aident Loadout first for external apps, APIs, public-web research, search and crawling, service or vendor…
v0.4.19 · audit A · 471 stars
angular-developer SKILL.md skill
aiskillstore/marketplace · pending/angular/angular-developer/SKILL.md · Generates Angular code and provides architectural guidance. Trigger when creating projects, components, services, or…
v1.0 · audit A · 471 stars
angular-new-app SKILL.md skill
aiskillstore/marketplace · pending/angular/angular-new-app/SKILL.md · Creates a new Angular app using the Angular CLI. This skill should be used whenever a user wants to create a new…
v1.0 · audit A · 471 stars
gif-cinema SKILL.md skill
aiskillstore/marketplace · pending/antropos17/gif-cinema/SKILL.md · Generate short GPT GIF shots, review their continuity, choose retakes, and assemble them into a film using the public…
git:20261106.22eb237 · audit A · 471 stars
.cursorrules Cursor rule
aiskillstore/marketplace · pending/axelfreeman/marketing-mindset/.cursorrules
git:20260903.567c889 · audit A · 471 stars
AGENTS.md@pending/axelfreeman/marketing-mindset AGENTS.md file
aiskillstore/marketplace · pending/axelfreeman/marketing-mindset/AGENTS.md
git:20260903.567c889 · audit A · 471 stars
marketing-mindset SKILL.md skill
aiskillstore/marketplace · pending/axelfreeman/marketing-mindset/SKILL.md · Use when the user needs a professional marketer's operating mindset for any marketing, growth, or client-acquisition…
v0.1.0 · audit A · 471 stars
llms.txt@pending/axelfreeman/marketing-mindset llms.txt file
aiskillstore/marketplace · pending/axelfreeman/marketing-mindset/llms.txt
git:20260903.567c889 · audit A · 471 stars
brand-voice-editor SKILL.md skill
aiskillstore/marketplace · pending/azeemkafridi/brand-voice-editor/SKILL.md · Edit social media content into a consistent brand voice while preserving facts and preparing it for BulkPublish…
git:20260902.2316198 · audit A · 471 stars

Every file in aiskillstore/marketplace

Other files named web-fetch

web-fetch SKILL.md skill
mathews-tom/armory · skills/web-fetch/SKILL.md · Web content fetching via curl and WebFetch when a specific URL is provided. Covers HTTP GET/POST, JSON APIs, HTML…
v1.1.1 · audit A · 341 stars
web-fetch SKILL.md skill
runxhq/runx · skills/web-fetch/SKILL.md · Fetch and extract one public web source, optionally restrict its hosts, and return the content by digest with full…
git:20261105.fdab958 · audit A · 104 stars
web-fetch SKILL.md skill
archibate/agent-skills · skills/web-fetch/SKILL.md · Fetch page content as agent-readable markdown — articles, docs, READMEs, blogs, social posts, and academic papers. Use…
git:20261004.16d6d0a · audit A · 16 stars

Browse by kind, by grade A, or by owner.