smart-web-fetch SKILL.md skillA

smart-web-fetch from jkheadley/instar is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add jkheadley/instar/smart-web-fetch@v1.0

Pins v1.0 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
jkheadley/instar
Path
skills/smart-web-fetch/SKILL.md
Versions recorded
1
Latest version
v1.0, committed Feb 21, 2026
Size
8,316 bytes
Repository stars
85
License
MIT

Fetch web content efficiently by checking llms.txt first, then Cloudflare markdown endpoints, then falling back to HTML. Reduces token usage by 80% on sites that support clean markdown delivery. No external dependencies — installs a single Python script. Trigger words: fetch URL, web content, read website, scrape page, download page, get webpage, read this link.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# smart-web-fetch — Token-Efficient Web Content Fetching

Fetching a webpage with the default WebFetch tool retrieves full HTML — navigation menus, footers, ads, cookie banners, and all. For a documentation page, 90% of the tokens go to chrome, not content. This script fixes that by trying cleaner sources first.

## How It Works

The fetch chain, in order:

1. **Check `llms.txt`** — Many sites publish `/llms.txt` or `/llms-full.txt` with curated content for AI agents. If present, this is the best source: intentionally structured, no noise.
2. **Try Cloudflare markdown** — Cloudflare's network serves clean markdown for millions of sites via a URL prefix trick. If the site is behind Cloudflare, this returns structured markdown at ~20% of the HTML token cost.
3. **Fall back to HTML** — Standard fetch, with HTML stripped to readable text. Reliable but verbose.

The result: typically 60-80% fewer tokens on documentation sites, blog posts, and product pages.

---

## Installation

Copy the script into your project's scripts directory:

```bash
mkdir -p .claude/scripts
```

Then create `.claude/scripts/smart-fetch.py` with the contents below.

---

## The Script
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add jkheadley/instar/smart-web-fetch@sha256:acdaebd7290e4d8f

The line at the top of this page pins the label v1.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_pe2vyt76wqajhkr2.svg)](https://markdownregistry.com/a/art_pe2vyt76wqajhkr2)

4 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 1 version of this file, committed on Feb 21, 2026.

versioncommittedcommitsizeaudit
v1.0 latest2026-02-21 3644d67 8,316 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (8316 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

jkheadley/instar · 85 stars · license MIT · pushed 2026-11-05 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_pe2vyt76wqajhkr2
GET https://markdownregistry.com/api/v1/resolve?ref=jkheadley/instar/smart-web-fetch
GET https://markdownregistry.com/api/v1/blob/acdaebd7290e4d8f207db3db88b167b84797dd6400fd2e3edf36625343b5405c

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from jkheadley/instar

autonomous SKILL.md skill
jkheadley/instar · .claude/skills/autonomous/SKILL.md · Enter autonomous development mode with STRUCTURAL enforcement. Uses a stop hook to prevent premature exit. Generates…
git:20261022.976268d · audit A · 85 stars
instar-project SKILL.md skill
jkheadley/instar · .claude/skills/instar-project/SKILL.md · Register, inspect, and drive multi-spec projects via the instar /projects API. Twelve subcommands cover the full Phase…
git:20260801.e224316 · audit A · 85 stars
secret-setup SKILL.md skill
jkheadley/instar · .claude/skills/secret-setup/SKILL.md · Focused micro-skill for secret management setup. Explains options, guides through Bitwarden installation/login/unlock…
git:20260405.b4a3a2d · audit A · 85 stars
setup-wizard SKILL.md skill
jkheadley/instar · .claude/skills/setup-wizard/SKILL.md · Interactive conversational setup wizard for instar. Walks users through initial configuration and identity…
git:20261103.bc0315a · audit B · 85 stars
test-as-self SKILL.md skill
jkheadley/instar · .claude/skills/test-as-self/SKILL.md · Deploy the current instar dist into a throwaway agent home and verify the deploy is healthy — clean evidence instead of…
git:20260528.835672c · audit A · 85 stars
CLAUDE.md CLAUDE.md file
jkheadley/instar · CLAUDE.md
git:20261022.5708ebe · audit A · 85 stars
llms.txt@site/public llms.txt file
jkheadley/instar · site/public/llms.txt
git:20260309.f153ee9 · audit A · 85 stars
agent-identity SKILL.md skill
jkheadley/instar · skills/agent-identity/SKILL.md · Set up persistent agent identity files (AGENT.md, USER.md, MEMORY.md) and teach the agent to read them at every session…
v1.0 · audit A · 85 stars
agent-memory SKILL.md skill
jkheadley/instar · skills/agent-memory/SKILL.md · Teach cross-session memory patterns using MEMORY.md — what to save, how to organize it, how to maintain it over time…
v1.0 · audit A · 85 stars
agent-passport SKILL.md skill
jkheadley/instar · skills/agent-passport/SKILL.md · View this agent's digital passport (identity + trust + allowed/forbidden actions) and verify a peer's passport against…
git:20260606.972e9ab · audit A · 85 stars
agent-readiness SKILL.md skill
jkheadley/instar · skills/agent-readiness/SKILL.md · Score a task or workflow on its coordination-vs-judgment ratio to tell whether it's a good agent candidate (EXO 3.0…
git:20260606.a5aaf68 · audit A · 85 stars
command-guard SKILL.md skill
jkheadley/instar · skills/command-guard/SKILL.md · Set up a PreToolUse hook in .claude/settings.json that blocks dangerous commands — rm -rf, force push, database drops…
v1.0 · audit A · 85 stars

Every file in jkheadley/instar

Browse by kind, by grade A, or by owner.