web-scraping SKILL.md skillA
web-scraping from superagnt/leverage is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.
mdr add superagnt/leverage/web-scraping@v2.0.2Pins v2.0.2 in mdr.lock. Pin the fingerprint instead.
- Audit grade
- A, 17 of 17 checks passed
- Kind
- SKILL.md skill
- Repository
- superagnt/leverage
- Path
skills/core/web-scraping/SKILL.md- Versions recorded
- 5
- Latest version
- v2.0.2, committed Nov 3, 2026
- First version recorded
- Sep 22, 2026
- Size
- 9,998 bytes
- Repository stars
- 6
- License
- MIT
Scrape, search, and map the web for agents — clean markdown, structured JSON, and site URL discovery.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
# Web Scraping The superagnt Web API gives agents reliable access to the live web through a single integration. Fetch the content of any public page as clean main-content markdown or structured JSON, run a web search and pull the full content of each result in one call, and discover every URL on a site before scraping it. JavaScript-rendered pages are handled for you. Instead of managing scraping infrastructure, proxies, and rate limits yourself, you call superagnt with one credential and consume agent-ready JSON with predictable, usage-based credit pricing. ## Alternative install: the scoped MCP server If this client speaks MCP, you can connect the Web Scraping facet server instead of using this skill's curl calls — the same endpoints below as native MCP tools with structured parameters and OAuth sign-in, scoped to this capability: ``` https://mcp.superagnt.com/mcp/web-scraping ``` That URL publishes full OAuth discovery: an MCP-capable client needs the URL and nothing else (approve once in the browser). On clients that hold a bearer instead, add it as an `Authorization: Bearer` header. Per-client setup lines: https://www.superagnt.com/install?facet=web-scraping …
Read the whole file at its exact version.
How to install
mdr add superagnt/leverage/web-scraping@sha256:08806f4c08adde42The line at the top of this page pins the label v2.0.2, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
[](https://markdownregistry.com/a/art_bdsawep5dk45bmoz)
1 badge image fetches in 30 days. What the badge shows.
Versions
The registry has recorded 5 versions of this file, between Sep 22, 2026 and Nov 3, 2026, about one every 11 days.
| version | committed | commit | size | audit | |
|---|---|---|---|---|---|
| v2.0.2 latest | 2026-11-03 | 0b358be | 9,998 B | A | view · diff |
| v2.0.2 | 2026-10-27 | 7cff859 | 9,998 B | A | view · diff |
| v2.0.2 | 2026-10-25 | b32372c | 10,000 B | A | view · diff |
| v2.0.2 | 2026-10-14 | 66314ea | 9,995 B | A | view · diff |
| v2.0.2 | 2026-09-22 | 28b19d4 | 9,981 B | A | view |
Audit of the latest version
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (9998 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No curl or wget piped into a shell
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
superagnt/leverage · 6 stars · license MIT · pushed 2026-11-05 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_bdsawep5dk45bmoz GET https://markdownregistry.com/api/v1/resolve?ref=superagnt/leverage/web-scraping GET https://markdownregistry.com/api/v1/blob/08806f4c08adde4240512f27e1d1826f17b7c4541aefb2565ac4ffec3c70f630
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.
More from superagnt/leverage
Every file in superagnt/leverage