web-scraper SKILL.md skillA

web-scraper from cowork-os/cowork-os is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add cowork-os/cowork-os/web-scraper@v1.0.0

Pins v1.0.0 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
cowork-os/cowork-os
Path
resources/skills/web-scraper/SKILL.md
Versions recorded
4
Latest version
v1.0.0, committed Sep 26, 2026
First version recorded
Feb 28, 2026
Size
1,808 bytes
Repository stars
517
License
MIT

Scrape web pages and extract structured data using Scrapling.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Web Scraper

## Purpose

Scrape web pages and extract structured data using Scrapling.

## Routing

- Use when: Use when the user wants to scrape content from websites, especially pages with dynamic content or structured data that needs extraction.
- Do not use when: Don't use for simple URL fetching where web_fetch works fine. Don't use for internal files or local content.
- Outputs: Extracted web content including text, tables, links, images, and metadata.
- Success criteria: Successfully extracts the requested content from the target URL with clean formatting.

## Trigger Examples

### Positive

- Use the web-scraper skill for this request.
- Help me with web scraper.
- Use when the user wants to scrape content from websites, especially pages with dynamic content or structured data that needs extraction.
- Web Scraper: provide an actionable result.

### Negative

- Don't use for simple URL fetching where web_fetch works fine. Don't use for internal files or local content.
- Do not use web-scraper for unrelated requests.
- This request is outside web scraper scope.
- This is conceptual discussion only; no tool workflow is needed.

## Parameters
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add cowork-os/cowork-os/web-scraper@sha256:485e30d9a052183a

The line at the top of this page pins the label v1.0.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_uabkedafeq3x42u3.svg)](https://markdownregistry.com/a/art_uabkedafeq3x42u3)

1 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 4 versions of this file, between Feb 28, 2026 and Sep 26, 2026, about one every 70 days.

versioncommittedcommitsizeaudit
v1.0.0 latest2026-09-26 dadbc49 1,808 BA view · diff
v1.0.02026-09-19 7c80a56 1,900 BA view · diff
v1.0.02026-08-20 5b97842 1,753 BA view · diff
git:20260228.1068a232026-02-28 1068a23 1,670 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (1808 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

cowork-os/cowork-os · 517 stars · license MIT · pushed 2026-11-02 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_uabkedafeq3x42u3
GET https://markdownregistry.com/api/v1/resolve?ref=cowork-os/cowork-os/web-scraper
GET https://markdownregistry.com/api/v1/blob/485e30d9a052183a09f19139cc6735e38603f0b66d5f61886ab5c728cfd0c01b

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from cowork-os/cowork-os

attack-path-analysis SKILL.md skill
cowork-os/cowork-os · resources/plugin-packs/codex-security/skills/attack-path-analysis/SKILL.md · Use when Codex is already in the attack-path-analysis phase of a security scan or the user explicitly asks to trace a…
git:20260919.4f2a470 · audit A · 517 stars
deep-security-scan SKILL.md skill
cowork-os/cowork-os · resources/plugin-packs/codex-security/skills/deep-security-scan/SKILL.md · Use when the user asks for a deep, exhaustive, multi-pass, or variance-reducing repository-wide Codex Security scan…
git:20260606.a4decec · audit A · 517 stars
finding-discovery SKILL.md skill
cowork-os/cowork-os · resources/plugin-packs/codex-security/skills/finding-discovery/SKILL.md · Use when Codex is already in the finding-discovery phase of a security scan or the user explicitly asks to discover…
git:20260919.ad0495b · audit A · 517 stars
fix-finding SKILL.md skill
cowork-os/cowork-os · resources/plugin-packs/codex-security/skills/fix-finding/SKILL.md · Use when the user explicitly asks to fix and verify a validated or plausible security finding. Do not use as the…
git:20260606.a4decec · audit A · 517 stars
security-diff-scan SKILL.md skill
cowork-os/cowork-os · resources/plugin-packs/codex-security/skills/security-diff-scan/SKILL.md · Use when the user asks for a security review of a pull request, commit, branch diff, working-tree patch, or other…
git:20260919.c03e78b · audit A · 517 stars
security-scan SKILL.md skill
cowork-os/cowork-os · resources/plugin-packs/codex-security/skills/security-scan/SKILL.md · Use when the user asks for a repository-wide or scoped-path security scan.
git:20260919.7b075ca · audit A · 517 stars
threat-model SKILL.md skill
cowork-os/cowork-os · resources/plugin-packs/codex-security/skills/threat-model/SKILL.md · Use when Codex is already in the threat-modeling phase of a security scan, the user explicitly invokes $threat-model…
git:20260606.a4decec · audit A · 517 stars
validation SKILL.md skill
cowork-os/cowork-os · resources/plugin-packs/codex-security/skills/validation/SKILL.md · Use when Codex is already in the validation phase of a security scan or the user explicitly asks to determine whether…
git:20260606.a4decec · audit A · 517 stars
1password SKILL.md skill
cowork-os/cowork-os · resources/skills/1password/SKILL.md · Set up and use 1Password CLI (op). Use when installing the CLI, enabling desktop app integration, signing in (single or…
v1.0.0 · audit A · 517 stars
add-documentation SKILL.md skill
cowork-os/cowork-os · resources/skills/add-documentation/SKILL.md · Generate JSDoc/docstrings for functions
v1.0.0 · audit A · 517 stars
agentic-image-loop SKILL.md skill
cowork-os/cowork-os · resources/skills/agentic-image-loop/SKILL.md · Generate -> annotate -> refine -> repeat using generate_image + Visual Annotator (Live Canvas).
v1.0.0 · audit A · 517 stars
analyze-csv SKILL.md skill
cowork-os/cowork-os · resources/skills/analyze-csv/SKILL.md · Load a CSV and provide insights
v1.0.0 · audit A · 517 stars

Every file in cowork-os/cowork-os

Other files named web-scraper

web-scraper SKILL.md skill
sandbaseai/sandbase-skills · research/web-scraper/SKILL.md · Scrape web pages, crawl sites, extract structured data, and capture screenshots through SandBase. Use when asked to…
git:20260813.23df50e · audit A · 206 stars
web-scraper SKILL.md skill
roedyrustam/vibes-plug · skills/web-scraper/SKILL.md · Smart agentic web data extraction with multi-strategy scraping (Crawl4AI v4, Firecrawl), LLM extraction loops, anti-bot…
v4.2.0 · audit A · 118 stars
web-scraper SKILL.md skill
stijnman/grok-custom-skills · .grok/skills/web-scraper/SKILL.md · Extracts structured data from web pages. Use for: scrape page, extract from website, get page data, web extract.
v1.2.0 · audit A · 14 stars
web-scraper SKILL.md skill
jqaisystems/jqai-ai-skills · skills/web-scraper/SKILL.md · Generate browser console scripts to scrape paginated websites. Extracts structured data (text, images, links) across…
git:20260526.32c2e2d · audit B · 3 stars
web-scraper SKILL.md skill
skalesapp/devkit · examples/skills/web-scraper/SKILL.md · Scrape web pages, extract structured data, and save as JSON or CSV
git:20260821.6af77ba · audit A · 3 stars

Browse by kind, by grade A, or by owner.