web-scraping SKILL.md skillB

web-scraping from billy-enrizky/openbrowser-ai is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add billy-enrizky/openbrowser-ai/web-scraping@git:20260521.0c71c6f

Pins git:20260521.0c71c6f in mdr.lock. Pin the fingerprint instead.

Audit grade
B, 16 of 17 checks passed
Kind
SKILL.md skill
Repository
billy-enrizky/openbrowser-ai
Path
plugin/skills/web-scraping/SKILL.md
Versions recorded
5
Latest version
git:20260521.0c71c6f, committed May 21, 2026
First version recorded
Mar 15, 2026
Size
6,748 bytes
Repository stars
279
License
MIT

Extract structured data from websites, scrape page content, and collect information across multiple pages. Trigger when the user asks to: extract data from a website, scrape a page, collect information from URLs, pull content from web pages, gather data across multiple pages, or download page content.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Web Scraping

Extract structured data from websites using Python code execution with browser automation functions. Handles JavaScript-rendered content, pagination, and multi-page scraping.

All code runs via `openbrowser-ai -c`. The daemon starts automatically and persists variables across calls. All browser functions are async -- use `await`.

The CLI daemon also persists cookies and login state in `~/.config/openbrowser/profiles/daemon/storage_state.json`, so authenticated sessions can be reused across later runs.

## Setup

Before running, verify openbrowser-ai is installed:

```bash
openbrowser-ai --help
```

If not found, install:

```bash
# macOS/Linux
curl -fsSL https://raw.githubusercontent.com/billy-enrizky/openbrowser-ai/main/install.sh | sh

# Windows (PowerShell)
irm https://raw.githubusercontent.com/billy-enrizky/openbrowser-ai/main/install.ps1 | iex
```

## Workflow

### Step 1 -- Navigate and get content overview

```bash
openbrowser-ai -c - <<'EOF'
await navigate("https://example.com/data")

# Get browser state to see page title, URL, element count
state = await browser.get_browser_state_summary()
print(f"Title: {state.title}")
print(f"URL: {state.url}")
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add billy-enrizky/openbrowser-ai/web-scraping@sha256:6a9afed5a86d9ba1

The line at the top of this page pins the label git:20260521.0c71c6f, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_lxc2rwnz337x73bt.svg)](https://markdownregistry.com/a/art_lxc2rwnz337x73bt)

4 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 5 versions of this file, between Mar 15, 2026 and May 21, 2026, about one every 17 days.

versioncommittedcommitsizeaudit
git:20260521.0c71c6f latest2026-05-21 0c71c6f 6,748 BB view · diff
git:20260506.8ed3a322026-05-06 8ed3a32 5,475 BB view · diff
git:20260317.4749a902026-03-17 4749a90 5,299 BB view · diff
git:20260316.285dea52026-03-16 285dea5 5,113 BB view · diff
git:20260315.1192abb2026-03-15 1192abb 5,025 BB view

Audit of the latest version

B  16 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • fail: No curl or wget piped into a shell (matched: curl -fsSL https://raw.githubusercontent.com/billy-enrizky/openbrowser-ai/main/install.sh | sh)
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (6748 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Starting a new one? Use a template for SKILL.md on mdpantry, which passes every one of these checks and says what to change in it.

Source

GitHub

billy-enrizky/openbrowser-ai · 279 stars · license MIT · pushed 2026-09-28 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_lxc2rwnz337x73bt
GET https://markdownregistry.com/api/v1/resolve?ref=billy-enrizky/openbrowser-ai/web-scraping
GET https://markdownregistry.com/api/v1/blob/6a9afed5a86d9ba1f00d2a2478457e31b67f0b51df59c1643b3f188e77977c1a

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from billy-enrizky/openbrowser-ai

accessibility-audit SKILL.md skill
billy-enrizky/openbrowser-ai · plugin/skills/accessibility-audit/SKILL.md · Audit web pages for accessibility issues, WCAG compliance, and screen reader compatibility. Trigger when the user asks…
git:20260521.0c71c6f · audit B · 279 stars
deep-research SKILL.md skill
billy-enrizky/openbrowser-ai · plugin/skills/deep-research/SKILL.md · Conduct deep web research using the openbrowser-ai agent: decompose a query, investigate sub-questions across multiple…
git:20260920.eb6953e · audit B · 279 stars
e2e-testing SKILL.md skill
billy-enrizky/openbrowser-ai · plugin/skills/e2e-testing/SKILL.md · Test web applications end-to-end by simulating user interactions and verifying expected outcomes. Trigger when the user…
git:20260521.0c71c6f · audit B · 279 stars
file-download SKILL.md skill
billy-enrizky/openbrowser-ai · plugin/skills/file-download/SKILL.md · Download files from websites, save PDFs, and read downloaded content. Trigger when the user asks to: download a file…
git:20260521.0c71c6f · audit B · 279 stars
form-filling SKILL.md skill
billy-enrizky/openbrowser-ai · plugin/skills/form-filling/SKILL.md · Fill out web forms, submit data, and handle login or registration flows. Trigger when the user asks to: fill a form…
git:20260521.0c71c6f · audit B · 279 stars
page-analysis SKILL.md skill
billy-enrizky/openbrowser-ai · plugin/skills/page-analysis/SKILL.md · Analyze web page content, structure, and layout to understand what a page contains and how it is organized. Trigger…
git:20260521.0c71c6f · audit B · 279 stars
llms-full.txt@stress-tests llms.txt file
billy-enrizky/openbrowser-ai · stress-tests/llms-full.txt
git:20260218.510531e · audit A · 279 stars

Every file in billy-enrizky/openbrowser-ai

Other files named web-scraping

web-scraping SKILL.md skill
maxmiksa/auto-company · .claude/skills/web-scraping/SKILL.md · Web scraping with anti-bot bypass, content extraction, undocumented APIs and poison pill detection. Use when extracting…
git:20260205.e30af14 · audit A · 3,191 stars
web-scraping SKILL.md skill
ginlix-ai/langalpha · plugins/alternative_data/skills/web-scraping/SKILL.md · Web scraping: scrape_page / scrape_pages MCP tools for fetching pages as markdown, HTML, or text (fast HTTP, browser…
git:20260921.26f807b · audit A · 2,249 stars
web-scraping SKILL.md skill
platonai/browser4 · browser4-agentic/src/main/resources/skills/web-scraping/SKILL.md · Extracts data from web pages using browser automation and CSS/JavaScript selectors. Use when you need to scrape…
v1.0.0 · audit A · 1,178 stars
web-scraping SKILL.md skill
jamditis/claude-skills-journalism · dev-toolkit/skills/web-scraping/SKILL.md · Authorized web scraping with fallback cascades and access-failure handling. Use for social media, yt-dlp, CAPTCHA or…
git:20261024.21f0bb2 · audit A · 450 stars
web-scraping SKILL.md skill
chainlesschain/chainlesschain · desktop-app-vue/src/main/ai-engine/cowork/skills/builtin/web-scraping/SKILL.md · Extract structured data from websites - scrape tables, lists, product info, text content
v1.0.0 · audit A · 11 stars
web-scraping SKILL.md skill
superagnt/leverage · skills/core/web-scraping/SKILL.md · Scrape, search, and map the web for agents — clean markdown, structured JSON, and site URL discovery.
v2.0.2 · audit A · 6 stars
web-scraping SKILL.md skill
slilbudget/knowledge-delta-skills · skills/engineering/web-scraping/SKILL.md · Mass crawl/scrape sites incl. anti-bot (Cloudflare, Akamai, DataDome, PerimeterX). Crawl4AI = scale (arun_many…
git:20260929.c1f17bd · audit A · 3 stars
web-scraping SKILL.md skill
sergeyizmailov/knowledge-delta-skills · skills/engineering/web-scraping/SKILL.md · Mass crawl/scrape sites incl. anti-bot (Cloudflare, Akamai, DataDome, PerimeterX). Crawl4AI = scale (arun_many…
git:20260929.c1f17bd · audit A · 3 stars

Browse by kind, by grade B, or by owner.