web-scraper v1.1.0A

Immutable. This exact content is served forever at /api/v1/blob/21ca5b81e409310d.

---
name: web-scraper
description: >
  Extracts structured data from web pages. Use when user needs page content or
   says scrape page, extract from website, get page data. Triggers: scrape pag
  e, extract from website, get page data, web extract.
version: 1.1.0
author: Stijnman
license: MIT
metadata:
  grok:
    tags: [scrape page, extract from website, get page data, web extract]
    related_skills: [sandbox-internet-handler, humanization-stealth-browsing, internet-enabler]
compatibility: Grok agent; optional MCP and shell access
---

# Web Scraper

## When to Use

- User says **scrape page** or task matches this capability
- User says **extract from website** or task matches this capability
- User says **get page data** or task matches this capability
- User says **web extract** or task matches this capability

## Workflow

1. Fetch via sandbox-internet-handler or WebFetch.
2. Parse HTML to text, tables, or JSON per user spec.
3. Respect robots.txt and rate limits.
4. Return data with source URL and timestamp.

## Integrations

- `sandbox-internet-handler`
- `humanization-stealth-browsing`
- `internet-enabler`

## Error Handling

| Failure | Response |
|---------|----------|
| Blocked by site | Try stealth mode or ask user for export. |

## Gotchas

- Never scrape authenticated pages without user session.

## Example

**Input:** User request matching triggers above.
**Output:** Structured result per workflow with integrations invoked as needed.