web-forager SKILL.md skillA

web-forager from jiamingshi-jsphys/web-forager is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add jiamingshi-jsphys/web-forager/web-forager@v1.1.0

Pins v1.1.0 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
jiamingshi-jsphys/web-forager
Path
SKILL.md
Versions recorded
5
Latest version
v1.1.0, committed Nov 9, 2026
First version recorded
Nov 6, 2026
Size
16,166 bytes
Repository stars
3
License
MIT

Polite, robots-aware web information gathering with two modes. HTTP mode searches 360/Bing/Sogou/WeChat, reads HTML/PDF/DOCX/XLSX/EPUB/CSV and RSS/Atom, collects public pages from Bilibili through a dedicated adapter and reads other sites as ordinary pages, discovers sitemaps, chunks long Markdown, caches responses, and surfs the web link by link with resumable sessions. Browser mode drives a real browser through a bridge for login-state pages, rendered content, danmaku and seven read-only…

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

> ## 免责声明(务必阅读)
>
> **本插件仅供学习与信息收集使用。使用者需遵守目标网站的 Terms of Service 及相关版权法律。禁止用于抓取个人隐私数据或进行恶意并发攻击。**

# web-forager

Clean-room implementation. Only `requests`, `beautifulsoup4`, `trafilatura`
and (optional) `playwright` / `pypdf` are used. No GPL/AGPL dependency.

- **Stage:** `domain_extensions` · **Sandbox:** no
- **Dependencies:** requests, beautifulsoup4, trafilatura
- **Optional:** playwright (JavaScript rendering), pypdf (PDF text)
- **Standard-library formats:** DOCX, XLSX, EPUB, CSV, RSS, Atom, sitemap
- **MCP:** `python mcp_server.py` (stdio JSON-RPC; tools: web_fetch,
  web_search, web_surf, web_scholar, web_map, web_bilibili, web_clean,
  web_doctor) and
  `node browser/mcp_server.js` (browser_list, browser_run, browser_session,
  browser_doctor)

> **启用 JS 渲染:** 用户需自行运行
> `pip install playwright && playwright install chromium`。
> 未安装时 `--render auto` 会跳过渲染并在 `warnings` 中说明;`--render always`
> 会以**退出码 6**优雅报错,不会抛 Python Traceback。

> **启用 PDF:** 用户需自行运行 `pip install pypdf`。未安装时 PDF 请求以
> **退出码 7** 报错并提示安装命令,不会抛 Python Traceback。

## Quick Execution

Run these exact forms from the plugin root — do not read the source tree:

```bash
# one URL
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add jiamingshi-jsphys/web-forager/web-forager@sha256:10873848ef7e3abe

The line at the top of this page pins the label v1.1.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_qxm56tab2fuxqley.svg)](https://markdownregistry.com/a/art_qxm56tab2fuxqley)

0 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 5 versions of this file, between Nov 6, 2026 and Nov 9, 2026, more than one a day.

versioncommittedcommitsizeaudit
v1.1.0 latest2026-11-09 ee3cae5 16,166 BA view · diff
v1.0.22026-11-08 f04ee5e 11,338 BA view · diff
v1.0.12026-11-06 3674fff 11,154 BA view · diff
v1.0.02026-11-06 12cdcff 11,154 BA view · diff
v1.0.02026-11-06 7a98c2b 11,145 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (16166 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

jiamingshi-jsphys/web-forager · 3 stars · license MIT · pushed 2026-11-09 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_qxm56tab2fuxqley
GET https://markdownregistry.com/api/v1/resolve?ref=jiamingshi-jsphys/web-forager/web-forager
GET https://markdownregistry.com/api/v1/blob/10873848ef7e3abeb5a9b627420c96578fb1e243ebf40aecf0110a30087201cf

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from jiamingshi-jsphys/web-forager

web-forager Cursor rule
jiamingshi-jsphys/web-forager · .cursor/rules/web-forager.mdc · web-forager operating rules (v1.0.0)
git:20261109.ee3cae5 · audit A · 3 stars
AGENTS.md AGENTS.md file
jiamingshi-jsphys/web-forager · AGENTS.md
git:20261109.ee3cae5 · audit A · 3 stars

Every file in jiamingshi-jsphys/web-forager

Other files named web-forager

web-forager Cursor rule
jiamingshi-jsphys/web-forager · .cursor/rules/web-forager.mdc · web-forager operating rules (v1.0.0)
git:20261109.ee3cae5 · audit A · 3 stars

Browse by kind, by grade A, or by owner.