test-reliability SKILL.md skillA
test-reliability from fishzjp/qa-skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.
mdr add fishzjp/qa-skills/test-reliability@v0.9.0Pins v0.9.0 in mdr.lock. Pin the fingerprint instead.
- Audit grade
- A, 17 of 17 checks passed
- Kind
- SKILL.md skill
- Repository
- fishzjp/qa-skills
- Path
skills/test-reliability/SKILL.md- Versions recorded
- 4
- Latest version
- v0.9.0, committed Oct 10, 2026
- First version recorded
- Sep 8, 2026
- Size
- 10,878 bytes
- Repository stars
- 60
- License
- MIT
Govern flaky tests and suite reliability: rerun-pass verdicts, root-cause classes, quarantine, retry semantics, health metrics. Not for: in-run failures (e2e/api), triage, confirmed bugs. 治理 flaky 测试与套件可靠性：时好时坏/重跑变绿判定、根因四分类、隔离门禁、重试诚实语义、健康度。不用于：执行中单条失败（e2e/api）、批量分流（triage）、已确认 Bug（bug-analysis）。.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
# 测试可靠性治理（test-reliability）
测试套件自身的稳定性治理——回答一个问题：**这套测试的结果还能不能信**。单条用例时好时坏、重跑变绿、夜间全量靠重试撑绿、发布卡点被 flaky 疲劳轰炸，都属于本 skill 的治理对象。本 skill 是套件级的"判定 → 隔离 → 根因 → 门禁 → 健康度"闭环，不替代任何单次执行流程。
- **输入**：失败/翻灯历史（CI 运行记录、重跑日志、triage 分流表 D 类条目）、套件清单与运行统计；项目存在 `.qa/` 时先读其 flaky-tests 主题（经 `qa-memory` 沉淀的历史判定）
- **输出（落盘）**：《可靠性报告_{套件}_{日期}.md》——逐条 flaky 清单（判定 × 根因分类 × 处置 × 状态，缺一字段即报告不合规）+ 套件健康度机读摘要（字段规范见 `references/flaky-playbook.md` 第 5 节，挂靠 `../core/report-template.md` 机读段）；沉淀判定结论（哪些发现值得写入 `.qa/`，交 `qa-memory` 工作流执行）
- **边界（三层分工，同源 `../core/triage.md` 第 7 节）**：执行中单条失败的即时定性（first-run-flaky 规则、等待策略）→ 各执行 skill 工程约定；一批失败的首轮分类与路由 → `../core/triage.md`；已确认 Bug 的根因/影响/修复建议 → `bug-analysis`；**本 skill 管"套件与门禁"层**——单条定性做完之后的跨轮追踪、根因分类、隔离策略、重试语义与健康度
## When to Use
- 用户问"这条用例为什么时好时坏 / 这算不算 flaky / 重跑绿了算修好吗"
- CI 夜间套件靠重试撑绿，需要裁决重试策略或制定隔离（quarantine）门禁
- 需要产出套件健康度（flaky 率、隔离数、重试救回率）或发布卡点的可靠性证据
- 分流表 D 类（不稳定）条目跨轮累积，需要根因分类与治理排期
- 项目要给"测试套件可信度"立规矩：什么样的套件状态允许作为发布证据
## When NOT to Use
- 一次执行中的单条失败即时处理（截图、重跑定性、等待降级）→ 各执行 skill 工程约定（如 `automated-e2e-testing`）
- 一轮执行结束失败 ≥3 条的批量定性分流 → `../core/triage.md`（其结论为 D 类的条目跨轮追踪时回到本 skill）
- 已确认 Bug 的根因定位、影响分析与修复建议 → `bug-analysis`
…Read the whole file at its exact version.
How to install
mdr add fishzjp/qa-skills/test-reliability@sha256:f73a04199af53dd2The line at the top of this page pins the label v0.9.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
[](https://markdownregistry.com/a/art_p222ndkjc4nepr7h)
5 badge image fetches in 30 days. What the badge shows.
Versions
The registry has recorded 4 versions of this file, between Sep 8, 2026 and Oct 10, 2026, about one every 11 days.
| version | committed | commit | size | audit | |
|---|---|---|---|---|---|
| v0.9.0 latest | 2026-10-10 | ff6957f | 10,878 B | A | view · diff |
| v0.9.0 | 2026-10-10 | d4b822e | 10,857 B | A | view · diff |
| v0.9.0 | 2026-09-20 | 21f92dc | 10,857 B | A | view · diff |
| v0.8.1 | 2026-09-08 | 9d93d04 | 10,857 B | A | view |
Audit of the latest version
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (10878 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No curl or wget piped into a shell
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
fishzjp/qa-skills · 60 stars · license MIT · pushed 2026-11-04 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_p222ndkjc4nepr7h GET https://markdownregistry.com/api/v1/resolve?ref=fishzjp/qa-skills/test-reliability GET https://markdownregistry.com/api/v1/blob/f73a04199af53dd2a904933918b388f024b15be575459081690d81fe7f024551
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.
More from fishzjp/qa-skills
Every file in fishzjp/qa-skills