test-run · diff
git:20260416.643a522 to git:20260426.8006c0f
45 added, 13 removed. Audit A to A.
---
name: test-run
- description: Run all plugin test suites, report pass/fail summary
+ description: Run plugin test suites in this monorepo and report a concise pass/fail summary. Optional plugin slug arg; without arg, runs all plugins under plugins/.
disable-model-invocation: true
---
# Test Run
- Run all test suites and report a concise summary.
+ Run plugin test suites and report a concise summary. Operates on a single plugin when given a slug; otherwise loops every plugin in `plugins/`.
- ## Plan
+ ## Usage
- ### 1. Run all suites
+ `/test-run` — run tests for every plugin in `plugins/` and report a per-plugin summary plus an overall PASS/FAIL.
- ```bash
- bash tests/run-all.sh 2>&1
- ```
+ `/test-run <plugin-slug>` — run tests for just that plugin.
- Capture the output. Extract pass/fail counts from each suite's summary line.
+ Examples:
+ - `/test-run claude-code-hermit`
+ - `/test-run claude-code-homeassistant-hermit`
+ ## Steps
+
+ ### 0. Resolve target slugs
+
+ - If a slug arg was passed, validate `plugins/<slug>/.claude-plugin/plugin.json` exists. If not, abort with: `Plugin 'plugins/<slug>/' not found. Available: <comma-separated slugs>.`
+ - If no slug, glob `plugins/*/.claude-plugin/plugin.json` and collect the directory names. Run tests for each in sequence.
+
+ ### 1. Run each suite (per slug)
+
+ Plugins ship one of two test conventions. Detect and dispatch:
+
+ - **Bash entrypoint** — if `plugins/<slug>/tests/run-all.sh` exists:
+ ```bash
+ bash plugins/<slug>/tests/run-all.sh 2>&1
+ ```
+ - **Pytest** — else if `plugins/<slug>/tests/conftest.py` or any `plugins/<slug>/tests/test_*.py` exists:
+ ```bash
+ cd plugins/<slug> && .venv/bin/pytest tests/ -v 2>&1
+ ```
+ If `.venv/bin/pytest` is missing, mark this plugin as `SKIP — venv missing` and continue to the next plugin (don't abort the whole run).
+ - **Neither marker** — mark `no tests configured` and continue.
+
+ Capture full output. Extract pass/fail counts from each suite's summary line.
+
### 2. Report
- Output a concise summary:
+ Per-plugin block:
```
- Hook tests: X passed, Y failed
- Contract tests: X passed, Y failed
- Script tests: X passed, Y failed
- Overall: PASS / FAIL
+ === <slug> ===
+ Hook tests: X passed, Y failed (bash convention only)
+ Contract tests: X passed, Y failed (bash convention only)
+ Script tests: X passed, Y failed (bash convention only)
+ Pytest: X passed, Y failed (pytest convention only)
+ Plugin result: PASS / FAIL / SKIP
+ ```
+
+ Final overall line:
+
+ ```
+ Overall: PASS / FAIL (<n> passed, <m> failed, <k> skipped across <p> plugins)
```
If any test failed, include the failure details below the summary so the developer can act on them immediately.