quality-validation · git:20260921.7dfd510 · 2026-09-21 · sha256 ada4264a999f536f
quality-validation git:20260921.7dfd510A
Immutable. This exact content is served forever at /api/v1/blob/ada4264a999f536f.
--- name: quality-validation description: "Score ResearchPacks (>=80) and Implementation Plans (>=85) against quality gates. TRIGGER when: gating research or a plan before implementation. SKIP: writing or running tests (use testing-strategy); security threat review (use security-review-checklists); verifying finished work by executing it (use verification-before-completion)." --- # Quality Validation Skill Systematic validation ensuring ResearchPacks and Implementation Plans meet quality standards before implementation. ## Auto-Invoke Triggers - ResearchPack completion requires validation - Implementation Plan requires validation before coding - User requests quality check - Proceeding to next workflow phase (quality gate) ## Quality Gates ### Gate 1: Research → Planning - **Trigger**: ResearchPack completion - **Pass**: Score ≥ 80 - **Fail**: Block, return defects ### Gate 2: Planning → Implementation - **Trigger**: Implementation Plan completion - **Pass**: Score ≥ 85 AND APIs match - **Fail**: Block, return defects - Note: the ≥ 85 plan gate / design review may run on the opus tier (architect/analyst on `model: opus`, `effort: high`) for higher rigor. See `docs/model-tiers.md`. ### Gate 3: Implementation → Completion - **Trigger**: Code complete - **Pass**: your project's validate/lint/test command passes (e.g. `npm run validate`, `pytest`, `make check`, `cargo test`) - **Fail**: Trigger self-correction (max 3 attempts) ## ResearchPack Validation (100 pts, pass: 80) ### Completeness (40 pts) - Library/API with version: 10 pts - 3+ key APIs documented: 10 pts - Setup/configuration steps: 10 pts - 1+ complete code examples: 10 pts ### Accuracy (30 pts) - API signatures match official docs: 15 pts - Version numbers correct: 5 pts - All URLs valid, official sources: 10 pts ### Citation (20 pts) - Every API has source URL: 10 pts - Version/section references: 5 pts - Confidence level stated: 5 pts ### Actionability (10 pts) - Implementation checklist: 5 pts - Open questions identified: 5 pts ## Implementation Plan Validation (100 pts, pass: 85) ### Completeness (35 pts) - All file changes listed: 10 pts - Step-by-step sequence: 10 pts - Verification per step: 10 pts - Test plan included: 5 pts ### Safety (30 pts) - Rollback plan complete: 15 pts - Risk assessment (3+ risks): 10 pts - Minimal changes: 5 pts ### Clarity (20 pts) - Actionable steps: 10 pts - Success criteria defined: 5 pts - Time estimates: 5 pts ### Alignment (15 pts) - Plan matches ResearchPack: 10 pts - Addresses all requirements: 5 pts ## Validation Commands Run your project's own validate/lint/type-check/test command at the completion gate. The exact command depends on your stack — substitute the equivalents below. | Step | Generic intent | Example (Node/TS) | Example (Python) | |------|----------------|-------------------|------------------| | Type check | Static type safety | `npm run type-check` | `mypy .` | | Lint | Style / static analysis | `npm run lint` | `ruff check .` | | Build | Compile / package | `npm run build` | `python -m build` | | Tests | Behavioral verification | `npm test` | `pytest` | | Full gate | One command runs all | `npm run validate` | `make check` | ```bash # Example (Node/TypeScript): full validation npm run validate # Example (Python): full validation pytest && ruff check . && mypy . ``` ## Common Failures | Failure | Description | |---------|-------------| | Hallucinated APIs | APIs not in official docs | | Version mismatch | Wrong version in research | | Missing citations | No source URLs | | No rollback plan | Missing reversion procedure | | Ambiguous steps | Non-actionable instructions | | API misalignment | Plan uses undocumented APIs | ## Validation Output Format ```markdown ## Validation Report **Artifact**: [ResearchPack|ImplementationPlan] **Score**: XX/100 **Result**: [PASS|FAIL] ### Scoring Breakdown - Completeness: XX/40 - Accuracy: XX/30 - Citation: XX/20 - Actionability: XX/10 ### Defects Found 1. [Defect description] 2. [Defect description] ### Recommendations - [Fix suggestion] ```