git:20260719.a1da98e to git:20260802.f93c659

52 added, 61 removed. Audit A to A.

---
name: multi-persona-review
description: >-
A panel-review skill that critiques ONE artifact (launch post, README, doc, markdown, plan,
design) via 3-5 disjoint user-perspective personas running in parallel, then synthesizes deduped,
severity-ranked improvement points (P0/P1/P2). Use when the user says "작성글을 사용자 관점의
페르소나를 여러명 만들어서 (손넷 모델정도로) 피드백 받아바", "다면 리뷰 해볼까", "페르소나로 리뷰",
"여러 관점으로 피드백", or in English "multi-persona review", "review this from different user
perspectives", "get persona feedback on this post/README/doc", "panel review this artifact".
- Lighter than a full service audit — point it at ONE artifact, not a whole codebase. NOT for a
- whole-codebase multi-dimension audit (use ultracode-service-audit) or a single-axis
- gap-vs-benchmark loop (use gap-analysis-e2e).
+ Lighter than a full service audit — point it at ONE artifact, not a whole codebase. Do NOT use it
+ for a whole-service or whole-codebase audit, nor for a gap-vs-benchmark loop (both are
+ audit-service-gaps), and do NOT simulate diversity by renaming reviewers that inspect the same
+ evidence.
---
# Multi-Persona Review (다면페르소나 워크플로우 리뷰)
Run a small panel of realistic target-user personas over one artifact, independently and in
parallel, then synthesize their findings into a deduped, prioritized fix list. This is how the
user actually works: "작성글을 사용자 관점의 페르소나를 여러명 만들어서 손넷 모델정도로 피드백 받아바"
and "이부분도 다면 리뷰 해볼까?" — 4-5 Sonnet-tier personas across 1-2 passes over a launch post,
yielding P0~P2 prioritized fixes.
## When to use
- A draft is "done" but you want blind spots an author is fatigue-blind to: launch post, README,
PRD/plan, doc, marketing copy, a design.
- The user names personas or "다면 리뷰" / "여러 관점" / "multi-persona" / "panel review".
- You want **reproducible, severity-ranked** feedback, not one reviewer's gut reaction.
- Do **not** use this for whole-codebase quality work — that's `ultracode-service-audit`. This skill
- is deliberately lighter: one artifact, one panel, one synthesis. For surfacing missing user
- journeys end-to-end, this feeds the UX lens of `gap-analysis-e2e`.
+ Do **not** use this for whole-codebase quality work or for a gap-vs-benchmark loop — that is
+ `audit-service-gaps` (its FULL and BENCHMARK modes). This skill is deliberately lighter: one
+ artifact, one panel, one synthesis. For surfacing missing user journeys end-to-end, this feeds the
+ user-perspective lens of `audit-service-gaps`.
## Why a panel beats one reviewer (the evidence)
The whole method rests on one empirical fact: **independent reviewers find largely
non-overlapping problems.**
- **Heuristic Evaluation (Nielsen & Molich) + the 3-5 evaluator rule** — a single evaluator
catches only ~35% of usability issues; aggregating independent evaluators raises coverage to
~85% at five, with sharp diminishing returns beyond. The value comes from *low overlap between
perspectives*, not any one reviewer being thorough. Some of the hardest issues are found by an
evaluator who otherwise finds few. Each judges against the *same explicit checklist* so reviews
stay comparable and dedupable.
https://www.nngroup.com/articles/how-to-conduct-a-heuristic-evaluation/theory-heuristic-evaluations/
- **Panel of LLM evaluators (PoLL)** — a panel of several smaller, *disjoint* judges beats one
large judge, shows less self-preference bias, and costs ~7x less. This is the cost-tier reason
the user runs the persona panel at Sonnet tier and reserves the main model for orchestration and
synthesis. https://arxiv.org/abs/2404.18796
- **"Nine Judges, Two Effective Votes"** — panels help *only to the extent members fail
independently*. A 9-judge panel carried only ~2 independent votes' worth of information because
the models made the same mistakes on the same items. The bottleneck is **correlated reviewers,
not panel size or aggregation math** — so persona design must maximize genuine viewpoint
diversity, not nominal count. https://arxiv.org/abs/2605.29800
- **LLM-as-persona-reviewer vs human experts (GPT-4o study)** — persona review finds many real
issues but also emits false positives humans wouldn't flag, and misses issues needing embodied
experience. Recommended posture: a **hybrid** where personas generate candidate findings that a
human validates — never a replacement for human judgment. https://arxiv.org/pdf/2506.16345
- **RICE prioritization (Intercom)** — (Reach × Impact × Confidence) / Effort turns rough guesses
into one comparable score, down-weighting low-confidence/high-effort items and countering the
reviewer's bias toward what they'd personally use. A lightweight analog gives a *defensible,
reproducible* map from findings to P0/P1/P2.
https://www.intercom.com/blog/rice-simple-prioritization-for-product-managers/
## Core workflow
### 1. Frame the artifact (orchestrator, main model)
Capture three things the personas will all share:
- **Goal** — what is this artifact trying to achieve? (e.g. "get a developer to `npx` install in
under 2 minutes and star the repo")
- **Audience** — who is the real target reader?
- **Rubric** — the shared checklist every persona scores against, so findings are comparable and
dedupable. Default rubric (adapt to the artifact): *clarity of value prop · first-action
friction · credibility/trust signals · scannability · accuracy/honesty · accessibility ·
call-to-action*. Without a shared rubric, red-team reviews decay into proofreading and generic
opinions, and findings stop being comparable across personas.
### 2. Design 3-5 genuinely disjoint personas
Cap the panel at five — coverage flattens beyond that, and extra personas mostly inflate tokens
and false confidence (the "Nine Judges" trap). Engineer **diversity, not count**: pick personas
with disjoint goals, contexts, and *failure-fears* so their blind spots don't correlate. A strong
default spread:
| Persona | Lens / what they fear |
|---|---|
| Skeptical newcomer | Doesn't know the domain; fears wasting time on hype. Tests "do I get it in 10s?" |
| Time-pressured expert | Knows the domain; fears fluff between them and the command. Tests scannability + first action. |
| Accessibility-dependent user | Screen reader / low vision / non-native reader. Tests structure, alt text, plain language. |
| Hostile/adversarial reader | Looks for overclaims, vague benefits, anything to dismiss. Tests honesty + credibility. |
| Adjacent-tool migrant *(optional 5th)* | Already uses a competitor. Tests differentiation + "why switch?". |
Swap personas to fit the artifact (e.g. for a PRD: implementing engineer, on-call SRE, PM,
security reviewer). The test is always: would these two personas make the *same* mistake? If yes,
- they're not independent — replace one.
+ they're not independent — replace one. The mechanical version of that test, more lens patterns per
+ artifact type, and the fixed field list each reviewer returns are in
+ [references/reviewer-design.md](references/reviewer-design.md).
### 3. Review in parallel, independently (Sonnet-tier panel)
Spawn one sub-agent per persona via the **Task tool** (or the harness's sub-agent mechanism). Each
one gets the artifact + goal + audience + the *same* rubric, and **must not see the other personas'
output** — independence is the precondition that makes aggregation add information. Anchoring on a
peer collapses the panel toward one effective vote.
**Have each persona write its findings to a file, not return them inline** — a panel report is
exactly the long payload that gets dropped in transit, and the loss is silent. Losing one persona's
report does not merely cost that report: it quietly shrinks the panel, which is the one variable
the whole method depends on (see "Nine Judges, Two Effective Votes" above). Name the path when you
spawn, not after — see [[model-orchestration]] "Worker lifecycle" for the general rule.
Prefer pinning the persona sub-agents to a cheaper tier (Sonnet) — see the cost-tier note. But this
degrades gracefully: if the harness can't pin sub-agents to a specific model, just run the panel on
the default sub-agent model and note in the step-6 coverage caveat that the panel ran at the
orchestrator tier. The tier is an economy, not a hard prerequisite.
Each persona returns findings as **strengths / weaknesses / specific recommendations**. Require
every finding to be specific and actionable: **quote the offending passage and propose a concrete
fix.** Ban vague "needs work" notes — that's the classic red-team failure mode (briefing +
structured findings + independence are the load-bearing parts, not the critical attitude).
https://loopio.com/blog/red-team-review/
### 4. Synthesize: dedupe, but preserve minority findings (orchestrator, main model)
- **Close every panel worker as you collect it.** A panel is the highest fan-out this repo runs —
+ **Close every panel worker as you collect it.** A panel is the highest fan-out this method runs —
3-5 workers spawned in one breath — so it is also where leftovers accumulate fastest: a finished
agent keeps its pane/window open and keeps pinging the session, and after two or three panels the
clutter is the session. Read the persona's report file, then stop that agent in the same motion
(TaskStop or the harness's stop mechanism); do not defer it to "cleanup later". By the time you
start deduping, zero panel agents should still be running. The general rule and its rationale live
in [[model-orchestration]] "Worker lifecycle" — this is that rule at panel scale.
Do **not** keep the panel alive for the step-6 second pass. Re-verification wants a *fresh* agent
reading the fixed artifact from disk, not a resumed one carrying its own first-pass findings —
a resumed reviewer grades against its memory of what it already said, which is the anchoring
failure this method exists to avoid.
Collapse overlapping findings into one entry, noting *how many personas raised it* (frequency is a
prioritization signal). **But never drop a single-persona finding** — heuristic-evaluation data
says the hardest, most valuable issues are often raised by only one reviewer. Majority-vote /
consensus filtering would silently discard exactly those. Keep them, tagged as single-source.
+ When two personas recommend contradictory fixes, do not average them — resolve against the
+ artifact's declared goal and the stronger evidence, and keep the rejected alternative on the record
+ ([references/reviewer-design.md](references/reviewer-design.md), "Conflict resolution").
+
### 5. Prioritize with a transparent rule → P0/P1/P2
Map each finding to a bucket with a **reproducible** rule, not by gut feel or by which persona
phrased it loudest. Use a RICE-style or **severity × frequency** score:
- **P0** — blocks the artifact's goal for many readers (e.g. value prop unreadable in first
screen; a false claim). High impact × high confidence, any effort.
- **P1** — meaningfully hurts conversion/trust but has a workaround.
- **P2** — polish, edge-reader, or low-confidence/high-effort items.
Show the score inputs so the ranking is auditable.
### 6. Triage as candidates, state coverage honestly
Present the list as **candidate findings needing a validation pass**, not gospel. Flag likely
false positives and note where real-user confirmation is warranted before committing fixes — LLM
personas both miss embodied issues and invent non-issues. End with an honest coverage caveat: a
panel never finds every issue and offers no systematic fix generation (Nielsen's own caveat).
- Claiming exhaustiveness here would be a no-false-ship violation.
+ Claiming exhaustiveness here would be a false-ship.
**Second pass (the "1-2 passes"):** run the same panel again *after fixes land* to confirm the P0s
- are actually closed and that the edits didn't introduce new issues. One pass to find, one to verify
- — a third rarely pays off.
-
- ## Worked example (Input → Output)
-
- **Input:** Trigger — "이 런치 포스트 다면 리뷰 해볼까? 손넷으로 페르소나 4명." Artifact: a launch
- post for an npm installer CLI. Goal: "reader runs `npx ... init` and stars the repo." Audience:
- indie devs scanning a feed.
-
- **Panel (parallel, Sonnet tier):** skeptical newcomer · time-pressured expert ·
- accessibility-dependent reader · hostile reader.
-
- **Raw findings (excerpt):**
- - Newcomer: "Paragraph 1 says 'context-engineered harness' — I don't know what that buys me.
- Quote: *'A context-engineered harness for agentic CLIs.'* Fix: lead with the outcome — *'Install
- vetted plugins, skills, and rules across 4 AI CLIs in one command.'*"
- - Expert: "The install command is below three paragraphs of philosophy. Fix: move `npx` line to
- the first screen." *(also raised by newcomer → frequency 2)*
- - Accessibility: "Demo is a GIF with no text fallback; the actual command only appears in the GIF.
- Fix: put the command in a code block as text."
- - Hostile: "'Works everywhere' — claims 4 CLIs but only shows Claude. Fix: either show all four or
- soften to 'Claude today, others in progress.'" *(single-source, kept)*
-
- **Synthesized + prioritized output:**
-
- | ID | Finding (deduped) | Personas | Sev × Freq | Bucket |
- |---|---|---|---|---|
- | F1 | Install command buried below the fold / inside GIF only | expert, newcomer, a11y | high × 3 | **P0** |
- | F2 | Value prop is jargon, not outcome, in first screen | newcomer | high × 1 | **P0** |
- | F3 | "Works everywhere" overclaims vs. evidence shown | hostile | med × 1 | **P1** |
- | F4 | Demo GIF has no text alternative | a11y | med × 1 | **P1** |
-
- **Caveat returned to user:** candidate findings from a 4-persona Sonnet panel; F3 (overclaim) is
- worth confirming against what the post can actually demo before rewording. Not exhaustive — a real
- indie-dev read may surface more.
+ are actually closed and that the edits didn't introduce new issues. **One pass to find, one to
+ verify — a third rarely pays off.** Use a *fresh* agent per persona, never a resumed one, for the
+ anchoring reason in step 4.
- This mirrors the user's real run (memory: `persona-feedback-improvements`, P0-before-publish gate).
+ A complete Input → Output run — trigger sentence, four personas' raw quotes and proposed fixes, the
+ deduped findings table with severity × frequency and buckets, and the caveat returned to the user —
+ is in [references/worked-example.md](references/worked-example.md).
## Cost-tier note
Run the **persona panel at a cheaper tier (Sonnet)** — PoLL shows a disjoint panel of smaller
judges beats one big judge at a fraction of the cost. Reserve the **main/orchestrator model** for
- framing the rubric and synthesizing (steps 1, 4-6), where reasoning quality pays off most.
+ framing the rubric and synthesizing (steps 1, 4-6), where reasoning quality pays off most. Where
+ the harness cannot pin a sub-agent's model, run the panel on the default sub-agent model and say so
+ in the coverage caveat — the tier is an economy, not a prerequisite.
+ ## Output, side effects, and stop conditions
+
+ - **Output** — persona definitions plus why they are disjoint · per-persona findings, each with a
+ quoted passage and a concrete fix · the deduped, attributed findings table with score inputs and
+ P0/P1/P2 · contradictions and the rejected alternative · the honest coverage caveat.
+ - **Side effects** — spawning reviewers changes runtime state, and every worker must be stopped as
+ its report is collected (step 4). Reviewers stay read-only unless the user asked for edits and
+ each worker owns a disjoint file set.
+ - **Stop** at five lenses, or earlier when one more persona would inspect the same evidence with
+ the same failure fear — that persona buys tokens, not coverage.
+
## Pitfalls to avoid
- **False diversity** — personas that share the model's default assumptions give far fewer than N
- views. Design for disjoint fears; if two would make the same mistake, replace one.
+ views. Design for disjoint fears; if two would make the same mistake, replace one. Renaming a
+ reviewer does not create a second reviewer.
- **Scaling count to fix quality** — past ~5 personas you mostly buy tokens and noise. Fix
independence, not size.
- **Consensus filtering** — dropping single-persona findings discards the rare, hard issues that
are the whole point.
- **Anchoring** — letting personas see each other's output before judging collapses the panel.
- **Opaque P0/P1/P2** — ranking by vibe or loudest wording is unauditable. Show the score.
- **Over-claiming coverage** — report it as candidate findings, never "found everything."
- **Leaving the panel running** — the panel dies when you stop it, not when it answers. N finished
agents left open per review is the fastest way to a session full of idle workers; stop each one
as you read its report (step 4).
## Cross-references
- - `ultracode-service-audit` — full multi-dimensional audit of a whole service/codebase; this skill
- is the lighter, single-artifact UX lens.
- - `gap-analysis-e2e` — this skill feeds its UX/user-journey lens.
- - `critique` — design-specific persona critique with anti-pattern detection; reach for it when the
- artifact is a UI rather than prose/markdown.
- - `gemini-consult` — its persona mode also answers "다면 페르소나 / second opinion" phrasing, but
- via ONE external Gemini call role-playing personas. Prefer THIS skill for a native, genuinely
- independent parallel panel; reach for gemini-consult when an external non-Claude model's opinion
- is specifically the point.
-
- > This SKILL.md is complete and self-contained — everything needed to run a panel is above. If the
- > method ever needs deeper appendices (full default rubrics per artifact type, persona prompt
- > templates, a RICE scoring worksheet), a `reference/` file alongside this SKILL.md is the place to
- > add them. That's a future-extension option, not a missing dependency.
+ - `audit-service-gaps` — the multi-mode service audit. Its FULL mode is the whole-service sweep
+ this skill is deliberately lighter than, and its user-perspective lens delegates *here* instead
+ of re-implementing persona evaluation.
+ - `north-star` — the same target state seen from the other end: it *directs* the product; a panel
+ only judges one artifact against a goal you already hold.
+ - `recurrence-prevention` — borrows this panel's mechanics to design countermeasures when the
+ failure model itself is disputed.
+ - `external-model-consult` — its persona mode also answers "다면 페르소나 / second opinion"
+ phrasing, but through ONE external model call role-playing several personas. Prefer THIS skill
+ for a native, genuinely independent parallel panel; reach for the external consult when a
+ non-Claude model's opinion is specifically the point.
+ - A UI artifact wants design-specific critique with anti-pattern detection rather than prose
+ review — use whichever design-critique skill the project installs, not this one.