metric-impact-analyzer · git:20260515.bb6e390 · 2026-05-15 · sha256 4b696759456cfe0f

metric-impact-analyzer git:20260515.bb6e390A

Immutable. This exact content is served forever at /api/v1/blob/4b696759456cfe0f.

---
name: metric-impact-analyzer
description: Evaluate metric and semantic model changes for BI/reporting breakage and business meaning drift.
---

# Metric Impact Analyzer

Use this skill when a change may affect metrics, semantic models, dashboards, reporting, or stakeholder-facing KPIs.

## Goals
- Detect whether a technical change also changes business meaning.
- Identify likely downstream breakage in BI tooling and dashboards.
- Separate harmless refactors from definition-level changes.

## What to Inspect
- Metric definitions and calculation logic.
- Semantic model changes (dimensions, measures, relationships).
- Renamed or removed fields referenced by saved queries or dashboards.
- Changed filters, time windows, or default values.
- Changed joins, granularity, or fanout.
- Contract-breaking field type changes (e.g., INT → FLOAT, nullable → NOT NULL).

## Change Classification

| Change type | Risk level | Action required |
|---|---|---|
| Column rename with alias preserved | Low | Validate alias propagation |
| Description or label change | Low | Confirm no tooling parses descriptions |
| New optional field added | Low | No action unless it changes defaults |
| Filter condition tightened | Medium | Validate that the new filter matches intent |
| Metric formula changed | High | Stakeholder review required |
| Grain changed (e.g., day → week) | High | All downstream rollups must be revalidated |
| Dimension removed | Breaking | Cannot ship without migration plan |
| Join path changed | Breaking | All dependent metrics may be affected |

## Analysis Steps

1. Summarize what changed technically (field names, types, logic, joins).
2. Classify each change using the table above.
3. Infer what may have changed semantically — ask: "will this metric return a different number for the same time period?"
4. Identify who or what downstream may break: dashboards, saved queries, alerts, exports, downstream dbt models, BI tool semantic layers.
5. Flag whether stakeholder sign-off is required before the change is promoted.

## Output Format

1. **Technical change summary** — what exactly changed, at the field/model level.
2. **Business meaning impact** — does this change what the number means to a business user?
3. **Likely reporting or dashboard breakage** — specific assets at risk.
4. **Required validation** — what must be confirmed before shipping.
5. **Stakeholder confirmation needed?** yes / no / depends — with reason.

## Validation / Done Criteria
- Technical change summary covers all modified fields, models, and logic.
- Every change is classified by risk level using the table above.
- Downstream breakage is identified or explicitly noted as "unknown — downstream consumers not traced."
- Stakeholder confirmation requirement is stated as yes / no / depends, with a reason.

## Rules
- Be explicit about uncertainty when you cannot trace all downstream consumers.
- Use plain business language in the final summary — avoid dbt/SQL jargon in the stakeholder section.
- Do not edit code or models unless explicitly asked.