observability-driven-testing SKILL.md skillA

observability-driven-testing from petrkindlmann/qa-skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add petrkindlmann/qa-skills/observability-driven-testing@v2.1

Pins v2.1 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
petrkindlmann/qa-skills
Path
skills/observability-driven-testing/SKILL.md
Versions recorded
5
Latest version
v2.1, committed Oct 21, 2026
First version recorded
May 10, 2026
Size
22,378 bytes
Repository stars
198
License
MIT

Use production telemetry as INPUT to design new tests. Covers OpenTelemetry integration with tests, trace-based assertions, log-informed test creation, production-error analysis for coverage gaps, and telemetry-driven test prioritization. Use when: "trace-based testing," "design tests from logs," "OpenTelemetry assertions," "production errors point to test gaps," "telemetry-driven testing." Not for: safe rollout techniques (flags, canary) during release — use testing-in-production. Not for…

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

<objective>
Production is the richest source of test design input: every error log, slow trace, and latency spike tells you where tests are missing. This skill closes the feedback loop between production observability and test creation, and makes trace structure a test assertion. A `200 OK` that silently hit the database on a path meant to be cache-only passes an HTTP assertion — a trace assertion catches it. Output: instrumented test runners, trace-based assertions, and a production-error-to-test pipeline.
</objective>

## Quick Route

| Situation | Go to |
|-----------|-------|
| Make test execution emit traces correlated with the app | OTel test-runner setup (`references/trace-assertions.md`) |
| Assert which services were called / no error spans / latency | Traces as Test Evidence |
| Turn a Sentry/Datadog error into a test | Production Error to Test Pipeline |
| Decide which endpoints need tests next | Telemetry-Driven Test Prioritization |
| A trace assertion is flaky or a span never arrives | Failure Modes |

---

## Discovery Questions

Check `.agents/qa-project-context.md` first. If it exists, use it as context and skip questions already answered there.
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add petrkindlmann/qa-skills/observability-driven-testing@sha256:4fb0195700c1f560

The line at the top of this page pins the label v2.1, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_4izyquyvvvjcrzzv.svg)](https://markdownregistry.com/a/art_4izyquyvvvjcrzzv)

1 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 5 versions of this file, between May 10, 2026 and Oct 21, 2026, about one every 41 days.

versioncommittedcommitsizeaudit
v2.1 latest2026-10-21 b99ea46 22,378 BA view · diff
v2.02026-06-10 bcd1201 22,327 BA view · diff
v1.02026-05-30 d9b4edd 16,177 BA view · diff
v1.02026-05-21 c7fb325 21,839 BA view · diff
v1.02026-05-10 6331521 21,625 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (22378 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

petrkindlmann/qa-skills · 198 stars · license MIT · pushed 2026-10-21 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_4izyquyvvvjcrzzv
GET https://markdownregistry.com/api/v1/resolve?ref=petrkindlmann/qa-skills/observability-driven-testing
GET https://markdownregistry.com/api/v1/blob/4fb0195700c1f560e39d281d2534b9f79ef8f062c6ca38e81835d4fd1970be85

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from petrkindlmann/qa-skills

AGENTS.md AGENTS.md file
petrkindlmann/qa-skills · AGENTS.md
git:20261021.03fbcb2 · audit A · 198 stars
CLAUDE.md CLAUDE.md file
petrkindlmann/qa-skills · CLAUDE.md
git:20260323.b54e23c · audit B · 198 stars
accessibility-testing SKILL.md skill
petrkindlmann/qa-skills · skills/accessibility-testing/SKILL.md · Test for WCAG 2.2 AA compliance with axe-core + Playwright, keyboard navigation audits, screen reader testing, ARIA…
v2.0 · audit A · 198 stars
agentic-browser-testing SKILL.md skill
petrkindlmann/qa-skills · skills/agentic-browser-testing/SKILL.md · Goal-driven E2E testing where a browser agent (Playwright MCP / computer-use) reads a natural-language goal and…
v1.0 · audit A · 198 stars
ai-bug-triage SKILL.md skill
petrkindlmann/qa-skills · skills/ai-bug-triage/SKILL.md · Hybrid fingerprint + LLM pipeline for bug classification, deduplication, and ticket generation. Normalizes CI logs…
v2.0 · audit A · 198 stars
ai-qa-review SKILL.md skill
petrkindlmann/qa-skills · skills/ai-qa-review/SKILL.md · Review EXISTING test code for quality, smells, and testability issues. Detects test smells across six dimensions —…
v2.0 · audit A · 198 stars
ai-system-testing SKILL.md skill
petrkindlmann/qa-skills · skills/ai-system-testing/SKILL.md · Test AI/LLM features that ship in your product. Covers prompt regression testing, response quality evaluation…
v2.2 · audit F · 198 stars
ai-test-generation SKILL.md skill
petrkindlmann/qa-skills · skills/ai-test-generation/SKILL.md · Use AI to write NEW test code from specs, PRDs, user stories, code diffs, bug reports, or OpenAPI specs. Staged…
v2.0 · audit A · 198 stars
analytics-tracking-testing SKILL.md skill
petrkindlmann/qa-skills · skills/analytics-tracking-testing/SKILL.md · Validate that analytics and marketing tracking fire CORRECTLY: GA4/GTM dataLayer events, Meta/TikTok/LinkedIn pixels…
v1.1 · audit A · 198 stars
api-testing SKILL.md skill
petrkindlmann/qa-skills · skills/api-testing/SKILL.md · Test REST and GraphQL APIs with Playwright APIRequestContext, Supertest, or standalone HTTP clients. Covers schema…
v2.1 · audit A · 198 stars
bug-reproduction SKILL.md skill
petrkindlmann/qa-skills · skills/bug-reproduction/SKILL.md · Turn a vague bug report into a VERIFIED minimal reproduction and then a failing regression test, agent-driven end to…
v1.0 · audit A · 198 stars
chaos-engineering SKILL.md skill
petrkindlmann/qa-skills · skills/chaos-engineering/SKILL.md · Validate system resilience through controlled fault injection. Covers hypothesis-driven chaos experiments, failure…
v2.0 · audit A · 198 stars

Every file in petrkindlmann/qa-skills

Browse by kind, by grade A, or by owner.