kitaru-replay-experiment SKILL.md skillA

kitaru-replay-experiment from zenml-io/kitaru-skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add zenml-io/kitaru-skills/kitaru-replay-experiment@git:20260903.598f4b2

Pins git:20260903.598f4b2 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
zenml-io/kitaru-skills
Path
skills/kitaru-replay-experiment/SKILL.md
Versions recorded
5
Latest version
git:20260903.598f4b2, committed Sep 3, 2026
First version recorded
Aug 25, 2026
Size
14,702 bytes
Repository stars
6
License
Apache-2.0

Run and interpret one safe, bounded Kitaru replay comparison against an accepted cohort and exact evaluators. Use when a user wants to replay a cohort, test or compare a model, prompt, system prompt, parameter, agent version, or tool policy, supervise an experiment run, determine whether one candidate helped, or ask for one bounded change worth testing.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Kitaru replay experiment

Test one candidate condition against known cases and explain whether the available evidence improved, regressed, traded off, or stayed inconclusive. Do not make the deployment decision.

## Core contract

- Start from an accepted behavior, exact cohort version, exact evaluator versions and parameters, and one candidate change. Suggest one bounded candidate only when asked.
- Replay starts a fresh agent task from each historical session's stored top-level inputs after applying the override. It does not restore an arbitrary checkpoint, conversation, process memory, adapter instance state, filesystem, or external world state.
- Resolve adapter support and its construction path before asking to run the experiment. A shared replay schema does not prove that an adapter supports a requested override or tool source.
- Require an explicit tool policy for every tool-using run. Omission resolves to live passthrough on the current server and is unsafe as an implicit default.
- Carry exact IDs, versions, evaluator parameters, run-spec evidence, tool policy, failures, and missing results forward.
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add zenml-io/kitaru-skills/kitaru-replay-experiment@sha256:bb4f2c6bc6eeeaef

The line at the top of this page pins the label git:20260903.598f4b2, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_vt65qkjp5svgrhak.svg)](https://markdownregistry.com/a/art_vt65qkjp5svgrhak)

2 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 5 versions of this file, between Aug 25, 2026 and Sep 3, 2026, about one every 2 days.

versioncommittedcommitsizeaudit
git:20260903.598f4b2 latest2026-09-03 598f4b2 14,702 BA view · diff
git:20260902.d9aba702026-09-02 d9aba70 14,304 BA view · diff
git:20260902.1e2a1a92026-09-02 1e2a1a9 14,135 BA view · diff
git:20260825.ed9c6c32026-08-25 ed9c6c3 13,737 BA view · diff
git:20260825.9c0e2f12026-08-25 9c0e2f1 13,379 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (14702 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

zenml-io/kitaru-skills · 6 stars · license Apache-2.0 · pushed 2026-11-02 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_vt65qkjp5svgrhak
GET https://markdownregistry.com/api/v1/resolve?ref=zenml-io/kitaru-skills/kitaru-replay-experiment
GET https://markdownregistry.com/api/v1/blob/bb4f2c6bc6eeeaef820cc9405ad9e4bdb09933c081cbf9ecd8af1217de1abd79

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from zenml-io/kitaru-skills

skills-release SKILL.md skill
zenml-io/kitaru-skills · .claude/skills/skills-release/SKILL.md · Use when cutting a release of the kitaru-skills repository — pushing develop to main, bumping the kitaru plugin…
git:20260821.5fabdd1 · audit A · 6 stars
AGENTS.md AGENTS.md file
zenml-io/kitaru-skills · AGENTS.md
git:20261030.d38c791 · audit A · 6 stars
CLAUDE.md CLAUDE.md file
zenml-io/kitaru-skills · CLAUDE.md
git:20261030.d38c791 · audit A · 6 stars
kitaru-adapter-builder SKILL.md skill
zenml-io/kitaru-skills · skills/kitaru-adapter-builder/SKILL.md · Select a supported Kitaru adapter or build a project-local one for an unsupported Python or TypeScript agent framework…
git:20260902.d9aba70 · audit A · 6 stars
kitaru-guided-tour SKILL.md skill
zenml-io/kitaru-skills · skills/kitaru-guided-tour/SKILL.md · Give first-time users a short, value-first Kitaru tour with the PydanticAI returns agent example in the Kitaru…
git:20260825.cf46ae3 · audit A · 6 stars
kitaru-hosted-onboarding-tour SKILL.md skill
zenml-io/kitaru-skills · skills/kitaru-hosted-onboarding-tour/SKILL.md · Guide the ZenML Pro hosted Kitaru onboarding tour from preloaded traces through human review, one reusable evaluator…
git:20261023.8030665 · audit B · 6 stars
kitaru-importer-builder SKILL.md skill
zenml-io/kitaru-skills · skills/kitaru-importer-builder/SKILL.md · Build and validate a custom Kitaru trace importer when a provider, observability platform, export format, or agent…
git:20261023.8030665 · audit A · 6 stars
kitaru-insights SKILL.md skill
zenml-io/kitaru-skills · skills/kitaru-insights/SKILL.md · Read many recorded Kitaru sessions with the user's own coding agent and subagents, find recurring failure and success…
git:20261030.d38c791 · audit A · 6 stars
kitaru-investigation SKILL.md skill
zenml-io/kitaru-skills · skills/kitaru-investigation/SKILL.md · Guide users from their own agent code or recorded traces through Kitaru setup, session import or recording, human…
git:20261030.d38c791 · audit A · 6 stars
kitaru-validate-evaluator SKILL.md skill
zenml-io/kitaru-skills · skills/kitaru-validate-evaluator/SKILL.md · Guide a human through checking one evaluator against criterion-specific Kitaru investigation verdicts, inspecting…
git:20260921.499e730 · audit A · 6 stars

Every file in zenml-io/kitaru-skills

Browse by kind, by grade A, or by owner.