debug-agent-from-traces SKILL.md skillA

debug-agent-from-traces from contextjet-ai/awesome-llm-observability is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add contextjet-ai/awesome-llm-observability/debug-agent-from-traces@git:20260705.23078be

Pins git:20260705.23078be in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
contextjet-ai/awesome-llm-observability
Path
skills/debug-agent-from-traces/SKILL.md
Versions recorded
2
Latest version
git:20260705.23078be, committed Jul 5, 2026
First version recorded
Jul 5, 2026
Size
3,170 bytes
Repository stars
45
License
a license file GitHub does not identify

Use this to diagnose WHY an LLM agent or chain produced a wrong, empty, slow, or expensive result, by reading its observability trace. Trigger on "my agent gave the wrong answer", "the chain returned nothing", "why is this so slow/expensive", "debug this trace/run", or when a trace tree is available. Walk the span tree systematically instead of guessing.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Debug an agent from its trace

A trace is a tree of spans (parent request → LLM/tool/retrieval children). Most agent failures are visible in it if you read it in the right order. Don't guess from the final output - walk the tree.

## Triage by symptom

| Symptom | Look here first |
|---|---|
| **Wrong answer** | The LLM span *just before* the bad output: was the prompt/context correct? Then the retrieval span that fed it. |
| **Empty / truncated output** | `finish_reason` (length? content_filter?), `max_tokens`, and any span that raised an exception then got swallowed. |
| **Hallucinated facts** | Retrieval spans - were the right docs retrieved (check scores/IDs)? If not, it's a retrieval bug, not an LLM bug. |
| **Too slow** | Span durations - find the critical path. Usually one slow retrieval, a serial loop that should be parallel, or a huge context. |
| **Too expensive** | Token counts per LLM span - find the span with the largest `input_tokens` (usually bloated context or a retry storm). |
| **Silent failure** | A span with an error/exception that was caught and returned empty. A missing subtree = a step that never ran. |

## The systematic walk
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add contextjet-ai/awesome-llm-observability/debug-agent-from-traces@sha256:464d5d393d3eccd2

The line at the top of this page pins the label git:20260705.23078be, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_bnssdhoxatuvdjm3.svg)](https://markdownregistry.com/a/art_bnssdhoxatuvdjm3)

1 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 2 versions of this file, all committed on Jul 5, 2026.

versioncommittedcommitsizeaudit
git:20260705.23078be latest2026-07-05 23078be 3,170 BA view · diff
git:20260705.c7a8a662026-07-05 c7a8a66 3,180 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (3170 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

contextjet-ai/awesome-llm-observability · 45 stars · license a license file GitHub does not identify · pushed 2026-11-02 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_bnssdhoxatuvdjm3
GET https://markdownregistry.com/api/v1/resolve?ref=contextjet-ai/awesome-llm-observability/debug-agent-from-traces
GET https://markdownregistry.com/api/v1/blob/464d5d393d3eccd2e60c04cd732f70d6904be36ce32c8a7f4ed860a5bee5acf5

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from contextjet-ai/awesome-llm-observability

add-llm-evals SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/add-llm-evals/SKILL.md · Use this when adding evaluation to an LLM/agent app - measuring output quality (correctness, faithfulness, relevance…
git:20260705.23078be · audit A · 45 stars
add-llm-fallbacks SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/add-llm-fallbacks/SKILL.md · Use this to make an LLM app resilient to provider failures, rate limits, timeouts, and outages. Trigger on "handle LLM…
git:20260705.6b497b1 · audit A · 45 stars
add-llm-guardrails SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/add-llm-guardrails/SKILL.md · Use this to add safety and security guardrails to an LLM/agent app - blocking prompt injection, PII leakage…
git:20261015.76d5de4 · audit A · 45 stars
annotate-traces-for-review SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/annotate-traces-for-review/SKILL.md · Use this to set up human review and annotation of LLM traces, so people (often domain experts) can label outputs, do…
git:20260705.95f5cea · audit A · 45 stars
build-eval-dataset SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/build-eval-dataset/SKILL.md · Use this to build a good evaluation dataset for an LLM app, the part everyone underestimates. Trigger on "make an eval…
git:20260705.4a58130 · audit A · 45 stars
check-answer-consistency SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/check-answer-consistency/SKILL.md · Use this to get a cheap, reference-free signal that an LLM answer might be made up, by sampling the same prompt a few…
git:20260705.4a31848 · audit A · 45 stars
choose-observability-stack SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/choose-observability-stack/SKILL.md · Use this to recommend an LLM observability / evaluation tool or stack for a specific situation. Trigger on "which…
git:20261015.76d5de4 · audit A · 45 stars
collect-user-feedback SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/collect-user-feedback/SKILL.md · Use this to capture user feedback on LLM outputs (thumbs up/down, edits, corrections, implicit signals) and feed it…
git:20260705.6b497b1 · audit A · 45 stars
compare-llm-models SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/compare-llm-models/SKILL.md · Use this to pick or switch the LLM behind a feature, based on evidence instead of hype or the newest release. Trigger…
git:20260705.4a58130 · audit A · 45 stars
detect-hallucinations SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/detect-hallucinations/SKILL.md · Use this to detect when an LLM is making things up, so you can flag or block confident-but-wrong answers before users…
git:20260705.2cc0ac5 · audit A · 45 stars
estimate-llm-cost SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/estimate-llm-cost/SKILL.md · Use this to estimate what an LLM call or feature will cost, and to compare models on price, before or after shipping…
git:20261020.4f317d3 · audit A · 45 stars
eval-driven-development SKILL.md skill
contextjet-ai/awesome-llm-observability · skills/eval-driven-development/SKILL.md · Use this to build or change an LLM feature the reliable way, by writing evals first and iterating against them, instead…
git:20260705.23078be · audit A · 45 stars

Every file in contextjet-ai/awesome-llm-observability

Browse by kind, by grade A, or by owner.