Home / akillness / jeo-skills · .agent-skills/agent-observability/SKILL.md · GitHub

agent-observability skillA

agent-observability is agent-read markdown (skill) from akillness/jeo-skills: Instrument LLM agents with traces, metrics, and replay. Use when an agent in production is silently failing, regressing, drifting, or burning tokens. Selects LangSmith / Langfuse / Phoenix, defines node-level spans, attaches evals to traces, and enables session replay..

Indexed from public GitHub and served as immutable, content-addressed versions. Install it pinned to an exact SHA-256 with the mdr CLI, and every file is verified against the hash recorded here before it reaches your agent. The deterministic audit below grades the latest version, and the same file always earns the same grade.

What the file says

# Agent Observability

## Overview

Production agents fail differently than services: bad tool calls, hallucinated arguments, runaway loops, silent quality regression. This skill picks an observability backend, instruments node-level spans, attaches evals to traces, and sets up replay — so failures are *observable*, not just guessed at.

## When to use

- Agent works in dev, breaks in prod with no logs that explain why
- Need to compare prompt/model changes against a baseline (eval-in-trace)
- Token/latency cost is growing and you don't know which node is the culprit
- A user reports a bad answer and you need to *replay* the exact session
- Multiple agents/subagents — you need a single trace tree, not interleaved logs

## Platform selection

| Backend | Pick when | Hosting |
|---------|-----------|---------|
| LangSmith | LangChain/LangGraph stack, want managed | SaaS |
| Langfuse | Open-source, self-host required, multi-framework | SaaS or self-host |
| Arize Phoenix | OTel-native, embed/eval drift, OSS-first | Local or self-host |

Default: **Langfuse** when you need self-host, **LangSmith** when you're already on LangGraph, **Phoenix** when OTel is mandated.
…

Read the whole file at its exact version.

How to install

Latest version
mdr add akillness/jeo-skills/agent-observability@git:20260919.9f2a908
Exact content
mdr add akillness/jeo-skills/agent-observability@sha256:5d20fb8cf882f342

Pin to a label to follow the author's releases, or to a sha256 to freeze the exact bytes forever. Either way the resolved hash is written to mdr.lock, and mdr install reproduces it on any machine.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_4f6f5vmsfua6wrou.svg)](https://markdownregistry.com/a/art_4f6f5vmsfua6wrou)

0 badge views in 30 days

Versions

versioncommittedcommitsizeaudit
git:20260919.9f2a908 latest2026-09-19 9f2a908 3,143 BA view

Audit of the latest version

A  17 of 17 checks passed. Deterministic, no model, same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (3143 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

akillness/jeo-skills · 47 stars · license none · pushed 2026-09-22 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_4f6f5vmsfua6wrou
GET https://markdownregistry.com/api/v1/resolve?ref=akillness/jeo-skills/agent-observability
GET https://markdownregistry.com/api/v1/blob/5d20fb8cf882f3421344affa9afa0906e80850555ea2050af05efa5719f9eaba

Your agent does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

More from akillness/jeo-skills

a2a-protocol skill
akillness/jeo-skills · .agent-skills/a2a-protocol/SKILL.md · Agent-to-Agent horizontal messaging — Linux Foundation AAIF 2026 standard. Use when multiple agents across…
git:20260920.2a2b733 · audit A · 47 stars
ab-test-analysis skill
akillness/jeo-skills · .agent-skills/ab-test-analysis/SKILL.md · Analyze A/B test results with statistical significance, sample size validation, confidence intervals, and…
git:20260919.9f2a908 · audit A · 47 stars
academic-research skill
akillness/jeo-skills · .agent-skills/academic-research/SKILL.md · Full academic research pipeline from discovery to publication — 4 reference pipelines, 27 modes, 39-agent ensemble…
v1.0.0 · audit A · 47 stars
agent-benchmarking skill
akillness/jeo-skills · .agent-skills/agent-benchmarking/SKILL.md · Map agent capabilities to standard benchmarks (SWE-bench, WebArena, OSWorld, GAIA, TauBench) plus custom regression…
git:20260919.9f2a908 · audit A · 47 stars
agent-guardrails skill
akillness/jeo-skills · .agent-skills/agent-guardrails/SKILL.md · Layered agent safety — prompt-injection defense, data exfiltration prevention, tool-misuse blocking via NeMo Guardrails…
git:20260919.9f2a908 · audit B · 47 stars
agent-manager skill
akillness/jeo-skills · .agent-skills/agent-manager/SKILL.md · tmux + Python agent lifecycle manager — start, stop, monitor, and assign tasks to AI agents running in tmux sessions…
v1.0 · audit A · 47 stars
agent-memory-architecture skill
akillness/jeo-skills · .agent-skills/agent-memory-architecture/SKILL.md · Design tiered agent memory — core / recall / archival — with backend selection (mem0, Letta, Zep/Graphiti, LangMem) and…
git:20260919.9f2a908 · audit A · 47 stars
agent-principles skill
akillness/jeo-skills · .agent-skills/agent-principles/SKILL.md · Core principles for collaborative development with AI agents. Defines divide-and-conquer, context management…
v2.0.0 · audit A · 47 stars
agent-pulse skill
akillness/jeo-skills · .agent-skills/agent-pulse/SKILL.md · Operate and extend barretlee/agent-pulse, the evidence-backed AI industry intelligence system: inspect source catalog…
v1.0 · audit A · 47 stars
agent-reach skill
akillness/jeo-skills · .agent-skills/agent-reach/SKILL.md · Operate Panniantong/Agent-Reach, the MIT-licensed installer, doctor, and routing layer for platform-specific internet…
v1.0.0 · audit A · 47 stars
agent-system-design skill
akillness/jeo-skills · .agent-skills/agent-system-design/SKILL.md · Production agent SLA discipline — MAX_LOOPS, MAX_TOKENS, MAX_COST, MAX_LATENCY, MAX_TOOL_CALLS, circuit breakers…
git:20260920.2a2b733 · audit A · 47 stars
agent-tool-routing skill
akillness/jeo-skills · .agent-skills/agent-tool-routing/SKILL.md · Tool registry, capability discovery, schema-first routing, router policies and fallbacks. Use when an agent has more…
git:20260920.2a2b733 · audit A · 47 stars

Every file in akillness/jeo-skills

Other files named agent-observability

agent-observability skill
sickn33/agentic-awesome-skills · plugins/agentic-awesome-skills-claude/skills/agent-observability/SKILL.md · Instrument AI agents with tracing, token metrics, latency, and cost visibility.
v2.0 · audit A · 46,848 stars
agent-observability skill
vodailocz/kilo-kit-mcp · skills/operations/agent-observability/SKILL.md · Use when monitoring, tracing, or debugging agentic workflows in production. Keywords: observability, tracing…
git:20260907.70ddb5c · audit A · 26 stars
agent-observability skill
jnpiyush/agentx · .github/skills/ai-systems/agent-observability/SKILL.md · Instrument LLM agents with tracing, metrics, and evaluation telemetry. Use when adding OpenTelemetry GenAI semantic…
v1.0.0 · audit A · 16 stars

Browse by kind, by grade A, or by owner.