agent-observability SKILL.md skillA

agent-observability from jnpiyush/agentx is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add jnpiyush/agentx/agent-observability@v1.0.0

Pins v1.0.0 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
jnpiyush/agentx
Path
.github/skills/ai-systems/agent-observability/SKILL.md
Versions recorded
3
Latest version
v1.0.0, committed Sep 15, 2026
First version recorded
Apr 30, 2026
Size
5,598 bytes
Repository stars
18
License
Apache-2.0

Instrument LLM agents with tracing, metrics, and evaluation telemetry. Use when adding OpenTelemetry GenAI semantic conventions, integrating Langfuse / LangSmith / Arize Phoenix / Helicone / OpenLLMetry, capturing prompt/response spans, tool-call latency, token cost, eval scores, and feedback signals. Distinct from genaiops (release policy) and ai-evaluation (rubric design).

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Agent Observability

> **Purpose**: Make every LLM call, tool call, and agent decision observable, debuggable, and cost-attributable.

---

## When to Use This Skill

- Standing up an LLM-powered service in any environment beyond local dev
- Investigating regressions, latency spikes, or cost spikes
- Wiring evaluation scores into traces for replay
- Building a feedback loop from production data
- Debugging multi-agent handoffs (see `multi-agent-orchestration`)

---

## Three Pillars

| Pillar | What | Tools |
|--------|------|-------|
| **Traces** | Per-request span tree of model + tool calls | OpenTelemetry, Langfuse, LangSmith, Phoenix |
| **Metrics** | Aggregate latency, cost, error rate, eval scores | Prometheus, Azure Monitor, Datadog |
| **Logs** | Raw prompts, responses, tool args (PII-scrubbed) | Same backends + log store |

Use all three. Traces alone are not sufficient for SLO monitoring; metrics alone cannot debug a single bad response.

---

## OpenTelemetry GenAI Semantic Conventions

The OTel GenAI semantic conventions are now stable. Use them.

Key span attributes:

| Attribute | Example |
|-----------|---------|
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add jnpiyush/agentx/agent-observability@sha256:4a2581e6f6fed4cf

The line at the top of this page pins the label v1.0.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_m6iddpef3t6f6mzj.svg)](https://markdownregistry.com/a/art_m6iddpef3t6f6mzj)

5 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 3 versions of this file, between Apr 30, 2026 and Sep 15, 2026, about one every 69 days.

versioncommittedcommitsizeaudit
v1.0.0 latest2026-09-15 f17c505 5,598 BA view · diff
v1.0.02026-06-21 2514c5b 5,596 BA view · diff
v1.0.02026-04-30 4f38ce8 5,596 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (5598 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

jnpiyush/agentx · 18 stars · license Apache-2.0 · pushed 2026-11-01 · branch master

API

GET https://markdownregistry.com/api/v1/artifacts/art_m6iddpef3t6f6mzj
GET https://markdownregistry.com/api/v1/resolve?ref=jnpiyush/agentx/agent-observability
GET https://markdownregistry.com/api/v1/blob/4a2581e6f6fed4cf2ceb2832feeb8938f50f66eb9697e4c2174f7cfdc49f0ff0

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from jnpiyush/agentx

000-frontier-core Cursor rule
jnpiyush/agentx · .cursor/rules/000-frontier-core.mdc · Frontier canonical contracts and workspace context for Cursor.
git:20261012.38fb931 · audit A · 18 stars
ai Cursor rule
jnpiyush/agentx · .cursor/rules/ai.mdc · AI / agent / LLM workflow standards (Frontier)
git:20261010.87e53aa · audit A · 18 stars
csharp Cursor rule
jnpiyush/agentx · .cursor/rules/csharp.mdc · C# / .NET coding standards (Frontier)
git:20261010.87e53aa · audit A · 18 stars
python Cursor rule
jnpiyush/agentx · .cursor/rules/python.mdc · Python coding standards (Frontier)
git:20261010.87e53aa · audit A · 18 stars
react Cursor rule
jnpiyush/agentx · .cursor/rules/react.mdc · React / TSX frontend standards (Frontier)
git:20261010.87e53aa · audit A · 18 stars
typescript Cursor rule
jnpiyush/agentx · .cursor/rules/typescript.mdc · TypeScript / Node backend standards (Frontier)
git:20261010.87e53aa · audit A · 18 stars
agent-memory-systems SKILL.md skill
jnpiyush/agentx · .github/skills/ai-systems/agent-memory-systems/SKILL.md · Design agent memory beyond a single context window: short-term (working / scratchpad), long-term (episodic, semantic…
v1.0.0 · audit A · 18 stars
ai-agent-development SKILL.md skill
jnpiyush/agentx · .github/skills/ai-systems/ai-agent-development/SKILL.md · Build production-ready AI agents with Microsoft Foundry and Agent Framework. Use when creating AI agents, selecting LLM…
git:20261010.87e53aa · audit A · 18 stars
ai-evaluation SKILL.md skill
jnpiyush/agentx · .github/skills/ai-systems/ai-evaluation/SKILL.md · Use when evaluating AI quality, safety, completeness and cost with held-out tasks, executable graders, calibrated…
v1.1.0 · audit A · 18 stars
ai-safety-and-red-teaming SKILL.md skill
jnpiyush/agentx · .github/skills/ai-systems/ai-safety-and-red-teaming/SKILL.md · Defend LLM systems against prompt injection, jailbreaks, data exfiltration, and unsafe output. Covers input/output…
v1.0.0 · audit B · 18 stars
anthropic-claude SKILL.md skill
jnpiyush/agentx · .github/skills/ai-systems/anthropic-claude/SKILL.md · Implement production applications with Anthropic Claude models -- Messages API, tool use, prompt caching, adaptive…
v1.0.0 · audit A · 18 stars
azure-foundry SKILL.md skill
jnpiyush/agentx · .github/skills/ai-systems/azure-foundry/SKILL.md · Design and architect AI agents on Azure AI Foundry -- lifecycle planning, model selection strategy, evaluation…
git:20260915.f17c505 · audit A · 18 stars

Every file in jnpiyush/agentx

Other files named agent-observability

agent-observability SKILL.md skill
sickn33/agentic-awesome-skills · plugins/agentic-awesome-skills-claude/skills/agent-observability/SKILL.md · Instrument AI agents with tracing, token metrics, latency, and cost visibility.
v2.0 · audit A · 49,071 stars
agent-observability SKILL.md skill
francostino/opencode-skills-collection · bundled-skills/agent-observability/SKILL.md · Instrument AI agents with tracing, token metrics, latency, and cost visibility.
v2.0 · audit A · 90 stars
agent-observability SKILL.md skill
akillness/jeo-skills · .agent-skills/agent-observability/SKILL.md · Instrument LLM agents with traces, metrics, and replay. Use when an agent in production is silently failing…
git:20260919.9f2a908 · audit A · 53 stars
agent-observability SKILL.md skill
vodailocz/kilo-kit-mcp · skills/operations/agent-observability/SKILL.md · Use when monitoring, tracing, or debugging agentic workflows in production. Keywords: observability, tracing…
git:20260907.70ddb5c · audit A · 27 stars
agent-observability SKILL.md skill
glassflow/rius-coding-agents · .agents/skills/agent-observability/SKILL.md · Adds agent observability to an AI agent or LLM app with Rius, an OpenTelemetry-native tracing service: every run…
git:20261020.27f5db5 · audit A · 3 stars

Browse by kind, by grade A, or by owner.