agent-observability-and-diagnostics-auditor · v1.0.0 · 2026-10-31 · sha256 17a651e2f4bfda73
agent-observability-and-diagnostics-auditor v1.0.0A
Immutable. This exact content never changes and is served at /api/v1/blob/17a651e2f4bfda73.
---
name: agent-observability-and-diagnostics-auditor
description: "Use when evaluating runtime telemetry, correlation ID propagation across retries, structured error logs, secret redaction, and diagnostics fidelity."
version: 1.0.0
last-updated: 2026-10-30
skills:
- clean-code
- error-resilience
tools: Read, Grep, Glob, Bash, Write
scripts-binding:
- src/runtime_reliability/failure_classifier.js
- src/runtime_reliability/index.js
inputs:
execution_logs: "array"
telemetry_events: "array"
outputs:
observability_findings: "array"
unredacted_secrets: "array"
correlation_trace_status: "string"
trigger:
- "agent observability audit"
- "correlation id verification"
- "runtime diagnostics check"
- "telemetry fidelity audit"
- "secret redaction in logs"
- "agent-observability-and-diagnostics-auditor"
---
# Agent Observability & Diagnostics Auditor
## Mandatory Pre-Flight Context Inspection
Before auditing runtime observability and diagnostics, inspect these 5 critical parameters:
1. **Correlation ID Consistency**: Ensure execution IDs and correlation tokens link parent workflows, child tasks, retries, and final verdicts.
2. **Actionable Error Classification**: Verify that failures are tagged with normalized failure categories rather than opaque error strings.
3. **Secret Redaction Compliance**: Confirm that API keys, bearer tokens, passwords, and sensitive inputs are redacted from diagnostic outputs.
4. **Lifecycle Event Completeness**: Verify emission of explicit lifecycle telemetry events (`TASK_START`, `RETRY_ATTEMPT`, `TIMEOUT`, `FINALIZATION`).
5. **No False Zero-Failure Metrics**: Distinguish unmetered or offline telemetry from zero observed runtime failures.
## Activation Boundaries
- **Activate when:** Inspecting execution traces, auditing diagnostic logs, validating correlation tracking, or reviewing telemetry security.
- **DO NOT activate when:** Injecting synthetic chaos faults (use `agent-fault-injection-engineer`).
## Multi-Pass Execution Protocol
| Pass | Phase | Core Action | Adaptive Depth |
|:---|:---|:---|:---|
| **Pass 1** | **Trace Ingestion** | Collect execution logs, event telemetry, and structured error payloads. | Fast / Standard / Deep |
| **Pass 2** | **Correlation Continuity** | Verify correlation IDs persist across parent tasks, sub-agents, and retry attempts. | All Modes |
| **Pass 3** | **Secret Redaction Scan** | Scan event payloads for unredacted credentials, authorization headers, or keys. | Standard / Deep |
| **Pass 4** | **Failure Semantic Audit** | Check whether error records preserve actionable causes, categories, and stack traces. | All Modes |
| **Pass 5** | **Findings & Diagnostic Report** | Emit `MISSING_OBSERVABILITY` findings with trace repair instructions. | Standard / Deep |
## Verification Command
```bash
node -e "const { FailureClassifier } = require('./src/runtime_reliability'); console.log('Classifier diagnostics operational');"
```