principle-trace-token-burn-loop ยท diff
git:20260904.5579d02 to git:20260924.a859be2
15 added, 1 removed. Audit A to A.
---
name: principle-trace-token-burn-loop
description: >-
Apply when analyzing token burn or agent session spend. Prevents mistaking
the top task_type or prompt_type for the root cause. Forces a trace from the
session back to the loop script or plan entry point before prescribing a fix.
disable-model-invocation: true
---
# Trace token burn back to the loop script
When a session miner reports a task_type or prompt_type consuming tokens, the
symptom (what the agent was doing) is not necessarily the cause (what kept
re-spawning the agent).
**Why:** session JSONL contains `cwd`, `workflow_id`, and the first user prompt,
but the scheduler name is missing. An unbounded outer loop โ a worker
`intervalMs`, a `while true` shell driver, a cron plan, or a plan task with no
iteration limit โ can make a cheap plan become an expensive burn.
**Pattern:**
1. Rank spend by task_type / prompt_type, then open one representative session
- file.
+ file. Fleet-wide: `scripts/scan_session_tokens.py <session-dirs>` emits one
+ JSONL row per session file (codex exec, codex rollout, claude, OMP formats;
+ `--summary` for the agent x workload table), and is pipeable over ssh โ
+ `cat scan_session_tokens.py | ssh host python3 - ~/.invoker/agent-sessions
+ ~/.claude/projects ~/.codex/sessions`. For a single session's pricing /
+ thrash detail use `engine/skills/reflect/scripts/token_audit.py`.
+ 1a. Check whether the burn is session-lifetime (few long sessions, context
+ re-sent every turn) or run-count (many runs at a fixed per-run floor):
+ `scripts/context_growth.py --summary <session.jsonl>` reports turns,
+ peak/avg context, `clears` (sawtooth drops = /clear or compaction
+ cycles), and gross resend total; without `--summary` it emits the raw
+ per-call `{ts, ctx, out}` series. A long-running session that polls
+ (ScheduleWakeup, sleep-and-recheck loops) will show turns x ~500K avg
+ context; a one-shot run shows a single ramp. Cost ~= area under the
+ curve, not the task size.
2. Read its `cwd` and first user prompt to map it to a plan or workflow.
3. Open that plan or worker file.
4. Look for an unbounded loop:
- `intervalMs` without a max-tick or max-age bound
- `while true`, `sleep`, or a cron expression
- a plan task that calls `submitPlan` on every tick with no cooldown
- a shell loop driver that re-enters the plan on failure
5. Before adding a worker-level cooldown or a smarter prompt, confirm the
scheduler is not already responsible for re-running the same plan.
6. If the scheduler is unbounded, the root cause is the loop script / plan entry
point, not the plan content.
Avoid stopping at the worker that submitted the plan. The worker may be correct
on each tick; the bug is the loop that keeps ticking.