git:20260417.bd04f5c to git:20260417.869e9da

# AGENTS.md

Instructions for agents working in this repo.

## Repo structure

```

skills/

├── .agents/skills/skill-creator/ # The skill-creator skill (Anthropic upstream)

├── protect-route/ # Arcjet protect-route skill

│ ├── SKILL.md # The skill itself

│ └── evals/

│ ├── evals.json # Test prompts + expected outputs

│ └── files/ # Fixture input files for evals

└── .gitignore

```

## Running skill evals

### Workspace structure

The skill-creator expects this exact layout — do NOT add extra nesting (e.g. no `run-1/`):

```

<skill>-workspace/iteration-N/

eval-<name>/

eval_metadata.json # prompt + assertions

with_skill/

outputs/ # Files the agent produced

grading.json # Assertion results

timing.json # Token/time data

without_skill/

outputs/

grading.json

timing.json

```

### Launching the viewer

Use `generate_review.py` in **server mode** (not `--static`) so the feedback POST endpoint works:

```bash

nohup python3 .agents/skills/skill-creator/eval-viewer/generate_review.py \

<workspace>/iteration-N \

--skill-name "<name>" \

--benchmark <workspace>/iteration-N/benchmark.json \

--port 8080 \

> /dev/null 2>&1 &

```

Do NOT serve the static HTML with `python3 -m http.server` — the feedback submit button will silently fail (the simple server returns 405 on POST, but the JS `.then()` still fires, so it looks like it worked).

### Aggregating benchmarks

```bash

PYTHONPATH=.agents/skills/skill-creator python3 -m scripts.aggregate_benchmark \

<workspace>/iteration-N --skill-name <name>

```

### generate_review.py fixes applied

The upstream `generate_review.py` has a bug: `iterdir()` on line ~125 only lists direct children of `outputs/`, missing files in subdirectories like `src/index.ts`. We patched it to use `rglob("*")` instead. If the upstream is updated, check whether this fix was incorporated.