AGENTS.md@infrastructure/benchmark · git:20260712.72e6a04 · 2026-07-12 · sha256 033f165c55069c82
AGENTS.md@infrastructure/benchmark git:20260712.72e6a04A
Immutable. This exact content is served forever at /api/v1/blob/033f165c55069c82.
# infrastructure/benchmark/ — Agent Guide ## Purpose Maintain small benchmark harnesses that validate canonical template outputs using real files and deterministic scoring. ## Local rules - Keep benchmark logic generic to the public template; do not reference confidential or rotating local-only projects. - Exercise actual generated artifacts, manuscript Markdown, BibTeX, figures, and data files. - Keep rubric dimensions explicit in manifests; do not infer hidden benchmark weights from prior runs. - Require rubric dimensions to match checks exactly and keep all weights positive and finite. - Fail closed on missing public projects, validation reports, and declared reproducibility artifacts. - Preserve the No-Mocks Policy: no mock frameworks, no fake clients, and no monkeypatched external behavior. - Keep runtime bounded so harnesses can run in local readiness checks. ## Validation ```bash uv run pytest tests/infra_tests/benchmark/test_template_benchmark_harness.py -v uv run python -m infrastructure.benchmark --repo-root . ``` ## See also - [`README.md`](README.md) - [`../validation/AGENTS.md`](../validation/AGENTS.md) - [`../../tests/infra_tests/benchmark/AGENTS.md`](../../tests/infra_tests/benchmark/AGENTS.md)