AGENTS.md@web/src/features/evals/v2 · git:20260822.a7fa476 · 2026-08-22 · sha256 3e3bc2083e6dfb2f
AGENTS.md@web/src/features/evals/v2 git:20260822.a7fa476A
Immutable. This exact content never changes and is served at /api/v1/blob/3e3bc2083e6dfb2f.
# Evaluators v2 This is the new version of evaluations that uses a new data model. The old change used: - `eval_templates` (definition of an evaluator) - `job_configurations` (variable mapping and which events it runs against) The new data model is - Evaluator - Rule (basically the old `job_configuration`) - Rule assignments (association table handling the n:m relationship) Traces captured during the eval executions in the past only captured `job_configuration_id`. Only new runs capture `evaluator_id` and `evaluation_rule_id`.