evolve ยท diff
git:20260918.3197adc to git:20260918.c9794ad
9 added, 9 removed. Audit A to A.
---
name: evolve
description: Iteratively improve any artifact and its improvement harness, inventing evaluation when needed; supports bounded runs, tournaments and continuous resumable search.
disable-model-invocation: true
---
- Apply [library context](../../references/library-context.md) and the required [evaluation](references/evaluation.md) and [state](references/state.md) contracts. Inputs are artifacts, multiple seeds or a creation brief, the caller's purpose and constraints, and optional bounds, output location and scoped settings. Infer missing quality criteria; clarify only gaps that prevent meaningful creation or assessment. Ordinary production follows core staffing rules and evaluation's context exclusions.
+ Apply [library context](../../references/library-context.md) and required [evaluation](references/evaluation.md) and [state](references/state.md) contracts. Accept artifacts, seeds or a creation brief; purpose and constraints; optional bounds, output location and scoped settings. Infer quality criteria; clarify gaps that prevent meaningful creation or assessment. Production follows core staffing rules and evaluation's context exclusions.
## Start or resume
- Use the caller's run directory or a distinct `evolve-runs/<run-id>/` in their workspace. On resume, reconcile state and in-flight work before starting anything new.
+ Use the caller's directory or a distinct `evolve-runs/<run-id>/` in their workspace. Reconcile saved state and in-flight work before new work.
- For a new run, preserve the original; if only a brief exists, make a seed. Design, calibrate and save evaluation before challengers. Evaluate the seeds and select the initial incumbent (current best). Save the working harness: instructions, tools and search policy actually used.
+ For a new run, preserve the original or create a seed from the brief. Design, calibrate and save evaluation before challengers. Evaluate seeds, choose the incumbent (current best), and save the harness: working instructions, tools and search policy.
- Record bounds, scoped settings and per-experiment limits. Default to three rounds and one challenger per round. An explicit continuous request has no total round cap: continue until stopped, a supplied bound is reached or execution is blocked. A target stops work only if the caller makes it a stop condition; a plateau is not completion.
+ Record bounds, scoped settings and per-experiment limits. Default to three rounds and one challenger per round. Explicit continuous requests remove the total round cap: continue until stopped, a supplied bound is reached or execution is blocked. A target stops work only if the caller says so; plateau is not completion.
## Repeat
- 1. **Start and choose.** Start each artifact or harness attempt under core's iteration bounds and the state contract, before proposal or production work. Read the checkpoint and relevant evidence; select a concrete hypothesis and predicted benefit. After three rounds since the last promotion that provide usable candidate or harness evidence but no promotion, change the approach, investigate the repeated failure or test a harness change. Failures outside the candidate or harness neither advance nor reset this trigger; all attempts and spent resources still count against caller bounds.
- 2. **Make.** Save the plan and isolated candidate locations. Produce each challenger from its parent snapshot, hypothesis, active harness, public evaluation and applicable guidance. Give each candidate one owner; keep incumbent, evaluation and journal outside production write scope. For a harness round, apply the required [harness experiment](references/harness.md) instead; it replaces an ordinary round.
- 3. **Compare.** Freeze candidates. Apply evaluation, including screening, matched versions, independent `orch-review` judgments and required confirmation. Compare every proposed replacement with the incumbent. Missing evidence, failed requirements, ties and unconfirmed wins retain the incumbent. Save actual failures without inventing scores.
- 4. **Record and continue.** Journal the decision and evidence, then checkpoint the verified winner, retained alternatives, lessons and remaining bounds. Check stop conditions before starting another round. If evaluation is uninformative, inconsistent or exploitable, repair it between rounds: preserve purpose and constraints, version it and re-evaluate the incumbent and contenders before any promotion. Never compare scores across versions or count an easier evaluator as progress. Evaluation repair is separate from harness promotion; it consumes resources but adds no artifact/harness round and grants no repair loop or reset of attempts.
+ 1. **Start and choose.** Record each artifact/harness attempt under core's iteration bounds and the state contract before proposal or production. Read checkpoint/evidence; choose a hypothesis and predicted benefit. After three rounds since promotion with usable candidate/harness evidence but no promotion, change approach, investigate repeated failure or test a harness change. External failures neither advance nor reset this trigger; all attempts and resources still count.
+ 2. **Make.** Save the plan and isolated candidate locations. Supply each challenger its parent snapshot, hypothesis, active harness, public evaluation and guidance. Give it one owner; exclude incumbent, evaluation and journal from production writes. A [harness experiment](references/harness.md) replaces the ordinary round.
+ 3. **Compare.** Freeze candidates. Apply screening, matched evaluation versions, independent `orch-review` judgments and confirmation. Compare every proposed replacement with the incumbent. Missing evidence, failed requirements, ties or unconfirmed wins retain the incumbent. Record failures without invented scores.
+ 4. **Record and continue.** Journal decision/evidence, then checkpoint winner, alternatives, lessons and remaining bounds. Check stopping conditions before another round. Repair uninformative, inconsistent or exploitable evaluation between rounds: preserve purpose/constraints, version it, and re-evaluate incumbent/contenders before promotion. Scores across versions are incomparable; easier evaluation is not progress. Evaluator repair spends resources but adds no artifact/harness round, repair loop or attempt reset.
## Return or yield
- Persist state at each decision and before interruption or context rollover. Return the best artifact, improvements and their evaluation version, active harness, evidence, observable resource use, actual stop reason and resume path. Distinguish measured, judge-preferred and untested claims. If execution or continuation is unavailable, report the checkpoint and gap without claiming background execution. A finite run reaching its bound completes the search; it does not prove no further improvement is possible.
+ Persist at each decision and before interruption/context rollover. Return best artifact, improvements/evaluation version, active harness, evidence, observable resource use, actual stop reason and resume path. Separate measured, judge-preferred and untested claims. Missing execution/continuation capability requires a checkpoint and gap, not a background-execution claim. Reaching a finite bound completes the search without proving further improvement impossible.