run-tests · git:20260812.aa98c4b · 2026-08-12 · sha256 b36569a6b14d1811
run-tests git:20260812.aa98c4bA
Immutable. This exact content is served forever at /api/v1/blob/b36569a6b14d1811.
--- name: run-tests description: Run the tests, run one spec, run e2e locally or on Daytona, investigate a skipped spec. Use for executing @openwork/testkit agent-first verification. --- # Skill: Run Tests ## Run the landable tree - Check out the exact PR head that will land. After any rebase or cherry-pick, discard the old verdict and run again. - Run one spec at a time so each failure and ambient tape has one owner. ## Choose the execution environment - Prefer Daytona when Daytona credentials, tooling, and service access are available. Set `OPENWORK_EVAL_DAYTONA=1` for that run. - If Daytona is unavailable, run the same spec locally with `OPENWORK_EVAL_DAYTONA` unset. Missing Daytona access is an expected path for OSS contributors and does not make the verdict fail or incomplete. - Record the selected lane. For local fallback, report which Daytona prerequisite was unavailable without printing secret values. ## Prepare local fallback ```bash pnpm --filter @openwork/types build pnpm --filter @openwork-ee/den-db build pnpm --filter @openwork/email build pnpm dev:den:mysql ``` - Local `server()` requires MySQL at `127.0.0.1:3306`. - Build those workspace dependencies before local Den; otherwise den-api imports can fail. - If the checkout path contains spaces, set `OPENWORK_EVAL_SURFACES_DIR` to a space-free path before app specs. node-gyp and electron-rebuild require it. ## Choose one lane - Run one app-less PR-lane spec: ```bash pnpm evals:spec specs/<name>.test.ts ``` - Run one app/Den-driving stack-lane spec: ```bash pnpm evals <name> # Fallback: OPENWORK_EVAL_APP_SPECS=1 pnpm --dir evals exec vitest run --config vitest.config.ts --project stack specs/<name>.slow.test.ts ``` - The commands above use Daytona when `OPENWORK_EVAL_DAYTONA=1` is set and isolated local resources when it is unset. ## Read the verdict - Record the exact command, exit code, and passed/failed/skipped counts. - Report each skip as `skipped — needs: X`; never call it passed. A green command containing skips makes the overall verdict `Incomplete`. - Use `Passed`, `Incomplete`, or `Failed` for the overall result. ## Iterate, then cold-boot - While iterating, reuse a warm Den with `OPENWORK_EVAL_DEN_API_URL`. - Before declaring `Passed`, remove the reuse override and cold-boot through `server()` on the same commit. - Inject secrets with `infisical run --silent --`; never print or echo values.