jev-eval skillA
jev-eval is agent-read markdown (skill) from softtor/nestjs-hexagonal: Calibrates or evaluates a semantic (Jev) rule of the nestjs-hexagonal rulebook — adds labelled golden cases, runs the calibration harness against the real model, fits thresholds, reads the report and decides whether the rule stays advisory or moves to ask; also produces the weekly pilot report from the hook logs. Use when a semantic rule misfires, when a new semantic rule is added, when asked to "calibrate a rule", "add golden cases", "raise a rule to ask" or "weekly Jev report"..
Indexed from public GitHub and served as immutable, content-addressed versions. Install it pinned to an exact SHA-256 with the mdr CLI, and every file is verified against the hash recorded here before it reaches your agent. The deterministic audit below grades the latest version, and the same file always earns the same grade.
What the file says
# jev-eval A semantic rule is a question the rulebook asks Jev (`jev-1.13.0`) about a code slice. Its decision thresholds are not written by hand: they are fitted from labelled golden cases by `calibration/fit.ts`, and the rule only gains a threshold it has earned. This skill is the procedure for adding cases, running the calibration and reading the result. The detailed workflow, the cost model and the report format are in `references/calibration-workflow.md`. **Cost and key.** `calibration/run.ts` needs `TYPESAFE_API_KEY` and sends one request per golden case (about 300 ms and a fraction of a cent each; the E1 experiment cost about US$ 0.003 for 50 requests). Without the key the run refuses to start; never commit the key, never paste it in a report. Everything else (`fit.ts`, the tests, the report) is offline. --- ## 1. Decide what the rule must catch Read the rule in `rulebooks/hexagonal.rulebook.yaml` (`question.instructions`, `question.options` or `levels`, `state.slice`, `thresholds.uncertain`). Write down, in one sentence each, the violation the rule exists for and the legitimate code it must leave alone. Every golden case is one of those sentences made concrete. …
Read the whole file at its exact version.
How to install
mdr add softtor/nestjs-hexagonal/jev-eval@git:20260921.98d05f3mdr add softtor/nestjs-hexagonal/jev-eval@sha256:25c1dff7517ddf4fPin to a label to follow the author's releases, or to a sha256 to freeze the exact bytes forever. Either way the resolved hash is written to mdr.lock, and mdr install reproduces it on any machine.
[](https://markdownregistry.com/a/art_zbnbquky5rmhu5pz)
1 badge views in 30 days
Versions
Audit of the latest version
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (6785 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No curl or wget piped into a shell
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
softtor/nestjs-hexagonal · 5 stars · license MIT · pushed 2026-09-23 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_zbnbquky5rmhu5pz GET https://markdownregistry.com/api/v1/resolve?ref=softtor/nestjs-hexagonal/jev-eval GET https://markdownregistry.com/api/v1/blob/25c1dff7517ddf4f025a4038520292ffbf206e22582d07d77e220c24a0ba025d
Your agent does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
More from softtor/nestjs-hexagonal
Every file in softtor/nestjs-hexagonal