llms.txt · git:20260424.b363a74 · 2026-04-24 · sha256 f9140665dfdb8289

llms.txt git:20260424.b363a74A

Immutable. This exact content is served forever at /api/v1/blob/f9140665dfdb8289.

# hermes-blind

> Context-compensation scaffold for LLM evaluation prompts. A ~40-token string prepended to a scoring prompt to force disclosure of prior exposure, evidence-gated scoring, and hedging on thin evidence. Backend-agnostic. Complementary to claude --bare.

## What it does

Prepends a versioned language scaffold to the caller's LLM prompt. The scaffold
forces the model to:

1. State any prior exposure to the target or its author in one line
2. Score using only quoted evidence from the target text
3. Hedge on thin or absent evidence rather than confabulate confident scores

The scaffold is a string constant. No API, no model, no network. Pure
standard-library Python.

## Install

    pip install hermes-blind

## Python

    from hermes_blind import wrap, extract_disclosure, VARIANTS

    prompt = wrap("Score this paper 0-10.", variant="v1")
    response = your_model_call(prompt)
    disclosure = extract_disclosure(response)  # or None

## Variants

- null   — 0 tokens; control variant, wrap is a no-op
- micro  — ~8 tokens; minimum viable
- short  — ~18 tokens; tight token budgets
- v1     — ~40 tokens; default, four-mechanism scaffold
- full   — ~80 tokens; adds output-shape discipline

Strict length ordering is a tested invariant.

## When to use

- Any LLM scoring or evaluation pipeline where the scorer may have
  session-context or preference knowledge of the target
- Cross-backend ablation where `--bare` mode is unavailable (Ollama, OpenAI,
  in-session scoring)
- Self-scoring contexts where the scorer authored the target

## When not to use

- Generation debiasing (v0.0.x tested only for scoring)
- Long-target scoring >10k tokens (unvalidated)
- Multi-turn dialogue debiasing
- Non-English prompts
- Cases requiring guaranteed bias elimination (scaffold is statistical)

## Status

v0.0.6 — experimental. The empirical variance-reduction test has **not** been
run. The package is structurally complete (19/19 unit tests green, deterministic)
but the core hypothesis — that the scaffold actually reduces score variance — is
measured by Phase 4 of a staged build. See PLAN-v2.md for the test protocol.

## Related

- hermes-rubric — evidence-first structured scoring tool; hermes-blind plugs
  into the prompt layer below it
- hermes-seal — cryptographic attestation for agent policy artifacts
- claude --bare — stronger isolation primitive for claude-cli specifically;
  complementary, not a substitute

## Repo

https://github.com/hermes-labs-ai/hermes-blind