golden-eval SKILL.md skillA

golden-eval from nebius/nebius-physical-ai is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add nebius/nebius-physical-ai/golden-eval@git:20261001.0555584

Pins git:20261001.0555584 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
nebius/nebius-physical-ai
Path
skills/tools/golden-eval/SKILL.md
Versions recorded
2
Latest version
git:20261001.0555584, committed Oct 1, 2026
First version recorded
Aug 17, 2026
Size
5,717 bytes
Repository stars
106
License
Apache-2.0

Use to prove a workbench container image actually works — the per-container hello-world manifest, dry-run/local/serverless execution tiers, batch runs across every image, and the offline manifest validation that gates CI.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Golden eval (does this container actually work?)

A golden eval is the minimal tested rerun that proves one container image is
functional. It answers a narrow, valuable question — *does this image run its own
smoke on a real GPU?* — without standing up a cluster or a workflow. Reach for it
after building or republishing an image, and when triaging whether a failure is
the image or the pipeline around it.

The manifest is `npa/src/npa/smoke/golden_evals.yaml`
(format `npa_golden_evals_v1`); every container in `CONTAINER_IMAGE_NAMES` must
have an entry, enforced by `npa/tests/smoke/test_golden_eval_manifest.py`.

## Inspect before running

```bash
npa workbench golden-eval list                 # every container, kind, gpu, status
npa workbench golden-eval list --output json
npa workbench golden-eval show <container>     # full safety + Physical AI record
```

Read the `status` column before spending anything:

- `ready` — runnable now.
- `gpu-gated` — needs a real GPU; a local run without one proves nothing.
- `blocked-on-upstream` — excluded from batch runs unless you pass
  `--include-blocked`. A failure here is expected and is not your regression.
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add nebius/nebius-physical-ai/golden-eval@sha256:b2d1a5c2899d773c

The line at the top of this page pins the label git:20261001.0555584, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_bdg46lgybgz6cfpe.svg)](https://markdownregistry.com/a/art_bdg46lgybgz6cfpe)

4 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 2 versions of this file, between Aug 17, 2026 and Oct 1, 2026, about one every 45 days.

versioncommittedcommitsizeaudit
git:20261001.0555584 latest2026-10-01 0555584 5,717 BA view · diff
git:20260817.be3cf062026-08-17 be3cf06 5,524 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (5717 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

nebius/nebius-physical-ai · 106 stars · license Apache-2.0 · pushed 2026-11-08 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_bdg46lgybgz6cfpe
GET https://markdownregistry.com/api/v1/resolve?ref=nebius/nebius-physical-ai/golden-eval
GET https://markdownregistry.com/api/v1/blob/b2d1a5c2899d773c30c27c2d3084bf649b8460adc4f7b29e6329c88c88c376d2

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from nebius/nebius-physical-ai

.cursorrules Cursor rule
nebius/nebius-physical-ai · .cursorrules
git:20260703.ce2e3a8 · audit A · 106 stars
AGENTS.md AGENTS.md file
nebius/nebius-physical-ai · AGENTS.md
git:20261106.20ba2be · audit A · 106 stars
CLAUDE.md CLAUDE.md file
nebius/nebius-physical-ai · CLAUDE.md
git:20261018.f0ea799 · audit A · 106 stars
DESIGN.md DESIGN.md file
nebius/nebius-physical-ai · DESIGN.md
git:20260906.525ee24 · audit A · 106 stars
access-approval SKILL.md skill
nebius/nebius-physical-ai · skills/atomic/access-approval/SKILL.md · Prepare, verify, and resume operator-owned Hugging Face or NVIDIA NGC access for exact NPA dependencies, including…
git:20260912.c87fdb2 · audit A · 106 stars
agent-development SKILL.md skill
nebius/nebius-physical-ai · skills/atomic/agent-development/SKILL.md · Use when building, enhancing, or testing the NPA chat agent backend — grounded-first routing, cost-aware Token Factory…
git:20261003.bd54c8c · audit A · 106 stars
agent-run-data-collection SKILL.md skill
nebius/nebius-physical-ai · skills/atomic/agent-run-data-collection/SKILL.md · Use when collecting NPA agent work for fine-tuning or evaluation so every goal-level episode emits a sanitized…
git:20260906.2f687b4 · audit A · 106 stars
agent-visual-feedback SKILL.md skill
nebius/nebius-physical-ai · skills/atomic/agent-visual-feedback/SKILL.md · Use when the NPA agent should describe or critique the current viewer (Rerun, video, image, or data) via the Describe…
git:20260906.4539e93 · audit A · 106 stars
architecture SKILL.md skill
nebius/nebius-physical-ai · skills/atomic/architecture/SKILL.md · Use for Claude Code architectural review of the Nebius Physical AI platform, workbench layer, orchestrator choices, and…
git:20260906.2f687b4 · audit A · 106 stars
audit-container-docs SKILL.md skill
nebius/nebius-physical-ai · skills/atomic/audit-container-docs/SKILL.md · Reconcile NPA container-image catalogs and related documentation whenever a workbench image or solution is added…
git:20260827.6716731 · audit A · 106 stars
build-and-push-image SKILL.md skill
nebius/nebius-physical-ai · skills/atomic/build-and-push-image/SKILL.md · Use when building, tagging, validating, or publishing NPA workbench container images through immutable full-SHA public…
git:20260906.2f687b4 · audit A · 106 stars
contributions SKILL.md skill
nebius/nebius-physical-ai · skills/atomic/contributions/SKILL.md · Write or review NPA contributions, including workbench agent changes, using the repository's readability…
git:20260907.370e595 · audit A · 106 stars

Every file in nebius/nebius-physical-ai

Browse by kind, by grade A, or by owner.