vibeic/vibe-ic · vibe-ic-marketplace/plugins/vibe-ic/skills/open-benchmark-methodology/SKILL.md

open-benchmark-methodology skillA

Name: open-benchmark-methodology
Author: vibeic

open-benchmark-methodology is agent-read markdown (skill) from vibeic/vibe-ic: Mandatory for VerilogEval, VerilogEval-v2, VerilogEval-Human, CVDP, RTLLM, PyHDL-Eval, RTL-Repo, MetRex, ResBench, ChipAgentsBench, benchmark, pass@1, benchmark floor/defect, run/rerun/score benchmark, or interpreting benchmark results. Enforces one general product entry, clean-room blind evaluation, Program First plus independent AI review/backup, official host scoring, evidence-backed triage, and capture of general enhancements..

Indexed from public GitHub and served as immutable, content-addressed versions. Install it pinned to an exact SHA-256 with the mdr CLI, and every file is verified against the hash recorded here before it reaches your agent. The deterministic audit below grades the latest version, and the same file always earns the same grade.

How to install

Latest version

mdr add vibeic/vibe-ic/open-benchmark-methodology@git:20260906.63936c8

Exact content

mdr add vibeic/vibe-ic/open-benchmark-methodology@sha256:75e76bdaea703d0f

Pin to a label to follow the author's releases, or to a sha256 to freeze the exact bytes forever. Either way the resolved hash is written to mdr.lock, and mdr install reproduces it on any machine.

Badge

[![mdr](https://markdownregistry.com/badge/art_imyepob6k7i6447q.svg)](https://markdownregistry.com/a/art_imyepob6k7i6447q)

0 badge views in 30 days

Versions

version	committed	commit	size	audit
git:20260906.63936c8 latest	2026-09-06	63936c8	23,010 B	A	view · diff
git:20260904.3146662	2026-09-04	3146662	18,817 B	A	view · diff
git:20260902.baa5a16	2026-09-02	baa5a16	18,525 B	A	view · diff
git:20260902.104b97d	2026-09-02	104b97d	17,621 B	A	view · diff
git:20260902.fc32402	2026-09-02	fc32402	11,352 B	A	view

Audit of the latest version

A 17 of 17 checks passed. Deterministic, no model, same answer every run.

pass: Frontmatter block present
pass: Frontmatter declares a name
pass: Frontmatter declares a description
pass: Size between 200 bytes and 200 KB (23010 bytes)
pass: No zero-width or bidi control characters
pass: No instruction hidden inside an HTML comment
pass: No link to an exfiltration or paste host
pass: No credential-shaped string
pass: No instruction to send local credentials anywhere
pass: No text hidden with inline styles
pass: No prompt-injection phrasing
pass: No curl or wget piped into a shell
pass: No recursive delete of root, home or parent
pass: No instruction to read or print local credentials
pass: No base64 blob over 200 characters
pass: No link to a raw IP address
pass: No script tag

Source

GitHub

vibeic/vibe-ic · 22 stars · license Apache-2.0 · pushed 2026-09-06 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_imyepob6k7i6447q
GET https://markdownregistry.com/api/v1/resolve?ref=vibeic/vibe-ic/open-benchmark-methodology
GET https://markdownregistry.com/api/v1/blob/75e76bdaea703d0fdcac9c1bae99e639deb7712486c47b92aff619737dfcfd2c