vllm-gemma-4-31b SKILL.md skillA

vllm-gemma-4-31b from air-gapped/skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add air-gapped/skills/vllm-gemma-4-31b@git:20261018.e3f43e6

Pins git:20261018.e3f43e6 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
air-gapped/skills
Path
.claude/skills/vllm-gemma-4-31b/SKILL.md
Versions recorded
12
Latest version
git:20261018.e3f43e6, committed Oct 18, 2026
First version recorded
Jul 21, 2026
Size
20,575 bytes
Repository stars
6
License
MIT

Operating-point reference for serving Gemma 4 31B on vLLM — TP sizing, max_model_len, max_num_seqs, gpu_memory_utilization, kv_cache_dtype, EAGLE3 spec-dec, chat_template choice.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Gemma 4 31B on vLLM — operating-point reference

**One model, measured.** This is a worked operating point, not the general
method. The reusable machinery lives in the `vllm` plugin: flag and env
semantics in **`vllm-configuration`**, the K8s/container manifest in
**`vllm-deployment`**, reproducing or re-measuring these numbers in
**`vllm-benchmarking`**, and the prompt-side template in
**`vllm-chat-templates`**. Deploying a *different* model? Use those, not this.

For platform engineers deploying `google/gemma-4-31B-it` (BF16, FP8) or its
community quants (e.g. `cyankiwi/gemma-4-31B-it-AWQ-4bit`,
`RedHatAI/*-Gemma-4-31B-*`) on vLLM 0.29.0+ (version floor below).
Pulls together measurements from a 2× H100 SXM5 80GB (NVLink) audit on
2026-04-30 — **taken on vLLM 0.20.0
and not re-run since** (see `references/bench-numbers.md`; the shape of the
curves has held, but treat the absolute figures as 0.20.0 observations) — and
the upstream constraints that shape the answer.

> **Version floor: run vLLM 0.29.0 or newer; 0.30.0+ is the production line.**
> Do not pin 0.25.1 or older: they carry the `<turn|>` / `enable_thinking`
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add air-gapped/skills/vllm-gemma-4-31b@sha256:1b29324d4d78da2a

The line at the top of this page pins the label git:20261018.e3f43e6, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_avf2ooxur6irdzks.svg)](https://markdownregistry.com/a/art_avf2ooxur6irdzks)

3 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 12 versions of this file, between Jul 21, 2026 and Oct 18, 2026, about one every 8 days.

versioncommittedcommitsizeaudit
git:20261018.e3f43e6 latest2026-10-18 e3f43e6 20,575 BA view · diff
git:20261018.4e6579d2026-10-18 4e6579d 21,084 BA view · diff
git:20261018.2a3cd6e2026-10-18 2a3cd6e 20,840 BA view · diff
git:20261018.996b21b2026-10-18 996b21b 20,816 BA view · diff
git:20261018.381977d2026-10-18 381977d 22,744 BA view · diff
git:20260923.466430c2026-09-23 466430c 27,735 BA view · diff
git:20260922.fd884232026-09-22 fd88423 26,038 BA view · diff
git:20260811.5bb35172026-08-11 5bb3517 25,855 BA view · diff
git:20260802.08faa472026-08-02 08faa47 22,308 BA view · diff
git:20260802.c4bc43c2026-08-02 c4bc43c 21,217 BA view · diff
git:20260725.aef8f182026-07-25 aef8f18 14,988 BA view · diff
git:20260721.6b9197a2026-07-21 6b9197a 14,566 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (20575 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

air-gapped/skills · 6 stars · license MIT · pushed 2026-11-04 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_avf2ooxur6irdzks
GET https://markdownregistry.com/api/v1/resolve?ref=air-gapped/skills/vllm-gemma-4-31b
GET https://markdownregistry.com/api/v1/blob/1b29324d4d78da2a3c79d3d45cee1a5804ab7a44c531ee7d2af803bfaa6d07a1

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from air-gapped/skills

aiperf SKILL.md skill
air-gapped/skills · .claude/skills/aiperf/SKILL.md · NVIDIA AIPerf — vendor-neutral generative-AI inference benchmarking (genai-perf successor). `aiperf profile`…
git:20261019.9eca78f · audit A · 6 stars
airgap-vetting SKILL.md skill
air-gapped/skills · .claude/skills/airgap-vetting/SKILL.md · Vet an open-source product for air-gap readiness BEFORE adoption. Answers eight questions — telemetry…
git:20261027.4b5fb58 · audit A · 6 stars
analytical-troubleshooting SKILL.md skill
air-gapped/skills · .claude/skills/analytical-troubleshooting/SKILL.md · Structured live troubleshooting for deviation problems: something worked (or should work) and now doesn't, and the…
git:20261019.819b406 · audit A · 6 stars
ansible-idrac-9-10 SKILL.md skill
air-gapped/skills · .claude/skills/ansible-idrac-9-10/SKILL.md · Run and debug `dellemc.openmanage` Ansible playbooks against Dell PowerEdge **iDRAC 9** (14G–16G) and **iDRAC 10** (17G…
git:20261019.b3bbe99 · audit A · 6 stars
argo-cd-apps SKILL.md skill
air-gapped/skills · .claude/skills/argo-cd-apps/SKILL.md · Author and maintain Argo CD `Application` and `ApplicationSet` manifests as a GitOps consumer (publisher), targeting…
git:20261027.31fbcc7 · audit A · 6 stars
autoresearch SKILL.md skill
air-gapped/skills · .claude/skills/autoresearch/SKILL.md · Autonomous experiment loops that hill-climb a measurable metric — apply one change, measure, keep it only if the number…
git:20261027.75d87c7 · audit A · 6 stars
baml-expert SKILL.md skill
air-gapped/skills · .claude/skills/baml-expert/SKILL.md · BAML (Boundary ML) expert for projects defining LLM calls as typed functions in .baml files with a generated Python…
git:20261027.db2bb25 · audit A · 6 stars
ceph-performance SKILL.md skill
air-gapped/skills · .claude/skills/ceph-performance/SKILL.md · Tune and benchmark a healthy Ceph cluster, with Rook-on-Kubernetes specifics: mClock profiles and the NVMe…
git:20261027.28d2580 · audit A · 6 stars
ceph-s3 SKILL.md skill
air-gapped/skills · .claude/skills/ceph-s3/SKILL.md · Run Ceph RGW as an S3 endpoint under Rook (CephObjectStore, CephObjectStoreUser, ObjectBucketClaim, COSI…
git:20261027.61472c6 · audit A · 6 stars
ceph-troubleshooting SKILL.md skill
air-gapped/skills · .claude/skills/ceph-troubleshooting/SKILL.md · Diagnose and recover an unhealthy Ceph cluster, with Rook-on-Kubernetes specifics: slow or stuck recovery/backfill…
git:20261027.0ad34cc · audit A · 6 stars
chat-completions-api SKILL.md skill
air-gapped/skills · .claude/skills/chat-completions-api/SKILL.md · Reference for the OpenAI Chat Completions API (/v1/chat/completions) and legacy /v1/completions as the lingua-franca…
git:20261027.42f4242 · audit A · 6 stars
claude-code-ci-harness SKILL.md skill
air-gapped/skills · .claude/skills/claude-code-ci-harness/SKILL.md · Run Claude Code headlessly as an isolated CI harness against any Anthropic Messages-compatible endpoint (local engine…
git:20261019.25dcc92 · audit A · 6 stars

Every file in air-gapped/skills

Browse by kind, by grade A, or by owner.