vllm-deployment SKILL.md skillA

vllm-deployment from air-gapped/skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add air-gapped/skills/vllm-deployment@git:20261018.d292452

Pins git:20261018.d292452 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
air-gapped/skills
Path
.claude/skills/vllm-deployment/SKILL.md
Versions recorded
11
Latest version
git:20261018.d292452, committed Oct 18, 2026
First version recorded
Jul 21, 2026
Size
18,306 bytes
Repository stars
6
License
MIT

Use this skill when authoring, reviewing, or fixing a vLLM Kubernetes manifest, Docker/Podman pod, or OpenShift ServingRuntime — even when the user does not say "vllm". Triggers on: lab cluster performance practices, cache mount + survival across pod restarts (/root/.cache, VLLM_CACHE_ROOT, TORCHINDUCTOR_CACHE_DIR, TRITON_CACHE_DIR, "do we have caches saved"), HF_TOKEN secret in pod env, liveness + readiness probe tuning (initialDelaySeconds, failureThreshold, "pod takes 12 min to boot")…

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# vLLM deployment (Kubernetes first, Docker lab, OpenShift sidebar)

Target audience: platform engineers bringing up vLLM on production Kubernetes (H100/H200/B200/B300 fleets), and individual researchers running 1-to-2-node Docker / Podman setups in a lab.

This skill is a **pointer map**. It points to the canonical sources — in the vLLM repo, in docs.vllm.ai, in the ecosystem repos, and to the load-bearing blog posts — rather than paraphrasing them. Paraphrase rots; pointers survive.

## Decision guide — pick the path

| Situation | Go to |
|---|---|
| Single node, 1 container, TP ≤ 8 | `references/docker-lab.md` |
| Single host, 2 containers for PD disagg lab | `references/docker-lab.md` (compose template) + `references/disagg.md` |
| k8s, single model fits 1 pod | `references/pod-shape.md` + in-tree helm chart |
| k8s, model needs multi-node TP/PP | `references/multi-node.md` (LWS + `multi-node-serving.sh`) |
| k8s fleet, router + LMCache + observability bundled | `vllm-production-stack` (Helm) — see `references/ecosystem.md` |
| k8s fleet, disagg P/D + KV-aware + GAIE + SLA scheduler | `llm-d` — see `references/ecosystem.md` |
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add air-gapped/skills/vllm-deployment@sha256:6fe51c007a797eda

The line at the top of this page pins the label git:20261018.d292452, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_nagdrxrbcxfossgw.svg)](https://markdownregistry.com/a/art_nagdrxrbcxfossgw)

2 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 11 versions of this file, between Jul 21, 2026 and Oct 18, 2026, about one every 9 days.

versioncommittedcommitsizeaudit
git:20261018.d292452 latest2026-10-18 d292452 18,306 BA view · diff
git:20261018.13b56012026-10-18 13b5601 18,123 BA view · diff
git:20261018.050d0982026-10-18 050d098 18,229 BA view · diff
git:20261018.501e66a2026-10-18 501e66a 16,352 BA view · diff
git:20261018.286f95d2026-10-18 286f95d 19,055 BA view · diff
git:20260923.466430c2026-09-23 466430c 16,478 BA view · diff
git:20260915.0d436102026-09-15 0d43610 15,524 BA view · diff
git:20260915.9e1fc692026-09-15 9e1fc69 15,433 BA view · diff
git:20260811.e77838d2026-08-11 e77838d 14,032 BA view · diff
git:20260725.aef8f182026-07-25 aef8f18 13,750 BA view · diff
git:20260721.b467e282026-07-21 b467e28 13,419 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (18306 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

air-gapped/skills · 6 stars · license MIT · pushed 2026-11-04 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_nagdrxrbcxfossgw
GET https://markdownregistry.com/api/v1/resolve?ref=air-gapped/skills/vllm-deployment
GET https://markdownregistry.com/api/v1/blob/6fe51c007a797eda1231e7a622ba333578bcdf9027ac8c50d2ea5aa645994ad7

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from air-gapped/skills

aiperf SKILL.md skill
air-gapped/skills · .claude/skills/aiperf/SKILL.md · NVIDIA AIPerf — vendor-neutral generative-AI inference benchmarking (genai-perf successor). `aiperf profile`…
git:20261019.9eca78f · audit A · 6 stars
airgap-vetting SKILL.md skill
air-gapped/skills · .claude/skills/airgap-vetting/SKILL.md · Vet an open-source product for air-gap readiness BEFORE adoption. Answers eight questions — telemetry…
git:20261027.4b5fb58 · audit A · 6 stars
analytical-troubleshooting SKILL.md skill
air-gapped/skills · .claude/skills/analytical-troubleshooting/SKILL.md · Structured live troubleshooting for deviation problems: something worked (or should work) and now doesn't, and the…
git:20261019.819b406 · audit A · 6 stars
ansible-idrac-9-10 SKILL.md skill
air-gapped/skills · .claude/skills/ansible-idrac-9-10/SKILL.md · Run and debug `dellemc.openmanage` Ansible playbooks against Dell PowerEdge **iDRAC 9** (14G–16G) and **iDRAC 10** (17G…
git:20261019.b3bbe99 · audit A · 6 stars
argo-cd-apps SKILL.md skill
air-gapped/skills · .claude/skills/argo-cd-apps/SKILL.md · Author and maintain Argo CD `Application` and `ApplicationSet` manifests as a GitOps consumer (publisher), targeting…
git:20261027.31fbcc7 · audit A · 6 stars
autoresearch SKILL.md skill
air-gapped/skills · .claude/skills/autoresearch/SKILL.md · Autonomous experiment loops that hill-climb a measurable metric — apply one change, measure, keep it only if the number…
git:20261027.75d87c7 · audit A · 6 stars
baml-expert SKILL.md skill
air-gapped/skills · .claude/skills/baml-expert/SKILL.md · BAML (Boundary ML) expert for projects defining LLM calls as typed functions in .baml files with a generated Python…
git:20261027.db2bb25 · audit A · 6 stars
ceph-performance SKILL.md skill
air-gapped/skills · .claude/skills/ceph-performance/SKILL.md · Tune and benchmark a healthy Ceph cluster, with Rook-on-Kubernetes specifics: mClock profiles and the NVMe…
git:20261027.28d2580 · audit A · 6 stars
ceph-s3 SKILL.md skill
air-gapped/skills · .claude/skills/ceph-s3/SKILL.md · Run Ceph RGW as an S3 endpoint under Rook (CephObjectStore, CephObjectStoreUser, ObjectBucketClaim, COSI…
git:20261027.61472c6 · audit A · 6 stars
ceph-troubleshooting SKILL.md skill
air-gapped/skills · .claude/skills/ceph-troubleshooting/SKILL.md · Diagnose and recover an unhealthy Ceph cluster, with Rook-on-Kubernetes specifics: slow or stuck recovery/backfill…
git:20261027.0ad34cc · audit A · 6 stars
chat-completions-api SKILL.md skill
air-gapped/skills · .claude/skills/chat-completions-api/SKILL.md · Reference for the OpenAI Chat Completions API (/v1/chat/completions) and legacy /v1/completions as the lingua-franca…
git:20261027.42f4242 · audit A · 6 stars
claude-code-ci-harness SKILL.md skill
air-gapped/skills · .claude/skills/claude-code-ci-harness/SKILL.md · Run Claude Code headlessly as an isolated CI harness against any Anthropic Messages-compatible endpoint (local engine…
git:20261019.25dcc92 · audit A · 6 stars

Every file in air-gapped/skills

Browse by kind, by grade A, or by owner.