jetson-inference-mem-tune SKILL.md skillA
jetson-inference-mem-tune from nvidia/skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.
mdr add nvidia/skills/jetson-inference-mem-tune@v0.0.1Pins v0.0.1 in mdr.lock. Pin the fingerprint instead.
- Audit grade
- A, 17 of 17 checks passed
- Kind
- SKILL.md skill
- Repository
- nvidia/skills
- Path
skills/jetson-inference-mem-tune/SKILL.md- Versions recorded
- 1
- Latest version
- v0.0.1, committed Jun 22, 2026
- Size
- 11,436 bytes
- Repository stars
- 3,871
- License
- Apache-2.0
Pick the serving stack and per-runtime memory flags (vLLM, SGLang, llama.cpp, TensorRT Edge-LLM) for an LLM/VLM workload on any NVIDIA Jetson.
Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.
What the file says
# Jetson Inference Memory Tuning Recommends an inference runtime and the specific memory-related flags to pass to it, given the Jetson SKU/variant and the user's workload. Does not include quantization recipe selection — that lives in the model-benchmarking skill — but it does point at the precision floor each runtime can serve efficiently. ## Purpose Turn a live `jetson-memory-audit` snapshot into runtime and launch-flag recommendations for LLM/VLM serving on Jetson. Use this when the user needs to fit a model, reduce OOM risk, or switch to a lower-memory serving stack. ## When to use - "Which serving stack should I use on Orin Nano 8 GB to run a 7B model?" - "vLLM is OOMing — what should `--gpu-memory-utilization` and `--max-model-len` be?" - "Same model, less memory — can I switch from vLLM to llama.cpp?" - After `jetson-memory-audit` shows a model server is the top NvMap / PSS consumer. ## Prerequisites - Start with a current `jetson-memory-audit/scripts/audit.sh` JSON snapshot from the target Jetson. - Know the intended workload: `llm-server`, `vlm-server`, `embedding`, or `rag`. …
Read the whole file at its exact version.
How to install
mdr add nvidia/skills/jetson-inference-mem-tune@sha256:329a322031d2971aThe line at the top of this page pins the label v0.0.1, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.
[](https://markdownregistry.com/a/art_ldgo4zlxi3egyxh5)
4 badge image fetches in 30 days. What the badge shows.
Versions
The registry has recorded 1 version of this file, committed on Jun 22, 2026.
Audit of the latest version
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (11436 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No curl or wget piped into a shell
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
nvidia/skills · 3,871 stars · license Apache-2.0 · pushed 2026-11-05 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_ldgo4zlxi3egyxh5 GET https://markdownregistry.com/api/v1/resolve?ref=nvidia/skills/jetson-inference-mem-tune GET https://markdownregistry.com/api/v1/blob/329a322031d2971ad46e2d88bd4744219eeb788e03cbd33001aa4a4fe35c19ab
Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.
Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.