av/skills · run-llms/SKILL.md
run-llms skillB
Set up and run local LLMs with Harbor. Use when the user wants to run models locally, install Harbor, start Open WebUI, llama.cpp, Ollama, vLLM, Docker Model Runner, MLX, or oMLX, pull GGUF or HuggingFace models, add SearXNG web search, Speaches TTS/STT, or Open Terminal code execution, launch Codex/Claude/Grok/OpenCode against a Harbor backend, or troubleshoot GPU, VRAM, and service startup.
Latest version
mdr add av/skills/run-llms@git:20260904.e0627a9Exact content
mdr add av/skills/run-llms@sha256:965ec80430a0787aBadge
[](https://markdownregistry.com/a/art_v72qzhixg63o2xeu)
0 badge views in 30 days
Versions
| version | committed | commit | size | audit | |
|---|---|---|---|---|---|
| git:20260904.e0627a9 latest | 2026-09-04 | e0627a9 | 8,031 B | B | view · diff |
| git:20260403.517220a | 2026-04-03 | 517220a | 37,391 B | C | view · diff |
| git:20260123.1d1fc24 | 2026-01-23 | 1d1fc24 | 7,935 B | B | view · diff |
| git:20260123.eeaa581 | 2026-01-23 | eeaa581 | 7,903 B | B | view |
Audit of the latest version
B 16 of 17 checks passed. Deterministic, no model, same answer every run.
- fail: No curl or wget piped into a shell (matched: curl -fsSL https://raw.githubusercontent.com/av/harbor/refs/heads/main/install.sh | bash)
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (8031 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
GitHub
av/skills · 14 stars · license MIT · pushed 2026-09-05 · branch master
API
GET https://markdownregistry.com/api/v1/artifacts/art_v72qzhixg63o2xeu GET https://markdownregistry.com/api/v1/resolve?ref=av/skills/run-llms GET https://markdownregistry.com/api/v1/blob/965ec80430a0787ac6cfe08d2092997af2ce2d6abb50cd9f9aeb779eee836330