llamacpp-xpu-run SKILL.md skillA

llamacpp-xpu-run from intel/skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add intel/skills/llamacpp-xpu-run@git:20260903.b1ad034

Pins git:20260903.b1ad034 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
intel/skills
Path
skills/llamacpp-xpu-run/SKILL.md
Versions recorded
1
Latest version
git:20260903.b1ad034, committed Sep 3, 2026
Size
5,770 bytes
Repository stars
29
License
Apache-2.0

Run a GGUF model on an Intel GPU using llama.cpp's SYCL backend (Level Zero) with the official intel.Dockerfile. Covers building the Docker image from source at a pinned tag, launching llama-server with an OpenAI-compatible API, device selection, multi-GPU layer splitting, all recommended runtime env vars, flash-attention, and quantisation selection. Use when the user has a GGUF model and wants fast local inference or an OpenAI-compatible endpoint on Intel GPU without Python/PyTorch. The CUDA…

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# llamacpp-xpu-run

Run GGUF models on Intel GPUs via llama.cpp's SYCL backend.
The official `.devops/intel.Dockerfile` is the canonical build path.

Tested against tag **b9494** on Intel Arc B70 (Battlemage, `level_zero:0`).

**CRITICAL SAFETY RULE: When removing a docker container, always `docker stop` first, then `docker rm`. Never use `docker prune` or any system-wide process-kill command.**

## Performance note

When the Docker image and GGUF model are already present, launch the server immediately. Skip redundant image rebuilds and device checks — the server will fail fast if misconfigured. Always verify with the health endpoint after launch (see Validate section below).

**Use a pinned upstream tag (e.g. `:b9494`), not `:latest`.** `docker run` reuses any locally-tagged image with no upstream check, so a stale `llama-server-sycl:latest` will silently run. If the user requests `:latest`, rebuild with `--no-cache` first, or resolve `latest` to the current upstream tag and build with that pinned name.

## CUDA → XPU cheat sheet

| CUDA | Intel SYCL |
|---|---|
| `-DGGML_CUDA=ON` | `-DGGML_SYCL=ON -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx` |
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add intel/skills/llamacpp-xpu-run@sha256:7963fde6360eeb9e

The line at the top of this page pins the label git:20260903.b1ad034, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_w3h2u7qu7ueopbcg.svg)](https://markdownregistry.com/a/art_w3h2u7qu7ueopbcg)

2 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 1 version of this file, committed on Sep 3, 2026.

versioncommittedcommitsizeaudit
git:20260903.b1ad034 latest2026-09-03 b1ad034 5,770 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (5770 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

intel/skills · 29 stars · license Apache-2.0 · pushed 2026-11-06 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_w3h2u7qu7ueopbcg
GET https://markdownregistry.com/api/v1/resolve?ref=intel/skills/llamacpp-xpu-run
GET https://markdownregistry.com/api/v1/blob/7963fde6360eeb9e03f23800d86ced3a6c930c25f64c99b234f13096f8222c51

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from intel/skills

ai-inference-deploy SKILL.md skill
intel/skills · skills/ai-inference-deploy/SKILL.md · Top-level router for an Intel GPU inference request that has not settled what it wants yet. Use for the bare ask —…
git:20261101.933b9e9 · audit A · 29 stars
cuda-to-xpu-migration SKILL.md skill
intel/skills · skills/cuda-to-xpu-migration/SKILL.md · Create a CUDA-to-XPU migration assessment for an existing AI repo. Identify CUDA-specific assumptions, route to the…
git:20260903.b1ad034 · audit A · 29 stars
dpnp-interop SKILL.md skill
intel/skills · skills/dpnp-interop/SKILL.md · Passing dpnp arrays to and from other Python libraries on Intel CPUs and GPUs. Use when dpnp numeric work has to feed…
v1.0 · audit A · 29 stars
dpnp-io SKILL.md skill
intel/skills · skills/dpnp-io/SKILL.md · Reading and writing files from dpnp code on Intel CPUs and GPUs. Use when the user needs to load an array into dpnp or…
v1.0 · audit A · 29 stars
dpnp-linalg-fft SKILL.md skill
intel/skills · skills/dpnp-linalg-fft/SKILL.md · Linear algebra and FFT with dpnp on Intel CPUs and GPUs, backed by oneMKL. Use when a matrix multiply, solve…
v1.0 · audit A · 29 stars
dpnp-memory SKILL.md skill
intel/skills · skills/dpnp-memory/SKILL.md · Device memory management for dpnp arrays on Intel CPUs and GPUs. Use when a dpnp script grows in memory until it fails…
v1.0 · audit A · 29 stars
dpnp-migration SKILL.md skill
intel/skills · skills/dpnp-migration/SKILL.md · Porting an existing NumPy or CuPy program to dpnp on Intel CPUs and GPUs. Use when deciding whether a codebase can run…
v1.0 · audit A · 29 stars
dpnp-quickstart SKILL.md skill
intel/skills · skills/dpnp-quickstart/SKILL.md · NumPy-compatible array operations optimized for Intel hardware. Use when the user wants to migrate or port NumPy code…
v1.0 · audit A · 29 stars
dpnp-random SKILL.md skill
intel/skills · skills/dpnp-random/SKILL.md · Random number generation with dpnp on Intel CPUs and GPUs, backed by oneMKL. Use when NumPy random calls move to dpnp…
v1.0 · audit A · 29 stars
dpnp-troubleshooting SKILL.md skill
intel/skills · skills/dpnp-troubleshooting/SKILL.md · Diagnosing dpnp failures on Intel CPUs and GPUs. Use when dpnp raises NotImplementedError or an unexpected TypeError…
v1.0 · audit A · 29 stars
linux-perf SKILL.md skill
intel/skills · skills/linux-perf/SKILL.md · Profile and fix Linux performance problems using `perf`. Workflows: (A) hardware counters -- IPC, cache-miss, branch…
git:20260903.b1ad034 · audit A · 29 stars
mkl-extension-advisor SKILL.md skill
intel/skills · skills/mkl-extension-advisor/SKILL.md · Deciding whether Intel's MKL extension packages apply to NumPy or SciPy code on Intel CPUs. Use when a user asks…
v1.0 · audit A · 29 stars

Every file in intel/skills

Browse by kind, by grade A, or by owner.