hqq-quantization SKILL.md skillA

This file is byte-identical to the first copy the registry indexed, one of 4 indexed copies. Same content hash, so the same checks give both the same grade.

hqq-quantization from jensen-yao/agents-skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add jensen-yao/agents-skills/hqq-quantization@v1.0.0

Pins v1.0.0 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
jensen-yao/agents-skills
Path
skills/hqq/SKILL.md
Versions recorded
1
Latest version
v1.0.0, committed Aug 15, 2026
Size
11,466 bytes
Repository stars
5
License
MIT

Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision without needing calibration datasets, for fast quantization workflows, or when deploying with vLLM or HuggingFace Transformers.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# HQQ - Half-Quadratic Quantization

Fast, calibration-free weight quantization supporting 8/4/3/2/1-bit precision with multiple optimized backends.

## When to use HQQ

**Use HQQ when:**
- Quantizing models without calibration data (no dataset needed)
- Need fast quantization (minutes vs hours for GPTQ/AWQ)
- Deploying with vLLM or HuggingFace Transformers
- Fine-tuning quantized models with LoRA/PEFT
- Experimenting with extreme quantization (2-bit, 1-bit)

**Key advantages:**
- **No calibration**: Quantize any model instantly without sample data
- **Multiple backends**: PyTorch, ATEN, TorchAO, Marlin, BitBlas for optimized inference
- **Flexible precision**: 8/4/3/2/1-bit with configurable group sizes
- **Framework integration**: Native HuggingFace and vLLM support
- **PEFT compatible**: Fine-tune quantized models with LoRA

**Use alternatives instead:**
- **AWQ**: Need calibration-based accuracy, production serving
- **GPTQ**: Maximum accuracy with calibration data available
- **bitsandbytes**: Simple 8-bit/4-bit without custom backends
- **llama.cpp/GGUF**: CPU inference, Apple Silicon deployment

## Quick start

### Installation

```bash
pip install hqq
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add jensen-yao/agents-skills/hqq-quantization@sha256:4feba64227f6db50

The line at the top of this page pins the label v1.0.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_2l7yg7gmacqkrovm.svg)](https://markdownregistry.com/a/art_2l7yg7gmacqkrovm)

0 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 1 version of this file, committed on Aug 15, 2026.

versioncommittedcommitsizeaudit
v1.0.0 latest2026-08-15 3e2d588 11,466 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (11466 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

jensen-yao/agents-skills · 5 stars · license MIT · pushed 2026-10-26 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_2l7yg7gmacqkrovm
GET https://markdownregistry.com/api/v1/resolve?ref=jensen-yao/agents-skills/hqq-quantization
GET https://markdownregistry.com/api/v1/blob/4feba64227f6db505044663cd5432bf9c0599c5c8984d94d3b2d1598711a1f80

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from jensen-yao/agents-skills

autoresearch SKILL.md skill
jensen-yao/agents-skills · skills/0-autoresearch-skill/SKILL.md · Orchestrates end-to-end autonomous AI research projects using a two-loop architecture. The inner loop runs rapid…
v1.0.0 · audit A · 5 stars
evolving-ai-agents SKILL.md skill
jensen-yao/agents-skills · skills/a-evolve/SKILL.md · Provides guidance for automatically evolving and optimizing AI agents across any domain using LLM-driven evolution…
v1.0.0 · audit A · 5 stars
academic-plotting SKILL.md skill
jensen-yao/agents-skills · skills/academic-plotting/SKILL.md · Generates publication-quality figures for ML papers from research context. Given a paper section or description…
v1.0.0 · audit A · 5 stars
huggingface-accelerate SKILL.md skill
jensen-yao/agents-skills · skills/accelerate/SKILL.md · Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for…
v1.0.0 · audit A · 5 stars
alibabacloud-find-skills SKILL.md skill
jensen-yao/agents-skills · skills/alibabacloud-find-skills/SKILL.md · Use this skill when users want to search, discover, browse, or find Alibaba Cloud (阿里云) agent skills. Triggers include…
git:20260815.3e2d588 · audit A · 5 stars
animation-vocabulary SKILL.md skill
jensen-yao/agents-skills · skills/animation-vocabulary/SKILL.md · Reverse-lookup glossary that turns a vague description of a web animation or motion effect into its exact term ("the…
git:20261026.7e4054d · audit A · 5 stars
app-shell-ui SKILL.md skill
jensen-yao/agents-skills · skills/app-shell-ui/SKILL.md · Build or restyle an explicit App Shell UI or macOS-style desktop-tool shell with shared navigation and light/dark…
git:20260817.88cdab2 · audit A · 5 stars
apple-design SKILL.md skill
jensen-yao/agents-skills · skills/apple-design/SKILL.md · Apply Apple's interface and physical-motion principles to gesture, spring, drag, swipe, sheet, momentum, material, or…
git:20261026.7e4054d · audit A · 5 stars
audiocraft-audio-generation SKILL.md skill
jensen-yao/agents-skills · skills/audiocraft/SKILL.md · PyTorch library for audio generation including text-to-music (MusicGen) and text-to-sound (AudioGen). Use when you need…
v1.0.0 · audit A · 5 stars
awq-quantization SKILL.md skill
jensen-yao/agents-skills · skills/awq/SKILL.md · Activation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when…
v1.0.0 · audit A · 5 stars
axolotl SKILL.md skill
jensen-yao/agents-skills · skills/axolotl/SKILL.md · Expert guidance for fine-tuning LLMs with Axolotl - YAML configs, 100+ models, LoRA/QLoRA, DPO/KTO/ORPO/GRPO…
v1.0.0 · audit A · 5 stars
baseline-ui SKILL.md skill
jensen-yao/agents-skills · skills/baseline-ui/SKILL.md · Apply a fast spacing, hierarchy, typography, and small-layout cleanup. Use only when explicitly invoked or selected by…
git:20260817.88cdab2 · audit A · 5 stars

Every file in jensen-yao/agents-skills

Other files named hqq-quantization

hqq-quantization SKILL.md skill
orchestra-research/ai-research-skills · 10-optimization/hqq/SKILL.md · Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision…
v1.0.0 · audit A · 14,233 stars
hqq-quantization SKILL.md skill
skillmds/skillmd · plugins/data-ml/skills/hqq-quantization/SKILL.md · Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision…
v1.0.0 · audit A · 192 stars
hqq-quantization SKILL.md skill
yichen-zju/claude-for-research · skills/hqq/SKILL.md · Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision…
v1.0.0 · audit A · 12 stars
hqq-quantization SKILL.md skill
yichen-zju/claude-for-research · claude/skills/hqq/SKILL.md · Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision…
v1.0.0 · audit A · 12 stars

Browse by kind, by grade A, or by owner.