long-context SKILL.md skillA

This file is byte-identical to the first copy the registry indexed. Same content hash, so the same checks give both the same grade.

long-context from yichen-zju/claude-for-research is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add yichen-zju/claude-for-research/long-context@v1.0.0

Pins v1.0.0 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
yichen-zju/claude-for-research
Path
claude/skills/long-context/SKILL.md
Versions recorded
1
Latest version
v1.0.0, committed Oct 14, 2026
Size
15,577 bytes
Repository stars
10
License
none declared

Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when processing long documents (32k-128k+ tokens), extending pre-trained models beyond original context limits, or implementing efficient positional encodings. Covers rotary embeddings, attention biases, interpolation methods, and extrapolation strategies for LLMs.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Long Context: Extending Transformer Context Windows

## When to Use This Skill

Use Long Context techniques when you need to:
- **Process long documents** (32k, 64k, 128k+ tokens) with transformer models
- **Extend context windows** of pre-trained models (LLaMA, Mistral, etc.)
- **Implement efficient positional encodings** (RoPE, ALiBi)
- **Train models** with length extrapolation capabilities
- **Deploy models** that handle variable-length inputs efficiently
- **Fine-tune** existing models for longer contexts with minimal compute

**Key Techniques**: RoPE (Rotary Position Embeddings), YaRN, ALiBi (Attention with Linear Biases), Position Interpolation

**Papers**: RoFormer (arXiv 2104.09864), YaRN (arXiv 2309.00071), ALiBi (arXiv 2108.12409), Position Interpolation (arXiv 2306.15595)

## Installation

```bash
# HuggingFace Transformers (includes RoPE, YaRN support)
pip install transformers torch

# For custom implementations
pip install einops  # Tensor operations
pip install rotary-embedding-torch  # Standalone RoPE

# Optional: FlashAttention for efficiency
pip install flash-attn --no-build-isolation
```

## Quick Start

### RoPE (Rotary Position Embeddings)

```python
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add yichen-zju/claude-for-research/long-context@sha256:6426eb21a38b8a31

The line at the top of this page pins the label v1.0.0, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_2wj3yux2ybazaz4j.svg)](https://markdownregistry.com/a/art_2wj3yux2ybazaz4j)

1 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 1 version of this file, committed on Oct 14, 2026.

versioncommittedcommitsizeaudit
v1.0.0 latest2026-10-14 9f2a5e0 15,577 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (15577 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

yichen-zju/claude-for-research · 10 stars · license none declared · pushed 2026-10-21 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_2wj3yux2ybazaz4j
GET https://markdownregistry.com/api/v1/resolve?ref=yichen-zju/claude-for-research/long-context
GET https://markdownregistry.com/api/v1/blob/6426eb21a38b8a314078292b8172d889b7f2b1a226901fcda78ac4d28a98a5e7

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from yichen-zju/claude-for-research

CLAUDE.md CLAUDE.md file
yichen-zju/claude-for-research · CLAUDE.md
git:20260930.9b33ccf · audit A · 10 stars
CLAUDE.md@claude CLAUDE.md file
yichen-zju/claude-for-research · claude/CLAUDE.md
git:20261014.9f2a5e0 · audit A · 10 stars
evolving-ai-agents SKILL.md skill
yichen-zju/claude-for-research · claude/skills/a-evolve/SKILL.md · Provides guidance for automatically evolving and optimizing AI agents across any domain using LLM-driven evolution…
v1.0.0 · audit A · 10 stars
academic-plotting SKILL.md skill
yichen-zju/claude-for-research · claude/skills/academic-plotting/SKILL.md · Generates publication-quality figures for ML papers from research context. Given a paper section or description…
v1.0.0 · audit A · 10 stars
academic-research-suite SKILL.md skill
yichen-zju/claude-for-research · claude/skills/academic-research-suite/SKILL.md · Claude-native Academic Research Skills suite (ported from the Codex adapter) for deep research, academic paper writing…
v0.1.14 · audit A · 10 stars
huggingface-accelerate SKILL.md skill
yichen-zju/claude-for-research · claude/skills/accelerate/SKILL.md · Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for…
v1.0.0 · audit A · 10 stars
ai-use-disclosure SKILL.md skill
yichen-zju/claude-for-research · claude/skills/ai-use-disclosure/SKILL.md · Generate venue-specific AI-use disclosure statements for manuscript submission (ICLR, NeurIPS, ICML, Nature, Science…
git:20261014.9f2a5e0 · audit A · 10 stars
alpha-research SKILL.md skill
yichen-zju/claude-for-research · claude/skills/alpha-research/SKILL.md · Search, read, and query research papers via the alphaxiv MCP server (2.5M+ arXiv papers). Use when the user asks about…
git:20261014.9f2a5e0 · audit A · 10 stars
alphafold2 SKILL.md skill
yichen-zju/claude-for-research · claude/skills/alphafold2/SKILL.md · Predict or audit protein structures with AlphaFold2-style workflows. Use when a research task needs monomer/multimer…
git:20261014.9f2a5e0 · audit A · 10 stars
anti-defensive-writing-en SKILL.md skill
yichen-zju/claude-for-research · claude/skills/anti-defensive-writing-en/SKILL.md · Stops defensive writing across the entire paper lifecycle — writing, revising, cutting, and organizing experiments…
git:20261014.9f2a5e0 · audit A · 10 stars
anti-defensive-writing SKILL.md skill
yichen-zju/claude-for-research · claude/skills/anti-defensive-writing/SKILL.md · 论文写作、修改、压缩和实验组织全流程中阻止【防御性写作】。把论文视为一场学术发布会, 而不是项目总结、实验日志或自我审查报告:识别这项工作最值得发表的价值,围绕它建立…
git:20261014.9f2a5e0 · audit A · 10 stars
autoresearch SKILL.md skill
yichen-zju/claude-for-research · claude/skills/autoresearch/SKILL.md · Autonomous experiment loop with evidence-driven move selection — scales from parameter tuning (directional search) to…
git:20261014.9f2a5e0 · audit A · 10 stars

Every file in yichen-zju/claude-for-research

Other files named long-context

long-context SKILL.md skill
orchestra-research/ai-research-skills · 19-emerging-techniques/long-context/SKILL.md · Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when…
v1.0.0 · audit A · 13,718 stars

Browse by kind, by grade A, or by owner.