Home / terrylica / cc-skills · plugins/devops-tools/skills/python-memory-safe-scripts/SKILL.md · GitHub

python-memory-safe-scripts skillA

python-memory-safe-scripts is agent-read markdown (skill) from terrylica/cc-skills: Memory-safe Python script patterns for long-running processes under systemd MemoryMax constraints. Covers allocator purge (mimalloc/glibc malloc_trim), HTTP response lifecycle, DataFrame cleanup, thread-local connection reuse, and periodic GC cadence. Battle-tested through 5 OOM optimization cycles on production GPU workstations. Use this skill proactively whenever writing or reviewing Python scripts that: run under systemd with MemoryMax, process data in loops (downloads, ETL, backfill), use Th.

Indexed from public GitHub and served as immutable, content-addressed versions. Install it pinned to an exact SHA-256 with the mdr CLI, and every file is verified against the hash recorded here before it reaches your agent. The deterministic audit below grades the latest version, and the same file always earns the same grade.

What the file says

# Memory-Safe Python Script Patterns

Battle-tested patterns for keeping Python scripts alive under systemd `MemoryMax` constraints. Extracted from `repair_direct_parquet.py` (24-worker parallel repair) and `exness_tick_cache_seeder.py` (10-symbol daily seeder) after 5 OOM optimization cycles on a 62 GB GPU workstation.

**Core insight**: Python's garbage collector frees objects, but the C allocator (glibc ptmalloc2) does NOT return freed pages to the OS. Without explicit `malloc_trim(0)`, RSS only grows — even after `del` and `gc.collect()`. mimalloc with `MIMALLOC_PURGE_DELAY` helps but explicit purge is faster.

> **Self-Evolving Skill**: This skill improves through use. If instructions are wrong, parameters drifted, or a workaround was needed — fix this file immediately, don't defer. Only update for real, reproducible issues.

## The 7 Patterns

### 1. Cached Allocator Purge

The most important pattern. Cache the ctypes library handle on first call so subsequent purges are a single FFI invocation with zero allocation overhead.

```python
import ctypes
import gc
import sys

_purge_lib = None
_purge_method = None  # "mimalloc" | "glibc" | "none"

def _force_allocator_purge():
…

Read the whole file at its exact version.

How to install

Latest version
mdr add terrylica/cc-skills/python-memory-safe-scripts@git:20260401.b664eaf
Exact content
mdr add terrylica/cc-skills/python-memory-safe-scripts@sha256:72317a0b541c88fc

Pin to a label to follow the author's releases, or to a sha256 to freeze the exact bytes forever. Either way the resolved hash is written to mdr.lock, and mdr install reproduces it on any machine.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_plsivvsmsviepqhl.svg)](https://markdownregistry.com/a/art_plsivvsmsviepqhl)

1 badge views in 30 days

Versions

versioncommittedcommitsizeaudit
git:20260401.b664eaf latest2026-04-01 b664eaf 11,858 BA view · diff
git:20260401.6be22af2026-04-01 6be22af 11,636 BA view · diff
git:20260324.e205bec2026-03-24 e205bec 11,066 BA view

Audit of the latest version

A  17 of 17 checks passed. Deterministic, no model, same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (11858 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

terrylica/cc-skills · 74 stars · license MIT · pushed 2026-09-24 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_plsivvsmsviepqhl
GET https://markdownregistry.com/api/v1/resolve?ref=terrylica/cc-skills/python-memory-safe-scripts
GET https://markdownregistry.com/api/v1/blob/72317a0b541c88fc66a0883b223ee68287e1a2db5b25e39cec45a5dcd96c5aa2

Your agent does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

More from terrylica/cc-skills

CLAUDE.md claude
terrylica/cc-skills · CLAUDE.md
git:20260920.d5f6026 · audit A · 74 stars
CLAUDE.md@docs claude
terrylica/cc-skills · docs/CLAUDE.md
git:20260903.abf94c3 · audit A · 74 stars
CLAUDE.md@docs/design claude
terrylica/cc-skills · docs/design/CLAUDE.md
git:20260903.3d243d7 · audit A · 74 stars
CLAUDE.md@plugins claude
terrylica/cc-skills · plugins/CLAUDE.md
git:20260920.d5f6026 · audit A · 74 stars
CLAUDE.md@plugins/agent-reach claude
terrylica/cc-skills · plugins/agent-reach/CLAUDE.md
git:20260722.52c9284 · audit A · 74 stars
agent-reach skill
terrylica/cc-skills · plugins/agent-reach/skills/agent-reach/SKILL.md · Give your AI agent eyes to see the entire internet. 17 platforms via CLI, MCP, curl, and Python scripts. Zero config…
git:20260527.fb73e18 · audit A · 74 stars
CLAUDE.md@plugins/arxiv-source-first claude
terrylica/cc-skills · plugins/arxiv-source-first/CLAUDE.md
git:20260822.291af0a · audit A · 74 stars
arxiv-source-first-paper-ingest skill
terrylica/cc-skills · plugins/arxiv-source-first/skills/arxiv-source-first-paper-ingest/SKILL.md · Read an arXiv paper faithfully by fetching the authors' own LaTeX source instead of OCR-ing the PDF. Extracts every…
git:20260731.1bd7c64 · audit A · 74 stars
CLAUDE.md@plugins/asciinema-tools claude
terrylica/cc-skills · plugins/asciinema-tools/CLAUDE.md
git:20260812.1b1cc81 · audit A · 74 stars
analyze skill
terrylica/cc-skills · plugins/asciinema-tools/skills/analyze/SKILL.md · Semantic analysis of converted recordings. TRIGGERS - analyze cast, keyword extraction, find patterns.
git:20260401.b664eaf · audit A · 74 stars
asciinema-analyzer skill
terrylica/cc-skills · plugins/asciinema-tools/skills/asciinema-analyzer/SKILL.md · Semantic analysis of asciinema recordings. TRIGGERS - analyze cast, keyword extraction, find patterns in recordings.
git:20260401.b664eaf · audit A · 74 stars
asciinema-cast-format skill
terrylica/cc-skills · plugins/asciinema-tools/skills/asciinema-cast-format/SKILL.md · Asciinema v3 .cast file format reference. TRIGGERS - cast format, asciicast spec, event codes, parse cast file.
git:20260401.b664eaf · audit A · 74 stars

Every file in terrylica/cc-skills

Browse by kind, by grade A, or by owner.