lh-data-pipelines SKILL.md skillA

lh-data-pipelines from jrodrigopuca/local-agents is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add jrodrigopuca/local-agents/lh-data-pipelines@v1.1

Pins v1.1 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
jrodrigopuca/local-agents
Path
data-ml/skills/lh-data-pipelines/SKILL.md
Versions recorded
1
Latest version
v1.1, committed Oct 14, 2026
Size
4,751 bytes
Repository stars
2
License
Apache-2.0

Moving data reliably: ingestion, transformation, quality validation, storage, and pipeline design. Trigger: load when building or fixing data pipelines, ETL/ELT, data quality issues, or deciding how to store and model DERIVED data (warehouse, lake, feature store) — the transactional source of truth is dba's.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

## Critical Patterns

### 1. Understand the data before you move it

Before writing a pipeline, profile the source: what each field actually means
(not what its name suggests), its ranges, its nulls, its duplicates, its
encoding, how it's generated and how often it lies. Most pipeline bugs are
misunderstandings of the source dressed up as code bugs — the "amount" column
that's sometimes cents and sometimes dollars, the timestamp in three timezones,
the "unique" id that isn't. Curiosity here is cheaper than debugging downstream.

### 2. Validate at the boundary — data contracts, not hope

Every pipeline stage that ingests data checks it against an explicit contract:
expected schema, types, ranges, nullability, referential integrity. Bad data is
caught and quarantined at the door, not discovered three tables downstream as a
wrong dashboard number. This is [lh-fullstack-boundaries](../../../senior-dev/skills/lh-fullstack-boundaries/SKILL.md)
applied to data: the source is untrusted until validated, and a silent bad row
is worse than a loud rejected one because it poisons everything computed from it.

### 3. Idempotent and reprocessable — run it twice, same result
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add jrodrigopuca/local-agents/lh-data-pipelines@sha256:7a1e6a41a5244642

The line at the top of this page pins the label v1.1, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_xxu7xmzjpbvlwff4.svg)](https://markdownregistry.com/a/art_xxu7xmzjpbvlwff4)

2 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 1 version of this file, committed on Oct 14, 2026.

versioncommittedcommitsizeaudit
v1.1 latest2026-10-14 9571e8f 4,751 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (4751 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

jrodrigopuca/local-agents · 2 stars · license Apache-2.0 · pushed 2026-10-23 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_xxu7xmzjpbvlwff4
GET https://markdownregistry.com/api/v1/resolve?ref=jrodrigopuca/local-agents/lh-data-pipelines
GET https://markdownregistry.com/api/v1/blob/7a1e6a41a5244642a944f7d4917ce727ef112c93fbfc2834469b2eeaeacf315b

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from jrodrigopuca/local-agents

AGENTS.md AGENTS.md file
jrodrigopuca/local-agents · AGENTS.md
git:20261022.50892c2 · audit A · 2 stars
AGENTS.md@apple-dev AGENTS.md file
jrodrigopuca/local-agents · apple-dev/AGENTS.md · Use this agent for Swift, iOS, and macOS development as a mentor — it teaches you to solve alone (Socratic first)…
git:20261014.9571e8f · audit A · 2 stars
lh-code-review SKILL.md skill
jrodrigopuca/local-agents · apple-dev/skills/lh-code-review/SKILL.md · Reviewing Swift/SwiftUI code as mentor: the severity system, the Apple-specific defect checklist, and…
v1.1 · audit A · 2 stars
lh-debugging SKILL.md skill
jrodrigopuca/local-agents · apple-dev/skills/lh-debugging/SKILL.md · Debugging Apple-platform issues as taught method: crashes, leaks, hangs, and weird behavior — Socratic first, tools…
v1.1 · audit A · 2 stars
lh-shipping SKILL.md skill
jrodrigopuca/local-agents · apple-dev/skills/lh-shipping/SKILL.md · Getting apps into users' hands: signing, provisioning, TestFlight, App Review, and macOS-specific distribution…
v1.1 · audit A · 2 stars
lh-state-architecture SKILL.md skill
jrodrigopuca/local-agents · apple-dev/skills/lh-state-architecture/SKILL.md · SwiftUI state management and app architecture: ownership, MVVM shape, navigation, dependency injection, project…
v1.1 · audit A · 2 stars
AGENTS.md@architect AGENTS.md file
jrodrigopuca/local-agents · architect/AGENTS.md · Use this agent for software architecture guidance, design patterns, expensive-to-reverse technical decisions…
git:20261021.e01dd0b · audit A · 2 stars
lh-design-review SKILL.md skill
jrodrigopuca/local-agents · architect/skills/lh-design-review/SKILL.md · How to review a codebase's architecture or a proposed design: dependency direction, boundary integrity, coupling…
v1.1 · audit A · 2 stars
lh-mentoring SKILL.md skill
jrodrigopuca/local-agents · architect/skills/lh-mentoring/SKILL.md · Turning a correction into learning without lecturing. Trigger: load when a real misconception would hurt the user…
v1.1 · audit A · 2 stars
lh-tradeoffs SKILL.md skill
jrodrigopuca/local-agents · architect/skills/lh-tradeoffs/SKILL.md · Method for analyzing and presenting expensive-to-reverse technical decisions: drivers, options, tradeoff table…
v1.1 · audit A · 2 stars
AGENTS.md@data-ml AGENTS.md file
jrodrigopuca/local-agents · data-ml/AGENTS.md · Use this agent for data pipelines, ML modeling, and LLM integration — ingestion/quality, honest evaluation, and…
git:20261014.9571e8f · audit A · 2 stars
lh-llm-integration SKILL.md skill
jrodrigopuca/local-agents · data-ml/skills/lh-llm-integration/SKILL.md · Building reliable product features on LLMs: RAG, prompting-as-code, output validation, evals, and cost/latency…
v1.1 · audit A · 2 stars

Every file in jrodrigopuca/local-agents

Browse by kind, by grade A, or by owner.