data-platform-pipeline SKILL.md skillA

This file is byte-identical to the first copy the registry indexed, one of 3 indexed copies. Same content hash, so the same checks give both the same grade.

data-platform-pipeline from aws-samples/sample-aws-solutions-skills is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add aws-samples/sample-aws-solutions-skills/data-platform-pipeline@git:20261103.21e6521

Pins git:20261103.21e6521 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
aws-samples/sample-aws-solutions-skills
Path
data-platform-pipeline-skill/claude-code/skills/data-platform-pipeline/SKILL.md
Versions recorded
5
Latest version
git:20261103.21e6521, committed Nov 3, 2026
First version recorded
Jun 24, 2026
Size
75,742 bytes
Repository stars
14
License
MIT-0

Build a production-ready serverless data lake pipeline on AWS. Creates S3 storage (S3 Tables or Hive), Glue Catalog, ETL jobs, IAM roles, and Athena query layer. Offers optional SageMaker Unified Studio integration, chosen by the customer before provisioning. Use for AWS Data Lab builds, new data platform setup, or adding data sources to an existing lake. Triggers: "build data pipeline", "data lake setup", "ingest data", "ETL pipeline", "Glue job", "data platform", "serverless analytics".

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Data Platform Pipeline (AWS Serverless)

This skill builds the **ingestion → storage → catalog → query** layers of a serverless data platform. The output is a working CDK TypeScript project plus the Glue scripts and Athena DDL to run it. Downstream consumption (Quick Sight, dashboards, chat agents) is out of scope — this skill stops at "data is queryable in Athena."

Implementation defaults are opinionated, but **whether to use SageMaker Unified Studio (SMUS) is always the customer’s decision**. Both SMUS and standalone pipelines are supported. Ask for this choice before any provisioning; there is no default.

> **Another customer-owned decision.** If the catalog + query layers must live in a different region from storage (follow-up #8), the choice between the two mechanisms is **presented to the user, not decided** — it turns on a legal question (is data residency a mandate or a preference?) and a cost question that depends on customer-specific volume. See `reference/cross-region-query.md` §2.

---

## 🔴 CRITICAL RULES (never violate)
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add aws-samples/sample-aws-solutions-skills/data-platform-pipeline@sha256:10f9a7878c5f7e0f

The line at the top of this page pins the label git:20261103.21e6521, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_r3emlrcj2udu2tmg.svg)](https://markdownregistry.com/a/art_r3emlrcj2udu2tmg)

3 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 5 versions of this file, between Jun 24, 2026 and Nov 3, 2026, about one every 33 days. Its first recorded version is graded B and its latest A.

versioncommittedcommitsizeaudit
git:20261103.21e6521 latest2026-11-03 21e6521 75,742 BA view · diff
git:20260810.da5d4492026-08-10 da5d449 69,102 BA view · diff
git:20260701.7a96ae22026-07-01 7a96ae2 50,274 BA view · diff
git:20260630.2c45edf2026-06-30 2c45edf 50,483 BA view · diff
git:20260624.50dd7db2026-06-24 50dd7db 50,537 BB view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (75742 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

aws-samples/sample-aws-solutions-skills · 14 stars · license MIT-0 · pushed 2026-11-03 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_r3emlrcj2udu2tmg
GET https://markdownregistry.com/api/v1/resolve?ref=aws-samples/sample-aws-solutions-skills/data-platform-pipeline
GET https://markdownregistry.com/api/v1/blob/10f9a7878c5f7e0f2f422f4ba64b8cbf67538f18f7dbede8b21d48b78b0629cd

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from aws-samples/sample-aws-solutions-skills

agentic-media-archive SKILL.md skill
aws-samples/sample-aws-solutions-skills · agentic-media-archive-skill/claude-code/skills/agentic-media-archive/SKILL.md · Build an AWS-native, MCP-exposed agentic media archive: video ingest → MediaConvert analysis proxies → Bedrock video…
v1.0 · audit A · 14 stars
agentic-media-archive SKILL.md skill
aws-samples/sample-aws-solutions-skills · agentic-media-archive-skill/codex/skills/agentic-media-archive/SKILL.md · Build an AWS-native, MCP-exposed agentic media archive: video ingest → MediaConvert analysis proxies → Bedrock video…
v1.0 · audit A · 14 stars
agentic-media-archive SKILL.md skill
aws-samples/sample-aws-solutions-skills · agentic-media-archive-skill/kiro/skills/agentic-media-archive/SKILL.md · Build an AWS-native, MCP-exposed agentic media archive: video ingest → MediaConvert analysis proxies → Bedrock video…
v1.0 · audit A · 14 stars
data-platform-consumption SKILL.md skill
aws-samples/sample-aws-solutions-skills · data-platform-consumption-skill/claude-code/skills/data-platform-consumption/SKILL.md · Connect existing data sources to Amazon Quick (Quick Sight + chat agents) for visualization and natural language…
git:20260701.7a96ae2 · audit A · 14 stars
data-platform-consumption SKILL.md skill
aws-samples/sample-aws-solutions-skills · data-platform-consumption-skill/codex/skills/data-platform-consumption/SKILL.md · Connect existing data sources to Amazon Quick (Quick Sight + chat agents) for visualization and natural language…
git:20260715.292e1e2 · audit A · 14 stars
data-platform-consumption SKILL.md skill
aws-samples/sample-aws-solutions-skills · data-platform-consumption-skill/kiro/skills/data-platform-consumption/SKILL.md · Connect existing data sources to Amazon Quick (Quick Sight + chat agents) for visualization and natural language…
git:20260701.7a96ae2 · audit A · 14 stars
data-platform-pipeline SKILL.md skill
aws-samples/sample-aws-solutions-skills · data-platform-pipeline-skill/codex/skills/data-platform-pipeline/SKILL.md · Build a production-ready serverless data lake pipeline on AWS. Creates S3 storage (S3 Tables or Hive), Glue Catalog…
git:20261103.21e6521 · audit A · 14 stars
data-platform-pipeline SKILL.md skill
aws-samples/sample-aws-solutions-skills · data-platform-pipeline-skill/kiro/skills/data-platform-pipeline/SKILL.md · Build a production-ready serverless data lake pipeline on AWS. Creates S3 storage (S3 Tables or Hive), Glue Catalog…
git:20261103.21e6521 · audit A · 14 stars
db-migration-agent SKILL.md skill
aws-samples/sample-aws-solutions-skills · db-migration-agent-skill/claude-code/skills/db-migration-agent/SKILL.md · Plan and execute production database migrations to AWS managed services — MySQL, MariaDB, PostgreSQL, Oracle, SQL…
v2.0 · audit A · 14 stars
db-migration-agent SKILL.md skill
aws-samples/sample-aws-solutions-skills · db-migration-agent-skill/codex/skills/db-migration-agent/SKILL.md · Plan and execute production database migrations to AWS managed services — MySQL, MariaDB, PostgreSQL, Oracle, SQL…
v2.0 · audit A · 14 stars
db-migration-agent SKILL.md skill
aws-samples/sample-aws-solutions-skills · db-migration-agent-skill/kiro/skills/db-migration-agent/SKILL.md · Plan and execute production database migrations to AWS managed services — MySQL, MariaDB, PostgreSQL, Oracle, SQL…
v2.0 · audit A · 14 stars
eks-hybrid-node-architecture-advisor SKILL.md skill
aws-samples/sample-aws-solutions-skills · eks-hybrid-node-architecture-advisor-skill/claude-code/skills/eks-hybrid-node-architecture-advisor/SKILL.md · Design and operate remote capacity attached to an existing Amazon EKS cluster with EKS Hybrid Nodes, primarily EC2 in…
v1.0 · audit A · 14 stars

Every file in aws-samples/sample-aws-solutions-skills

Other files named data-platform-pipeline

data-platform-pipeline SKILL.md skill
aws-samples/sample-aws-solutions-skills · data-platform-pipeline-skill/kiro/skills/data-platform-pipeline/SKILL.md · Build a production-ready serverless data lake pipeline on AWS. Creates S3 storage (S3 Tables or Hive), Glue Catalog…
git:20261103.21e6521 · audit A · 14 stars
data-platform-pipeline SKILL.md skill
aws-samples/sample-aws-solutions-skills · data-platform-pipeline-skill/codex/skills/data-platform-pipeline/SKILL.md · Build a production-ready serverless data lake pipeline on AWS. Creates S3 storage (S3 Tables or Hive), Glue Catalog…
git:20261103.21e6521 · audit A · 14 stars

Browse by kind, by grade A, or by owner.