agent-profiler SKILL.md skillA

agent-profiler from ai-evals-course/cartwheel-homeworks is an agent skill: a SKILL.md folder an AI agent loads when a task calls for it.

Install it, pinned
mdr add ai-evals-course/cartwheel-homeworks/agent-profiler@git:20260902.cdf1964

Pins git:20260902.cdf1964 in mdr.lock. Pin the fingerprint instead.

Audit grade
A, 17 of 17 checks passed
Kind
SKILL.md skill
Repository
ai-evals-course/cartwheel-homeworks
Path
.agents/skills/agent-profiler/SKILL.md
Versions recorded
1
Latest version
git:20260902.cdf1964, committed Sep 2, 2026
Size
2,085 bytes
Repository stars
95
License
none declared

Review Cartwheel model call costs and propose measured cost reductions. Use for Homework 10 after profile/results/calls.csv and profile/results/profile.json have been created.

Collected from public GitHub. Every version is saved exactly as it was and never changes. Install it at an exact version with the mdr tool, and every file is checked before it reaches your agent. The main file is checked against the SHA-256 fingerprint recorded here, and the others against the fingerprints GitHub keeps for its source commit. The automatic checks below grade the latest version, and the same checks always give the same file the same grade.

What the file says

# Agent cost review

Read `homework/module-5/hw10.md`, `profile/results/calls.csv`, `profile/results/profile.json`, and `profile/models.json`. Stop and name the missing file when an input is absent.

Use `rg` to find the Python file and line that starts each model call named in `calls.csv`. Check the surrounding prompt, tools, retrieval, conversation history, and model choice. Do not infer a call site from its name when the code does not support the match.

Write `reports/optimization_plan.md`. Separate suggestions for customer conversation cost from suggestions for judge cost, and do not add the two costs into one total. Order suggestions by estimated saving within each category, and include the following fields for every suggestion:

- `Cost category`: `customer_conversation` or `judge`.
- `Code`: the file and line affected.
- `Measured cost`: the call count, tokens, or cost from the saved report.
- `Suggested change`: one specific change.
- `Estimated saving`: the arithmetic from the measured cost to the estimate.
- `Assumptions`: every value not measured in the saved report.
- `Risk`: the agent behavior that could get worse.
…

Read the whole file at its exact version.

How to install

The exact contents, by fingerprint
mdr add ai-evals-course/cartwheel-homeworks/agent-profiler@sha256:ba54af463c06ef70

The line at the top of this page pins the label git:20260902.cdf1964, which is what most people want. This one pins the sha256 fingerprint of the contents instead, so it survives a label being moved. Either way the exact version is written to mdr.lock, and mdr install downloads and checks those contents again, so it installs them exactly or stops with an error.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_dgfholracfyjjsz4.svg)](https://markdownregistry.com/a/art_dgfholracfyjjsz4)

5 badge image fetches in 30 days. What the badge shows.

Versions

The registry has recorded 1 version of this file, committed on Sep 2, 2026.

versioncommittedcommitsizeaudit
git:20260902.cdf1964 latest2026-09-02 cdf1964 2,085 BA view

Audit of the latest version

A  17 of 17 checks passed. Fixed automatic checks with no AI involved, so the same checks give the same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (2085 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

ai-evals-course/cartwheel-homeworks · 95 stars · license none declared · pushed 2026-10-10 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_dgfholracfyjjsz4
GET https://markdownregistry.com/api/v1/resolve?ref=ai-evals-course/cartwheel-homeworks/agent-profiler
GET https://markdownregistry.com/api/v1/blob/ba54af463c06ef706d453cf5d48bf382f25ab95df2a865ec753b1448392b71ca

Your AI assistant does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

Guides: the SKILL.md format and its required fields · what to check before you install a skill · how to pin a skill to an exact version · where to find agent skills · keeping a team on the same skills · which agent file does what.

More from ai-evals-course/cartwheel-homeworks

improve-loop SKILL.md skill
ai-evals-course/cartwheel-homeworks · .agents/skills/improve-loop/SKILL.md · Run an autoresearch loop that hill climbs on a project's evaluation score. Edit only allowed files, one change at a…
git:20260930.c1b179f · audit A · 95 stars
AGENTS.md AGENTS.md file
ai-evals-course/cartwheel-homeworks · AGENTS.md
git:20261010.a0d616b · audit A · 95 stars
CLAUDE.md CLAUDE.md file
ai-evals-course/cartwheel-homeworks · CLAUDE.md
git:20260907.218f404 · audit B · 95 stars
skill SKILL.md skill
ai-evals-course/cartwheel-homeworks · analysis/skill/SKILL.md
git:20260916.3095893 · audit C · 95 stars
synthetic-trace-generation SKILL.md skill
ai-evals-course/cartwheel-homeworks · scenarios/skill/SKILL.md · Generate grounded, diverse user interactions and run them against an instrumented application to create a verified…
git:20261010.764a57a · audit A · 95 stars

Every file in ai-evals-course/cartwheel-homeworks

Browse by kind, by grade A, or by owner.