Home / datarobot-oss / datarobot-agent-skills · skills/datarobot-model-monitoring/SKILL.md · GitHub

datarobot-model-monitoring skillA

datarobot-model-monitoring is agent-read markdown (skill) from datarobot-oss/datarobot-agent-skills: Tools and guidance for monitoring model performance, tracking data drift, managing model health, and detecting prediction anomalies. Use when monitoring deployed models, tracking drift, or investigating prediction anomalies..

Indexed from public GitHub and served as immutable, content-addressed versions. Install it pinned to an exact SHA-256 with the mdr CLI, and every file is verified against the hash recorded here before it reaches your agent. The deterministic audit below grades the latest version, and the same file always earns the same grade.

What the file says

# DataRobot Model Monitoring Skill

This skill provides comprehensive guidance for monitoring deployed models, tracking performance metrics, detecting data drift, and managing model health.

## Quick Start

**Most common use case**: Check deployment health and data drift

1. **Check service stats**: `deployment.get_service_stats(...)` to review prediction volume/latency
2. **Check drift**: `deployment.get_feature_drift(...)` / `deployment.get_target_drift(...)`
3. **Compare over time**: Use `get_service_stats_over_time(...)` and drift periods to assess trends

**Example**: "Check the health of deployment abc123 and report any data drift issues"

## When to use this skill

Use this skill when you need to:
- Monitor model performance in production
- Track data drift and feature drift
- Detect prediction anomalies
- Monitor prediction accuracy over time
- Set up alerts for model degradation
- Analyze model health metrics
- Compare production performance to training performance

## Key capabilities

### 1. Performance Monitoring

- Track prediction accuracy and metrics over time
- Compare production metrics to training metrics
- Monitor prediction volume and latency
…

Read the whole file at its exact version.

How to install

Latest version
mdr add datarobot-oss/datarobot-agent-skills/datarobot-model-monitoring@git:20260826.60ce5c5
Exact content
mdr add datarobot-oss/datarobot-agent-skills/datarobot-model-monitoring@sha256:9e36e406af0a8752

Pin to a label to follow the author's releases, or to a sha256 to freeze the exact bytes forever. Either way the resolved hash is written to mdr.lock, and mdr install reproduces it on any machine.

Badge

mdr badge

[![mdr](https://markdownregistry.com/badge/art_32mamlbml45wuppn.svg)](https://markdownregistry.com/a/art_32mamlbml45wuppn)

1 badge views in 30 days

Versions

versioncommittedcommitsizeaudit
git:20260826.60ce5c5 latest2026-08-26 60ce5c5 7,291 BA view · diff
git:20260825.cfbd8e92026-08-25 cfbd8e9 7,172 BA view · diff
git:20260819.0d95a802026-08-19 0d95a80 7,387 BA view · diff
git:20260728.b41ca002026-07-28 b41ca00 7,416 BA view · diff
git:20260519.03d3b202026-05-19 03d3b20 7,419 BA view

Audit of the latest version

A  17 of 17 checks passed. Deterministic, no model, same answer every run.
  • pass: Frontmatter block present
  • pass: Frontmatter declares a name
  • pass: Frontmatter declares a description
  • pass: Size between 200 bytes and 200 KB (7291 bytes)
  • pass: No zero-width or bidi control characters
  • pass: No instruction hidden inside an HTML comment
  • pass: No link to an exfiltration or paste host
  • pass: No credential-shaped string
  • pass: No instruction to send local credentials anywhere
  • pass: No text hidden with inline styles
  • pass: No prompt-injection phrasing
  • pass: No curl or wget piped into a shell
  • pass: No recursive delete of root, home or parent
  • pass: No instruction to read or print local credentials
  • pass: No base64 blob over 200 characters
  • pass: No link to a raw IP address
  • pass: No script tag

Source

GitHub

datarobot-oss/datarobot-agent-skills · 27 stars · license Apache-2.0 · pushed 2026-09-23 · branch main

API

GET https://markdownregistry.com/api/v1/artifacts/art_32mamlbml45wuppn
GET https://markdownregistry.com/api/v1/resolve?ref=datarobot-oss/datarobot-agent-skills/datarobot-model-monitoring
GET https://markdownregistry.com/api/v1/blob/9e36e406af0a87523ac180cf150155cb90edabb58b67de8059fcd6532da41079

Your agent does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.

More from datarobot-oss/datarobot-agent-skills

progressive-disclosure skill
datarobot-oss/datarobot-agent-skills · .skills/progressive-disclosure/SKILL.md · Refactor large DataRobot skill files by moving detailed content into directly linked reference files while preserving…
git:20260522.e07bcb1 · audit A · 27 stars
AGENTS.md agents
datarobot-oss/datarobot-agent-skills · AGENTS.md
git:20260827.ad4f673 · audit A · 27 stars
CLAUDE.md claude
datarobot-oss/datarobot-agent-skills · CLAUDE.md
git:20260519.505d6df · audit B · 27 stars
datarobot-agent-assist skill
datarobot-oss/datarobot-agent-skills · skills/datarobot-agent-assist/SKILL.md · Use when the user wants to design, build, code, simulate, or deploy an AI agent (not a predictive model) to DataRobot…
git:20260921.83fdf11 · audit B · 27 stars
datarobot-agent-assist-build skill
datarobot-oss/datarobot-agent-skills · skills/datarobot-agent-assist/agent-assist-build/SKILL.md · Use when the user wants to design, build, code, or deploy an AI agent on DataRobot; mentions agent_spec.md, dress…
git:20260921.783ecc2 · audit A · 27 stars
datarobot-agent-assist-simulate skill
datarobot-oss/datarobot-agent-skills · skills/datarobot-agent-assist/agent-assist-simulate/SKILL.md · Use when the user wants to adversarially test, evaluate, or harden an implemented AI agent before deployment; mentions…
git:20260805.1ef1aa0 · audit B · 27 stars
datarobot-agent-llm-selection skill
datarobot-oss/datarobot-agent-skills · skills/datarobot-agent-llm-selection/SKILL.md · Use when the user wants to configure LLM integration for a DataRobot agent application. This skill helps to change LLM…
git:20260827.173ef3c · audit C · 27 stars
datarobot-app-framework-cicd skill
datarobot-oss/datarobot-agent-skills · skills/datarobot-app-framework-cicd/SKILL.md · Guidance for setting up CI/CD pipelines for DataRobot application templates using GitLab, GitHub Actions, and Pulumi…
git:20260519.3111310 · audit B · 27 stars
datarobot-data-preparation skill
datarobot-oss/datarobot-agent-skills · skills/datarobot-data-preparation/SKILL.md · Tools and guidance for data upload, dataset management, data validation, and preparing data for DataRobot projects. Use…
git:20260825.cfbd8e9 · audit A · 27 stars
datarobot-discover skill
datarobot-oss/datarobot-agent-skills · skills/datarobot-discover/SKILL.md · Use when the user wants to find DataRobot capabilities — skills, MCP servers, agents, or platform resources — for a…
git:20260623.fa30c37 · audit A · 27 stars
datarobot-external-agent-monitoring skill
datarobot-oss/datarobot-agent-skills · skills/datarobot-external-agent-monitoring/SKILL.md · Instrument any external or existing AI agent with OpenTelemetry to send traces, logs, and metrics to DataRobot for…
git:20260713.606fd37 · audit C · 27 stars
datarobot-feature-engineering skill
datarobot-oss/datarobot-agent-skills · skills/datarobot-feature-engineering/SKILL.md · Guidance for feature engineering, feature discovery, feature importance analysis, and understanding DataRobot's…
git:20260825.cfbd8e9 · audit A · 27 stars

Every file in datarobot-oss/datarobot-agent-skills

Browse by kind, by grade A, or by owner.