analyze · git:20260611.1d9847e · 2026-06-11 · sha256 200ddbde5c4a8001
analyze git:20260611.1d9847eA
Immutable. This exact content is served forever at /api/v1/blob/200ddbde5c4a8001.
---
name: analyze
description: Analyze a large file (CSV, Excel, PDF, JSON, code) and return a token-efficient summary. Instead of reading thousands of rows or pages, get schema + statistics + sample in under 500 tokens. Use when user mentions a file path, asks to analyze data, pastes many rows, or references a CSV/Excel/PDF/JSON file.
---
Analyze a file using TokenMizer's file intelligence layer.
## IMPORTANT rule
**Never ask the user to paste the file content.** Always call TokenMizer to analyze it from the path. Pasting a 50,000-row CSV = 400,000 tokens. TokenMizer reduces it to ~450 tokens.
## What to do
Parse $ARGUMENTS:
- First word = file path
- Remaining words = query (what user wants to know)
```bash
FILE_PATH=$(echo "$ARGUMENTS" | awk '{print $1}')
QUERY=$(echo "$ARGUMENTS" | cut -d' ' -f2-)
python3 -c "
from tokenmizer.filters.file_intelligence import FileIntelligence
fi = FileIntelligence()
result = fi.process(
open('${FILE_PATH}', 'rb').read(),
'${FILE_PATH}'.split('/')[-1],
token_budget=600,
query='${QUERY}'
)
print(f'File: {result.file_type} | {result.original_tokens:,} → {result.extracted_tokens} tokens ({result.savings_pct:.0f}% saved)')
print()
print(result.content)
"
```
## Token savings by file type
| Type | Typical savings |
|---|---|
| CSV (50k rows) | 99.9% |
| PDF (200 pages) | 98.8% |
| Excel (10 sheets) | 99.7% |
| JSON (1k items) | 95% |
| Code (large file) | 60-80% |
## If TokenMizer not installed
```bash
pip install "tokenmizer[anthropic]"
```
## Examples of $ARGUMENTS
- `/data/sales.csv` → analyze with no specific query
- `/data/sales.csv which regions are underperforming` → targeted analysis
- `/reports/Q1.pdf key findings and risks` → relevant page extraction
- `/data/users.xlsx find inactive accounts` → per-sheet analysis