mine-channel ยท diff
git:20261003.a2d662f to git:20261007.cd6c208
0 added, 1 removed. Audit A to A.
---
name: mine-channel
description: >-
Mine any Telegram channel or chat for signal in one command: incremental zero-token scrape,
deterministic detector shortlist, LLM judge for what is genuinely valuable to this owner, then
linked vault notes, a database row, a map-of-content entry and reindex. Triggers:
"/mine-channel <@channel|id>", "alpha from <channel>".
license: MIT
---
# /mine-channel โ pull in a channel and squeeze out the alpha in one command
> ๐ง Finish the reply to a non-technical operator with a simple "In plain words" recap (memory `eli5-always`).
This generalizes a pattern that was repeated by hand 5+ times across different channels. Cost ladder [[vault-data-architecture]]: a deterministic detector (0 tokens) โ an LLM judge over the shortlist only โ the vault.
## Steps
**0. RECALL (do not duplicate).** Has this channel been mined already? Check `$IMPORTS_ROOT/alpha/<slug>\` and memory (`*-mine`, `*-community-import`). If yes, this is a TOP-UP: same slug, incremental.
**1. Resolve the channel.** A username (`@some_channel` / `some_channel`) or a numeric id (`<YOUR_CHAT_ID>`). If you do not know the id โ `mcp__telegram__search_dialogs` or `/chat <name>`. Pick a short Latin **slug** (e.g. `silmeshok`).
**2. Scrape + detector (0 tokens, 0 GPU):**
```
set PYTHONIOENCODING=utf-8
python $IMPORTS_ROOT/alpha/mine_channel.py --channel <name|id> --slug <slug> [--limit N] [--top 40] [--since YYYY-MM-DD --until YYYY-MM-DD]
```
โ `_imports\alpha\<slug>\<slug>.jsonl` + `<slug>.db` + the shortlist `_imports\alpha\candidates\<slug>-report.md`.
(The scrape goes through the subscription Telethon session `<TELEGRAM_MCP_DIR>/.env`, account work_acct_a โ NOT a paid API [[prefer-included-limits-before-paid-api]]. Re-running without `--channel` plus `--detect-only` = re-detect without re-scraping.)
**3. The judge (LLM, shortlist only).** Run the shortlist through a **cheap grunt model** (grunt work โ the small model [[model-routing-sonnet-grunt]]; a subagent with `model:'sonnet'`, or the `alpha-judge` skill): keep only REAL alpha FOR THE OWNER (a tool/model/deal ยท a technique or workflow ยท a mental model ยท a proof point or benchmark ยท a build pattern), and drop promos, banter, and anything we already do better. Verdicts: โ
alpha ยท ๐ก watch ยท ๐ noise.
**4. Into the vault (obsidian-ingest).** Backup first [[vault-backup-rule]]. โ
alpha โ atomic notes + concept links ([[no-orphan-notes-rule]]) + a MOC `_<Slug>-MOC`; a sensitive channel โ `#private`. The original jsonl stays in `_imports\alpha\<slug>\` (that IS the _originals copy for the channel). Reindex [[reindex-routine]] (or let the nightly job pick it up).
**5. Make it a routine? ([[evaluate-recurring-into-routine]])** A valuable channel โ propose a weekly top-up (night window [[routines-run-at-night]]).
## Boundaries
The detector is generic (AI / tool / deal / startup keywords); per-channel keyword and promo filters are tuned inside `mine_channel.py`. Sensitivity: closed / adult / personal channels โ `#private`, never surfaced outside. Read the channel only, never post into it.
-
<!--kit-footer-->
---
**Like this skill?** It is one of 100 in [second-brain-starter-kit](https://github.com/tonydzi/second-brain-starter-kit): the second brain we built for ourselves and run every day at Palo Alto AI Research Lab. Install the whole set with `npx skills add tonydzi/second-brain-starter-kit`. Everything is open source and free, so take what you need.
Flagships worth a look on their own: [secondop-panel](https://github.com/tonydzi/secondop-panel) (a second opinion from a panel of external models), [claude-memory-tidy](https://github.com/tonydzi/claude-memory-tidy) (stop your agent's memory from rotting), [telegram-mcp-kit](https://github.com/tonydzi/telegram-mcp-kit) (your own Telegram over MCP in about 15 minutes).
Author: **Anton Dziatkovskii**, Palo Alto AI Research Lab. Telegram [@tonydzi](https://t.me/tonydzi) - WhatsApp [+1 341 222 9178](https://wa.me/13412229178) - X [@Tony_Stef_](https://x.com/Tony_Stef_)
**Engineers: want to test-drive this setup?** Message me. I hand out free starter seeds to engineers who test and report back, and custom skill requests are welcome.