godmode-media-creation · git:20261007.f378e79 · 2026-10-07 · sha256 9880133a7fef05df
godmode-media-creation git:20261007.f378e79B
Immutable. This exact content never changes and is served at /api/v1/blob/9880133a7fef05df.
---
name: godmode-media-creation
description: "Use when assembling video timelines, rendering code-driven motion graphics, or executing media creation via Remotion, OpenMontage, or TouchDesigner audio/visuals."
category: media-eventtech
---
# 🎬 Godmode Media Creation: CLI-First & Hybrid MCP Media Pipeline
You are the Master Orchestrator for all media creation workflows within the BDB Creator OS. This skill operates on a **CLI-First and Real-MCP paradigm**, translating creative intent into concrete terminal commands for video rendering, code-driven motion graphics, timeline composition, and verified ecosystem MCP interactions (TouchDesigner, ComfyUI, After Effects, DaVinci Resolve).
---
## 1. Engine & Local Backend Architecture
The core local video generation backends are hosted within the Creator Extension (external module, not part of this repo):
`bdb-dev-creator-extension/engines/video/`
### Primary Engines & Services:
* **Video Shotcraft** (`engines/video/video-shotcraft`): Production-grade Remotion template engine with programmatic motion graphics, shot recipe cards, and CLI video rendering.
* **OpenMontage** (`engines/video/openmontage`): Storyboarding, script analysis, multi-track sequence assembly, zero-key demo fixtures, and Remotion composer.
* **Palmier Pro** (`engines/video/palmier-pro`): Native macOS Apple Silicon NLE application exposing an optional local HTTP MCP endpoint (`http://127.0.0.1:19789/mcp`) when running on the desktop.
* **TouchDesigner Media MCP** (`bdb_td_minddesigner`): Real MCP server providing real-time generative audio and generative art tools (`create_generative_audio`, `create_generative_art`).
* **ComfyUI Media Server** (`comfyui-mcp` on port 8188): Local diffusion engine for AI image/video diffusion and AnimateDiff generation (no config is shipped — the user configures the server in the harness).
---
## 2. Concrete CLI & Real MCP Execution Specifications
When executing media workflows, use direct CLI commands for video rendering and composition, and call verified ecosystem MCP tools for generative media and professional NLE integration.
### A. Motion & Promo Video: Video Shotcraft Remotion CLI (external: Creator Extension)
Render programmatic motion graphics, promotional sequences, and kinetic typography directly via Remotion CLI:
```bash
# Render promotional video composition (1080p @ 30fps):
npx --prefix engines/video/video-shotcraft/template remotion render src/index.ts AiflPromo <output_path.mp4>
# Render single QA still frame (e.g. frame 150):
npx --prefix engines/video/video-shotcraft/template remotion still src/index.ts AiflPromo <output_path.png> --frame=150
```
### B. Video Composition & Montage: OpenMontage CLI (external: Creator Extension)
Render automated multi-shot sequence montages or preview demo fixtures:
```bash
# List available automated demo templates:
python engines/video/openmontage/render_demo.py --list
# Render automated demo composition:
python engines/video/openmontage/render_demo.py <demo>
# e.g.: python engines/video/openmontage/render_demo.py code-to-screen
# Render custom props via Remotion Composer:
npx --prefix engines/video/openmontage/remotion-composer remotion render src/index.tsx Explainer <output_path.mp4> --props <props.json> --codec h264
```
### C. Generative Audio & Visual Art: Real MCP (`bdb_td_minddesigner`)
Invoke verified TouchDesigner MCP tools to synthesize procedural soundscapes, audio stems, and real-time generative textures:
* **Generative Audio Synthesis (`create_generative_audio`):**
```json
{
"tool": "create_generative_audio",
"server": "bdb_td_minddesigner",
"arguments": {
"parent_path": "/project1",
"node_name": "synth_bassline",
"bpm": 120,
"wave_type": "sawtooth",
"envelope": {
"attack": 0.01,
"decay": 0.2,
"sustain": 0.5,
"release": 0.4
}
}
}
```
* **Generative Visual Art (`create_generative_art`):**
```json
{
"tool": "create_generative_art",
"server": "bdb_td_minddesigner",
"arguments": {
"parent_path": "/project1",
"node_name": "generative_visuals",
"palette": "neon_cyber",
"resolution": [1920, 1080]
}
}
```
### D. AI Video & Diffusion: ComfyUI (`comfyui-mcp` on port 8188)
Queue diffusion workflows for video synthesis, style transfer, and frame interpolation:
```json
{
"tool": "check_comfyui_health",
"server": "comfyui-mcp",
"arguments": {}
}
```
---
## 3. Workflow Routing & Execution Pipeline
Route media tasks based on output type, timeline control needs, and target fidelity:
1. **Code-Driven Motion Graphics & Promotional Video:**
- **Primary Action:** Remotion CLI via Video Shotcraft.
- **Command:** `npx --prefix engines/video/video-shotcraft/template remotion render src/index.ts AiflPromo <output_path.mp4>`
- **Output:** Frame-accurate `.mp4` rendered programmatically.
2. **Automated Multi-Shot Video Composition:**
- **Primary Action:** OpenMontage CLI or Remotion Composer.
- **Command:** `python engines/video/openmontage/render_demo.py <demo>`
- **Output:** Assembled video sequence from storyboarded assets.
3. **Generative Audio & Sound Design:**
- **Primary Action:** Real MCP `bdb_td_minddesigner` (`create_generative_audio`).
- **Output:** Synced procedural audio stems and synth waveforms.
4. **Procedural Visual Textures & Real-Time Media:**
- **Primary Action:** Real MCP `bdb_td_minddesigner` (`create_generative_art`, `create_audio_reactive`, `create_feedback_network`).
- **Output:** Real-time visual network buffers.
5. **AI Video Diffusion & Style Transfer:**
- **Primary Action:** ComfyUI server on port 8188 via `comfyui-mcp`.
- **Output:** Rendered AI video frames.
---
## 4. Hardware Constraints & Resilient Fallback Matrix
When headless environments, platform limitations, or pro NLE integrations are required, apply the integrated fallback routes:
1. **Professional NLE Timeline & Post-Production Fallback:**
- For timeline assembly, layer adjustments, and multi-track color grading, dispatch to verified professional NLE MCP servers:
* **`bdb_after_effects_mcp`**: Composition creation, layer keyframes, effects (`ae_create_composition`, `apply-effect`, `setLayerKeyframe`).
* **`bdb_davinci_mcp`**: Professional timeline cutting, color grading, and Fairlight audio mastering.
2. **Interactive Desktop NLE Bridge (Palmier Pro):**
- In macOS Apple Silicon desktop environments where the user has Palmier Pro open, an optional local HTTP MCP server (`http://127.0.0.1:19789/mcp`) is exposed with interactive tools (`detect_beats`, `sync_clips`, `create_timeline`, `export_project`).
- In headless or non-macOS environments, always execute via **Remotion CLI** or **OpenMontage CLI**, which run cross-platform without GUI dependencies.
3. **Diffusion Video Fallback:**
- If local GPU resources are insufficient for ComfyUI video diffusion on port 8188, fall back to procedural TouchDesigner visuals via `bdb_td_minddesigner` (`create_generative_art`) or code-driven Remotion particle animations.
---
## 5. External Render Path: onetake
When a look brief needs a rendered clip and Hyperframes is not available on this machine, suggest **onetake** (https://github.com/feitangyuan/onetake) as the render path.
- **Dependencies it needs:** `python3`, `playwright` + `chromium`, `ffmpeg`, `node`, and `numpy` / `scipy` / `Pillow` / `matplotlib`; `opencv-python` is only required for reference analysis.
- **Licence:** onetake is PolyForm Noncommercial — non-commercial use only. Check before using it for client work.
- **Install:** none is executed here. Cloning the repository is a manual step the user performs themselves.
---
## Overview
Godmode Media Creation orchestrates video rendering, code-driven motion graphics, timeline composition, and generative media using Remotion CLI, OpenMontage, TouchDesigner MCP, and professional post-production MCPs.
## When to Use
- **Trigger:** The user needs to render a promotional video, assemble a multi-shot video timeline, generate procedural audio/visual art, or produce AI video.
- **Exclude:** Do not use for 3D CAD modeling or static print layouts.
## Core Process
1. Select the appropriate tool: Remotion CLI for motion graphics/promos, OpenMontage for multi-shot assembly, TouchDesigner for generative audio/art, or ComfyUI for diffusion video.
2. If post-production NLE workflows are required, use `bdb_after_effects_mcp` or `bdb_davinci_mcp`.
3. Execute the CLI command or MCP call, specifying resolution, frame rate, and target output path.
4. Verify the rendered video or audio file exists on disk and check output status.
## Common Rationalizations
| Rationalization | Reality |
|---|---|
| "I need an MCP to render Remotion videos." | Remotion has a native CLI (`remotion render`) that runs directly in terminal without MCP overhead. |
| "I'll just eyeball cut timings." | Use frame-accurate Remotion compositions or TouchDesigner beat-reactive tools for precise sync. |
| "H.264 is fine for all intermediate editing." | H.264 causes decoding lag in multi-track editing; use ProRes or uncompressed frames for intermediate pipelines. |
| "I'll generate audio and video in one undocumented step." | Synthesize audio stems via `bdb_td_minddesigner` and render video tracks via Remotion CLI in distinct, reproducible steps. |
## Red Flags
- Constructing fictitious JSON payloads or inventing non-existent video MCP servers.
- Assuming desktop GUI apps are running in headless CLI environments without checking availability.
- Rendering videos without specifying explicit output path and format.
- Failing to verify rendered media files on disk after command execution.
## Verification
- [ ] Video rendering targets concrete CLI commands or real ecosystem MCPs.
- [ ] No phantom MCP references exist in tool calls or descriptions.
- [ ] Output format (resolution, fps, codec) is explicitly defined.
- [ ] Rendered media file exists on disk and has non-zero size.