--- name: anime_studio description: AI-powered 2D anime generator with VLM-verified assets, video analysis via Gemini, sequential keyframes, scene continuity chain, multi-model image/video generation, LLM-powered error recovery, and parallel asset+music pipeline version: 2.10.0 type: extension entry: plugin.py permissions: [net, route, widget, ws_handler, tool, read_settings, subprocess] env_from_settings: [OPENROUTER_API_KEY] when_to_use: User wants to generate a short animated 2D anime cartoon, music video, or animated scene with consistent characters, VLM verification, and narrative continuity. timeout_sec: 300 dependencies: [Pillow] ui_tab: tab_id: studio title: Anime Studio icon: film render: kind: declarative schema_version: 1 components: - type: form title: "🎬 Generate Anime" route: generate method: POST mode: job status_route: status fields: - name: theme label: Theme / Story type: textarea placeholder: "A young samurai discovers a magical sword in an ancient temple..." required: true - name: style label: Anime Style type: select options: ["modern anime", "retro 90s anime", "chibi cute anime", "dark gothic anime", "watercolor anime", "Studio Ghibli style", "cyberpunk anime", "shounen action anime"] default: modern anime - name: mood label: Mood type: select options: ["adventurous", "comedic", "dramatic", "melancholic", "mysterious", "romantic", "action-packed", "wholesome"] default: adventurous - name: duration_sec label: Duration (seconds) type: number default: 30 - name: num_scenes label: Number of Scenes type: number default: 4 - name: image_model label: Image Generator type: select options: ["gpt-image-2", "gpt-5-image", "gpt-5-image-mini", "nanobanana", "gemini-3-pro-image", "flux.2-pro", "flux.2-max", "seedream-4.5", "grok-imagine"] default: gpt-image-2 - name: video_model label: Video Model type: select options: ["bytedance/seedance-2.0", "bytedance/seedance-2.0-fast", "bytedance/seedance-1-5-pro", "google/veo-3.1", "google/veo-3.1-fast", "google/veo-3.1-lite", "minimax/hailuo-2.3", "kwaivgi/kling-v3.0-pro", "kwaivgi/kling-v3.0-std", "kwaivgi/kling-video-o1"] default: "bytedance/seedance-2.0" - name: music_style label: Music Style type: select options: ["orchestral cinematic", "electronic ambient", "acoustic guitar folk", "j-pop instrumental", "lo-fi hip hop beats", "epic battle drums"] default: orchestral cinematic submit_label: "🎬 Generate Anime" - type: subscription event: studio_progress render: - type: progress value_key: progress_pct label_key: message - type: gallery title: Character Sheets items_key: character_sheets item_type: image route_prefix: "asset?path=" - type: gallery title: Keyframes items_key: keyframes item_type: image route_prefix: "asset?path=" - type: key_value title: Verification items_key: verification_display condition_key: has_verification - type: key_value title: Warnings items_key: warnings_display condition_key: has_warnings --- # Anime Studio v2.7 A professional-grade 2D anime cartoon generator with **VLM-verified assets**, **video analysis via Gemini 3.1 Pro**, **sequential keyframes for continuity**, **multi-model image/video generation**, **LLM-powered error recovery**, **smart prompt condensation**, and **parallel asset + music pipeline**. ## What's New in v2.7 - **Smart Prompt Condensation** — Models with strict prompt character limits (e.g. Kling's 2500-char ceiling) now get their prompts automatically shortened by a fast LLM (Gemini 3.5 Flash) before submission. The LLM preserves all visual details, character identity, and camera directions while trimming boilerplate. Falls back to hard truncation if the LLM result is still too long. - **Kling models restored** — Kling v3.0 Pro/Std and Kling Video O1 are back in the selection list. With automatic prompt condensation, their 2500-char limit is no longer a blocker. Kling has a less aggressive copyright filter than Seedance. - **10 Video Models** — Seedance 2.0/1.5, Veo 3.1/Fast/Lite, Hailuo 2.3, and Kling v3.0 Pro/Std/O1. Prompt-length error detection remains as a safety net. ## What's New in v2.4 - **Smart Error Recovery (LLM Advisor)** — When a video scene fails (copyright filter, timeout, content policy), a fast LLM (Gemini 3.5 Flash) analyzes the error and recommends an action: retry the same model, switch to an alternative, or skip. The advisor picks the best alternative model based on the error type and scene needs. - **Parallel Music + Assets** — Music generation now runs in parallel with asset generation (character sheets, locations, keyframes) via `asyncio.gather`, cutting total pipeline time by the duration of music generation (~30-60s). ### Retained from v2.3 - Video VLM verification via Gemini 3.1 Pro (multi-frame analysis) - Sequential keyframes for visual continuity - Best-of-2 character sheet selection - Multi-dimensional video scoring (5 axes, weighted average) - Cross-scene identity check with worst-scene regeneration - Adaptive scene simplification on repeated failures - Progressive prompt learning from VLM feedback ## Pipeline 1. **Scenario Generation** — LLM creates a structured storyboard with scene transitions, dynamic action descriptions, and narrative continuity cues 2. **Asset + Music Generation (parallel)** — Character sheets (parallel), location art (parallel), keyframes (SEQUENTIAL with inter-frame context), and music all run concurrently via `asyncio.gather` 3. **Image VLM Verification** — Each critical asset (characters, keyframes) is checked by Claude Sonnet for correctness and regenerated if needed (up to 2 retries) 4. **Video Animation** — Sequential scene generation with: - Full continuity chain (last frame → next scene reference) - ALL character sheets as references (not just first) - Explicit character identity descriptions in prompts - Negative prompting against text artifacts - **Video VLM verification via Gemini 3.1 Pro** (max 1 retry per scene) - **Smart error recovery** — LLM advisor recommends model switch on failure 5. **Assembly** — ffmpeg concatenation with audio mixing ## Models Used (via OpenRouter) | Model | Purpose | |-------|---------| | `openai/gpt-5.4-image-2` | Character sheets, keyframes (default) | | `google/gemini-3.1-flash-image-preview` | Character sheets, keyframes (nanobanana option) | | `anthropic/claude-sonnet-4.6` | Scenario generation + image VLM verification | | `google/gemini-3.5-flash` | **Error advisor + prompt condensation** — analyzes failures, condenses long prompts for models with character limits | | `google/gemini-3.1-pro-preview` | **Video VLM verification** (multi-frame analysis) | | `bytedance/seedance-2.0` | Video generation (default) | | `google/veo-3.1` | Video generation (alternative — Google quality) | | `minimax/hailuo-2.3` | Video generation (cheapest option) | | `kwaivgi/kling-v3.0-pro` | Video generation (less strict copyright filter, auto-condensed prompts) | | `google/lyria-3-pro-preview` | Original soundtrack clips | ## Requirements - `OPENROUTER_API_KEY` with access to the models above - `ffmpeg` installed on the host system (for video assembly + frame extraction)