v1.0.0 to v1.0.0

5 added, 560 removed. Audit A to A.

---
name: hive-mind-advanced
description: Queen-led collective-intelligence coordination with consensus mechanisms and persistent shared memory. Use when orchestrating a large swarm of agents under a lead coordinator, building consensus across agents, or maintaining durable cross-agent memory.
version: 1.0.0
category: coordination
tags: [hive-mind, swarm, queen-worker, consensus, collective-intelligence, multi-agent, coordination]
author: Claude Flow Team
---
# Hive Mind Advanced Skill
Master the advanced Hive Mind collective intelligence system for sophisticated multi-agent coordination using queen-led architecture, Byzantine consensus, and collective memory.
## Overview
The Hive Mind system represents the pinnacle of multi-agent coordination in Claude Flow, implementing a queen-led hierarchical architecture where a strategic queen coordinator directs specialized worker agents through collective decision-making and shared memory.
## Core Concepts
### Architecture Patterns
**Queen-Led Coordination**
- Strategic queen agents orchestrate high-level objectives
- Tactical queens manage mid-level execution
- Adaptive queens dynamically adjust strategies based on performance
**Worker Specialization**
- Researcher agents: Analysis and investigation
- Coder agents: Implementation and development
- Analyst agents: Data processing and metrics
- Tester agents: Quality assurance and validation
- Architect agents: System design and planning
- Reviewer agents: Code review and improvement
- Optimizer agents: Performance enhancement
- Documenter agents: Documentation generation
**Collective Memory System**
- Shared knowledge base across all agents
- LRU cache with memory pressure handling
- SQLite persistence with WAL mode
- Memory consolidation and association
- Access pattern tracking and optimization
### Consensus Mechanisms
**Majority Consensus**
Simple voting where the option with most votes wins.
**Weighted Consensus**
Queen vote counts as 3x weight, providing strategic guidance.
**Byzantine Fault Tolerance**
Requires 2/3 majority for decision approval, ensuring robust consensus even with faulty agents.
## Getting Started
### 1. Initialize Hive Mind
```bash
# Basic initialization
npx claude-flow hive-mind init
# Force reinitialize
npx claude-flow hive-mind init --force
# Custom configuration
npx claude-flow hive-mind init --config hive-config.json
```
### 2. Spawn a Swarm
```bash
# Basic spawn with objective
npx claude-flow hive-mind spawn "Build microservices architecture"
# Strategic queen type
npx claude-flow hive-mind spawn "Research AI patterns" --queen-type strategic
# Tactical queen with max workers
npx claude-flow hive-mind spawn "Implement API" --queen-type tactical --max-workers 12
# Adaptive queen with consensus
npx claude-flow hive-mind spawn "Optimize system" --queen-type adaptive --consensus byzantine
# Generate Claude Code commands
npx claude-flow hive-mind spawn "Build full-stack app" --claude
```
### 3. Monitor Status
```bash
# Check hive mind status
npx claude-flow hive-mind status
# Get detailed metrics
npx claude-flow hive-mind metrics
# Monitor collective memory
npx claude-flow hive-mind memory
```
- ## Advanced Workflows
- ### Session Management
-
- **Create and Manage Sessions**
-
- ```bash
- # List active sessions
- npx claude-flow hive-mind sessions
-
- # Pause a session
- npx claude-flow hive-mind pause <session-id>
-
- # Resume a paused session
- npx claude-flow hive-mind resume <session-id>
-
- # Stop a running session
- npx claude-flow hive-mind stop <session-id>
- ```
-
- **Session Features**
- - Automatic checkpoint creation
- - Progress tracking with completion percentages
- - Parent-child process management
- - Session logs with event tracking
- - Export/import capabilities
-
- ### Consensus Building
-
- The Hive Mind builds consensus through structured voting:
-
- ```javascript
- // Programmatic consensus building
- const decision = await hiveMind.buildConsensus(
- 'Architecture pattern selection',
- ['microservices', 'monolith', 'serverless']
- );
-
- // Result includes:
- // - decision: Winning option
- // - confidence: Vote percentage
- // - votes: Individual agent votes
- ```
-
- **Consensus Algorithms**
-
- 1. **Majority** - Simple democratic voting
- 2. **Weighted** - Queen has 3x voting power
- 3. **Byzantine** - 2/3 supermajority required
-
- ### Collective Memory
-
- **Storing Knowledge**
-
- ```javascript
- // Store in collective memory
- await memory.store('api-patterns', {
- rest: { pros: [...], cons: [...] },
- graphql: { pros: [...], cons: [...] }
- }, 'knowledge', { confidence: 0.95 });
- ```
-
- **Memory Types**
- - `knowledge`: Permanent insights (no TTL)
- - `context`: Session context (1 hour TTL)
- - `task`: Task-specific data (30 min TTL)
- - `result`: Execution results (permanent, compressed)
- - `error`: Error logs (24 hour TTL)
- - `metric`: Performance metrics (1 hour TTL)
- - `consensus`: Decision records (permanent)
- - `system`: System configuration (permanent)
-
- **Searching and Retrieval**
-
- ```javascript
- // Search memory by pattern
- const results = await memory.search('api*', {
- type: 'knowledge',
- minConfidence: 0.8,
- limit: 50
- });
-
- // Get related memories
- const related = await memory.getRelated('api-patterns', 10);
-
- // Build associations
- await memory.associate('rest-api', 'authentication', 0.9);
- ```
-
- ### Task Distribution
-
- **Automatic Worker Assignment**
-
- The system intelligently assigns tasks based on:
- - Keyword matching with agent specialization
- - Historical performance metrics
- - Worker availability and load
- - Task complexity analysis
-
- ```javascript
- // Create task (auto-assigned)
- const task = await hiveMind.createTask(
- 'Implement user authentication',
- priority: 8,
- { estimatedDuration: 30000 }
- );
- ```
-
- **Auto-Scaling**
-
- ```javascript
- // Configure auto-scaling
- const config = {
- autoScale: true,
- maxWorkers: 12,
- scaleUpThreshold: 2, // Pending tasks per idle worker
- scaleDownThreshold: 2 // Idle workers above pending tasks
- };
- ```
-
- ## Integration Patterns
-
- ### With Claude Code
-
- Generate Claude Code spawn commands directly:
-
- ```bash
- npx claude-flow hive-mind spawn "Build REST API" --claude
- ```
-
- Output:
- ```javascript
- Task("Queen Coordinator", "Orchestrate REST API development...", "coordinator")
- Task("Backend Developer", "Implement Express routes...", "backend-dev")
- Task("Database Architect", "Design PostgreSQL schema...", "code-analyzer")
- Task("Test Engineer", "Create Jest test suite...", "tester")
- ```
-
- ### With SPARC Methodology
-
- ```bash
- # Use hive mind for SPARC workflow
- npx claude-flow sparc tdd "User authentication" --hive-mind
-
- # Spawns:
- # - Specification agent
- # - Architecture agent
- # - Coder agents
- # - Tester agents
- # - Reviewer agents
- ```
-
- ### With GitHub Integration
-
- ```bash
- # Repository analysis with hive mind
- npx claude-flow hive-mind spawn "Analyze repo quality" --objective "owner/repo"
-
- # PR review coordination
- npx claude-flow hive-mind spawn "Review PR #123" --queen-type tactical
- ```
-
- ## Performance Optimization
-
- ### Memory Optimization
-
- The collective memory system includes advanced optimizations:
-
- **LRU Cache**
- - Configurable cache size (default: 1000 entries)
- - Memory pressure handling (default: 50MB)
- - Automatic eviction of least-used entries
-
- **Database Optimization**
- - WAL (Write-Ahead Logging) mode
- - 64MB cache size
- - 256MB memory mapping
- - Prepared statements for common queries
- - Automatic ANALYZE and OPTIMIZE
-
- **Object Pooling**
- - Query result pooling
- - Memory entry pooling
- - Reduced garbage collection pressure
-
- ### Performance Metrics
-
- ```javascript
- // Get performance insights
- const insights = hiveMind.getPerformanceInsights();
-
- // Includes:
- // - asyncQueue utilization
- // - Batch processing stats
- // - Success rates
- // - Average processing times
- // - Memory efficiency
- ```
-
- ### Task Execution
-
- **Parallel Processing**
- - Batch agent spawning (5 agents per batch)
- - Concurrent task orchestration
- - Async operation optimization
- - Non-blocking task assignment
-
- **Benchmarks**
- - 10-20x faster batch spawning
- - 2.8-4.4x speed improvement overall
- - 32.3% token reduction
- - 84.8% SWE-Bench solve rate
-
- ## Configuration
-
- ### Hive Mind Config
-
- ```javascript
- {
- "objective": "Build microservices",
- "name": "my-hive",
- "queenType": "strategic", // strategic | tactical | adaptive
- "maxWorkers": 8,
- "consensusAlgorithm": "byzantine", // majority | weighted | byzantine
- "autoScale": true,
- "memorySize": 100, // MB
- "taskTimeout": 60, // minutes
- "encryption": false
- }
- ```
-
- ### Memory Config
-
- ```javascript
- {
- "maxSize": 100, // MB
- "compressionThreshold": 1024, // bytes
- "gcInterval": 300000, // 5 minutes
- "cacheSize": 1000,
- "cacheMemoryMB": 50,
- "enablePooling": true,
- "enableAsyncOperations": true
- }
- ```
-
- ## Hooks Integration
-
- Hive Mind integrates with Claude Flow hooks for automation:
-
- **Pre-Task Hooks**
- - Auto-assign agents by file type
- - Validate objective complexity
- - Optimize topology selection
- - Cache search patterns
-
- **Post-Task Hooks**
- - Auto-format deliverables
- - Train neural patterns
- - Update collective memory
- - Analyze performance bottlenecks
-
- **Session Hooks**
- - Generate session summaries
- - Persist checkpoint data
- - Track comprehensive metrics
- - Restore execution context
-
- ## Best Practices
-
- ### 1. Choose the Right Queen Type
-
- **Strategic Queens** - For research, planning, and analysis
- ```bash
- npx claude-flow hive-mind spawn "Research ML frameworks" --queen-type strategic
- ```
-
- **Tactical Queens** - For implementation and execution
- ```bash
- npx claude-flow hive-mind spawn "Build authentication" --queen-type tactical
- ```
-
- **Adaptive Queens** - For optimization and dynamic tasks
- ```bash
- npx claude-flow hive-mind spawn "Optimize performance" --queen-type adaptive
- ```
-
- ### 2. Leverage Consensus
-
- Use consensus for critical decisions:
- - Architecture pattern selection
- - Technology stack choices
- - Implementation approach
- - Code review approval
- - Release readiness
-
- ### 3. Utilize Collective Memory
-
- **Store Learnings**
- ```javascript
- // After successful pattern implementation
- await memory.store('auth-pattern', {
- approach: 'JWT with refresh tokens',
- pros: ['Stateless', 'Scalable'],
- cons: ['Token size', 'Revocation complexity'],
- implementation: {...}
- }, 'knowledge', { confidence: 0.95 });
- ```
-
- **Build Associations**
- ```javascript
- // Link related concepts
- await memory.associate('jwt-auth', 'refresh-tokens', 0.9);
- await memory.associate('jwt-auth', 'oauth2', 0.7);
- ```
-
- ### 4. Monitor Performance
-
- ```bash
- # Regular status checks
- npx claude-flow hive-mind status
-
- # Track metrics
- npx claude-flow hive-mind metrics
-
- # Analyze memory usage
- npx claude-flow hive-mind memory
- ```
-
- ### 5. Session Management
-
- **Checkpoint Frequently**
- ```javascript
- // Create checkpoints at key milestones
- await sessionManager.saveCheckpoint(
- sessionId,
- 'api-routes-complete',
- { completedRoutes: [...], remaining: [...] }
- );
- ```
-
- **Resume Sessions**
- ```bash
- # Resume from any previous state
- npx claude-flow hive-mind resume <session-id>
- ```
-
- ## Troubleshooting
-
- ### Memory Issues
-
- **High Memory Usage**
- ```bash
- # Run garbage collection
- npx claude-flow hive-mind memory --gc
-
- # Optimize database
- npx claude-flow hive-mind memory --optimize
-
- # Export and clear
- npx claude-flow hive-mind memory --export --clear
- ```
-
- **Low Cache Hit Rate**
- ```javascript
- // Increase cache size in config
- {
- "cacheSize": 2000,
- "cacheMemoryMB": 100
- }
- ```
-
- ### Performance Issues
-
- **Slow Task Assignment**
- ```javascript
- // Enable worker type caching
- // The system caches best worker matches for 5 minutes
- // Automatic - no configuration needed
- ```
-
- **High Queue Utilization**
- ```javascript
- // Increase async queue concurrency
- {
- "asyncQueueConcurrency": 20 // Default: min(maxWorkers * 2, 20)
- }
- ```
-
- ### Consensus Failures
-
- **No Consensus Reached (Byzantine)**
- ```bash
- # Switch to weighted consensus for more decisive results
- npx claude-flow hive-mind spawn "..." --consensus weighted
-
- # Or use simple majority
- npx claude-flow hive-mind spawn "..." --consensus majority
- ```
-
- ## Advanced Topics
-
- ### Custom Worker Types
-
- Define specialized workers in `.claude/agents/`:
-
- ```yaml
- name: security-auditor
- type: specialist
- capabilities:
- - vulnerability-scanning
- - security-review
- - penetration-testing
- - compliance-checking
- priority: high
- ```
-
- ### Neural Pattern Training
-
- The system trains on successful patterns:
-
- ```javascript
- // Automatic pattern learning
- // Happens after successful task completion
- // Stores in collective memory
- // Improves future task matching
- ```
-
- ### Multi-Hive Coordination
-
- Run multiple hive minds simultaneously:
-
- ```bash
- # Frontend hive
- npx claude-flow hive-mind spawn "Build UI" --name frontend-hive
-
- # Backend hive
- npx claude-flow hive-mind spawn "Build API" --name backend-hive
-
- # They share collective memory for coordination
- ```
-
- ### Export/Import Sessions
-
- ```bash
- # Export session for backup
- npx claude-flow hive-mind export <session-id> --output backup.json
-
- # Import session
- npx claude-flow hive-mind import backup.json
- ```
-
- ## API Reference
-
- ### HiveMindCore
-
- ```javascript
- const hiveMind = new HiveMindCore({
- objective: 'Build system',
- queenType: 'strategic',
- maxWorkers: 8,
- consensusAlgorithm: 'byzantine'
- });
-
- await hiveMind.initialize();
- await hiveMind.spawnQueen(queenData);
- await hiveMind.spawnWorkers(['coder', 'tester']);
- await hiveMind.createTask('Implement feature', 7);
- const decision = await hiveMind.buildConsensus('topic', options);
- const status = hiveMind.getStatus();
- await hiveMind.shutdown();
- ```
-
- ### CollectiveMemory
-
- ```javascript
- const memory = new CollectiveMemory({
- swarmId: 'hive-123',
- maxSize: 100,
- cacheSize: 1000
- });
-
- await memory.store(key, value, type, metadata);
- const data = await memory.retrieve(key);
- const results = await memory.search(pattern, options);
- const related = await memory.getRelated(key, limit);
- await memory.associate(key1, key2, strength);
- const stats = memory.getStatistics();
- const analytics = memory.getAnalytics();
- const health = await memory.healthCheck();
- ```
-
- ### HiveMindSessionManager
-
- ```javascript
- const sessionManager = new HiveMindSessionManager();
-
- const sessionId = await sessionManager.createSession(
- swarmId, swarmName, objective, metadata
- );
-
- await sessionManager.saveCheckpoint(sessionId, name, data);
- const sessions = await sessionManager.getActiveSessions();
- const session = await sessionManager.getSession(sessionId);
- await sessionManager.pauseSession(sessionId);
- await sessionManager.resumeSession(sessionId);
- await sessionManager.stopSession(sessionId);
- await sessionManager.completeSession(sessionId);
- ```
-
- ## Examples
-
- ### Full-Stack Development
-
- ```bash
- # Initialize hive mind
- npx claude-flow hive-mind init
-
- # Spawn full-stack hive
- npx claude-flow hive-mind spawn "Build e-commerce platform" \
- --queen-type strategic \
- --max-workers 10 \
- --consensus weighted \
- --claude
-
- # Output generates Claude Code commands:
- # - Queen coordinator
- # - Frontend developers (React)
- # - Backend developers (Node.js)
- # - Database architects
- # - DevOps engineers
- # - Security auditors
- # - Test engineers
- # - Documentation specialists
- ```
-
- ### Research and Analysis
-
- ```bash
- # Spawn research hive
- npx claude-flow hive-mind spawn "Research GraphQL vs REST" \
- --queen-type adaptive \
- --consensus byzantine
+ ## Reference
- # Researchers gather data
- # Analysts process findings
- # Queen builds consensus on recommendation
- # Results stored in collective memory
- ```
- ### Code Review
+ The full detail lives in `references/` and loads only when needed:
- ```bash
- # Review coordination
- npx claude-flow hive-mind spawn "Review PR #456" \
- --queen-type tactical \
- --max-workers 6
+ - [`references/workflows-and-config.md`](references/workflows-and-config.md) — advanced workflows, integration, performance, configuration, hooks & troubleshooting.
+ - [`references/api-and-examples.md`](references/api-and-examples.md) — aPI reference & examples.
- # Spawns:
- # - Code analyzers
- # - Security reviewers
- # - Performance reviewers
- # - Test coverage analyzers
- # - Documentation reviewers
- # - Consensus on approval/changes
- ```
+ ---
## Skill Progression
### Beginner
1. Initialize hive mind
2. Spawn basic swarms
3. Monitor status
4. Use majority consensus
### Intermediate
1. Configure queen types
2. Implement session management
3. Use weighted consensus
4. Access collective memory
5. Enable auto-scaling
### Advanced
1. Byzantine fault tolerance
2. Memory optimization
3. Custom worker types
4. Multi-hive coordination
5. Neural pattern training
6. Session export/import
7. Performance tuning
## Related Skills
- `swarm-orchestration`: Basic swarm coordination
- `consensus-mechanisms`: Distributed decision making
- `memory-systems`: Advanced memory management
- `sparc-methodology`: Structured development workflow
- `github-integration`: Repository coordination
## References
- [Hive Mind Documentation](https://github.com/ruvnet/claude-flow/docs/hive-mind)
- [Collective Intelligence Patterns](https://github.com/ruvnet/claude-flow/docs/patterns)
- [Byzantine Consensus](https://github.com/ruvnet/claude-flow/docs/consensus)
- [Memory Optimization](https://github.com/ruvnet/claude-flow/docs/memory)
---
**Skill Version**: 1.0.0
**Last Updated**: 2025-10-19
**Maintained By**: Claude Flow Team
**License**: MIT