haystack-pipeline ยท diff
git:20260507.313363d to git:20260507.50823d8
4 added, 0 removed. Audit A to A.
---
name: haystack-pipeline
description: Haystack NLP pipeline configuration for document processing and QA
allowed-tools:
- Read
- Write
- Edit
- Bash
- Glob
- Grep
graph:
domains: [domain:software-engineering]
+ specializations: [specialization:ai-agents-conversational]
+ skillAreas: [skill-area:natural-language-processing]
+ roles: [role:ml-engineer, role:backend-engineer]
+ workflows: [workflow:ml-model-lifecycle, workflow:feature-development]
---
# Haystack Pipeline Skill
## Capabilities
- Configure Haystack pipeline components
- Set up document stores and retrievers
- Implement reader/generator models
- Design custom pipeline graphs
- Configure preprocessing pipelines
- Implement evaluation pipelines
## Target Processes
- rag-pipeline-implementation
- intent-classification-system
## Implementation Details
### Core Components
1. **DocumentStores**: Elasticsearch, Weaviate, FAISS, etc.
2. **Retrievers**: BM25, Dense, Hybrid
3. **Readers/Generators**: Extractive and generative QA
4. **Preprocessors**: Document cleaning and splitting
### Pipeline Types
- Retrieval pipelines
- RAG pipelines
- Evaluation pipelines
- Indexing pipelines
### Configuration Options
- Component selection
- Pipeline graph design
- Document store backend
- Model selection
- Preprocessing settings
### Best Practices
- Modular pipeline design
- Proper preprocessing
- Evaluation integration
- Component versioning
### Dependencies
- haystack-ai
- farm-haystack (legacy)