AGENTS.md@src/gnn/llm/providers git:20260906.e62b9e9A

Immutable. This exact content is served forever at /api/v1/blob/38e7683210a79901.

# LLM Provider Sub-module

## Overview

Implements the provider abstraction layer for the LLM module. Each provider implements the `BaseLLMProvider` abstract class, ensuring consistent behavior across different LLM backends.

## Architecture

```
providers/
├── __init__.py                # Provider registry and factory (48 lines)
├── base_provider.py           # Abstract base class defining the provider interface (255 lines)
├── ollama_provider.py         # Ollama local model provider (330 lines)
├── openai_provider.py         # OpenAI API provider (354 lines)
├── openrouter_provider.py     # OpenRouter multi-model gateway (436 lines)
└── perplexity_provider.py     # Perplexity AI provider (419 lines)
```

## Provider Interface

All providers implement `BaseLLMProvider` with these core members:

- **`generate_response(messages, config) → LLMResponse`** — Text generation.
- **`generate_stream(messages, config) → AsyncGenerator`** — Streaming text generation.
- **`get_available_models() → List[str]`** — List models available from this provider.
- **`health_check() → bool`** — Verify provider connectivity.
- **`default_model` / `available_models`** — Properties declaring provider defaults.

## Provider Selection

The provider factory in `__init__.py` selects providers based on:
1. Explicit configuration in `input/config.yaml`
2. Environment variables (`OLLAMA_MODEL`, `OPENAI_API_KEY`, etc.)
3. Fallback chain: Ollama → OpenAI → OpenRouter → Perplexity

## Parent Module

See [llm/AGENTS.md](../AGENTS.md) for the overall LLM architecture.

**Version**: 3.2.0