llm-streaming · git:20261004.4bb7222 · 2026-10-04 · sha256 cfae0c0a265f3734

llm-streaming git:20261004.4bb7222A

Immutable. This exact content never changes and is served at /api/v1/blob/cfae0c0a265f3734.

---
description: Streaming completion safety and protocol termination
globs:
  - "internal/llm/**/*.go"
  - "internal/agent/**/*.go"
  - "external/httpserver/**/*stream*.go"
  - "features/llm_stream*.feature"
  - "features/llamacpp_openai_stream.feature"
  - "features/openai_stream_compat.feature"
alwaysApply: false
---
# LLM streaming

- Never retry after any visible delta has been emitted.
- Cancellation, truncation, and idle-stall errors retain partial content.
- Require the protocol terminal event where specified; clean EOF alone is not success.
- Accept legal SSE comments and blank frames. Malformed non-empty frames produce bounded diagnostic errors.
- A filtered view emits keepalive comments for swallowed frames or owns an independent idle timer.