Research index
Each file here is a dated snapshot: research or a decision record as it stood when it was written. The files are never edited afterwards, and their status lives only in this table. A superseded doc is kept as history. Read it for why a choice was made, never for how the stack works today (for that, see architecture.md and the source it links).
| Doc | Status | Note |
|---|---|---|
| 500k-context-2-parallel-agents-gpu-roadmap.md | Background research | Hardware exploration for larger contexts. Not an active plan, and neither is ../server-planing.md, whatever this doc says about it |
| classifier-context-window-scaling.md | Current | Classifier model sizing decision |
| colibri-ai-stack-evaluation.md | Current | Rejected option ("watch, don't integrate"). It lists ComfyUI, which has since been removed |
| connecting-cloud-providers.md | Superseded by the OmniRoute migration | Written for LiteLLM. It mentions Open WebUI, which has been removed |
| dashscope-websearch-selfhost-options.md | Current | Why DashScope web search isn't emulated |
| fast-model-choice.md | Current (drift) | Classifier model choice. Its addendum records the service name (qwen-classifier) and quant drift |
| langchain-pgvector-vs-litellm-pgvector.md | Superseded by the OmniRoute migration | LiteLLM-era RAG comparison |
| lazytainer-omniroute-idle-stop.md | Superseded: Lazytainer and switch-model.sh removed |
Root cause of why Lazytainer's idle-stop never fired behind the gateway, which is the reason it was removed |
| litellm-knowledgebase.md | Superseded by the OmniRoute migration | LiteLLM vector-store feature. Its claim that Open WebUI is qdrant's only user no longer holds |
| litellm-searxng-search.md | Superseded by omniroute-qwen-websearch.md | Still the origin of the search.home DNS gotcha (gateway → Web search) |
| omniroute-account-semaphore-timeout.md | Current | Gateway timeout: per-connection semaphore |
| omniroute-direct-response-timeout-outage-2026-09-15.md | Current | Gateway timeout: direct response headers, plus the ROCm stall incident |
| omniroute-memory-tool-injection-breaks-classifier.md | Current | Memory tools must stay off for the classifier connection |
| omniroute-non-ping-sse-stream-timeout.md | Current | Gateway timeout: first non-ping SSE event, and why --cache-reuse is set |
| omniroute-qwen-websearch.md | Current | Qwen Code routing and web search through the gateway |
| opencode-auto-compact.md | Current | OpenCode's client-side compaction |
| opencode-cli-setup.md | Superseded (v1-era) | Written for OpenCode v1. Its config shape (provider, npm, options) is deprecated, and its base URL points at a backend directly. Use the gateway and the v2 config (setup) |
| ponytail-audit-2026-09-09.md | Superseded (point-in-time audit) | Findings are fixed or folded into the docs cleanup |
| proxy-request-priority.md | Superseded by the OmniRoute migration | Priority tiers via LiteLLM's scheduler, never built on OmniRoute |
| proxy-shadow-pricing.md | Superseded by the OmniRoute migration | Shadow cost was wired into LiteLLM config, and nothing implements it now |
| proxy-tool-choice.md | Superseded by the OmniRoute migration | Chose LiteLLM. It mentions Open WebUI, which has been removed |
| inference-engine-spec-decoding-multi-gpu.md | Current | llama.cpp vs. vLLM vs. SGLang on R9700: drafters, multi-GPU, licenses, --cache-ram misspelling bug. Not benchmarked |
| qwen3.8-27b-quant.md | Current | Main model quant and VRAM budget |
| qwen3.8-27b-throughput-tuning.md | Current | Tokens/s tuning from the server log, DDR RAM as a cache tier, comparison with five outside R9700 configs. Proposals only, nothing applied |
| qwen3.8-27b-tool-calling.md | Current | Tool-calling parser risk for the main model |
| rocm-gpu-pin-and-render-group.md | Current (name drift) | Findings apply to llama-server + qwen-classifier. The service names in it are older |
| voidllm-evaluation.md | Superseded by the OmniRoute migration | VoidLLM vs. LiteLLM, both moot |