Files
LLM-Server/docs/research
haylanandClaude Bot a0e5e9704b docs: restructure around source-of-truth pages
- CONTEXT.md glossary
- README reduced to intro, quickstart and doc index
- new architecture.md, gateway.md (from proxy-key-onboarding.md),
  operations.md; network-access.md rewritten
- coding-cli-setup: stale OMNIROUTE_PORT:-4000 endpoint, terms and
  duplicated per-slot/classifier explanations fixed
- research/README.md index; proxy-request-priority.md moved there as
  superseded

Every doc names keys instead of restating values and links its source.

Refs #55 (#56, #57, #59, #60)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-24 21:51:01 +02:00
..

Research index

← back to README

Each file here is a dated snapshot: research or a decision record as it stood when it was written. The files are never edited afterwards, and their status lives only in this table. A superseded doc is kept as history. Read it for why a choice was made, never for how the stack works today (for that, see architecture.md and the source it links).

Doc Status Note
500k-context-2-parallel-agents-gpu-roadmap.md Background research Hardware exploration for larger contexts. Not an active plan, and neither is ../server-planing.md, whatever this doc says about it
classifier-context-window-scaling.md Current Classifier model sizing decision
colibri-ai-stack-evaluation.md Current Rejected option ("watch, don't integrate"). It lists ComfyUI, which has since been removed
connecting-cloud-providers.md Superseded by the OmniRoute migration Written for LiteLLM. It mentions Open WebUI, which has been removed
dashscope-websearch-selfhost-options.md Current Why DashScope web search isn't emulated
fast-model-choice.md Current (drift) Classifier model choice. Its addendum records the service name (qwen-classifier) and quant drift
langchain-pgvector-vs-litellm-pgvector.md Superseded by the OmniRoute migration LiteLLM-era RAG comparison
lazytainer-omniroute-idle-stop.md Superseded: Lazytainer and switch-model.sh removed Root cause of why Lazytainer's idle-stop never fired behind the gateway, which is the reason it was removed
litellm-knowledgebase.md Superseded by the OmniRoute migration LiteLLM vector-store feature. Its claim that Open WebUI is qdrant's only user no longer holds
litellm-searxng-search.md Superseded by omniroute-qwen-websearch.md Still the origin of the search.home DNS gotcha (gateway → Web search)
omniroute-account-semaphore-timeout.md Current Gateway timeout: per-connection semaphore
omniroute-direct-response-timeout-outage-2026-09-15.md Current Gateway timeout: direct response headers, plus the ROCm stall incident
omniroute-memory-tool-injection-breaks-classifier.md Current Memory tools must stay off for the classifier connection
omniroute-non-ping-sse-stream-timeout.md Current Gateway timeout: first non-ping SSE event, and why --cache-reuse is set
omniroute-qwen-websearch.md Current Qwen Code routing and web search through the gateway
opencode-auto-compact.md Current OpenCode's client-side compaction
opencode-cli-setup.md Current (drift) The provider JSON shape is valid, but its base URL points at a backend directly. Use the gateway (setup)
ponytail-audit-2026-09-09.md Superseded (point-in-time audit) Findings are fixed or folded into the docs cleanup
proxy-request-priority.md Superseded by the OmniRoute migration Priority tiers via LiteLLM's scheduler, never built on OmniRoute
proxy-shadow-pricing.md Superseded by the OmniRoute migration Shadow cost was wired into LiteLLM config, and nothing implements it now
proxy-tool-choice.md Superseded by the OmniRoute migration Chose LiteLLM. It mentions Open WebUI, which has been removed
qwen3.8-27b-quant.md Current Main model quant and VRAM budget
qwen3.8-27b-tool-calling.md Current Tool-calling parser risk for the main model
rocm-gpu-pin-and-render-group.md Current (name drift) Findings apply to llama-server + qwen-classifier. The service names in it are older
voidllm-evaluation.md Superseded by the OmniRoute migration VoidLLM vs. LiteLLM, both moot