fix(llm): drop --cache-reuse, unsupported by this model's context

Startup log: 'cache_reuse is not supported by this context, it will be disabled'.
Correct architecture.md, which claimed it fixed the SSE timeout.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
This commit is contained in:
haylanandClaude Bot committed 2026-10-20 21:12:07 +02:00
1 parent 408ed3e586
commit f4bc4dd7fa
2 files changed
+1 -2

No files matched your search

-1
View File
@@ -27,7 +27,6 @@ services:
--flash-attn on
--cache-type-k q8_0
--cache-type-v q8_0
--cache-reuse 256
--cache-ram ${LLAMA_CACHE_RAM:-24576}
--spec-type draft-dflash
-md /models/${LLAMA_DRAFT_MODEL_FILE:-Qwen3.8-27B-DFlash2-Q4_K_M.gguf}