fix(llm): drop --cache-reuse, unsupported by this model's context
Startup log: 'cache_reuse is not supported by this context, it will be disabled'. Correct architecture.md, which claimed it fixed the SSE timeout. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
408ed3e586
commit
f4bc4dd7fa
2 files changed
+1
-2
No files matched your search
@@ -27,7 +27,6 @@ services:
|
||||
--flash-attn on
|
||||
--cache-type-k q8_0
|
||||
--cache-type-v q8_0
|
||||
--cache-reuse 256
|
||||
--cache-ram ${LLAMA_CACHE_RAM:-24576}
|
||||
--spec-type draft-dflash
|
||||
-md /models/${LLAMA_DRAFT_MODEL_FILE:-Qwen3.8-27B-DFlash2-Q4_K_M.gguf}
|
||||
|
||||
Reference in new issue
Block a user