haylan/LLM-Server
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity

chore(env): set LLAMA_CACHE_RAM to 0 in .env.example

Browse Source
This commit is contained in:
haylan committed 2026-10-31 19:04:40 +01:00
1 parent c25e7e835f
commit a89cccb3d5
1 file changed
+1 -1
Download Patch File Download Diff File Expand all files Collapse all files
.env.example
+1 -1
View File
@@ -5,7 +5,7 @@ LLAMA_MODEL_FILE=Qwen3.8-27B-UD-Q4_K_XL.gguf
LLAMA_GPU_LAYERS=999 LLAMA_GPU_LAYERS=999
LLAMA_CTX_SIZE=262144 LLAMA_CTX_SIZE=262144
LLAMA_PARALLEL=2 LLAMA_PARALLEL=2
LLAMA_CACHE_RAM=8192 LLAMA_CACHE_RAM=0
LLAMA_KV_CACHE_TYPE=q8_0 LLAMA_KV_CACHE_TYPE=q8_0
# Blank = speculative decoding off; see docs/architecture.md#llama-server # Blank = speculative decoding off; see docs/architecture.md#llama-server