haylanandClaude Bot
8927e440aa
Move all speculative-decoding flags into LLAMA_SPEC_ARGS (blank = off) and the KV cache quant into LLAMA_KV_CACHE_TYPE, so token-corruption A/B tests are a single .env edit instead of a compose edit. Replaces LLAMA_DRAFT_MODEL_FILE and LLAMA_SPEC_N_MAX. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
8 lines
488 B
YAML
8 lines
488 B
YAML
# Model files the downloader fetches into the models volume; see docs/operations.md#model-downloads
|
|
# `file` must match the name in .env that loads it (LLAMA_MODEL_FILE, or -md in LLAMA_SPEC_ARGS).
|
|
models:
|
|
- file: Qwen3.8-27B-UD-Q4_K_XL.gguf
|
|
url: https://huggingface.co/unsloth/Qwen3.8-27B-GGUF/resolve/main/Qwen3.8-27B-UD-Q4_K_XL.gguf
|
|
- file: Qwen3.8-27B-DFlash2-Q8_0.gguf
|
|
url: https://huggingface.co/z-lab/Qwen3.8-27B-DFlash2-GGUF/resolve/main/Qwen3.8-27B-DFlash2-Q8_0.gguf
|