Files
LLM-Server/models.yml
T
haylanandClaude Bot 7d142ed59d fix(models): correct DFlash2 Q8_0 drafter download URL
The URL used the filename as the Hugging Face repo name. Also align
the compose fallback for LLAMA_DRAFT_MODEL_FILE with Q8_0.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-31 17:01:27 +01:00

8 lines
456 B
YAML

# Model files the downloader fetches into the models volume; see docs/operations.md#model-downloads
# `file` must match the LLAMA_*_FILE value in .env that loads it.
models:
- file: Qwen3.8-27B-UD-Q4_K_XL.gguf
url: https://huggingface.co/unsloth/Qwen3.8-27B-GGUF/resolve/main/Qwen3.8-27B-UD-Q4_K_XL.gguf
- file: Qwen3.8-27B-DFlash2-Q8_0.gguf
url: https://huggingface.co/z-lab/Qwen3.8-27B-DFlash2-GGUF/resolve/main/Qwen3.8-27B-DFlash2-Q8_0.gguf