feat: remove llama-server-fast (Qwen3-4B classifier model) #51

Merged

haylan merged 1 commits from remove-fast-model into main

2026-09-07 17:56:27 +00:00

Author	SHA1	Message	Date
haylanandClaude-Bot	5d6a17fd9b	feat: remove llama-server-fast (Qwen3-4B classifier model) Drops the second always-resident llama.cpp instance, its downloader, and the omniroute depends_on entry. Also strips the now-dead LLAMA_FAST_* block from .env.example and the stale VRAM-budget comment in scripts/switch-model.sh that assumed this service was always up. Note: this was qwen-code's Auto Mode Stage 1 classifier (fastModel) — see docs/research/fast-model-choice.md and issue #44. Auto Mode will lose that classifier until/unless it's reconfigured to route elsewhere or fall back to prompt-only classification. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01DjhxWirQepKFEQj1huXNJR	2026-09-07 19:33:50 +02:00

Author

SHA1

Message

Date

haylanandClaude-Bot

5d6a17fd9b

feat: remove llama-server-fast (Qwen3-4B classifier model)

Drops the second always-resident llama.cpp instance, its downloader,
and the omniroute depends_on entry. Also strips the now-dead
LLAMA_FAST_* block from .env.example and the stale VRAM-budget comment
in scripts/switch-model.sh that assumed this service was always up.

Note: this was qwen-code's Auto Mode Stage 1 classifier (fastModel) —
see docs/research/fast-model-choice.md and issue #44. Auto Mode will
lose that classifier until/unless it's reconfigured to route
elsewhere or fall back to prompt-only classification.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01DjhxWirQepKFEQj1huXNJR

2026-09-07 19:33:50 +02:00