haylanandClaude Bot 408ed3e586 feat(llm): raise prompt cache RAM budget via --cache-ram ...

Log shows 253 prompt-cache evictions and 146 full ~42k re-prefills at the default budget.
Add LLAMA_CACHE_RAM and the throughput-tuning research note.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

2026-10-20 21:05:27 +02:00

..

agents

docs(agents): add writing-docs guide and new-term procedure

2026-09-24 21:52:19 +02:00

coding-cli-setup

docs(opencode): document v2 config, mark v1 deprecated

2026-10-05 21:32:58 +02:00

research

feat(llm): raise prompt cache RAM budget via --cache-ram

2026-10-20 21:05:27 +02:00

architecture.md

feat(llm): raise prompt cache RAM budget via --cache-ram

2026-10-20 21:05:27 +02:00

gateway.md

feat(llm): switch to DFlash2 speculative decoding, drop qwen-classifier

2026-10-05 21:28:55 +02:00

network-access.md

feat(llm): switch to DFlash2 speculative decoding, drop qwen-classifier

2026-10-05 21:28:55 +02:00

operations.md

docs: restructure around source-of-truth pages

2026-09-24 21:51:01 +02:00

server-planing.md

Add build plan documentation for 4x Radeon AI PRO R9700 rackmount LLM server

2026-08-25 07:20:58 +02:00