haylan/LLM-Server
1
0 Fork 0
Code Issues 4 Pull Requests Actions Packages Projects Releases Wiki Activity
163 Commits 1 Branch 0 Tags
6ce527741b5faf94e263aef43d3846719481333c
Commit Graph
6 Commits
Author SHA1 Message Date
haylan 9fbdf3e664 Merge pull request 'Feat/dual gpu' (#67) from feat/dual-gpu into main 
Reviewed-on: #67
 2026-11-04 06:23:16 +00:00
haylanandClaude Bot 1484907ff8 docs(research): add inference engine, spec decoding and multi-GPU research 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 2026-11-02 19:42:45 +01:00
haylan baf54002cd Update README.md 2026-10-31 16:24:33 +01:00
haylanandClaude Bot 408ed3e586 feat(llm): raise prompt cache RAM budget via --cache-ram 
Log shows 253 prompt-cache evictions and 146 full ~42k re-prefills at the default budget.
Add LLAMA_CACHE_RAM and the throughput-tuning research note.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-20 21:05:27 +02:00
haylanandClaude Bot 433ebc6597 docs(research): mark opencode-cli-setup as v1-era 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 21:36:27 +02:00
haylanandClaude Bot a0e5e9704b docs: restructure around source-of-truth pages 
- CONTEXT.md glossary
- README reduced to intro, quickstart and doc index
- new architecture.md, gateway.md (from proxy-key-onboarding.md),
  operations.md; network-access.md rewritten
- coding-cli-setup: stale OMNIROUTE_PORT:-4000 endpoint, terms and
  duplicated per-slot/classifier explanations fixed
- research/README.md index; proxy-request-priority.md moved there as
  superseded

Every doc names keys instead of restating values and links its source.

Refs #55 (#56, #57, #59, #60)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-24 21:51:01 +02:00