Arthur Erlich

haylan commented on issue haylan/LLM-Server#26

2026-09-03 04:43:40 +00:00

opencode: context size and compaction settings for the litellm/qwen3.8-27b-local stack

limit.context in ~/.config/opencode/opencode.json bumped 65536 -> 131072: the server's live LLAMA_CTX_SIZE was changed directly on the box, ahead of merging the ctx-size-128k branch into this…

haylan commented on issue haylan/LLM-Server#29

2026-09-03 04:42:16 +00:00

Point opencode's provider block at litellm.home with a virtual key

Done: provider block added to ~/.config/opencode/opencode.json (baseURL http://litellm.home/v1, model id qwen3.8-27b-local matching litellm's model_name, virtual key supplied directly by the user…

haylan commented on issue haylan/LLM-Server#28

2026-09-03 04:42:15 +00:00

Should opencode's context/output limits be generated from litellm-config.yaml, or hand-maintained?

Decided in practice, not via a generator script: opencode's limit.context/limit.output are hand-set in ~/.config/opencode/opencode.json (65536/16384, matching what's currently live), with an…

haylan closed issue haylan/LLM-Server#29

2026-09-03 04:42:01 +00:00

Point opencode's provider block at litellm.home with a virtual key

haylan closed issue haylan/LLM-Server#28

2026-09-03 04:42:00 +00:00

Should opencode's context/output limits be generated from litellm-config.yaml, or hand-maintained?

haylan pushed to ctx-size-128k at haylan/LLM-Server

2026-09-03 04:35:50 +00:00

c5864beec9 feat(llama.cpp): raise default context to 128K, document RAM/SSD offload knobs

haylan created branch ctx-size-128k in haylan/LLM-Server

2026-09-03 04:35:50 +00:00

haylan commented on issue haylan/LLM-Server#27

2026-09-03 04:26:22 +00:00

How does opencode's auto-compact actually work — trigger threshold and config surface?

Researched OpenCode's auto-compact mechanism directly from source (anomalyco/opencode @ b578b72, v1.18.27, cloned 2026-09-03) plus live docs.opencode.ai fetches.

Key findings — full writeup at…

haylan closed issue haylan/LLM-Server#27

2026-09-03 04:26:08 +00:00

How does opencode's auto-compact actually work — trigger threshold and config surface?

haylan opened issue haylan/LLM-Server#29

2026-09-03 04:19:56 +00:00

Point opencode's provider block at litellm.home with a virtual key

haylan opened issue haylan/LLM-Server#28

2026-09-03 04:19:45 +00:00

Should opencode's context/output limits be generated from litellm-config.yaml, or hand-maintained?

haylan opened issue haylan/LLM-Server#27

2026-09-03 04:19:33 +00:00

How does opencode's auto-compact actually work — trigger threshold and config surface?

haylan opened issue haylan/LLM-Server#26

2026-09-03 04:19:22 +00:00

opencode: context size and compaction settings for the litellm/qwen3.8-27b-local stack

haylan pushed to main at haylan/LLM-Server

2026-09-02 21:53:45 +00:00

124053cf89 feat(scripts): auto-register memory-and-notes in litellm's DB for the Admin UI

haylan pushed to main at haylan/LLM-Server

2026-09-02 21:35:27 +00:00

47bdb22457 docs: record issue #24's smoke-test findings and local litellm-pgvector patches

7e8b5069d4 fix(scripts): update.sh never applied litellm-pgvector's db schema

eaf11b6d4b fix(scripts): ingest-memory.sh never actually computed embeddings

213550e44b fix(litellm): prefix EMBEDDING__MODEL with openai/ for litellm-pgvector

3eda4e3ec0 fix(litellm-pgvector): honor caller-supplied id on vector store create

Compare 7 commits »

haylan pushed to main at haylan/LLM-Server

2026-09-02 21:08:01 +00:00

e2dd106f74 feat(scripts): fold model downloads into update.sh, skip if already present

haylan pushed to main at haylan/LLM-Server

2026-09-02 21:00:00 +00:00

fb7cfc9148 fix(litellm): raise qwen3.8-27b-local max_tokens floor 4096 -> 16384

haylan pushed to main at haylan/LLM-Server

2026-09-02 20:55:45 +00:00

30a8523433 fix(lazytainer): drop network_mode: host, join ai-stack (fixes self-ID panic)

haylan pushed to main at haylan/LLM-Server

2026-09-02 20:48:02 +00:00

c7848f356a chore(scripts): mark update.sh executable

haylan pushed to main at haylan/LLM-Server

2026-09-02 20:47:20 +00:00

cb9b3a9045 fix(docs): update stale MEMORY_RETRIEVAL_EMBEDDING_KEY refs after litellm-pgvector revert

e7983f0710 Revert "feat(knowledgebase): replace litellm-pgvector connector with memory-retrieval"

Compare 2 commits »