Arthur Erlich haylan
0 Followers · 0 Following
Repositories
12
 Projects Packages Public Activity Starred Repositories
2
haylan commented on issue haylan/LLM-Server#40 2026-09-05 18:57:36 +00:00
Why lazytainer idle-stop doesn't work today, and how the switch script should handle it

Confirmed: lazytainer's packet-threshold detector (gopacket/libpcap BPF filter on the port, counting every packet, no source/traffic-class filtering — confirmed in vmorganp/Lazytainer source)…

haylan pushed to main at haylan/LLM-Server 2026-09-05 18:57:28 +00:00
451d5c7b28 docs(research): confirm lazytainer/omniroute idle-stop conflict (#40)
haylan opened issue haylan/LLM-Server#43 2026-09-05 17:36:39 +00:00
scripts/switch-model.sh: swap GPU residency between Qwen and ComfyUI
haylan opened issue haylan/LLM-Server#42 2026-09-05 17:36:38 +00:00
Extend downloader for the diffusion model weights
haylan opened issue haylan/LLM-Server#41 2026-09-05 17:36:37 +00:00
Add comfyui service to docker-compose.yml, register with OmniRoute
haylan opened issue haylan/LLM-Server#40 2026-09-05 17:36:36 +00:00
Why lazytainer idle-stop doesn't work today, and how the switch script should handle it
haylan opened issue haylan/LLM-Server#39 2026-09-05 17:36:34 +00:00
Best diffusion model given full ~32GB headroom (Qwen stopped)
haylan opened issue haylan/LLM-Server#38 2026-09-05 17:36:14 +00:00
Local image generation via ComfyUI + OmniRoute
haylan pushed to main at haylan/LLM-Server 2026-09-05 10:00:11 +00:00
d8736b6dd7 fix(llama-server): quantize KV cache, restore full 262144 context
haylan pushed to main at haylan/LLM-Server 2026-09-05 09:32:21 +00:00
5767f548c3 perf(llama-server): enable flash attention
haylan pushed to main at haylan/LLM-Server 2026-09-05 09:29:16 +00:00
633292b291 fix(omniroute): raise stream-idle timeout to 180s
haylan pushed to main at haylan/LLM-Server 2026-09-05 09:26:39 +00:00
23e90fe8fb fix(llama-server): cap concurrent slots at 2 to curb prefill contention
haylan pushed to main at haylan/LLM-Server 2026-09-04 19:47:45 +00:00
ae812cd9e0 feat(ctx): larger context size
haylan pushed to main at haylan/LLM-Server 2026-09-03 20:20:17 +00:00
9e9cac254b feat(stack): drop qdrant and embedding-server, use OmniRoute's built-in memory
haylan pushed to main at haylan/LLM-Server 2026-09-03 19:43:30 +00:00
9e1362c22c feat(omniroute): add dedicated embedding-server for memory feature
haylan pushed to main at haylan/LLM-Server 2026-09-03 19:19:16 +00:00
885de477ba feat(stack): bring back qdrant as OmniRoute's memory vector store
haylan pushed to main at haylan/LLM-Server 2026-09-03 18:49:34 +00:00
c795993a64 fix(omniroute): publish API and dashboard ports directly, drop OMNIROUTE_PORT
haylan pushed to main at haylan/LLM-Server 2026-09-03 18:37:59 +00:00
c38375c0f4 fix(omniroute): add required WS bridge secret, memory ceiling, shutdown grace period
haylan pushed to main at haylan/LLM-Server 2026-09-03 18:28:31 +00:00
6132e6263e docs: fix gateway hostname to proxy-ai.home/proxy-ai.haylan.ch
haylan pushed to main at haylan/LLM-Server 2026-09-03 18:17:18 +00:00
90ef1a1061 fix(omniroute): keep the gateway published on host port 4000