Arthur Erlich haylan
haylan opened issue haylan/LLM-Server#14 2026-08-25 04:40:05 +00:00
Author the docker-compose service for the chosen proxy
haylan opened issue haylan/LLM-Server#13 2026-08-25 04:39:56 +00:00
Network/hostname plan for exposing the proxy (LAN + external)
haylan opened issue haylan/LLM-Server#12 2026-08-25 04:39:56 +00:00
How should per-workload API keys/accounts be provisioned, rotated, and documented?
haylan opened issue haylan/LLM-Server#11 2026-08-25 04:39:55 +00:00
Reference cloud model/pricing for the shadow-cost estimate
haylan opened issue haylan/LLM-Server#10 2026-08-25 04:39:41 +00:00
Which self-hosted AI gateway/proxy tool fits this effort's needs?
haylan opened issue haylan/LLM-Server#9 2026-08-25 04:39:30 +00:00
AI gateway/proxy: routing, per-workload keys, and cloud-cost estimation for the local LLM stack
haylan pushed to main at haylan/LLM-Server 2026-08-24 16:29:13 +00:00
c01ef8965d Fix docs: no localhost, wire up ai.home / ai.haylan.ch via existing NPM
haylan closed issue haylan/LLM-Server#8 2026-08-24 16:28:23 +00:00
How is ai.home / ai.haylan.ch reverse-proxied and TLS-terminated?
haylan commented on issue haylan/LLM-Server#8 2026-08-24 16:28:23 +00:00
How is ai.home / ai.haylan.ch reverse-proxied and TLS-terminated?

Resolved. No new reverse-proxy service needed — the existing Nginx Proxy Manager (NPM) instance on this network already fronts other self-hosted services and will handle this one too.

-…

haylan opened issue haylan/LLM-Server#8 2026-08-24 16:24:59 +00:00
How is ai.home / ai.haylan.ch reverse-proxied and TLS-terminated?
haylan pushed to main at haylan/LLM-Server 2026-08-24 16:20:50 +00:00
7d8c9324b2 Write local-usage docs for Claude Code CLI, Kimi CLI, and OpenCode CLI
b773d9cb8f research: OpenCode CLI install + local llama.cpp provider config
Compare 2 commits »
haylan closed issue haylan/LLM-Server#6 2026-08-24 16:20:05 +00:00
Write local-usage docs for Claude Code CLI, Kimi CLI, and OpenCode CLI against the local endpoint
haylan commented on issue haylan/LLM-Server#6 2026-08-24 16:20:04 +00:00
Write local-usage docs for Claude Code CLI, Kimi CLI, and OpenCode CLI against the local endpoint

Resolved. Wrote docs/coding-cli-setup.md (linked from README) covering all three CLIs — committed on main (7d8c932).

  • Claude Code CLI: ANTHROPIC_BASE_URL=http://localhost:8080 + dummy…
haylan closed issue haylan/LLM-Server#7 2026-08-24 16:17:37 +00:00
Research OpenCode CLI installation and local-endpoint setup
haylan commented on issue haylan/LLM-Server#7 2026-08-24 16:17:31 +00:00
Research OpenCode CLI installation and local-endpoint setup

Resolved. Full findings: docs/research/opencode-cli-setup.md on branch research/opencode-cli-setup.

Project confirmed: sst/opencode moved orgs — now github.com/anomalyco/opencode

haylan opened issue haylan/LLM-Server#7 2026-08-24 16:13:20 +00:00
Research OpenCode CLI installation and local-endpoint setup
haylan pushed to main at haylan/LLM-Server 2026-08-24 16:10:05 +00:00
408a1f16ae Ignore .claude/ worktree scratch dir
f0e473048d Author docker-compose stack: llama.cpp (ROCm) + Open WebUI + Qdrant + Lazytainer
19d62aefd3 Merge branch 'research/qwen3.8-27b-tool-calling'
ce1ab05c3e docs: research Qwen3.8-27B Unsloth dynamic GGUF quant + VRAM budget
a55fbcaa18 research: Qwen3.8-27B tool-calling compat with llama.cpp Anthropic shim
haylan created branch main in haylan/LLM-Server 2026-08-24 16:10:04 +00:00
haylan commented on issue haylan/LLM-Server#4 2026-08-24 11:01:37 +00:00
Author the docker-compose stack (llama.cpp + Open WebUI + Qdrant + Lazytainer)

Resolved. Authored docker-compose.yml, .env.example, scripts/download-model.sh, and a top-level README.md quickstart — committed on main (f0e4730).

  • llama-server: `ghcr.io/ggml-org…
haylan closed issue haylan/LLM-Server#4 2026-08-24 11:01:21 +00:00
Author the docker-compose stack (llama.cpp + Open WebUI + Qdrant + Lazytainer)