Arthur Erlich

haylan pushed to main at haylan/LLM-Server

2026-09-03 18:09:09 +00:00

977e9d3dd7 fix(omniroute): healthcheck used python3, which the image doesn't have

haylan commented on issue haylan/LLM-Server#37

2026-09-03 17:55:56 +00:00

OmniRoute: docker-compose service design and secrets/config plan

Follow-up (commit 3bbda09): Open WebUI and Qdrant removed from the stack entirely per user request — no longer needed, every client is now a coding CLI. This drops the open-webui service, its…

haylan pushed to main at haylan/LLM-Server

2026-09-03 17:55:41 +00:00

3bbda098b3 feat(stack): remove Open WebUI and Qdrant

haylan pushed to main at haylan/LLM-Server

2026-09-03 17:49:58 +00:00

472e3a4738 feat(gateway): migrate LiteLLM to OmniRoute, drop the memory/knowledgebase feature

haylan commented on issue haylan/LLM-Server#37

2026-09-03 17:49:53 +00:00

OmniRoute: docker-compose service design and secrets/config plan

Implemented on main (commit 472e3a4): docker-compose.yml, .env.example, scripts/update.sh, and docs updated per the design above. Also, separately, the user asked to drop the gateway-level…

haylan closed issue haylan/LLM-Server#37

2026-09-03 17:38:46 +00:00

OmniRoute: docker-compose service design and secrets/config plan

haylan commented on issue haylan/LLM-Server#37

2026-09-03 17:38:45 +00:00

OmniRoute: docker-compose service design and secrets/config plan

Resolved — design captured in the issue body above. Proceeding to implementation on main (docker-compose.yml, .env.example, scripts/update.sh).

haylan opened issue haylan/LLM-Server#37

2026-09-03 17:38:36 +00:00

OmniRoute: docker-compose service design and secrets/config plan

haylan pushed to main at haylan/LLM-Server

2026-09-03 17:36:03 +00:00

4fe910a5f3 docs(agents): fix tea comment syntax, note map-edit race condition

haylan deleted branch research/voidllm-evaluation from haylan/LLM-Server

2026-09-03 17:35:17 +00:00

haylan deleted branch research/proxy-tool-choice from haylan/LLM-Server

2026-09-03 17:35:17 +00:00

haylan deleted branch research/proxy-shadow-pricing from haylan/LLM-Server

2026-09-03 17:35:15 +00:00

haylan deleted branch research/litellm-searxng-search from haylan/LLM-Server

2026-09-03 17:35:14 +00:00

haylan deleted branch research/litellm-knowledgebase from haylan/LLM-Server

2026-09-03 17:35:14 +00:00

haylan deleted branch research/langchain-pgvector-vs-litellm-pgvector from haylan/LLM-Server

2026-09-03 17:35:12 +00:00

haylan deleted branch research/connecting-cloud-providers from haylan/LLM-Server

2026-09-03 17:35:12 +00:00

haylan commented on issue haylan/LLM-Server#36

2026-09-03 17:33:00 +00:00

OmniRoute: per-workload virtual keys, admin UI, and deployment shape (Docker/compose)

Second correction — the previous correction was wrong. The files exist. I'd checked the `main` branch; the original research (and this repo's actual release line) is on `release/v3.8.51`.…

haylan commented on issue haylan/LLM-Server#36

2026-09-03 17:28:21 +00:00

OmniRoute: per-workload virtual keys, admin UI, and deployment shape (Docker/compose)

Correction: the earlier resolution comment's claim that this repo's docs include STEALTH_GUIDE.md, MITM-TPROXY-DECRYPT.md, and PUBLIC_CREDS.md does not hold up. Verified directly:

A…

haylan closed issue haylan/LLM-Server#32

2026-09-03 17:24:11 +00:00

OmniRoute: can it route to arbitrary OpenAI-compatible local endpoints (llama-server), not just Ollama?

haylan commented on issue haylan/LLM-Server#32

2026-09-03 17:24:07 +00:00

OmniRoute: can it route to arbitrary OpenAI-compatible local endpoints (llama-server), not just Ollama?

Answer: No, OmniRoute is not Ollama-only. It supports arbitrary OpenAI-compatible api_base for both chat and embeddings, verified from primary source (github.com/diegosouzapw/OmniRoute, main…