Arthur Erlich haylan
0 Followers · 0 Following
Repositories
12
 Projects Packages Public Activity Starred Repositories
2
haylan reopened issue haylan/LLM-Server#32 2026-09-03 17:24:04 +00:00
OmniRoute: can it route to arbitrary OpenAI-compatible local endpoints (llama-server), not just Ollama?
haylan closed issue haylan/LLM-Server#32 2026-09-03 17:23:55 +00:00
OmniRoute: can it route to arbitrary OpenAI-compatible local endpoints (llama-server), not just Ollama?
haylan closed issue haylan/LLM-Server#36 2026-09-03 17:21:22 +00:00
OmniRoute: per-workload virtual keys, admin UI, and deployment shape (Docker/compose)
haylan closed issue haylan/LLM-Server#35 2026-09-03 17:21:18 +00:00
OmniRoute: web-search tool equivalent to the SearXNG standalone endpoint
haylan commented on issue haylan/LLM-Server#35 2026-09-03 17:21:13 +00:00
OmniRoute: web-search tool equivalent to the SearXNG standalone endpoint

Answer: Yes — OmniRoute has a native standalone REST search API equivalent to LiteLLM's search_tools, plus its own SSRF/egress opt-in for LAN targets.

**1. Standalone REST endpoint,…

haylan commented on issue haylan/LLM-Server#36 2026-09-03 17:21:12 +00:00
OmniRoute: per-workload virtual keys, admin UI, and deployment shape (Docker/compose)

Findings (from github.com/diegosouzapw/OmniRoute, checked out at release/v3.8.51, its default branch)

**1. Per-workload key scoping / mintable-via-API equivalent to /key/generate: yes,…

haylan closed issue haylan/LLM-Server#33 2026-09-03 17:20:59 +00:00
OmniRoute due-diligence: maintainer, repo history, npm package trust
haylan commented on issue haylan/LLM-Server#33 2026-09-03 17:20:55 +00:00
OmniRoute due-diligence: maintainer, repo history, npm package trust

Findings

Maintainer/repo (github.com/diegosouzapw/OmniRoute): Legitimate, large, active OSS project — 60.8k stars, 8.4k forks, 550+ contributors, 8,242+ commits, MIT license, first…

haylan closed issue haylan/LLM-Server#34 2026-09-03 17:20:50 +00:00
OmniRoute: memory/knowledgebase parity with litellm-pgvector
haylan commented on issue haylan/LLM-Server#34 2026-09-03 17:20:46 +00:00
OmniRoute: memory/knowledgebase parity with litellm-pgvector

No parity — keep vendor/litellm-pgvector as-is. Researched directly from github.com/diegosouzapw/OmniRoute (docs/frameworks/MEMORY.md and docs/frameworks/LOCAL_CORPUS_CONTEXT.md, raw.githubusercon…

haylan opened issue haylan/LLM-Server#36 2026-09-03 17:18:11 +00:00
OmniRoute: per-workload virtual keys, admin UI, and deployment shape (Docker/compose)
haylan opened issue haylan/LLM-Server#35 2026-09-03 17:18:05 +00:00
OmniRoute: web-search tool equivalent to the SearXNG standalone endpoint
haylan opened issue haylan/LLM-Server#34 2026-09-03 17:17:58 +00:00
OmniRoute: memory/knowledgebase parity with litellm-pgvector
haylan opened issue haylan/LLM-Server#33 2026-09-03 17:17:47 +00:00
OmniRoute due-diligence: maintainer, repo history, npm package trust
haylan opened issue haylan/LLM-Server#32 2026-09-03 17:17:39 +00:00
OmniRoute: can it route to arbitrary OpenAI-compatible local endpoints (llama-server), not just Ollama?
haylan opened issue haylan/LLM-Server#31 2026-09-03 17:17:29 +00:00
Migrate the AI gateway from LiteLLM to OmniRoute
haylan deleted branch ctx-size-128k from haylan/LLM-Server 2026-09-03 04:44:35 +00:00
haylan pushed to main at haylan/LLM-Server 2026-09-03 04:44:35 +00:00
6b06d6001f Merge pull request 'feat(llama.cpp): raise default context to 128K, document RAM/SSD offload knobs' (#30) from ctx-size-128k into main
c5864beec9 feat(llama.cpp): raise default context to 128K, document RAM/SSD offload knobs
Compare 2 commits »
haylan merged pull request haylan/LLM-Server#30 2026-09-03 04:44:34 +00:00
feat(llama.cpp): raise default context to 128K, document RAM/SSD offload knobs
haylan created pull request haylan/LLM-Server#30 2026-09-03 04:44:28 +00:00
feat(llama.cpp): raise default context to 128K, document RAM/SSD offload knobs