Arthur Erlich haylan
0 Followers · 0 Following
Repositories
12
 Projects Packages Public Activity Starred Repositories
2
haylan created branch feat-rag-databases in haylan/LLM-Server 2026-09-07 17:20:26 +00:00
haylan pushed to feat-rag-databases at haylan/LLM-Server 2026-09-07 17:20:26 +00:00
20f2ec3ab2 feat: add qdrant and neo4j for RAG vector/graph storage
haylan commented on issue haylan/LLM-Server#44 2026-09-06 20:34:29 +00:00
Add llama-server-fast: small non-thinking classifier/fast model for qwen-code Auto Mode

Confirmed working end-to-end on the real server: llama-server-fast deployed, registered in OmniRoute (qwen3-4b-fast), wired into qwen-code's fastModel, and the Auto Mode classifier now works…

haylan closed issue haylan/LLM-Server#5 2026-09-06 20:30:07 +00:00
Verify the stack on the real Radeon R9700 box (GPU passthrough + Lazytainer idle-stop)
haylan commented on issue haylan/LLM-Server#5 2026-09-06 20:30:06 +00:00
Verify the stack on the real Radeon R9700 box (GPU passthrough + Lazytainer idle-stop)

Confirmed: GPU_MAX_HW_QUEUES=1 + the numeric-GID group_add fix (#47) resolved the 100%-GPU-pin with both llama-server and llama-server-fast up. Combined with the earlier classifier-context and…

haylan commented on issue haylan/LLM-Server#5 2026-09-06 20:27:21 +00:00
Verify the stack on the real Radeon R9700 box (GPU passthrough + Lazytainer idle-stop)

Confirmed on the real server (#49, merged): the interactive gum-based config sync in scripts/update.sh works as designed — the conflict screen appeared for the stale LLAMA_FAST_PARALLEL=2 vs…

haylan pushed to main at haylan/LLM-Server 2026-09-06 20:21:54 +00:00
5b7548dc7c Merge pull request 'Fix llama-server-fast context-size exhaustion breaking Auto Mode' (#49) from fix-fastmodel-context-size into main
ea7b05fb99 feat: interactive per-key conflict resolution in update.sh's config sync
9def240a8e feat: update.sh force-syncs tracked config from .env.example
52a92f6508 fix: llama-server-fast context-size exhaustion breaking Auto Mode classifier
Compare 4 commits »
haylan deleted branch fix-fastmodel-context-size from haylan/LLM-Server 2026-09-06 20:21:54 +00:00
haylan merged pull request haylan/LLM-Server#49 2026-09-06 20:21:53 +00:00
Fix llama-server-fast context-size exhaustion breaking Auto Mode
haylan pushed to fix-fastmodel-context-size at haylan/LLM-Server 2026-09-06 20:20:31 +00:00
ea7b05fb99 feat: interactive per-key conflict resolution in update.sh's config sync
haylan pushed to fix-fastmodel-context-size at haylan/LLM-Server 2026-09-06 20:10:54 +00:00
9def240a8e feat: update.sh force-syncs tracked config from .env.example
haylan created pull request haylan/LLM-Server#49 2026-09-06 20:07:17 +00:00
Fix llama-server-fast context-size exhaustion breaking Auto Mode
haylan created branch fix-fastmodel-context-size in haylan/LLM-Server 2026-09-06 20:07:02 +00:00
haylan pushed to fix-fastmodel-context-size at haylan/LLM-Server 2026-09-06 20:07:02 +00:00
52a92f6508 fix: llama-server-fast context-size exhaustion breaking Auto Mode classifier
haylan pushed to main at haylan/LLM-Server 2026-09-06 19:40:11 +00:00
63938e95c9 Merge pull request 'Run git pull first in update.sh, not mid-script' (#48) from fix-update-sh-pull-order into main
7b6d3f5802 fix: run git pull first in update.sh, not mid-script
Compare 2 commits »
haylan deleted branch fix-update-sh-pull-order from haylan/LLM-Server 2026-09-06 19:40:11 +00:00
haylan merged pull request haylan/LLM-Server#48 2026-09-06 19:40:10 +00:00
Run git pull first in update.sh, not mid-script
haylan created pull request haylan/LLM-Server#48 2026-09-06 19:38:35 +00:00
Run git pull first in update.sh, not mid-script
haylan pushed to fix-update-sh-pull-order at haylan/LLM-Server 2026-09-06 19:38:22 +00:00
7b6d3f5802 fix: run git pull first in update.sh, not mid-script
haylan created branch fix-update-sh-pull-order in haylan/LLM-Server 2026-09-06 19:38:21 +00:00