Arthur Erlich haylan
0 Followers · 0 Following
Repositories
12
 Projects Packages Public Activity Starred Repositories
2
haylan commented on issue haylan/LLM-Server#2 2026-08-24 10:17:41 +00:00
Confirm quantization availability for Qwen3.8-27B

Resolved: yes, a dynamic 4-bit XL quant exists.

Repo: unsloth/Qwen3.8-27B-GGUF File: Qwen3.8-27B-UD-Q4_K_XL.gguf (17.6 GB) — confirmed directly from the HF repo's file tree.

VRAM budget…

haylan closed issue haylan/LLM-Server#2 2026-08-24 10:17:03 +00:00
Confirm quantization availability for Qwen3.8-27B
haylan closed issue haylan/LLM-Server#3 2026-08-24 10:16:43 +00:00
Confirm Qwen3.8-27B tool-calling compatibility with llama.cpp's Anthropic Messages API shim
haylan commented on issue haylan/LLM-Server#3 2026-08-24 10:16:43 +00:00
Confirm Qwen3.8-27B tool-calling compatibility with llama.cpp's Anthropic Messages API shim

Answer: No — not confirmed compatible; likely needs a fix, and it may not be a simple chat-template swap this time.

Short version: llama.cpp's Anthropic Messages API shim (PR #17570) just…

haylan opened issue haylan/LLM-Server#6 2026-08-24 10:09:59 +00:00
Write local-usage docs for Claude Code CLI and Kimi CLI against the local endpoint
haylan opened issue haylan/LLM-Server#5 2026-08-24 10:09:58 +00:00
Verify the stack on the real Radeon R9700 box (GPU passthrough + Lazytainer idle-stop)
haylan opened issue haylan/LLM-Server#4 2026-08-24 10:09:57 +00:00
Author the docker-compose stack (llama.cpp + Open WebUI + Qdrant + Lazytainer)
haylan opened issue haylan/LLM-Server#3 2026-08-24 10:09:42 +00:00
Confirm Qwen3.8-27B tool-calling compatibility with llama.cpp's Anthropic Messages API shim
haylan opened issue haylan/LLM-Server#2 2026-08-24 10:09:41 +00:00
Confirm quantization availability for Qwen3.8-27B
haylan opened issue haylan/LLM-Server#1 2026-08-24 10:09:29 +00:00
Local AI inference stack: llama.cpp + Qwen3.8-27B on Radeon R9700
haylan created repository haylan/LLM-Server 2026-08-24 09:48:51 +00:00
haylan deleted branch renovate/symfony from haylan/git-contribution-graph 2026-08-23 20:34:34 +00:00
haylan pushed to main at haylan/git-contribution-graph 2026-08-23 20:34:33 +00:00
466de04c40 Merge pull request 'chore(deps): update symfony packages to v7.4.17' (#25) from renovate/symfony into main
b0f042cc93 chore(deps): update symfony packages to v7.4.17
Compare 2 commits »
haylan merged pull request haylan/git-contribution-graph#25 2026-08-23 20:34:31 +00:00
chore(deps): update symfony packages to v7.4.17
haylan deleted branch renovate/phpstan-packages from haylan/git-contribution-graph 2026-08-23 19:50:19 +00:00
haylan pushed to main at haylan/git-contribution-graph 2026-08-23 19:50:17 +00:00
1a6e50e70f Merge pull request 'chore(deps): update dependency phpstan/phpstan to v2.2.9' (#24) from renovate/phpstan-packages into main
e6c54080a7 chore(deps): update dependency phpstan/phpstan to v2.2.9
Compare 2 commits »
haylan merged pull request haylan/git-contribution-graph#24 2026-08-23 19:50:16 +00:00
chore(deps): update dependency phpstan/phpstan to v2.2.9
haylan deleted branch renovate/phpstan-packages from haylan/git-contribution-graph 2026-08-20 15:52:00 +00:00
haylan pushed to main at haylan/git-contribution-graph 2026-08-20 15:51:58 +00:00
6dcc3d8114 Merge pull request 'chore(deps): update dependency phpstan/phpstan to v2.2.8' (#23) from renovate/phpstan-packages into main
f25e5c45c9 chore(deps): update dependency phpstan/phpstan to v2.2.8
Compare 2 commits »
haylan merged pull request haylan/git-contribution-graph#23 2026-08-20 15:51:56 +00:00
chore(deps): update dependency phpstan/phpstan to v2.2.8