haylan/LLM-Server
1
0
Fork 0
Code Issues 9 Pull Requests Actions Packages Projects Releases Wiki Activity

Write local-usage docs for Claude Code CLI, Kimi CLI, and OpenCode CLI against the local endpoint #6

New Issue
Closed
opened 2026-08-24 10:09:58 +00:00 by haylan · 1 comment
haylan commented 2026-08-24 10:09:58 +00:00
Owner
Copy Link
Copy Source

Part of #1
Blocked by: #3, #4, #7

Question

Write documentation (README or docs/ file in this repo) covering: how to point Claude Code CLI at the local llama.cpp Anthropic Messages API shim (ANTHROPIC_BASE_URL + dummy ANTHROPIC_API_KEY, any caveats from #3's findings), how to configure Kimi CLI's config.toml to use the local OpenAI-compatible endpoint, and how to configure OpenCode CLI per #7's findings. Include the verified ports/URLs from #4 and any known reliability caveats for using Qwen3.8-27B as an agentic coding backend, so the user knows what to expect before relying on it as a Claude Code fallback.

Part of #1 Blocked by: #3, #4, #7 ## Question Write documentation (README or docs/ file in this repo) covering: how to point Claude Code CLI at the local llama.cpp Anthropic Messages API shim (ANTHROPIC_BASE_URL + dummy ANTHROPIC_API_KEY, any caveats from #3's findings), how to configure Kimi CLI's config.toml to use the local OpenAI-compatible endpoint, and how to configure OpenCode CLI per #7's findings. Include the verified ports/URLs from #4 and any known reliability caveats for using Qwen3.8-27B as an agentic coding backend, so the user knows what to expect before relying on it as a Claude Code fallback.
haylan added the wayfinder:task label 2026-08-24 10:09:58 +00:00
haylan added a new dependency 2026-08-24 16:13:27 +00:00
#7 Research OpenCode CLI installation and local-endpoint setup
haylan changed title from Write local-usage docs for Claude Code CLI and Kimi CLI against the local endpoint to Write local-usage docs for Claude Code CLI, Kimi CLI, and OpenCode CLI against the local endpoint 2026-08-24 16:13:49 +00:00
haylan self-assigned this 2026-08-24 16:19:20 +00:00
haylan commented 2026-08-24 16:20:04 +00:00
Author
Owner
Copy Link
Copy Source

Resolved. Wrote docs/coding-cli-setup.md (linked from README) covering all three CLIs — committed on main (7d8c932).

  • Claude Code CLI: ANTHROPIC_BASE_URL=http://localhost:8080 + dummy ANTHROPIC_API_KEY, against llama.cpp's Anthropic Messages shim.
  • Kimi CLI: config.toml OpenAI provider block, base_url http://localhost:8080/v1.
  • OpenCode CLI: install command, opencode.json provider block per #7's findings, plus its own documented local-backend brittleness (#20669, #1890) called out alongside the shared Qwen3.8-27B tool-calling risk from #3.

The doc leads with the tool-calling risk warning rather than burying it, and points to the smoke test in #5 before anyone should trust this for unattended agentic work.

Resolved. Wrote `docs/coding-cli-setup.md` (linked from README) covering all three CLIs — committed on `main` (7d8c932). - **Claude Code CLI**: ANTHROPIC_BASE_URL=http://localhost:8080 + dummy ANTHROPIC_API_KEY, against llama.cpp's Anthropic Messages shim. - **Kimi CLI**: config.toml OpenAI provider block, base_url http://localhost:8080/v1. - **OpenCode CLI**: install command, opencode.json provider block per #7's findings, plus its own documented local-backend brittleness (#20669, #1890) called out alongside the shared Qwen3.8-27B tool-calling risk from #3. The doc leads with the tool-calling risk warning rather than burying it, and points to the smoke test in #5 before anyone should trust this for unattended agentic work.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
wayfinder:grilling
Wayfinder grilling ticket
 wayfinder:map
Wayfinder map issue
 wayfinder:prototype
Wayfinder prototype ticket
 wayfinder:research
Wayfinder research ticket
 wayfinder:task
Wayfinder task ticket
No labels wayfinder:task
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
haylan (Arthur Erlich)
No Assignees haylan
1 Participants
Notifications
Due Date
No due date set.
Depends on
#3 Confirm Qwen3.8-27B tool-calling compatibility with llama.cpp's Anthropic Messages API shim
haylan/LLM-Server
#4 Author the docker-compose stack (llama.cpp + Open WebUI + Qdrant + Lazytainer)
haylan/LLM-Server
#7 Research OpenCode CLI installation and local-endpoint setup
haylan/LLM-Server
Reference: haylan/LLM-Server#6