Removal inventory: image generation and Open WebUI #58
Notifications
Due Date
No due date set.
Blocks
#60 Target doc structure
haylan/LLM-Server
Reference: haylan/LLM-Server#58
Reference in new issue
Block a user
Part of #55
Question
List exactly what must go to remove ComfyUI, Qwen-Image, downloader-comfyui, scripts/switch-model.sh and Open WebUI: compose services, volumes, depends_on, env vars, update.sh lines, docs and research docs, and every other comment/doc that mentions them (e.g. GID comments naming comfyui, qdrant comment 'like comfyui above'). AFK.
Resolution: removal inventory
Grepped the whole repo, case-insensitive: comfy, qwen-image/qwen_image, image gen, diffusion, unet, open-webui/openwebui, switch-model, 8188/8138/8008, downloader-, llama-server-fast, #38/#42, comfy.home. The checklist below lists every hit that needs action. Anything not listed is either unaffected or is research history that stays verbatim (see the research docs section).
docker-compose.yml
downloader-comfyui, including its whole comment block (Qwen-Image 2.1 GGUF files,models/unetlayout, ponytail note about the ComfyUI models root).comfyui, including its comment block (yurisasc image / #38, ComfyUI-GGUF custom node, entrypoint/--base-directoryseeding, published port8138:8188/ comfy.home, OmniRoutecomfyuiprovider). ItsHSA_OVERRIDE_GFX_VERSIONandPYTORCH_ROCM_ARCHenv vars are only used here, so they go with it.open-webui, including its comment block (the "OmniRoute comfyui provider hardcodes CheckpointLoaderSimple" rationale, OPENWEBUI_OMNIROUTE_KEY, and the COMFYUI_WORKFLOW ponytail note). This also removes itsdepends_on: comfyuiandomniroute, port8008:8080, and everyCOMFYUI_*/IMAGE_GENERATION_*env var.volumes:entriescomfyui-dataandopen-webui-data.qdrantcomment: drop "like comfyui above". Keep the fact that the dashboard port is published directly and not gatewayed. The "see docs/agents/... (wayfinder)" pointer is also dangling; hand that to #56/#61.depends_onin the remaining services points at a removed service.omniroutedepends on llama-server andlazytainerdepends on llama-server, so both are unaffected..env.example
# --- ComfyUI (local image generation, see issue #38 wayfinder map) ---aboveHOST_VIDEO_GID/HOST_RENDER_GID. Rename it to something like# --- GPU access (group_add GIDs) ---, and change the list of services from "llama-server, llama-server-fast, comfyui" to llama-server, qwen-classifier.llama-server-fastnever existed under that name. Keep both vars: llama-server and qwen-classifier still use them ingroup_add.# --- ComfyUI diffusion model (Qwen-Image 2.1 …) ---with its comment block and keysCOMFYUI_DIFFUSION_MODEL_FILE,COMFYUI_TEXT_ENCODER_FILE,COMFYUI_VAE_FILE.# --- Open WebUI (chat + ComfyUI image-gen frontend) ---with keyOPENWEBUI_OMNIROUTE_KEY.scripts/update.sh
docker compose --profile tools run --rm downloader-comfyuiline in the "ensuring models are downloaded" step.HOST_VIDEO_GID/RENDER_GIDas host-resolved values, and that stays correct. Leave the header as is apart from whatever #61 moves.ensure_gum/GUM_*andscripts/vendor/gum_0.14.5_Linux_x86_64.tar.gz: keep. They are not image-gen related: gum drives the interactive.env.exampleconflict picker in update.sh itself.scripts/switch-model.sh
Docs (non-research)
docs/research/
docs/research/image-generation-options.mdanddocs/research/image-generation-model-choice.md, per the map. Only these two docs and their own cross-link reference each other, so no inbound links break.lazytainer-omniroute-idle-stop.md: the lazytainer root-cause analysis is still current, because lazytainer still idles llama-server. Its "Recommendation for scripts/switch-model.sh (#43)" section is superseded (image gen removed).rocm-gpu-pin-and-render-group.md: its namesllama-server-fast,comfyuiandCOMFYUI_VIDEO_GID/RENDER_GIDare historical. Its findings (GPU_MAX_HW_QUEUES=1, numeric GIDs) still apply, because two HIP contexts (llama-server + qwen-classifier) still share the card.ponytail-audit-2026-09-09.md: thedownloader-comfyuifor-loop item and theswitch-model.shmentions are moot.colibri-ai-stack-evaluation.md: lists ComfyUI as a stack component. Historical.connecting-cloud-providers.md,langchain-pgvector-vs-litellm-pgvector.md,litellm-knowledgebase.md(says open-webui is the only qdrant consumer, which becomes false),litellm-searxng-search.md,proxy-tool-choice.md. These are already LiteLLM-era or superseded, so the index note only needs "Open WebUI no longer in stack".fast-model-choice.md: itsllama-server-fast→qwen-classifiernote is already correct. Nothing to do.Becomes dead / now-unused
comfyuiprovider (if it was ever registered in the dashboard) and theopenwebui-chatvirtual key are orphaned. See the server steps below.modelsvolume,downloaderanddownloader-classifierare unaffected.Manual server-side steps (R9700 box, after push +
./scripts/update.sh)update.shends withdocker compose up -d --remove-orphans, which removes thecomfyuiandopen-webuicontainers automatically.docker volume ls | grep -E 'comfyui-data|open-webui-data', thendocker volume rm <project>_comfyui-data <project>_open-webui-data. The project prefix is normallyllm-server..envkeeps staleCOMFYUI_*andOPENWEBUI_OMNIROUTE_KEYlines, because update.sh only adds keys and never prunes them. They are harmless, but you can delete them by hand.openwebui-chatkey and delete thecomfyuiprovider if either exists.comfy.home(or one to :8008) was ever created, remove it.docker image rm yurisasc/comfyui-rocm7.1 ghcr.io/open-webui/open-webui:mainto reclaim disk.