reduced context of small modell · 1989ec9383 - LLM-Server - Gitea, hosted by Arthur

haylan/LLM-Server

0 Fork 0

haylan committed 2026-09-25 08:17:42 +02:00

1 parent a3437e9cc7

commit 1989ec9383

1 file changed

+1 -1

									
										docker-compose.yml
									
		+1
		-1
	
												View File
												
					@@ -59,7 +59,7 @@ services:

					      --host 0.0.0.0

					      --host 0.0.0.0

					      --port 8080

					      --port 8080

					      --n-gpu-layers 28

					      --n-gpu-layers 28

					      --ctx-size 65536

					      --ctx-size 50000

					      --parallel 1

					      --parallel 1

					      --batch-size 512

					      --batch-size 512

					      --ubatch-size 128

					      --ubatch-size 128