roger/k3s-cluster
1
0
Fork 1
Code Issues Pull Requests 6 Actions Packages Projects Releases Wiki Activity

fix llamacpp image

Browse Source
This commit is contained in:
Roger Oriol
2026-07-23 00:12:08 +02:00
parent 0143ebefd9
commit 70e4baf5e3
2 changed files with 8 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
llamacpp/README.md
View File

@@ -23,7 +23,8 @@ without re-downloading.
## GPU / Vulkan
The `server-vulkan` image bundles the Mesa/RADV Vulkan driver, which supports
The `server-vulkan` image (`ghcr.io/ggml-org/llama.cpp:server-vulkan`) bundles
the Mesa/RADV Vulkan driver, which supports
the Radeon 8060S (RDNA 3.5). Full layer offload (`-ngl 999`) puts the ~16 GiB
Q4 model entirely in the 96 GiB VRAM pool.