roger/k3s-cluster
1
0
Fork 1
Code Issues Pull Requests 6 Actions Packages Projects Releases Wiki Activity

deploy qwen 3.8

Browse Source
This commit is contained in:
Roger Oriol
2026-08-18 18:56:07 +02:00
parent 9da3fb3195
commit 7089763ffb
9 changed files with 86 additions and 453 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
llamacpp/args-qwen36-27b.md
View File

@@ -6,8 +6,8 @@
> model was live, so it can be redeployed later if the DeepSeek model is taken
> down or moved to different hardware.
>
> To redeploy: restore `deployment-qwen36-27b.yaml` (the manifest is preserved
> in git history) and re-add the LiteLLM entry. Re-check the VRAM budget —
> To redeploy: restore `deployment-qwen36-27b.yaml` from git history and
> re-add the LiteLLM entry. Re-check the VRAM budget —
> co-locating with the 87 GiB DeepSeek model is **not** possible on the current
> 90 GiB pool.