roger/k3s-cluster
1
0
Fork 1
Code Issues Pull Requests 6 Actions Packages Projects Releases Wiki Activity

deploy deepseek v4

Browse Source
This commit is contained in:
Roger Oriol
2026-08-01 00:24:26 +02:00
parent 5fe0ee361a
commit b132aae09c
14 changed files with 610 additions and 411 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
platform-engineer/README.md
View File

@@ -299,11 +299,12 @@ Design rules baked into SOUL.md:
## 11. Deployment checklist (do in this order)
1. **Add the Ollama model to LiteLLM** (already done in `litellm/litellm.yaml`):
the `qwen-3.6:27b` entry points at `http://10.88.20.12:11434`. Make sure
`qwen3.6:27b` is actually pulled on that Ollama host
(`ollama pull qwen3.6:27b`). Apply: `kubectl apply -f litellm/` and restart
the LiteLLM pod so the new config takes effect.
1. **Add the in-cluster model to LiteLLM** (already done in `litellm/litellm.yaml`):
the `deepseek-v4-flash-0731` entry points at the in-cluster llama.cpp server
`http://llamacpp-deepseek-v4-flash-0731.llamacpp/v1` (served from the NUCBox
APU; see `llamacpp/deployment-deepseek-v4-flash-0731.yaml`). Apply:
`kubectl apply -f litellm/` and restart the LiteLLM pod so the new config
takes effect.
2. **Create the `gitea-registry` secret in the new namespace** (ArgoCD won't
create it — it's not in the repo):
```