deploy deepseek v4

platform-engineer/README.md

@@ -299,11 +299,12 @@ Design rules baked into SOUL.md:
 
 ## 11. Deployment checklist (do in this order)
 
-1. **Add the Ollama model to LiteLLM** (already done in `litellm/litellm.yaml`):
-   the `qwen-3.6:27b` entry points at `http://10.88.20.12:11434`. Make sure
-   `qwen3.6:27b` is actually pulled on that Ollama host
-   (`ollama pull qwen3.6:27b`). Apply: `kubectl apply -f litellm/` and restart
-   the LiteLLM pod so the new config takes effect.
+1. **Add the in-cluster model to LiteLLM** (already done in `litellm/litellm.yaml`):
+   the `deepseek-v4-flash-0731` entry points at the in-cluster llama.cpp server
+   `http://llamacpp-deepseek-v4-flash-0731.llamacpp/v1` (served from the NUCBox
+   APU; see `llamacpp/deployment-deepseek-v4-flash-0731.yaml`). Apply:
+   `kubectl apply -f litellm/` and restart the LiteLLM pod so the new config
+   takes effect.
 2. **Create the `gitea-registry` secret in the new namespace** (ArgoCD won't
    create it — it's not in the repo):
    ```

platform-engineer/configmap.yaml

@@ -9,18 +9,18 @@ data:
   config.yaml: |
     model:
       provider: openai-api
-      default: qwen3.6-27b
+      default: deepseek-v4-flash-0731
       base_url: "http://litellm-service.litellm:80/v1"
       api_mode: chat_completions
 
     auxiliary:
       compression:
         provider: openai-api
-        model: qwen3.6-35b-a3b    # flash model for speed-sensitive auxiliary tasks
+        model: deepseek-v4-flash-0731    # in-cluster llama.cpp model (replaces the Qwen flash/dense pair)
         base_url: "http://litellm-service.litellm:80/v1"
       title_generation:
         provider: openai-api
-        model: qwen3.6-35b-a3b    # flash model for speed-sensitive auxiliary tasks
+        model: deepseek-v4-flash-0731    # in-cluster llama.cpp model (replaces the Qwen flash/dense pair)
         base_url: "http://litellm-service.litellm:80/v1"
 
     terminal:

platform-engineer/cron-seed.yaml

@@ -56,7 +56,7 @@ spec:
 
           # NOTE: `hermes cron create` has no --model flag. New jobs inherit the
           # global default model from config.yaml at creation time. To pin a
-          # specific model per-job (e.g. the flash model qwen3.6-35b-a3b for all
+          # specific model per-job (e.g. deepseek-v4-flash-0731 for all
           # cron tasks), edit /opt/data/cron/jobs.json directly after seeding:
           #   kubectl exec deploy/hermes -- python3 -c "...set model field..."
           # See llamacpp/README.md and the deployment notes for details.