- raw: youtube/2026-07-02_ct4004-anthropic-ceo-panik-open-weights-poisonai.md - wiki NEW: concepts/llm/poisonai-knowledge-poisoning.md - wiki UPDATE: people/dario-amodei.md (Open Weights Debate) - wiki UPDATE: institutions/anthropic.md - wiki UPDATE: concepts/llm/glm-5.2-zai-coding-model.md (c't-Referenz) - wiki UPDATE: concepts/llm/chinese-model-cost-routing.md (c't-Validation) - wiki UPDATE: index.md, log.md
147 lines
No EOL
9.5 KiB
Markdown
147 lines
No EOL
9.5 KiB
Markdown
---
|
||
created: 2026-06-29
|
||
updated: 2026-06-29
|
||
sources:
|
||
- xpost/2026-06-29_deronin-chinese-ai-stack-cost-savings.md
|
||
- xpost/2026-06-28_milesdeutscher-token-engineering-barbell.md
|
||
tags: [concept, llm, chinese-models, cost-routing, barbell, model-swap, kimi, qwen, glm, mimo, wan, kling, cost-reduction, factory-for-gods, practical-report, ct-validation]
|
||
---
|
||
sources_extra: [youtube/2026-07-02_ct4004-anthropic-ceo-panik-open-weights-poisonai.md]
|
||
|
||
# Chinese Model Cost Routing — The 87% Cost-Cut Playbook
|
||
|
||
> **TL;DR:** DeRonin's 30-day field report swaps six Western frontier models for Chinese alternatives — 87% cost reduction, 4% quality drop, revenue unchanged. This is the empirical validation of the Barbell Model Routing strategy and TheProphet's "Factory for Gods" thesis.
|
||
|
||
## Sources
|
||
|
||
| Source | Author | Date | Angle |
|
||
|--------|--------|------|-------|
|
||
| [X-Post: "My entire AI stack is now Chinese"](https://x.com/DeRonin_/status/2071561335234531578) | DeRonin (@DeRonin_) | 2026-06-29 | Practical field report |
|
||
| Miles Deutscher "Token Engineering" | @Milesdeutscher | 2026-06-28 | Barbell strategy formalization |
|
||
| [TheProphet "Factory for Gods"](https://x.com/_The_Prophet__/status/2067390526157185188) | @TheProphet | 2026-06-17 | Macro-thesis: China industrializes intelligence |
|
||
|
||
## The Swap Matrix
|
||
|
||
DeRonin replaced every layer of his AI stack with Chinese models:
|
||
|
||
| Task | Western (before) | Chinese (after) | Quality Gap | Cost Factor | Notes |
|
||
|------|------------------|-----------------|-------------|-------------|-------|
|
||
| Reasoning / Backend Brain | Claude Opus 4.8 | **Kimi K2.7** (Moonshot) | ~8% | ~11× cheaper | Largest absolute saving — Opus is premium-priced |
|
||
| Code Generation | GPT-5.5 | **Qwen 3.7 Max** (Alibaba) | ~18% | ~7× cheaper | Biggest quality gap, but still "good enough" for production |
|
||
| Agent Loops + Tool Calling | Claude Sonnet 4.7 | **GLM 5.2** (Z.ai) | ~3% | ~5× cheaper (input) | Smallest gap — GLM 5.2 is near-parity for agentic tasks |
|
||
| Cheap Volume / Bulk | GPT-5.5 mini | **MiMo V2.5** (Xiaomi) | ~6% | ~12× cheaper | Best cost ratio in the stack |
|
||
| Image Generation | GPT-Image-2 | **Wan 2.5** | ~5% | ~8× cheaper | — |
|
||
| Video Generation | Sora 2 | **Kling 3.0** (Kuaishou) | ~equal | ~6× cheaper | Roughly equal quality at a fraction of cost |
|
||
|
||
### 30-Day Outcome
|
||
|
||
| Metric | Before | After | Delta |
|
||
|--------|--------|-------|-------|
|
||
| Operating costs | baseline | 13% of baseline | **−87%** |
|
||
| Output quality (avg) | baseline | 96% of baseline | **−4%** |
|
||
| Revenue | baseline | unchanged | **0%** |
|
||
|
||
**Key insight:** The 4% quality drop is across all tasks averaged. For agent loops (GLM 5.2) and video (Kling 3.0), the gap is ≤3% — effectively parity. The biggest gap (Qwen 3.7 Max for code gen at 18%) is offset by the fact that code generation volume is high and verification is cheap.
|
||
|
||
## Connection to Barbell Model Routing
|
||
|
||
DeRonin's stack is a **natural implementation of the Barbell Strategy** (Miles Deutscher, 2026-06-28):
|
||
|
||
| Barbell Phase | DeRonin's Implementation | Model |
|
||
|---------------|--------------------------|-------|
|
||
| **First 10%** (Planning / expensive) | Reasoning tasks where 8% quality gap matters | Kimi K2.7 (cheapest "brain") |
|
||
| **Middle 80%** (Execution / cheap) | Agent loops, bulk processing, code gen | GLM 5.2, MiMo V2.5, Qwen 3.7 Max |
|
||
| **Last 10%** (Verification / expensive) | Implicit — revenue unchanged means verification held | (not detailed in post) |
|
||
|
||
### Our Setup vs. DeRonin's
|
||
|
||
| Task | DeRonin | Hector (us) | Match? |
|
||
|------|---------|-------------|--------|
|
||
| Primary agent brain | Kimi K2.7 | GLM 5.2 (cloud) | Different — we route reasoning to GLM 5.2 |
|
||
| Code generation | Qwen 3.7 Max | Kimi K2.7 Code (subagent) | Different — we use Kimi for code |
|
||
| Agent loops + tools | GLM 5.2 | GLM 5.2 (native in OpenClaw v2026.6.8) | ✅ Same |
|
||
| Bulk processing | MiMo V2.5 | MiMo in fallback chain | ✅ Same family |
|
||
| Routing logic | (promised article) | `skills/openclaw-model-router` 5-tier | We have formalized routing |
|
||
|
||
**Where we differ:** DeRonin uses Kimi K2.7 for reasoning and GLM 5.2 for agent loops. We use GLM 5.2 as the primary for everything including reasoning, with Kimi K2.7 Code as a subagent option. His split is more granular — reasoning gets a dedicated "brain" model, agent loops get the cheaper agentic model. Our 5-tier router achieves similar granularity via task-complexity classification rather than task-type classification.
|
||
|
||
## Connection to "Factory for Gods" Thesis
|
||
|
||
This is the **micro-level proof** of TheProphet's macro-thesis (see [[ai-intelligence-commoditization-thesis.md]]):
|
||
|
||
> *"America has the frontier gods. China is building the factory for gods."*
|
||
|
||
DeRonin's 30-day report demonstrates empirically what TheProphet argued theoretically:
|
||
|
||
1. **Near-frontier is good enough** — A 4% average quality drop is invisible to end-users and revenue-neutral
|
||
2. **Cost asymmetry is extreme** — 5–12× cheaper per task category, compounding to 87% total
|
||
3. **The swap is not hypothetical** — It's a production stack that ran for 30 days with unchanged revenue
|
||
4. **Every layer is covered** — Not just text generation, but code, agents, images, and video
|
||
|
||
### The Quality-Cost Curve in Practice
|
||
|
||
TheProphet's thesis predicts that "a 10% intelligence gap is economically irrelevant when the second-best model is radically cheaper." DeRonin's data refines this:
|
||
|
||
- **Agent loops:** 3% gap at 5× cheaper → **no-brainer swap**
|
||
- **Reasoning:** 8% gap at 11× cheaper → **clearly worth it**
|
||
- **Code gen:** 18% gap at 7× cheaper → **the interesting edge case** — still profitable because code verification is cheaper than code generation
|
||
- **Video:** ~0% gap at 6× cheaper → **pure arbitrage**
|
||
|
||
The threshold is not "10% gap" universally — it's task-dependent. Where verification is cheap (code), larger gaps are tolerable. Where it's expensive (reasoning), smaller gaps matter more.
|
||
|
||
## Chinese Model Landscape (Referenced)
|
||
|
||
| Model | Vendor | Category | In Our Stack? |
|
||
|-------|--------|----------|---------------|
|
||
| Kimi K2.7 | Moonshot AI | Reasoning / coding | ✅ Subagent option |
|
||
| Qwen 3.7 Max | Alibaba | Code generation | Qwen3 Coder in fallback |
|
||
| GLM 5.2 | Z.ai | Agent loops / tool calling | ✅ Primary model |
|
||
| MiMo V2.5 | Xiaomi | Bulk / cheap volume | ✅ Fallback chain |
|
||
| Wan 2.5 | Alibaba (Wan) | Image generation | ❌ Not integrated |
|
||
| Kling 3.0 | Kuaishou | Video generation | ❌ Not integrated |
|
||
|
||
See [[llm-model-catalog.md]] for full model inventory and [[glm-5.2-zai-coding-model.md]] for our GLM 5.2 deep-dive.
|
||
|
||
## Implications for Our Architecture
|
||
|
||
1. **GLM 5.2 as primary is validated** — DeRonin independently chose GLM 5.2 for agent loops, the task category with the smallest quality gap (3%). Our default model choice is optimal for the highest-volume task type.
|
||
|
||
2. **Kimi K2.7 for reasoning is worth considering** — DeRonin splits reasoning (Kimi) from agent loops (GLM). Our current setup routes both to GLM 5.2. A potential optimization: route complex reasoning tasks (Tier 4 in our 5-tier router) to Kimi K2.7 instead of GLM 5.2.
|
||
|
||
3. **MiMo for bulk is confirmed** — We already have MiMo in the fallback chain. DeRonin's 12× cost factor for bulk processing validates Tier 0/1 routing.
|
||
|
||
4. **Image/Video gap to explore** — We don't currently use Wan 2.5 or Kling 3.0. If image/video generation becomes a regular need, these are the cost-optimal choices.
|
||
|
||
5. **Full article pending** — DeRonin promised a detailed article with routing logic for 2026-06-30. This page should be updated when it drops.
|
||
|
||
## Cross-References
|
||
|
||
- [[ai-intelligence-commoditization-thesis.md]] — TheProphet's "Factory for Gods" macro-thesis
|
||
- [[ai-value-migration-orchestration.md]] — Aravind's investor angle on value migration
|
||
- [[flat-curve-society.md]] — Yegge's "route to the dumbest model that can handle it"
|
||
- [[glm-5.2-zai-coding-model.md]] — GLM 5.2 deep-dive (our primary = DeRonin's agent loop choice)
|
||
- [[real-world-coding-showdown.md]] — Kimi K2.7 vs GLM 5.2 head-to-head
|
||
- [[llm-model-catalog.md]] — Full model inventory
|
||
- [[../../architecture/model-routing.md]] — Our routing architecture
|
||
- [[../policy/ai-as-geopolitical-weapon.md]] — Miles Deutscher's weaponization thesis
|
||
- `skills/openclaw-model-router/SKILL.md` — 5-tier routing skill (external to wiki)
|
||
|
||
|
||
## c't 4004 #30 Validation (02.07.2026)
|
||
|
||
Die c't-Folge "Anthropic-CEO in Panik" (c't 4004 #30, 02.07.2026) liefert eine **unabhängige journalistische Bestätigung** der chinesischen Model-Cost-Routing-These:
|
||
|
||
- **Große Unternehmen wechseln** bereits weg von US-Cloud-Anbietern zu selbst gehosteten chinesischen Open-Weight-Modellen
|
||
- **GLM-5.2 explizit genannt** als Beispiel für Modelle, die den Rückstand zu US-Frontier bei dramatisch geringeren Kosten schließen
|
||
- **US-Sanktionspolitik als kurzsichtig kritisiert** — statt China aufzuhalten, beschleunigt sie unabhängige KI-Kapazitäten im Rest der Welt
|
||
- **Für Europe:** Chance zur Emanzipation von US-Hyperscalern
|
||
|
||
Diese journalistische Validierung aus dem Heise-Ökosystem (c't Magazin) ist signifikant, weil sie unabhängig von der X/Twitter-Community kommt und ein Mainstream-Tech-Publikum erreicht.
|
||
|
||
Quelle: [YouTube: c't 4004 #30](https://www.youtube.com/watch?v=Q6QkzJwcrEc) — Kapitel 16:55 "Chinas Open Weights killen die KI-Blase"
|
||
|
||
## External Sources
|
||
|
||
- [DeRonin X-Post (Original)](https://x.com/DeRonin_/status/2071561335234531578)
|
||
- [Miles Deutscher "Token Engineering" (2026-06-28)](https://x.com/Milesdeutscher)
|
||
- [TheProphet "Factory for Gods" (2026-06-17)](https://x.com/_The_Prophet__/status/2067390526157185188) |