knowledge-base/wiki/concepts/llm/chinese-model-cost-routing.md
Hector ae5f32abc1 ingest(youtube): c't 4004 #30 — Open Weights, Chinese Models, PoisonAI
- raw: youtube/2026-07-02_ct4004-anthropic-ceo-panik-open-weights-poisonai.md
- wiki NEW: concepts/llm/poisonai-knowledge-poisoning.md
- wiki UPDATE: people/dario-amodei.md (Open Weights Debate)
- wiki UPDATE: institutions/anthropic.md
- wiki UPDATE: concepts/llm/glm-5.2-zai-coding-model.md (c't-Referenz)
- wiki UPDATE: concepts/llm/chinese-model-cost-routing.md (c't-Validation)
- wiki UPDATE: index.md, log.md
2026-07-02 10:06:54 +02:00

9.5 KiB
Raw Blame History

created updated sources tags
2026-06-29 2026-06-29
xpost/2026-06-29_deronin-chinese-ai-stack-cost-savings.md
xpost/2026-06-28_milesdeutscher-token-engineering-barbell.md
concept
llm
chinese-models
cost-routing
barbell
model-swap
kimi
qwen
glm
mimo
wan
kling
cost-reduction
factory-for-gods
practical-report
ct-validation

sources_extra: [youtube/2026-07-02_ct4004-anthropic-ceo-panik-open-weights-poisonai.md]

Chinese Model Cost Routing — The 87% Cost-Cut Playbook

TL;DR: DeRonin's 30-day field report swaps six Western frontier models for Chinese alternatives — 87% cost reduction, 4% quality drop, revenue unchanged. This is the empirical validation of the Barbell Model Routing strategy and TheProphet's "Factory for Gods" thesis.

Sources

Source Author Date Angle
X-Post: "My entire AI stack is now Chinese" DeRonin (@DeRonin_) 2026-06-29 Practical field report
Miles Deutscher "Token Engineering" @Milesdeutscher 2026-06-28 Barbell strategy formalization
TheProphet "Factory for Gods" @TheProphet 2026-06-17 Macro-thesis: China industrializes intelligence

The Swap Matrix

DeRonin replaced every layer of his AI stack with Chinese models:

Task Western (before) Chinese (after) Quality Gap Cost Factor Notes
Reasoning / Backend Brain Claude Opus 4.8 Kimi K2.7 (Moonshot) ~8% ~11× cheaper Largest absolute saving — Opus is premium-priced
Code Generation GPT-5.5 Qwen 3.7 Max (Alibaba) ~18% ~7× cheaper Biggest quality gap, but still "good enough" for production
Agent Loops + Tool Calling Claude Sonnet 4.7 GLM 5.2 (Z.ai) ~3% ~5× cheaper (input) Smallest gap — GLM 5.2 is near-parity for agentic tasks
Cheap Volume / Bulk GPT-5.5 mini MiMo V2.5 (Xiaomi) ~6% ~12× cheaper Best cost ratio in the stack
Image Generation GPT-Image-2 Wan 2.5 ~5% ~8× cheaper
Video Generation Sora 2 Kling 3.0 (Kuaishou) ~equal ~6× cheaper Roughly equal quality at a fraction of cost

30-Day Outcome

Metric Before After Delta
Operating costs baseline 13% of baseline 87%
Output quality (avg) baseline 96% of baseline 4%
Revenue baseline unchanged 0%

Key insight: The 4% quality drop is across all tasks averaged. For agent loops (GLM 5.2) and video (Kling 3.0), the gap is ≤3% — effectively parity. The biggest gap (Qwen 3.7 Max for code gen at 18%) is offset by the fact that code generation volume is high and verification is cheap.

Connection to Barbell Model Routing

DeRonin's stack is a natural implementation of the Barbell Strategy (Miles Deutscher, 2026-06-28):

Barbell Phase DeRonin's Implementation Model
First 10% (Planning / expensive) Reasoning tasks where 8% quality gap matters Kimi K2.7 (cheapest "brain")
Middle 80% (Execution / cheap) Agent loops, bulk processing, code gen GLM 5.2, MiMo V2.5, Qwen 3.7 Max
Last 10% (Verification / expensive) Implicit — revenue unchanged means verification held (not detailed in post)

Our Setup vs. DeRonin's

Task DeRonin Hector (us) Match?
Primary agent brain Kimi K2.7 GLM 5.2 (cloud) Different — we route reasoning to GLM 5.2
Code generation Qwen 3.7 Max Kimi K2.7 Code (subagent) Different — we use Kimi for code
Agent loops + tools GLM 5.2 GLM 5.2 (native in OpenClaw v2026.6.8) Same
Bulk processing MiMo V2.5 MiMo in fallback chain Same family
Routing logic (promised article) skills/openclaw-model-router 5-tier We have formalized routing

Where we differ: DeRonin uses Kimi K2.7 for reasoning and GLM 5.2 for agent loops. We use GLM 5.2 as the primary for everything including reasoning, with Kimi K2.7 Code as a subagent option. His split is more granular — reasoning gets a dedicated "brain" model, agent loops get the cheaper agentic model. Our 5-tier router achieves similar granularity via task-complexity classification rather than task-type classification.

Connection to "Factory for Gods" Thesis

This is the micro-level proof of TheProphet's macro-thesis (see ai-intelligence-commoditization-thesis.md):

"America has the frontier gods. China is building the factory for gods."

DeRonin's 30-day report demonstrates empirically what TheProphet argued theoretically:

  1. Near-frontier is good enough — A 4% average quality drop is invisible to end-users and revenue-neutral
  2. Cost asymmetry is extreme — 512× cheaper per task category, compounding to 87% total
  3. The swap is not hypothetical — It's a production stack that ran for 30 days with unchanged revenue
  4. Every layer is covered — Not just text generation, but code, agents, images, and video

The Quality-Cost Curve in Practice

TheProphet's thesis predicts that "a 10% intelligence gap is economically irrelevant when the second-best model is radically cheaper." DeRonin's data refines this:

  • Agent loops: 3% gap at 5× cheaper → no-brainer swap
  • Reasoning: 8% gap at 11× cheaper → clearly worth it
  • Code gen: 18% gap at 7× cheaper → the interesting edge case — still profitable because code verification is cheaper than code generation
  • Video: ~0% gap at 6× cheaper → pure arbitrage

The threshold is not "10% gap" universally — it's task-dependent. Where verification is cheap (code), larger gaps are tolerable. Where it's expensive (reasoning), smaller gaps matter more.

Chinese Model Landscape (Referenced)

Model Vendor Category In Our Stack?
Kimi K2.7 Moonshot AI Reasoning / coding Subagent option
Qwen 3.7 Max Alibaba Code generation Qwen3 Coder in fallback
GLM 5.2 Z.ai Agent loops / tool calling Primary model
MiMo V2.5 Xiaomi Bulk / cheap volume Fallback chain
Wan 2.5 Alibaba (Wan) Image generation Not integrated
Kling 3.0 Kuaishou Video generation Not integrated

See llm-model-catalog.md for full model inventory and glm-5.2-zai-coding-model.md for our GLM 5.2 deep-dive.

Implications for Our Architecture

  1. GLM 5.2 as primary is validated — DeRonin independently chose GLM 5.2 for agent loops, the task category with the smallest quality gap (3%). Our default model choice is optimal for the highest-volume task type.

  2. Kimi K2.7 for reasoning is worth considering — DeRonin splits reasoning (Kimi) from agent loops (GLM). Our current setup routes both to GLM 5.2. A potential optimization: route complex reasoning tasks (Tier 4 in our 5-tier router) to Kimi K2.7 instead of GLM 5.2.

  3. MiMo for bulk is confirmed — We already have MiMo in the fallback chain. DeRonin's 12× cost factor for bulk processing validates Tier 0/1 routing.

  4. Image/Video gap to explore — We don't currently use Wan 2.5 or Kling 3.0. If image/video generation becomes a regular need, these are the cost-optimal choices.

  5. Full article pending — DeRonin promised a detailed article with routing logic for 2026-06-30. This page should be updated when it drops.

Cross-References

c't 4004 #30 Validation (02.07.2026)

Die c't-Folge "Anthropic-CEO in Panik" (c't 4004 #30, 02.07.2026) liefert eine unabhängige journalistische Bestätigung der chinesischen Model-Cost-Routing-These:

  • Große Unternehmen wechseln bereits weg von US-Cloud-Anbietern zu selbst gehosteten chinesischen Open-Weight-Modellen
  • GLM-5.2 explizit genannt als Beispiel für Modelle, die den Rückstand zu US-Frontier bei dramatisch geringeren Kosten schließen
  • US-Sanktionspolitik als kurzsichtig kritisiert — statt China aufzuhalten, beschleunigt sie unabhängige KI-Kapazitäten im Rest der Welt
  • Für Europe: Chance zur Emanzipation von US-Hyperscalern

Diese journalistische Validierung aus dem Heise-Ökosystem (c't Magazin) ist signifikant, weil sie unabhängig von der X/Twitter-Community kommt und ein Mainstream-Tech-Publikum erreicht.

Quelle: YouTube: c't 4004 #30 — Kapitel 16:55 "Chinas Open Weights killen die KI-Blase"

External Sources