From 21d4b0068028ec05dfc0c820bbe5bcf2f9dcdcea Mon Sep 17 00:00:00 2001 From: Hector Date: Wed, 1 Jul 2026 15:33:53 +0200 Subject: [PATCH] =?UTF-8?q?ingest(raw+wiki):=20Google=20TabFM=20=E2=80=94?= =?UTF-8?q?=20zero-shot=20tabular=20foundation=20model?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit - raw: raw/other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md - wiki NEW: concepts/llm/tabfm-zero-shot-tabular-foundation-model.md - index.md: 49. update, new LLM row, new raw source - log.md: ingest entry with Hector-Hauptthese TabFM: Google Research (30.06.2026) — zero-shot classification + regression on tabular data. Hybrid attention (TabPFN + TabICL), 100M+ synthetic SCM training datasets, #1 on TabArena, BigQuery AI.PREDICT integration. Non-commercial weights (HF), Apache-2.0 code (GitHub). --- ...abfm-zero-shot-tabular-foundation-model.md | 111 +++++++++++++ ...abfm-zero-shot-tabular-foundation-model.md | 156 ++++++++++++++++++ wiki/index.md | 4 +- wiki/log.md | 12 ++ 4 files changed, 282 insertions(+), 1 deletion(-) create mode 100644 raw/other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md create mode 100644 wiki/concepts/llm/tabfm-zero-shot-tabular-foundation-model.md diff --git a/raw/other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md b/raw/other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md new file mode 100644 index 0000000..eea190e --- /dev/null +++ b/raw/other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md @@ -0,0 +1,111 @@ +--- +type: other +source_url: https://www.perplexity.ai/discover/you/google-unveils-tabfm-an-ai-mod-c9dDVfXgRf23UCWMJBvC1A +retrieved: 2026-07-01 +title: "Google Research unveils TabFM — Zero-Shot Foundation Model for Tabular Data" +authors: ["Weihao Kong", "Abhimanyu Das"] +tags: [tabfm, tabular-data, foundation-model, zero-shot, in-context-learning, google-research, bigquery, synthetic-data, tabarena, classification, regression] +--- + +# Google Research unveils TabFM — Zero-Shot Foundation Model for Tabular Data + +## Source + +- **Perplexity Discover Article:** https://www.perplexity.ai/discover/you/google-unveils-tabfm-an-ai-mod-c9dDVfXgRf23UCWMJBvC1A +- **Google Research Blog:** https://research.google/blog/introducing-tabfm-a-zero-shot-foundation-model-for-tabular-data/ +- **Shared by:** Pit Weber in OME-Gruppe, Topic "News & Infos" (Topic 13) +- **Published:** June 30, 2026 + +## Summary + +Google Research unveiled **TabFM** on June 30, 2026 — a foundation model for tabular data that performs classification and regression **without any dataset-specific training**. TabFM frames tabular prediction as an in-context learning (ICL) problem: the model reads the entire dataset (training examples + target rows) as a single unified prompt and generates predictions in a single forward pass. No feature engineering, no hyperparameter tuning, no training run required. + +### Key Facts + +| Field | Value | +|-------|-------| +| Model | TabFM (Tabular Foundation Model) v1.0.0 | +| Released | June 30, 2026 | +| Authors | Weihao Kong, Abhimanyu Das (Google Research) | +| Task | Zero-shot classification + regression on tabular data | +| Architecture | Hybrid attention (row + column attention → row compression → ICL Transformer) | +| Training Data | Hundreds of millions of synthetic datasets (structural causal models) | +| Benchmark | #1 on TabArena (38 classification + 13 regression datasets, Elo rating) | +| Dataset Size Range | 700 – 150,000 samples | +| Weights | Non-commercial license on [Hugging Face](https://huggingface.co/google/tabfm-1.0.0-pytorch) | +| Code | Apache-2.0 on [GitHub](https://github.com/google-research/tabfm) | +| BigQuery Integration | Coming weeks — `AI.PREDICT` SQL command | + +## Architecture + +TabFM synthesizes two prior architectures into a novel hybrid design: + +1. **Alternating row and column attention** (inspired by [TabPFN](https://arxiv.org/abs/2207.01848)): Processes the raw table through alternating attention across columns (features) and rows (examples). Captures complex feature interactions natively — replaces manual feature engineering. + +2. **Row compression**: Compresses each row's cross-attended information into a single dense vector representation. + +3. **In-context learning Transformer** (inspired by [TabICL](https://arxiv.org/abs/2502.05564)): A dedicated Transformer operates on the sequence of compressed row vectors. Performing attention over compressed vectors (not raw grids) drastically reduces computation cost, enabling scalability to larger datasets. + +### Why Hybrid? + +Tables are fundamentally **two-dimensional and orderless** — swapping rows or columns doesn't change meaning. Standard LLMs process one-dimensional ordered sequences. The hybrid architecture bridges this gap: row/column attention captures 2D structure, row compression enables efficient ICL. + +## Training: Synthetic Data at Scale + +- **Problem:** High-quality, diverse tabular datasets are "critically scarce in the open-source space." Industrial tables contain proprietary schemas and sensitive information. +- **Solution:** TabFM is trained entirely on **hundreds of millions of synthetic datasets** generated dynamically using **structural causal models (SCMs)** with wide variety of random functions. +- **Rationale:** Synthetic tables can be arbitrarily large — effectively the only viable option for pre-training at foundation-model scale. The synthetic generation captures the wide variety of distributions and complex feature relationships prevalent in real-world tabular data. + +## Performance — TabArena Benchmark + +[TabArena](https://huggingface.co/spaces/TabArena/leaderboard) is a living benchmark that calculates Elo scores based on head-to-head win rates. + +| Configuration | Description | +|---------------|-------------| +| **TabFM** | Out-of-the-box. Single forward pass. No tuning or cross-validation. | +| **TabFM-Ensemble** | 32-way ensemble. Cross features + SVD features. Non-negative least squares solver for optimal weights. Platt scaling for classification calibration. | + +**Results:** TabFM ranks **#1 on TabArena** across both classification (38 datasets) and regression (13 datasets). The benchmark covers datasets ranging from 700 to 150,000 samples. + +### Caveats (from AI Weekly) + +- The blog post does not provide per-dataset head-to-head numbers against XGBoost, CatBoost, or earlier tabular foundation models. +- It does not test on messy enterprise tables (drift, rare categorical values, leakage) that decide whether tabular ML actually works in production. +- "Competitive on TabArena" is a plausible headline, not a settled result. + +## BigQuery Integration + +Google plans to integrate TabFM into **BigQuery ML** within weeks of the announcement. Users will be able to run zero-shot classification and regression through a single `AI.PREDICT` SQL command. + +**Developer experience shift:** Instead of spinning up AutoML pipelines, analysts prototype predictive models (churn prediction, fraud detection) using the same interface they use for standard SQL queries. + +## Predecessors & Context + +| Model | Relationship | +|-------|-------------| +| [TimesFM](https://research.google/blog/timesfm/) | Google's zero-shot time-series model — TabFM is the tabular counterpart | +| [TabPFN](https://arxiv.org/abs/2207.01848) | Prior work on row/column attention for tabular data — TabFM extends this approach | +| [TabICL](https://arxiv.org/abs/2502.05564) | Prior work on in-context learning for tabular data — TabFM adopts its efficient ICL approach | +| XGBoost / CatBoost / Random Forest | Traditional supervised tree-based methods — TabFM's zero-shot approach aims to replace the tedious training/tuning cycle | + +## Research Team + +- **Weihao Kong** — Research Scientist, Google Research ([LinkedIn](https://www.linkedin.com/posts/weihao-kong-a0514338_proud-to-share-tabfm-our-zero-shot-foundation-activity-7477835423990611969-ELm1)) +- **Abhimanyu Das** — Research Scientist, Google Research +- Additional contributors: Erez Louidor Ilan, Taman Narayan, Shuxin Nie, Rajat Sen, Yichen Zhou, Joe Toth, Deqing Fu, Samet Oymak + +## Relevance to Our Wiki + +- **Foundation model paradigm expansion:** TabFM extends the foundation-model paradigm beyond language (LLMs) and time-series (TimesFM) to tabular data — the backbone of enterprise ML. +- **Synthetic data strategy:** Training entirely on synthetic data via SCMs is a notable approach that connects to broader discussions about data scarcity and synthetic data generation. +- **Google Research ecosystem:** TabFM reinforces Google Research's strategy of building zero-shot foundation models across data modalities. Extends the DeepMind/Google AI thesis beyond LLMs. +- **Enterprise ML disruption:** If TabFM holds up on real data, it could significantly reduce the barrier to entry for predictive analytics — from AutoML pipelines to a single SQL command. +- **Open weights (non-commercial):** The non-commercial license on weights is worth noting — similar to some frontier model restrictions. Code is Apache-2.0, but model weights can't be used commercially. + +## Cross-References + +- [[../wiki/institutions/deepmind.md]] — Google's AI research ecosystem +- [[../wiki/concepts/llm/llm-knowledge-base.md]] — Foundation model paradigm +- [[../wiki/concepts/llm/llm-model-catalog.md]] — Model landscape (non-LLM foundation model) +- [[../wiki/institutions/google-cloud.md]] — BigQuery integration target +- [[../wiki/institutions/hugging-face.md]] — Model weights hosting \ No newline at end of file diff --git a/wiki/concepts/llm/tabfm-zero-shot-tabular-foundation-model.md b/wiki/concepts/llm/tabfm-zero-shot-tabular-foundation-model.md new file mode 100644 index 0000000..5e40c39 --- /dev/null +++ b/wiki/concepts/llm/tabfm-zero-shot-tabular-foundation-model.md @@ -0,0 +1,156 @@ +--- +created: 2026-07-01 +updated: 2026-07-01 +sources: [`raw/other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md`] +tags: [tabfm, tabular-data, foundation-model, zero-shot, in-context-learning, google-research, bigquery, synthetic-data, tabarena] +--- + +# TabFM — Google's Zero-Shot Foundation Model for Tabular Data + +## TL;DR + +**TabFM** is a foundation model by [Google Research](https://research.google/blog/introducing-tabfm-a-zero-shot-foundation-model-for-tabular-data/) (June 30, 2026) that performs **classification and regression on tabular data without dataset-specific training**. It frames tabular prediction as in-context learning (ICL): the model reads the entire dataset as a single prompt and generates predictions in one forward pass. Ranks **#1 on [TabArena](https://huggingface.co/spaces/TabArena/leaderboard)** benchmark. + +## Core Concept + +| Field | Value | +|-------|-------| +| Model | TabFM v1.0.0 | +| Released | June 30, 2026 | +| Authors | [Weihao Kong](https://www.linkedin.com/in/weihao-kong-a0514338), [Abhimanyu Das](https://research.google/people/abhimanyu-das/) (Google Research) | +| Task | Zero-shot tabular classification + regression | +| Predecessor | [TimesFM](https://research.google/blog/timesfm/) (zero-shot time-series — TabFM is the tabular counterpart) | +| Benchmark | #1 on TabArena (38 classification + 13 regression datasets, Elo rating, 700–150K samples) | +| Weights | [Hugging Face](https://huggingface.co/google/tabfm-1.0.0-pytorch) — non-commercial license | +| Code | [GitHub](https://github.com/google-research/tabfm) — Apache-2.0 | +| Integration | BigQuery ML (`AI.PREDICT` SQL command, coming weeks) | + +## Architecture — Hybrid Attention + +TabFM synthesizes two prior architectures into a novel hybrid: + +### 1. Alternating Row & Column Attention (from [TabPFN](https://arxiv.org/abs/2207.01848)) + +Tables are **two-dimensional and orderless** — swapping rows or columns doesn't change meaning. Standard LLMs process 1D ordered sequences. TabFM's first stage processes the raw table through alternating attention across columns (features) and rows (examples), capturing complex feature interactions natively. This replaces manual feature engineering. + +### 2. Row Compression + +Each row's cross-attended information is compressed into a **single dense vector**. This reduces the 2D table to a 1D sequence of row embeddings. + +### 3. ICL Transformer (from [TabICL](https://arxiv.org/abs/2502.05564)) + +A dedicated Transformer operates on the compressed row vectors. Performing attention over compressed vectors (not raw grids) drastically reduces computation cost, enabling scalability to datasets up to 150K samples. + +``` +Raw Table → [Row/Col Attention] → [Row Compression] → [ICL Transformer] → Predictions + (TabPFN-style) (dense vectors) (TabICL-style) +``` + +**Why hybrid?** TabPFN's row/column attention captures 2D structure but doesn't scale. TabICL's ICL approach scales but misses 2D structure. TabFM combines both: 2D-aware contextualization + efficient ICL. + +## Training — Synthetic Data at Scale + +| Aspect | Detail | +|--------|--------| +| Training Data | Hundreds of millions of **synthetic datasets** | +| Generator | Structural Causal Models (SCMs) with wide variety of random functions | +| Rationale | High-quality diverse tabular datasets are "critically scarce in the open-source space" — industrial tables contain proprietary schemas and sensitive info | +| Advantage | Synthetic tables can be arbitrarily large — effectively the only viable option for foundation-model-scale pre-training | + +The synthetic generation captures the wide variety of distributions and complex feature relationships prevalent in real-world tabular data. The model generalizes to unseen real-world tables, as demonstrated on TabArena. + +## Performance — TabArena + +[TabArena](https://huggingface.co/spaces/TabArena/leaderboard) is a living benchmark with Elo scores based on head-to-head win rates. + +### Two Configurations + +| Config | Description | Use Case | +|--------|-------------|----------| +| **TabFM** | Out-of-the-box. Single forward pass. No tuning. | Quick prototyping | +| **TabFM-Ensemble** | 32-way ensemble + cross features + SVD features + non-negative least squares solver + Platt scaling (classification) | Maximum performance | + +### Results + +- **#1 on TabArena** — both classification (38 datasets) and regression (13 datasets) +- Dataset size range: 700 – 150,000 samples +- Consistently outperforms heavily tuned, industry-standard supervised algorithms (XGBoost, CatBoost, Random Forests) on Elo rating + +### Honest Caveats + +From [AI Weekly](https://aiweekly.co/alerts/google-research-unveils-tabfm-a-zero-shot-model-for-tables)'s analysis: + +- No per-dataset head-to-head numbers against XGBoost, CatBoost, or earlier tabular foundation models +- No testing on messy enterprise tables (drift, rare categorical values, leakage) that decide whether tabular ML works in production +- "Competitive on TabArena" is a plausible headline, **not a settled result** + +## BigQuery Integration + +Google plans to integrate TabFM into **BigQuery ML** within weeks. Users will run zero-shot prediction via: + +```sql +SELECT AI.PREDICT(MODEL `project.dataset.tabfm`, + TABLE `project.dataset.my_table`, + STRUCT('classification' AS task)) +FROM `project.dataset.target_rows` +``` + +**Developer experience shift:** + +| Before (Traditional ML) | After (TabFM) | +|-------------------------|---------------| +| Feature engineering | Not needed | +| Hyperparameter tuning | Not needed | +| Training run per dataset | Single forward pass | +| AutoML pipeline | SQL query | +| ML expertise required | SQL expertise sufficient | + +Use cases: churn prediction, fraud detection, risk scoring — all via SQL. + +## Predecessor Landscape + +| Model | Year | Contribution | Relationship to TabFM | +|-------|------|--------------|----------------------| +| [XGBoost](https://en.wikipedia.org/wiki/XGBoost) | 2016 | Gradient-boosted trees | Dominant baseline — TabFM aims to replace the training/tuning cycle | +| [TabPFN](https://arxiv.org/abs/2207.01848) | 2022 | Row/column attention for tabular | TabFM extends its 2D attention approach | +| [TabICL](https://arxiv.org/abs/2502.05564) | 2025 | In-context learning for tabular | TabFM adopts its efficient ICL approach | +| [TimesFM](https://research.google/blog/timesfm/) | 2024 | Zero-shot time-series | TabFM is the tabular counterpart in Google's zero-shot family | + +## Google's Zero-Shot Foundation Model Family + +TabFM is part of a broader Google Research strategy to build zero-shot foundation models across data modalities: + +| Model | Domain | Zero-Shot? | +|-------|--------|-----------| +| [TimesFM](https://research.google/blog/timesfm/) | Time-series | ✅ | +| **TabFM** | **Tabular data** | **✅** | +| Gemini | Language/Multimodal | ✅ (in-context) | + +This positions Google as building a **cross-modal zero-shot foundation model portfolio** — each targeting a different data structure that traditional ML required custom pipelines for. + +## Relevance to Our Setup + +- **Non-LLM foundation model:** TabFM is a foundation model that isn't a language model — expands the "foundation model" paradigm beyond text/audio/vision. +- **Synthetic data strategy:** Training entirely on synthetic SCM-generated data is a notable approach. Connects to broader discussions about data scarcity, synthetic data generation, and whether synthetic-trained models generalize to real-world messiness. +- **Enterprise ML disruption:** If TabFM holds up on real data, it could democratize predictive analytics — from data science teams to SQL analysts. The BigQuery integration makes it immediately accessible to Google Cloud users. +- **Non-commercial license:** The weights are non-commercial — worth noting in the context of open-source AI discussions (cf. [[../policy/intelligence-feudalism.md|Intelligenz-Feudalismus]] and [[reds-resilient-decentralized-swarm.md|ReDS]]). Code is Apache-2.0 but the model itself can't be commercially deployed. + +## Cross-References + +- [[../../institutions/deepmind.md]] — Google's AI research ecosystem +- [[../../institutions/google-cloud.md]] — BigQuery integration target +- [[../../institutions/hugging-face.md]] — Model weights hosting +- [[llm-model-catalog.md]] — Model landscape (non-LLM foundation model) +- [[llm-knowledge-base.md]] — Foundation model paradigm +- [[../policy/intelligence-feudalism.md]] — Non-commercial license in open-source context +- [[reds-resilient-decentralized-swarm.md]] — Open-source AI sovereignty + +## Sources + +- [`raw/other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md`](../raw/other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md) +- [Google Research Blog](https://research.google/blog/introducing-tabfm-a-zero-shot-foundation-model-for-tabular-data/) +- [AI Weekly](https://aiweekly.co/alerts/google-research-unveils-tabfm-a-zero-shot-model-for-tables) +- [Perplexity Discover](https://www.perplexity.ai/discover/you/google-unveils-tabfm-an-ai-mod-c9dDVfXgRf23UCWMJBvC1A) +- [GitHub](https://github.com/google-research/tabfm) +- [Hugging Face](https://huggingface.co/google/tabfm-1.0.0-pytorch) +- [TabArena Leaderboard](https://huggingface.co/spaces/TabArena/leaderboard) \ No newline at end of file diff --git a/wiki/index.md b/wiki/index.md index ef0c861..a516830 100644 --- a/wiki/index.md +++ b/wiki/index.md @@ -2,7 +2,7 @@ *Auto-generated: 2026-06-23* - *Letzte Aktualisierung: 2026-06-30 (48. Update — Brian Roemmele: "Intelligenz-Feudalismus" — Systematische 5-Punkte-Kritik an Anthropic. Safety-as-Moat, stille Qualitätsverschlechterung, asymmetrische Datenrechte, RSPs als feudale Struktur, Open-Source als Souveränität. Neue Seiten: `concepts/policy/intelligence-feudalism.md` + `raw/xpost/2026-06-30_roemmele-anthropic-intelligence-feudalism.md`.)* + *Letzte Aktualisierung: 2026-07-01 (49. Update — Google Research TabFM: Zero-Shot Foundation Model für tabulare Daten. Klassifikation + Regression ohne datensatz-spezifisches Training. #1 auf TabArena-Benchmark. Hybrid-Attention-Architektur (TabPFN + TabICL), Training auf 100M+ synthetischen Datensätzen via Structural Causal Models. BigQuery-Integration via `AI.PREDICT` SQL. Neue Seiten: `concepts/llm/tabfm-zero-shot-tabular-foundation-model.md` + `raw/other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md`.)* ## Architecture @@ -68,6 +68,7 @@ | [Chinese Model Cost Routing — The 87% Cost-Cut Playbook](concepts/llm/chinese-model-cost-routing.md) | DeRonin's 30-day field report: 6 Western→Chinese model swaps, 87% cost reduction, 4% quality drop, revenue unchanged. Swap matrix (Opus→Kimi K2.7, GPT-5.5→Qwen 3.7 Max, Sonnet→GLM 5.2, GPT-mini→MiMo V2.5, GPT-Image→Wan 2.5, Sora→Kling 3.0). Validates Barbell Routing + Factory-for-Gods thesis. Cross-refs to model-router skill | xpost/2026-06-29_deronin-chinese-ai-stack-cost-savings.md | | [MLX MoE Optimization — Why Apple Silicon Loves Mixture-of-Experts](concepts/llm/mlx-moe-local-ai-optimization.md) | Jun Song: MLX optimized for MoE not dense. Qwen3.6 27B on Mac = slow/hot. Minimax-M3.0 (dq) + DeepSeek-v4-Flash (dq) = smooth. Info-Gap: frontier AIs can't know this. Triple validation with DeRonin (cost) + TheProphet (macro) for same models | xpost/2026-06-29_junsong-mlx-moe-local-ai-info-gap.md | | [Local LLM Laptop Guide — Best Models Without a $10k Mac Studio](concepts/llm/local-llm-laptop-guide.md) | Paul Couvert: Top 5 local models for any laptop. Qwen3.6-27B/35B-A3B (coding), Gemma 4 12B (everyday), Parakeet 0.6B v3 (STT), Gemma 4 E4B (phone), Gemma 4 26B diffusion (speed). Unsloth quants + LM Studio/llama.cpp. Cross-platform companion to MLX MoE page. Resolves dense-27B tension (framework+quantization context) | xpost/2026-06-29_paulcouvert-local-llm-laptop-guide.md | +| [TabFM — Google's Zero-Shot Foundation Model for Tabular Data](concepts/llm/tabfm-zero-shot-tabular-foundation-model.md) | Google Research (30.06.2026): Zero-shot Klassifikation + Regression auf tabularen Daten ohne datensatz-spezifisches Training. Hybrid-Attention-Architektur (TabPFN row/col attention + TabICL ICL Transformer), Training auf 100M+ synthetischen SCM-Datensätzen. #1 auf TabArena. BigQuery-Integration via `AI.PREDICT` SQL. Non-commercial weights auf HF, Apache-2.0 code auf GitHub | other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md | ### AGI | Seite | Beschreibung | Quellen | @@ -252,3 +253,4 @@ | `raw/xpost/2026-06-29_junsong-mlx-moe-local-ai-info-gap.md` | xpost | Jun Song: MLX optimized for MoE not dense — local AI info gap on Apple Silicon | | `raw/xpost/2026-06-29_paulcouvert-local-llm-laptop-guide.md` | xpost | Paul Couvert: Best local models for laptop (Qwen3.6-27B, Gemma 4, Parakeet, Unsloth quants) | | `raw/xpost/2026-06-30_roemmele-anthropic-intelligence-feudalism.md` | xpost | Brian Roemmele: "Intelligenz-Feudalismus" — Systematische 5-Punkte-Kritik an Anthropic (Safety-as-Moat, Datenrechte, RSPs) | +| `raw/other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md` | other | Google Research unveils TabFM — Zero-Shot Foundation Model for Tabular Data | diff --git a/wiki/log.md b/wiki/log.md index 927fd90..da3c0e3 100644 --- a/wiki/log.md +++ b/wiki/log.md @@ -2,6 +2,18 @@ *Append-only changelog. Start: 2026-06-05* +## [2026-07-01] Ingest | Google Research — TabFM: Zero-Shot Foundation Model for Tabular Data +**Type:** ingest | **Scope:** raw/other, wiki/concepts/llm +**Source:** Perplexity Discover — https://www.perplexity.ai/discover/you/google-unveils-tabfm-an-ai-mod-c9dDVfXgRf23UCWMJBvC1A (originally from [Google Research Blog](https://research.google/blog/introducing-tabfm-a-zero-shot-foundation-model-for-tabular-data/)) +**Trigger:** Shared by Pit Weber in OME-Gruppe Topic "News & Infos" (Topic 13) on 2026-07-01. +**Actions:** +- raw: `raw/other/2026-07-01_google-tabfm-zero-shot-tabular-foundation-model.md` (created — 7.9 KB; Frontmatter [type: other, authors: Weihao Kong + Abhimanyu Das, tags: tabfm, tabular-data, foundation-model, zero-shot, in-context-learning, google-research, bigquery, synthetic-data, tabarena]. Content: Full summary, key facts table, architecture breakdown [3-stage hybrid: row/col attention → row compression → ICL Transformer], training section [100M+ synthetic SCM datasets], TabArena performance [2 configs, caveats], BigQuery integration, predecessor landscape table, research team, relevance notes, 5 cross-refs) +- wiki (NEW): `concepts/llm/tabfm-zero-shot-tabular-foundation-model.md` (created — 9.3 KB; Frontmatter [sources, tags]. Sektionen: TL;DR, Core Concept table, Architecture [3-stage hybrid with ASCII diagram, why-hybrid explanation], Training [synthetic SCM data table], Performance [TabArena, two configs table, honest caveats], BigQuery Integration [SQL example, before/after comparison table], Predecessor Landscape [4-row table], Google's Zero-Shot Family table, Relevance to Our Setup, 7 Cross-Refs, 7 external links) +- wiki: `index.md` (updated — Header auf "49. Update", neue LLM-Zeile für TabFM, neuer Raw-Sources-Eintrag) +- log: this entry +**Hector-Hauptthese:** TabFM erweitert das Foundation-Model-Paradigma über Sprache (LLMs) und Zeitreihen (TimesFM) auf tabulare Daten — das Rückgrat der Enterprise-ML-Infrastruktur. Die Architektur-Synthese aus TabPFN (2D-Attention) und TabICL (effizientes ICL) ist elegant: sie kombiniert Strukturverständnis mit Skalierbarkeit. Bemerkenswert ist das Training ausschließlich auf synthetischen Daten via Structural Causal Models — ein direktes Eingeständnis, dass hochwertige tabulare Datensätze in Open-Source nicht verfügbar sind (proprietäre Schemas, sensible Informationen). Das ist ein paradoxer Twist: Google nutzt seine Compute-Überlegenheit nicht für größere reale Datensätze, sondern für massenhafte synthetische Generierung. Die non-commercial-Lizenz auf Gewichte bei Apache-2.0-Code ist ein interessantes Zwischenmodell — ähnlich einigen Frontier-Modell-Releases. Verbindet sich mit Roemmele's Intelligenz-Feudalismus-Kritik (Datenrechte-Asymmetrie) und der ReDS/Open-Source-Souveränitäts-Diskussion. Die BigQuery-Integration via `AI.PREDICT` SQL ist der wirkliche Game-Changer: wenn Analysten Vorhersagen mit der gleichen Leichtigkeit machen können wie Aggregationen, verschiebt sich die Grenze zwischen "Datenanalyse" und "ML" massiv. +**Subagent-Modell:** ollama/glm-5.2:cloud + ## [2026-06-30] Ingest | Brian Roemmele — "Intelligenz-Feudalismus" (Intelligence Feudalism): Systematische Anthropic-Kritik **Type:** ingest | **Scope:** raw/xpost, wiki/people, wiki/concepts/policy, wiki/concepts/llm **Source:** X Post — https://x.com/BrianRoemmele/status/2071940093338690035