Google TabFM: Nullskudds prediksjon for tabulære data

Architecture: alternating row-column attention

TabFM uses a hybrid-attention (alternating row-column) transformer architecture . Unlike text data, which is one-dimensional, tabular data requires understanding relationships across both rows and columns simultaneously. TabFM alternates attention between:

• Column-wise attention to capture dependencies between features
• Row-wise attention to capture dependencies between samples

This two-stage mechanism builds fixed-dimensional embeddings of rows and columns, allowing the model to generalize to arbitrary table structures at inference time . The approach combines elements from prior tabular foundation models, including TabPFN-style row/column attention and TabICL-style in-context learning .

Training entirely on synthetic data

TabFM was trained entirely on hundreds of millions of synthetic datasets generated by structural causal models (SCMs) . This approach sidesteps the scarcity and quality issues of open-source tabular data, much of which contains sensitive or proprietary information that cannot be freely used for large-scale pre-training . By controlling the data generation process, Google ensured a diverse and well-distributed training corpus without relying on real-world business data .

TabArena ranking: state-of-the-art results

TabFM was validated on TabArena, a living Elo-rated benchmark for tabular ML methods that features a public leaderboard at tabarena.ai . According to Google's reported results:

• TabFM-Ensemble (using 32 ensembles with cross-sectional and SVD features) achieves state-of-the-art results on TabArena, leading the leaderboard for both classification and regression tasks .
• TabFM-Single (single forward pass without ensembling) delivers strong second-place results, competitive with or exceeding prior tabular foundation models like TabPFN v2 and tuned gradient-boosted trees .

The exact Elo scores depend on the live leaderboard state, but Google's own figures show TabFM-Ensemble at the top in both classification and regression panels . As of early July 2026, the top single-model position on the TabArena classification leaderboard was held by TabPFN-3 (Elo 1721), with ensemble-based methods like AutoGluon extreme (4h) as the overall ceiling . TabFM's entry shifts that competitive landscape.

Licensing: dual model

TabFM uses a dual-license model:

The model weights are released under a non-commercial, source-available license — meaning they are not fully open source by the OSI definition or the G7's 2026 four-tier framework . The inference code and sample notebooks, however, use the permissive Apache 2.0 license . This pattern mirrors Google's approach with other research models such as Gemma (which later moved to Apache 2.0 for newer generations ) and is consistent with how Prior Labs releases TabPFN model weights under non-commercial terms .

BigQuery integration via AI.PREDICT

Google plans to directly integrate TabFM into BigQuery within the weeks following the announcement . BigQuery users will be able to run zero-shot classification and regression using the AI.PREDICT SQL command, following the syntax pattern of BigQuery ML's existing managed inference functions (similar to AI.FORECAST for TimesFM) . The expected syntax is:

SELECT * FROM AI.PREDICT(
  MODEL tabfm,
  TABLE your_data
)

This integration would allow data teams to apply TabFM predictions directly in SQL without managing separate ML infrastructure or model deployments . As of the announcement date (July 1, 2026), this integration was described as imminent but not yet reflected in BigQuery release notes . Google's existing BigQuery ML ecosystem already supports managed inference for TimesFM (AI.FORECAST), custom models (ML.PREDICT), and third-party open models from Hugging Face ; TabFM would be the first tabular foundation model to receive a built-in AI.PREDICT shortcut.

Key caveats to keep in mind

• The official Google Research blog post was published on July 1, 2026, meaning this is very recent . Some details — the full academic paper, exact live TabArena scores at release, and the precise BigQuery release timeline — may still be in flux.
• No official Google Research paper or arXiv preprint was publicly available at the time of this analysis. Technical architecture details come from secondary reporting and the blog post .
• The AI.PREDICT function currently documented for BigQuery ML uses ML.PREDICT with a registered model object ; the AI.PREDICT syntax for TabFM may be a new built-in shortcut analogous to AI.FORECAST for TimesFM, not yet documented in release notes as of this writing.
• TabFM's non-commercial weight license limits commercial use without a separate agreement, which may affect enterprise adoption plans.