The Shift to Table-Native Foundation Models
Tabular Foundation Models (TFMs) move tabular prediction from task-specific Gradient Boosted Decision Trees (GBDTs), such as XGBoost and CatBoost, toward “table-native” models built on In-Context Learning (ICL). The training data becomes a contextual prompt, and the model produces zero-shot predictions in a single forward pass without parameter updates.