Hugging Face's logo

Layer6
/
TabDPT

Tabular Classification
Tabular
In-Context-Learning
Transformer
Model card Files Community
TabDPT / README.md
rasaHusen's picture
rasaHusen
Update README.md
d2b60a7
preview code
|
raw
history blame contribute delete
1.17 kB
metadata
license: apache-2.0
pipeline_tag: tabular-classification
tags:
  - Tabular
  - In-Context-Learning
  - Transformer

TabDPT: Scaling Tabular Foundation Models

Installation 

git clone [email protected]:layer6ai-labs/TabDPT.git
cd TabDPT
pip install -e .

Example Usage

Please refer to the GitHub repo. For better performance, please increase context_size or increase n_ensembles to trade off speed and accuracy

Updates

Update April 2025: New Model

Version 1.1 is now available. We have improved the prediction performance of TabDPT through increased training stability.

Update December 2024: Faster Inference

Added support for flash attention (with bf16 precision) and compile flag. Both are enabled to True by default and should lead to a significant speed-up.

Citation 

@article{ma2024tabdpt,
  title={TabDPT: Scaling Tabular Foundation Models},
  author={Ma, Junwei and Thomas, Valentin and Hosseinzadeh, Rasa and Kamkari, Hamidreza and Labach, Alex and Cresswell, Jesse C and Golestan, Keyvan and Yu, Guangwei and Volkovs, Maksims and Caterini, Anthony L},
  journal={arXiv preprint arXiv:2410.18164},
  year={2024}
}