cs.LGNov 19, 2026

Antom 3-in-1 Transformer: A Payment Foundation Model

Authors: Weiyu Han, Haoyu Jiang, Jie Sheng, Youxi Pan, Xianglong Liu, Zeqi Ren, Dongquan Yi, Yinhao Liu, 

Organizations: Ant International · East China Normal University · Shanghai Jiao Tong University · Tongji University

Abstract

We report the development of Antom 3-in-1 Transformer, a payment foundation model that integrates sequence, tabular, and graph representations for payment risk detection. The model contains approximately 7B parameters, with approximately 1.7B activated per task route. Antom 3-in-1 Transformer is pretrained to learn reusable behavioral and relational representations, primarily on Ant International's internal payment data. In a cross-business transfer experiment, pretraining improves the target business metric by 34.5% over the same architecture trained from scratch. With only 25% of the training labels, the pretrained model outperforms the full-label scratch baseline in Average Precision (AP) and [email protected]% on different merchant domains. In a four-month online experiment on Ant International's billion-scale payment platform, the model reduced the overall loss rate by 37.88% relative to XGB-Online.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Large Payments Model

    Nov 11, 2026Natraj Raman, Abhenandhan Manoharan, Vishwasreddy Thuniki +12Representation LearningTabular Foundation Models

  2. TRIDENT-Seq: Profile-Matched Prefix-Future Contrast for Label-Efficient Payment Risk Modeling

    Oct 27, 2026Weiyu Han, Haoyu Jiang, Jie Sheng +7Financial Fraud DetectionContrastive Learning

  3. PRAGMA: Revolut Foundation Model

    Apr 9, 2026Maxim Ostroukhov, Ruslan Mikhailov, Vladimir Iashin +11Masked ModelingFinancial Services