cs.AINov 13, 2026

Experts Across Schemas: Agent-Guided Mixture-of-Relational-Experts for Cross-Database Generalization

Authors: Hiren Madhu, Sukanta Ganguly, Kiran Srinivasan, Smita Krishnaswamy, Rex Ying

Organizations: Yale University, USA · NetApp, USA

Abstract

Web platforms record user and item activity in relational databases whose schemas differ from platform to platform, which makes it difficult to transfer predictive models between them. Relational foundation models address this through cross-database pretraining, yet recent improvements have relied on increasingly large pretraining corpora. We ask whether a better architecture, together with features specific to the target database, can deliver comparable gains from far less pretraining data. We introduce MoREGT, a mixture-of-relational-experts graph transformer that represents both rows and cells as tokens, adds the log-ages of rows and the names of foreign-key relationships to attention, and routes cells and rows to experts by column metadata rather than by values. A label-blind LLM agent complements the model: it reads the target database's schema and column statistics and adds validated single-row derived columns, without access to labels or model scores. On 21 RelBench tasks with leave-one-database-out pretraining on six databases, the MoREGT backbone improves on the Relational Transformer pretrained on the same databases by 2.25 points of mean AUROC and 5.83 points of mean nMAE. The agent's columns raise mean AUROC from 78.45 to 79.63 and lower mean nMAE from 27.91 to 26.98, the highest means on both metrics among the compared methods, including RT-J, which pretrains on about 400 times as many databases.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. RelAgent: LLM Agents as Data Scientists for Relational Learning

    May 8, 2026Xingyue Huang, Louis Tichelman, Jinwoo Kim +2Interpretable MLLLM Agents

  2. RT-J: Large-Scale Pretraining of Relational Transformers for Context-Efficient Predictions

    Oct 13, 2026Rishabh Ranjan, Vignesh Kothapalli, Harshvardhan Agarwal +5Relational ICLRelational Foundation Models