cs.LGFeb 4, 2026

Federated Concept-Based Models: Interpretable models with distributed supervision

Authors: Dario Fenoglio, Arianna Casanova, Francesco De Santis, Gabriele Dominici, Johannes Schneider, Pietro Barbiero, Giovanni De Felice, Marc Langheinrich, 

Organizations: Universit`a della Svizzera italiana Lugano, Switzerland · University of Liechtenstein Vaduz, Liechtenstein · Politecnico di Torino Turin, Italy · IBM Research Zurich, Switzerland

Abstract

Concept-based Models (CMs) enhance interpretability in deep learning by grounding predictions in human-understandable concepts. However, concept annotations are costly and rarely available at scale within a single data source. Federated Learning (FL) could alleviate this limitation by enabling cross-institutional training over concept annotations distributed across multiple data owners. Yet, FL lacks interpretable modeling paradigms. Integrating CMs with FL is non-trivial: although FL supports heterogeneous and non-stationary client participation, it typically assumes a fixed shared architecture, whereas CMs may require architectural adaptation as the available concept set evolves. We propose Federated Concept-based Models (F-CMs), a new methodology for deploying CMs in evolving FL settings. F-CMs aggregate concept-level information across institutions and efficiently adapt the model architecture to changes in concept supervision while preserving privacy. Empirically, F-CMs maintain accuracy and intervention effectiveness comparable to training settings with full concept supervision, while outperforming on average non-adaptive federated baselines. Notably, F-CMs enable interpretable inference on concepts unavailable to a given institution, a key novelty over existing approaches.

Figures & tables

Appendix figures & tables35 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Enabling Federated Inference via Unsupervised Consensus Embedding

    May 7, 2026Yui Hashimoto, Takayuki Nishio, Yuichi Kitagawa +1Ensemble LearningPrivacy-Preserving ML

  2. Federated Rule Ensemble Method in Medical Data

    Apr 20, 2026Ke Wan, Kensuke Tanioka, Toshio ShimokawaInterpretable MLPrivacy-Preserving ML

  3. EFFEKT: Efficient Federated Knowledge Transfer to Foundation Models

    Aug 8, 2026Matteo Caligiuri, Francesco Barbato, Pietro Zanuttigh +1Federated Knowledge DistillationCross-Architecture Knowledge Distillation