Vertical federated learning (VFL) allows an active party with a top model, and multiple passive parties with bottom models to collaborate. In this scenario, passive parties possessing only features may attempt to infer active party's private labels, making label inference attacks (LIAs) a significant threat. Previous LIA studies have claimed that well-trained bottom models can effectively represent labels. However, we demonstrate that this view is misleading and exposes the vulnerability of existing LIAs. By leveraging mutual information, we present the first observation of the "model compensation" phenomenon in VFL. We theoretically prove that, in VFL, the mutual information between layer outputs and labels increases with layer depth, indicating that bottom models primarily extract feature information while the top model handles label mapping. Building on this insight, we introduce task reassignment to show that the success of existing LIAs actually stems from the distribution alignment between features and labels. When this alignment is disrupted, the performance of LIAs declines sharply or even fails entirely. Furthermore, the implications of this insight for defenses are also investigated. We propose a zero-overhead defense technique based on layer adjustment. Extensive experiments across five datasets and five representative model architectures indicate that shifting cut layers forward to increase the proportion of top model layers in the entire model not only improves resistance to LIAs but also enhances other defenses.
Figures & tables
Fig. 1: An illustration of the vertical federated learning framework. Solid lines represent forward propagation and dashed lines denote backpropagation.
Fig. 2: Mutual information between the outputs of each layer and the labels for different datasets and models. In each subfigure, the left side of the gray dotted line corresponds to the bottom model, while the right side corresponds to the top model. Lines of different colors indicate different passive parties. From left to right, the number of passive parties gradually increases.
Fig. 3: The mutual information between the cut layer of the bottom model and the labels decreases as the number of passive parties increases.
Fig. 4: The topology of the lumped Markov chains in VFL.
LIA
Dataset
Original Task
New Task 1
New Task 2
New Task 3
Attack Acc.
MTA
Attack Acc.
Δ MTA
Attack Acc.
Δ MTA
Attack Acc.
Δ MTA
Cluster
MNIST
85.54 ± 6.54%
97.10 ± 0.06%
37.48 ± 3.50%
-0.002
25.56 ± 4.02%
-0.000
17.00 ± 4.27%
0.003
CIFAR-10
18.66 ± 3.92%
60.44 ± 0.95%
17.29 ± 1.37%
-0.004
11.62 ± 3.67%
0.004
10.89 ± 0.85%
-0.006
CINIC-10
13.78 ± 0.68%
74.82 ± 1.34%
12.32 ± 1.28%
-0.012
11.79 ± 1.95%
0.004
10.79 ± 0.65%
-0.005
SVHN
20.50 ± 6.21%
90.11 ± 0.90%
11.46 ± 1.57%
0.001
9.70 ± 0.31%
-0.001
9.56 ± 0.62%
-0.004
GTSRB
36.33 ± 3.21%
73.71 ± 3.87%
12.69 ± 1.65%
-0.008
11.47 ± 2.14%
-0.001
4.42 ± 2.06%
-0.012
TABLE I: Performance of LIAs under newly assigned tasks
Fig. 5: Trends of attack accuracy and mutual information under different tasks. The first column presents the attack accuracy of LIA with cluster method. The second column presents the attack accuracy of LIA with model completion method. The third column presents the mutual information between the dataset features and the labels.
LIA
Dataset
Cut Layer Position: -2
Cut Layer Position: -3
Cut Layer Position: -4
Cut Layer Position: -5
Attack Acc.
MTA
Attack Acc.
Δ MTA
Attack Acc.
Δ MTA
Attack Acc.
Δ MTA
Cluster
MNIST
94.72 ± 4.70%
97.04 ± 0.09%
88.25 ± 6.68%
0.002
86.83 ± 6.22%
0.001
85.54 ± 6.54%
0.001
CIFAR-10
37.93 ± 7.35%
60.09 ± 1.79%
28.56 ± 5.90%
0.010
19.44 ± 3.36%
0.009
18.66 ± 3.92%
0.004
CINIC-10
44.31 ± 10.81%
73.35 ± 2.78%
24.35 ± 7.47%
0.007
16.96 ± 4.41%
-0.003
13.78 ± 0.68%
0.015
SVHN
72.96 ± 8.20%
89.80 ± 0.61%
40.61 ± 10.24%
0.002
30.10 ± 4.20%
0.001
20.50 ± 6.21%
0.003
GTSRB
55.50 ± 4.67%
72.52 ± 2.48%
54.58 ± 5.22%
0.000
49.59 ± 5.02%
0.003
36.33 ± 3.21%
0.012
TABLE II: The impact of cut layer position on MTA and attack accuracy
Fig. 6: An illustration of moving the cut layer position. Each layer of the model is depicted as an ellipse. We keep the total number of layers in the VFL model unchanged and only adjust the position of the cut layer.
Fig. 7: Mutual information decreases when the cut layer is moved closer to the bottom of the model.
Fig. 8: Moving the cut layer closer to bottom models can effectively enhance other defenses against LIAs.
Fig. 9: Robustness of the defense effect across networks with varying widths.
Fig. 10: Robustness of the defense effect across networks of different depths.
Fig. 11: Robustness of the defense effect across distinct model architectures.
A typical Vertical Federated Learning (VFL) scenario involves several participants collaboratively training a machine learning model, where each party has different features for the same samples, with labels held exclusively by one party. Since labels contain sensitive information, VFL must ensure the privacy of labels. However, existing VFL-targeted label inference attacks are either limited to specific scenarios or require auxiliary data, rendering them impractical in real-world applications. We introduce a novel Label Enumeration Attack (LEA) that, for the first time, achieves applicability across multiple VFL scenarios and eschews the need for auxiliary data. Our intuition is that an adversary, employing clustering to enumerate mappings between samples and labels, ascertains the accurate label mappings by evaluating the similarity between the benign model and the simulated models trained under each mapping. To achieve that, the first challenge is how to measure model similarity, as models trained on the same data can have different weights. Drawing from our findings, we propose an efficient approach for assessing congruence based on the cosine similarity of the first-round loss gradients, which offers superior efficiency and precision compared to the comparison of parameter similarities. However, the computational cost may be prohibitive due to the necessity of training and comparing the vast number of simulated models generated through enumeration. To overcome this challenge, we propose Binary-LEA from the perspective of reducing the number of models and eliminating futile training, which lowers the number of enumerations from n! to n^3. Moreover, LEA is resilient against common defense mechanisms such as gradient noise and gradient compression.
Wenhao Jiang, Shaojing Fu, Yuchuan Luo +1
College of Computer Science and Technology, National University of Defense Technology, Changsha, China
As a distributed collaborative machine learning paradigm, vertical federated learning (VFL) allows multiple passive parties with distinct features and one active party with labels to collaboratively train a model. Although it is known for the privacy-preserving capabilities, VFL still faces significant privacy and security threats from backdoor attacks. Existing backdoor attacks typically involve an attacker implanting a trigger into the model during the training phase and executing the attack by adding the trigger to the samples during the inference phase. However, in this paper, we find that triggers are not essential for backdoor attacks in VFL. In light of this, we disclose a new backdoor attack pathway in VFL by introducing a feature-based triggerless backdoor attack. This attack operates under a more stringent security assumption, where the attacker is honest-but-curious rather than malicious during the training phase. It comprises three modules: label inference for the targeted backdoor attack, poison generation with amplification and perturbation mechanisms, and backdoor execution to implement the attack. Extensive experiments on five benchmark datasets demonstrate that our attack outperforms three baseline backdoor attacks by 2 to 50 times while minimally impacting the main task. Even in VFL scenarios with 32 passive parties and only one set of auxiliary data, our attack maintains high performance. Moreover, when confronted with distinct defense strategies, our attack remains largely unaffected and exhibits strong robustness. We hope that the disclosure of this triggerless backdoor attack pathway will encourage the community to revisit security threats in VFL scenarios and inspire researchers to develop more robust and practical defense strategies.
Yige Liu, Yiwei Lou, Che Wang +2
Key Laboratory of High Confidence Software Technologies (Peking University), Ministry of Education; School of Computer Science, Peking University, Beijing, China. · Zhongguancun Laboratory, Beijing, China.
Vertical Federated Learning (VFL) enables organizations holding complementary features of shared entities to collaborate and train models. In this setting, the initiator can withhold information about the learning task, while other contributors participate without exposing their local datasets, creating an asymmetric information structure aligned with growing privacy demands. However, this asymmetry is a double-edged sword. Among various threats, backdoor attacks are particularly concerning because VFL not only enables malicious contributors to poison the model during training, but also allows them to activate the backdoor at inference time to manipulate predictions. Although prior work has reported near-perfect attack success rates and proposed effective defenses, we find that most findings fail to hold under realistic conditions, exposing a fundamental gap between research and practice. In this paper, we present a systematic, practice-oriented study of backdoor vulnerabilities in VFL, revealing this gap in both methodological design and evaluation practices. We show that existing approaches overlook key practical constraints and therefore rely on unrealistic prior knowledge. Furthermore, these limitations have remained hidden due to poorly designed evaluation practices in the literature. To bridge this gap, we redefine threat models under realistic constraints, propose practical backdoor workflows, and introduce BVBench, a backdoor-centric benchmark that enables fair, practical, and comprehensive evaluation, preloaded with state-of-the-art baselines. BVBench provides strong evidence of the fragility of the current understanding of VFL backdoor risks and establishes a foundation for steering research toward uncovering practical vulnerabilities and developing more meaningful defenses.
Ziqi Zhao, Jialin Lu, Junjie Shan +3
School of Computing and Data Science, The University of Hong Kong, Hong Kong SAR, China