FUSE: Fairness-aware Update Screening against Byzantine Exploitation in -Fair Federated Learning
Organizations: George Mason University · The University of Hong Kong · Huazhong University of Science and Technology · The Chinese University of Hong Kong, Shenzhen ·
Abstract
Client-level fair federated learning, in the form of -fair federated learning (-FFL), agnostic federated learning, or tilted empirical risk minimization, has emerged as an attractive solution to equalize utility across heterogeneous clients. This paradigm grants high-loss clients greater relative influence, while a central server aggregates their loss-weighted updates into a single shared model. Yet, the Byzantine robustness of -fair federated learning has been largely neglected, leaving the server unable to tell legitimate fairness-induced amplification from malicious update scaling. To address this critical gap, we formalize the problem of Byzantine-robust -fair federated learning under an update-only interface, in which the server observes nothing but the fairness-scaled client updates. Our analysis under shared class-conditional label skew shows that fairness scaling preserves the nonnegative class-mixture structure of honest updates, while replacing their unit-sum constraint by a client-dependent radial scale. Moving beyond magnitude-based screening, we show that this warped geometry supplies two complementary tests, one radial and one structural, that a single norm cannot provide. We then introduce FUSE, a structure-aware robust aggregator that uses a small trusted labeled dataset for coefficient recovery, scale and cone-consistency screening, and post-screening step-size control. Across four benchmarks and seven Byzantine attacks, FUSE improves seed-wise worst-attack accuracy over the strongest baseline on each benchmark by 3.9--30.1 percentage points, while largely preserving the influence of the high-loss honest clients that fairness is meant to protect.
Figures & tables
| High-loss honest rejected | Byzantine rejected | ||||
|---|---|---|---|---|---|
| Dataset/model | Method | Pooled | Worst | Pooled | Worst |
| CIFAR-10/ResNet-18 | H-nobs | ||||
| BOBA (cls.) | |||||
| FUSE | |||||
| MNIST/MLP | H-nobs | ||||
| BOBA (cls.) | |||||
| Variant | Scale | Cone | Loss norm. | Clean | Magnitude | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Worst attack |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FUSE | ✓ | ✓ | ✓ | 79.03 | 78.97 | 77.50 | 77.83 | 78.82 | 78.50 | 79.28 | 78.71 | 77.50 / 68.37 |
| w/o scale | – | ✓ | ✓ | 79.03 | 52.38 | 78.20 | 76.08 | 78.82 | 78.97 | 79.00 | 79.03 | 52.38/40.25 |
| w/o cone | ✓ | – | ✓ | 79.03 | 78.67 | 69.95 | – | 78.82 | 55.16 | 36.71 | 38.94 | – |
| w/o scale and cone | – | – | ✓ | 79.03 | 63.23 | 70.16 | – | 26.11 | 63.20 | 34.07 | 35.66 | – |
| w/o loss norm. | ✓ | ✓ | – | 78.04 | 70.06 | 73.33 | 74.01 | 77.89 | 76.98 | 76.04 | 76.02 | 70.06 / 59.88 |
| cone only | – | ✓ | – | 78.04 | 10.89 | 71.59 | 75.30 | 77.65 | 76.87 | 78.04 | 78.04 | 10.89/0.05 |
Appendix figures & tables42 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Model | LR | Rounds | Classes | Batch | Weight decay |
|---|---|---|---|---|---|---|
| CIFAR-10 | ResNet-18 | 0.03 | 1500 | 10 | whole client | 0 |
| MNIST | MLP (784–200–10) | 0.10 | 1000 | 10 | whole client | |
| EMNIST-Balanced | five-layer CNN | 0.03 | 1000 | 47 | whole client | |
| AGNews | one-layer GRU | 0.05 | 2000 | 4 | whole client |
| Method | Same fair update | Extra trusted server data | Output | Uses declared |
|---|---|---|---|---|
| q-FFL-GD (mean) | Yes | No | Shared global | No |
| H-nobs | Yes | No | Shared global | Yes |
| Trimmed Mean | Yes | No | Shared global | – |
| Median | Yes | No | Shared global | No documented dependence |
| Krum | Yes | No | Shared global | – |
| Multi-Krum | Yes | No | Shared global | – |
| Dataset | Clean | Sign | IPM | Gauss. | ALIE | Min-Max | Min-Sum | Mag. | Worst attack |
|---|---|---|---|---|---|---|---|---|---|
| CIFAR-10 / ResNet-18 | 78.34/68.84 | 11.01/0.30 | collapsed (18) | 76.29/66.97 | 24.27/11.68 | 45.57/33.37 | 65.26/53.62 | 62.50/51.41 | 11.01/0.30 |
| MNIST / MLP | n/a | 92.57/87.26 | collapsed (17) | n/a | collapsed (779) | n/a | n/a | 94.73/90.52 | – |
| EMNIST-Balanced / CNN | n/a | n/a | 2.69/0.17 | n/a | n/a | n/a | n/a | n/a | – |
| AGNews / GRU | n/a | n/a | incomplete (1047) | n/a | n/a | n/a | n/a | n/a | – |
| Method | Clean | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Magnitude | Worst attack |
|---|---|---|---|---|---|---|---|---|---|
| q-FFL-GD (mean) | / | / | - | / (3) | / | / (4) | / | / (4) | - |
| H-nobs | / | / (3) | / | / | / | / | / | / | / (3) |
| Trimmed Mean | / | / | / | / | / | / | / | / | / |
| Median | / | / | / | / | / | / | / | / | / |
| Krum | / | / | / | / | / | / | / | / | / |
| Multi-Krum | / | / (3) | / | / | / | / | / | / | / (3) |
| Method | Clean | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Magnitude | Worst attack |
|---|---|---|---|---|---|---|---|---|---|
| q-FFL-GD (mean) | / | / | - | / (3) | / | / (3) | / (3) | / (3) | - |
| H-nobs | / | / (3) | / | / | / | / | / (3) | / | / (3) |
| Trimmed Mean | / | / | / (4) | / | / (3) | / (3) | / (3) | / | / (3) |
| Median | / (4) | / (3) | / (3) | / (3) | / (3) | / (3) | / (3) | / (4) | / (2) |
| Krum | / | / | / | / | / (3) | / | / | / | / (3) |
| Multi-Krum | / | / (3) | / | / | / (3) | / | / (3) | / | / (3) |
| Method | Clean | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Magnitude | Worst attack |
|---|---|---|---|---|---|---|---|---|---|
| q-FFL-GD (mean) | / | / | - | / (1) | / (3) | / (3) | / (3) | / | - |
| H-nobs | / | / (2) | / | / | / (3) | / (3) | / (3) | / | / (2) |
| Trimmed Mean | / | / | / (4) | / | / (4) | / (3) | / (3) | / | / (2) |
| Median | / (4) | / | / | / (3) | / (4) | / (3) | / (3) | / (3) | / (3) |
| Krum | / | / (2) | / | / | / (3) | / (3) | / (3) | / | / (2) |
| Multi-Krum | / | / (3) | / (4) | / | / (4) | / (3) | / (3) | / | 38.14/30.05 |
| Method | Clean | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Magnitude | Worst attack |
|---|---|---|---|---|---|---|---|---|---|
| q-FFL-GD (mean) | / | / | - | / (4) | / | / | / (4) | / | - |
| H-nobs | / | / (3) | / | / | / | / | / | / | / (3) |
| Trimmed Mean | / | / | / | / | / | / | / | / | / |
| Median | / | / | / | / | / | / | / | / | / |
| Krum | / | / | / | / | / | / | / | / | / |
| Multi-Krum | / | / | / | / | / | / | / | / | / |
| Dataset | Baseline | FUSE worst attack | Baseline worst attack | [95% CI] | ( ) |
|---|---|---|---|---|---|
| CIFAR-10 / ResNet-18 | q-FFL-GD (mean) | 73.88 | - | - | - |
| CIFAR-10 / ResNet-18 | H-nobs | 73.88 | 12.19 | +63.89 [+56.93, +67.83] | 0.250 (3) |
| CIFAR-10 / ResNet-18 | Trimmed Mean | 73.88 | 13.18 | +60.70 [+52.08, +67.62] | 0.062 (5) |
| CIFAR-10 / ResNet-18 | Median | 73.88 | 12.34 | +61.53 [+53.51, +68.25] | 0.062 (5) |
| CIFAR-10 / ResNet-18 | Krum | 73.88 | 21.67 | +52.21 [+43.96, +61.29] | 0.062 (5) |
| CIFAR-10 / ResNet-18 | Multi-Krum | 73.88 | 12.97 | +63.12 [+56.20, +66.92] | 0.250 (3) |
| Variant | Scale | Cone | Loss norm. | Clean | Magnitude | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Worst attack |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FUSE | ✓ | ✓ | ✓ | 79.03 / 70.41 | 78.97 / 70.38 | 77.50 / 68.37 | 77.83 / 68.91 | 78.82 / 69.57 | 78.50 / 69.28 | 79.28 / 70.73 | 78.71 / 69.93 | 77.50 / 68.37 |
| w/o scale | – | ✓ | ✓ | 79.03 / 70.41 | 52.38/40.25 | 78.20 / 69.08 | 76.08 / 66.91 | 78.82 / 69.57 | 78.97 / 70.16 | 79.00 / 70.29 | 79.03 / 70.41 | 52.38/40.25 |
| w/o cone | ✓ | – | ✓ | 79.03 / 70.41 | 78.67 / 70.09 | 69.95/59.40 | – | 78.82 / 69.57 | 55.16/42.83 | 36.71/24.49 | 38.94/27.18 | – |
| w/o scale and cone | – | – | ✓ | 79.03 / 70.41 | 63.23/51.72 | 70.16/59.92 | – | 26.11/13.69 | 63.20/50.88 | 34.07/22.76 | 35.66/23.99 | – |
| w/o loss norm. | ✓ | ✓ | – | 78.04 / 69.52 | 70.06/59.88 | 73.33/63.97 | 74.01/64.70 | 77.89 / 68.61 | 76.98/67.90 | 76.04/67.28 | 76.02/67.30 | 70.06 / 59.88 |
| cone only | – | ✓ | – | 78.04 / 69.52 | 10.89/0.05 | 71.59/62.06 | 75.30/65.97 | 77.65/69.14 | 76.87/68.40 | 78.04/69.52 | 78.04/69.52 | 10.89/0.05 |
| Variant | Scale | Cone | Loss norm. | Clean | Magnitude | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Worst attack |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FUSE | ✓ | ✓ | ✓ | 93.95 / 89.26 | 93.94/89.23 | 93.20/88.09 | 92.35 / 87.01 | 93.95 / 89.26 | 93.94/89.14 | 93.94/89.23 | 93.96/89.26 | 92.35 / 87.01 |
| w/o scale | – | ✓ | ✓ | 93.95 / 89.26 | 94.40 / 89.91 | 93.22/88.23 | 91.83/86.29 | 93.95 / 89.26 | 93.95/89.27 | 93.95/89.26 | 93.95/89.26 | 91.83/86.29 |
| w/o cone | ✓ | – | ✓ | 93.95 / 89.26 | 93.96/89.27 | 92.43/87.07 | – | 93.95 / 89.26 | 93.97/89.38 | 89.06/83.15 | 55.42/41.64 | – |
| w/o scale and cone | – | – | ✓ | 93.95 / 89.26 | 95.14 / 89.63 | 92.39/87.11 | – | 52.87/39.71 | 93.96/89.21 | 89.78/84.07 | 79.52/69.42 | – |
| w/o loss norm. | ✓ | ✓ | – | 93.97 / 89.29 | 93.98/89.26 | 93.24 / 88.15 | 92.34 / 87.06 | 93.97 / 89.29 | 93.96/89.14 | 93.98 / 89.29 | 93.98 / 89.29 | 92.34 / 87.06 |
| cone only | – | ✓ | – | 93.97 / 89.29 | – | 93.27 / 88.25 | 92.09/86.73 | 93.97 / 89.29 | 93.98 / 89.29 | 93.97 / 89.29 | 93.97 / 89.29 | – |
| Variant | Scale | Cone | Loss norm. | Clean | Magnitude | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Worst attack |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FUSE | ✓ | ✓ | ✓ | 79.59 / 70.34 | 79.59/70.34 | 79.31 / 70.05 | 79.51 / 70.33 | 79.30 / 69.89 | 79.70 / 70.65 | 79.59 / 70.34 | 79.59 / 70.34 | 79.30 / 69.89 |
| w/o scale | – | ✓ | ✓ | 79.59 / 70.34 | 82.69 / 74.52 | 79.31 / 70.05 | 79.21 / 70.12 | 79.30 / 69.89 | 79.70 / 70.65 | 79.59 / 70.34 | 79.59 / 70.34 | 79.21 / 69.89 |
| w/o cone | ✓ | – | ✓ | 79.59 / 70.34 | 79.59/70.34 | 71.50/62.16 | – | 79.30 / 69.89 | 77.99/68.66 | 58.36/46.70 | 59.18/47.88 | – |
| w/o scale and cone | – | – | ✓ | 79.59 / 70.34 | 82.47 / 73.37 | 71.50/62.16 | – | – | 77.99/68.66 | 58.36/46.70 | 59.18/47.88 | – |
| w/o loss norm. | ✓ | ✓ | – | 80.34 / 71.73 | 80.34/71.73 | – | – | 20.01 / 11.20 | 58.01/48.11 | 80.34 / 71.73 | 80.34 / 71.73 | – |
| cone only | – | ✓ | – | 80.34 / 71.73 | – | – | – | 20.01 / 11.20 | 58.01/48.11 | 80.34 / 71.73 | 80.34 / 71.73 | – |
| Variant | Scale | Cone | Loss norm. | Clean | Magnitude | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Worst attack |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FUSE | ✓ | ✓ | ✓ | 83.66 / 68.09 | 83.65/68.09 | 79.45/62.86 | 81.56/65.49 | 83.35 / 67.62 | 81.31 / 68.09 | 83.14 / 67.13 | 82.94/66.88 | 79.45 / 62.86 |
| w/o scale | – | ✓ | ✓ | 83.64 / 68.03 | 86.53/73.99 | 83.64 / 68.03 | 83.64 / 68.03 | 83.65 / 68.06 | 80.44/66.99 | 83.64 / 68.03 | 83.70 / 68.16 | 80.44 / 66.99 |
| w/o cone | ✓ | – | ✓ | 83.66 / 68.09 | 83.66/68.09 | – | – | 28.34/17.87 | 80.53/67.12 | 40.94/16.66 | 55.80/37.26 | – |
| w/o scale and cone | – | – | ✓ | 83.66 / 68.09 | 86.90 / 75.05 | – | – | 28.41/16.32 | 81.26 / 67.35 | 43.55/21.00 | 56.08/36.75 | – |
| w/o loss norm. | ✓ | ✓ | – | 81.93/66.28 | 81.93/66.28 | 62.69/46.97 | 68.08/50.74 | 35.92/25.22 | 71.58/58.13 | 76.38/62.02 | 84.18 / 68.95 | 35.92/25.22 |
| cone only | – | ✓ | – | 81.93/66.28 | 67.41/46.86 | 81.93 / 66.28 | 81.93 / 66.28 | 81.93/66.33 | 77.01/63.68 | 81.93/66.28 | 79.36/62.37 | 67.41/46.86 |
| Attack | Recall | Honest FPR | Fair mass | Scale used | Cone used |
|---|---|---|---|---|---|
| Sign Flip | 58.4 | 16.7 | 82.9 | 0.15 | 3.85 |
| IPM ( ) | 59.4 | 16.2 | 83.6 | 0.06 | 3.94 |
| Gaussian | 100.0 | 0.0 | 100.0 | 4.00 | 0.00 |
| ALIE | 94.9 | 2.0 | 97.3 | 0.17 | 3.83 |
| Min-Max | 99.6 | 0.2 | 99.8 | 0.01 | 3.98 |
| Min-Sum | 99.7 | 0.1 | 99.8 | 0.03 | 3.97 |
| Dataset | Screened coords. | med. [p10, p90] | med. | med. / p90 | med. / p90 | gap med. / p90 | ||
|---|---|---|---|---|---|---|---|---|
| CIFAR-10 / ResNet-18 | classifier (5,130) | 0 | 0.92 [0.81, 1.18] | 0.65 | 0.080 / 0.111 | 0.102 / 0.175 | +0.024 / +0.066 | 1.00 |
| 1 | 0.92 [0.81, 1.18] | 0.59 | 0.080 / 0.111 | 0.111 / 0.223 | +0.035 / +0.113 | 1.00 | ||
| full (11,173,962) | 0 | 0.92 [0.81, 1.18] | 0.28 | 0.823 / 0.890 | 1.242 / 1.660 | +0.427 / +0.799 | 1.00 | |
| 1 | 0.92 [0.81, 1.18] | 0.26 | 0.823 / 0.890 | 1.307 / 2.079 | +0.502 / +1.267 | 1.00 | ||
| MNIST / MLP | classifier (2,010) | 0 | 0.24 [0.20, 0.30] | 0.88 | 0.178 / 0.297 | 0.185 / 0.306 | +0.008 / +0.047 | 1.00 |
| 1 | 0.24 [0.20, 0.30] | 0.21 | 0.178 / 0.297 | 1.077 / 3.247 | +0.899 / +3.057 | 1.00 |
| Structural model | Clean | Sign Flip | Magnitude | IPM | Min-Max | Min-Sum | |
|---|---|---|---|---|---|---|---|
| No screening | 1 | 93.95/89.26 | 92.39/87.11 | 95.20/90.06 | n/a | n/a | n/a |
| Simplex screening | 0 | 96.55/92.13 | 96.44/91.93 | 96.62/92.33 | n/a | n/a | n/a |
| Simplex screening | 1 | 93.95/89.26 | 93.85/89.08 | 93.95/89.26 | 89.91/83.98 | 92.91/87.46 | 92.83/87.40 |
| Scale + cone | 1 | 93.95/89.26 | 93.20/88.09 | 93.96/89.27 | 92.35/87.01 | 93.94/89.23 | 93.96/89.26 |
| Simplex screening, | Scale + cone, | |||||
|---|---|---|---|---|---|---|
| Attack | Recall | Honest FPR | Global acc. | Recall | Honest FPR | Global acc. |
| Sign Flip | 0.92 | 0.03 | 93.85 | 0.58 | 0.17 | 93.20 |
| Magnitude | 0.99 | 0.00 | 93.95 | 0.99 | 0.00 | 93.96 |
| IPM | 0.45 | 0.22 | 89.91 | 0.62 | 0.15 | 92.35 |
| Min-Max | 0.56 | 0.18 | 92.91 | 1.00 | 0.00 | 93.94 |
| Min-Sum | 0.62 | 0.15 | 92.83 | 1.00 | 0.00 | 93.96 |
| Pearson | Spearman | OLS slope | MALE | |
|---|---|---|---|---|
| 0.1 | 0.153 | 0.179 | 1.88 | 3.997 |
| 0.5 | 0.400 | 0.355 | 1.11 | 0.695 |
| 1.0 | 0.608 | 0.537 | 1.02 | 0.301 |
| 1.5 | 0.736 | 0.670 | 1.00 | 0.180 |
| 2.0 | 0.817 | 0.751 | 1.00 | 0.123 |
| 3.0 | 0.903 | 0.848 | 0.99 | 0.070 |
| Clean | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Magnitude | Worst | honest med/p90 | recall / FPR | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 93.95/89.26 | 93.20/88.09 | 92.35/87.01 | 93.95/89.26 | 93.94/89.14 | 93.94/89.23 | 93.96/89.26 | 93.96/89.27 | 92.35/87.01 | 0.139/0.238 | 0.944 | 0.88 / 0.05 |
| 2 | 94.98/90.37 | 92.85/87.57 | 91.33/85.96 | 94.98/90.37 | 94.95/90.22 | 95.01/90.41 | 95.01/90.45 | 94.98/90.37 | 91.33/85.96 | 0.246/0.391 | 0.981 | 0.81 / 0.08 |
| 5 | 96.06/91.42 | 94.07/89.02 | 91.45/85.78 | 96.06/91.42 | 96.03/91.49 | 96.04/91.47 | 96.05/91.52 | 96.06/91.42 | 91.45/85.78 | 0.358/0.530 | 0.976 | 0.79 / 0.08 |
| 0.5 | 1.0 | 1.5 | 2.0 | |
| Worst-attack global accuracy | 91.57 | 91.18 | 90.84 | 90.47 |
| Worst-attack worst-10% accuracy | 86.21 | 85.62 | 85.16 | 84.85 |
| 2.0 | 2.5 | 3.0 | 3.5 | |
| Worst-attack global / worst-10% | 91.20 /85.60 | 91.18/ 85.62 | 91.19 / 85.61 | 91.18/ 85.61 |
| Honest FPR | 5.71 | 5.00 | 4.14 | 4.14 |
| Retained fair mass | 93.66 | 94.70 | 95.75 | 95.74 |
| Dataset | Honest loss quantile | Rejection rate | Retained fair mass | Rejection share |
|---|---|---|---|---|
| CIFAR-10/ResNet-18 | 0–50% | 3.15% | 97.45% | 58.41% |
| 50–80% | 1.44% | 98.99% | 16.05% | |
| 80–100% | 3.45% | 96.64% | 25.54% | |
| MNIST | 0–50% | 4.74% | 95.42% | 46.82% |
| 50–80% | 5.19% | 95.20% | 30.76% | |
| 80–100% | 5.67% | 94.65% | 22.41% |
| Dataset/model | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Magnitude | Pooled | All honest |
|---|---|---|---|---|---|---|---|---|---|
| CIFAR-10/ResNet-18 | |||||||||
| MNIST/MLP | |||||||||
| EMNIST-Balanced/CNN | |||||||||
| AGNews/GRU |
| Dataset | Aggregation | Clean | Worst attack |
|---|---|---|---|
| CIFAR-10/ResNet-18 | server-loss q-FFL | 69.13/59.12 | 63.38 / 52.19 |
| mean- | 79.25 / 70.60 | 57.01/45.18 | |
| loss-normalized | 82.19 / 72.98 | 76.92 / 67.30 | |
| MNIST/MLP | server-loss q-FFL | 95.54 / 91.46 | 93.86 / 88.96 |
| mean- | 93.98/89.29 | 92.81 / 87.69 | |
| recovered q-FFL | 95.56 / 91.47 | – |
| Dataset | Denominator exponent | Clean | Worst attack |
|---|---|---|---|
| CIFAR-10/CNN | 39.80 / 27.55 | 39.70 / 27.45 | |
| CIFAR-10/CNN | 46.53 / 34.15 | 46.35 / 33.93 | |
| MNIST/MLP | 93.93 / 89.23 | 92.75 / 87.64 | |
| MNIST/MLP | 93.95 / 89.26 | 92.77 / 87.60 | |
| EMNIST/CNN | – | – | |
| EMNIST/CNN | 79.55 / 70.28 | 78.68 / 69.37 |
| Method | |||
|---|---|---|---|
| FUSE | 81.73 / 73.35 | 80.26 / 71.32 | 81.43 / 72.18 |
| server-loss q-FFL aggregation | 66.43/55.37 | 63.38/52.19 | 62.89/51.65 |
| mean- aggregation | 78.86 / 69.87 | 76.64 / 68.34 | 72.31 / 61.88 |
| Declared | Worst attack (global / worst-10% accuracy, %) |
|---|---|
| 2 | 81.91/74.58 |
| 4 | 92.35 / 87.01 |
| 6 | 92.86 / 87.63 |
| Checkpoint | Classifier energy | Classifier overlap | Full energy | Full overlap |
|---|---|---|---|---|
| Round 299 | 0.892 | 0.978 | 0.249 | 0.703 |
| Round 599 | 0.901 | 0.972 | 0.161 | 0.595 |
| Round 899 | 0.918 | 0.967 | 0.120 | 0.461 |
| Round 1499 | 0.852 | 0.975 | 0.051 | 0.337 |
| Repeats | Projection energy | Negative coefficient mass | Loss MAE | Time (s) |
|---|---|---|---|---|
| 1 | 0.9223 | 14.5973 | 1.7817 | 0.408 |
| 6 | 0.9237 | 5.1632 | 1.2567 | 1.061 |
| 12 | 0.9234 | 7.6181 | 1.3797 | 1.793 |
| 24 | 0.9236 | 6.6128 | 1.4823 | 3.358 |
| 64 | 0.9236 | 7.0401 | 1.4833 | 8.584 |
| Samples/class | Worst attack (global / worst-10% accuracy, %) |
|---|---|
| 1 | 90.30/84.44 |
| 20 | 92.35 / 87.01 |
| 50 | 92.79 / 87.52 |
| Dirichlet | Worst attack (global / worst-10% accuracy, %) |
|---|---|
| 0.1 | 92.70 /86.93 |
| 0.5 | 92.86 / 87.98 |
| 1.0 | 92.35/ 87.01 |
| Dataset | Numerical rank | Condition number | |
|---|---|---|---|
| CIFAR-10/ResNet-18 | 10 [10, 10] | 0.0823 [0.0649, 0.0971] | 6.78 [5.77, 9.22] |
| MNIST | 10 [10, 10] | 0.0590 [0.0529, 0.0785] | 8.64 [7.60, 9.99] |
| EMNIST-Balanced | 47 [47, 47] | 0.0968 [0.0145, 0.1951] | 14.26 [7.18, 34.02] |
| AGNews | 4 [4, 4] | 0.0286 [0.0157, 0.0456] | 4.09 [1.73, 7.09] |
| Method | Server time/round | Client vectors | Extra client statistics |
|---|---|---|---|
| q-FFL-GD | 1.71 ms | 1 | none |
| H-nobs | 3.05 ms | 1 | none |
| BOBA | 478.18 ms | 1 | none |
| FUSE | 1387.10 ms | 1 | none |
| Dataset/model | Matched | Always-on |
|---|---|---|
| CIFAR-10/ResNet-18 | 82.25 | 79.68 |
| MNIST/MLP | 93.83 | 93.78 |
| EMNIST-Balanced/CNN | 79.12 | 80.06 |
| Actual Byzantine | Sign | IPM λ=3 | Gauss. | ALIE | Min-Max | Min-Sum | Magnitude |
|---|---|---|---|---|---|---|---|
| 1 of 14: accuracy | 93.76/88.86 | 93.61/88.76 | 93.95/89.32 | 93.92/89.32 | 93.95/89.30 | 93.95/89.29 | 93.93/89.32 |
| recall / honest FPR | 0.77 / 0.32 | 0.78 / 0.32 | 1.00 / 0.30 | 0.49 / 0.35 | 1.00 / 0.30 | 1.00 / 0.30 | 1.00 / 0.30 |
| retained top-20% fair mass | 0.71 | 0.73 | 0.75 | 0.69 | 0.75 | 0.75 | 0.75 |
| 2 of 14: accuracy | 93.58/88.67 | 93.28/88.37 | 93.97/89.21 | 93.92/89.28 | 93.97/89.26 | 93.97/89.22 | 93.97/89.21 |
| recall / honest FPR | 0.74 / 0.25 | 0.75 / 0.25 | 1.00 / 0.20 | 0.45 / 0.31 | 1.00 / 0.20 | 1.00 / 0.20 | 1.00 / 0.20 |
| retained top-20% fair mass | 0.80 | 0.79 | 0.85 | 0.73 | 0.84 | 0.85 | 0.85 |
| Window | Clean | Surrogate | Oracle | Slack | Mixture |
|---|---|---|---|---|---|
| Rounds 200–299 | 54.1 | 20.9 | 13.6 | 12.7 | 19.3 |
| Rounds 1490–1499 | 82.4 | 65.6 | – | – | – |
Federated Learning
Federated learning trains shared models across data holders without requiring them to pool their raw data.
See all 951 papers