Certified but Private: Scalable Zero-Knowledge Proofs for Neural Network Guarantees
Organizations: Yale University · University of Illinois Urbana-Champaign
Abstract
With the growing deployment of machine learning models, formal guarantees of the robustness and fairness of these models have become increasingly important in safety-critical and legal-compliance settings. However, model parameters are often commercial secrets that cannot be disclosed to auditors or end users. To this end, we present PANDA, a scalable system that uses zero-knowledge proofs (ZKPs) to prove the robustness and fairness properties of a model without revealing its private parameters. PANDA is built on top of CROWN, an efficient robustness certification framework that is used in many state-of-the-art formal verification tools for neural networks. The core contribution of PANDA is a novel algorithm for proving linear relaxation bounds for non-linear activation layers, yielding simple, lightweight proofs. Remarkably, our system can generate proofs of local robustness for neural networks with more than 2.9M parameters in 5 minutes, and can verify them in 10 seconds. Prior ZKP-based robustness system rely on exponential-time algorithms that cannot scale to nontrivial networks. In contrast, PANDA scales polynomially in the number of neurons in a network, allowing us to support neural networks 4 orders of magnitude larger than previous approaches with significantly reduced prover overhead.
Figures & tables
| Dataset | Structure | Act. | Prove (s) | Verify (s) | Proof | CROWN | Drift |
| (MB) | (s) | (%) | |||||
| MNIST | |||||||
| ReLU | 3 | 1.3e-4 | 0.02 | ||||
| ReLU | 9 | 0.22 | 0.03 | ||||
| ReLU | 17 | 0.44 | -0.01 | ||||
| Sigmoid | 31 | 0.47 | 2.48 | ||||
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Offline prove (s) | Online prove (s) | Verify (s) | Proof (KB) |
| FairProof Adult | ||||
| MNIST ReLU | 4/5 timeout ( 1h), 1/5 OOM ( 512GiB) | — | — | |
| MNIST ReLU | timeout ( 12h) | — | — | — |
| MNIST ReLU | timeout ( 12h) | — | — | — |
| Dataset | Structure | Act. | Prove (s) | Verify (s) | Proof | CROWN | Drift | N |
| (MB) | (s) | (%) | ||||||
| MNIST | ||||||||
| ReLU | 3 | 0.00013 | 0.02 | 97 | ||||
| Sigmoid | 8 | 0.00014 | 0.19 | 94 | ||||
| Tanh | 8 | 0.00014 | 0.16 | 97 | ||||
| ReLU | 6 | 0.00018 | 0.04 | 95 | ||||
| Cryptographic | Non-crypto | ||||||||
| Structure | Act. | prove | commit | matmul | lookup | other | total | tangent | total |
| Absolute time (s); tangent in ms | |||||||||
| ReLU | 45.08 | 0.93 | 0.35 | 43.59 | 0.21 | 45.07 | 0.000 | 0.01 | |
| Sigmoid | 92.34 | 0.86 | 0.33 | 90.25 | 0.89 | 92.33 | 0.009 | 0.01 | |
| Tanh | 116.45 | 0.94 | 0.36 | 113.27 | 1.87 | 116.44 | 0.013 | 0.01 | |
| ReLU | 106.95 | 15.70 | 8.54 | 66.08 | 0.51 | 90.82 | 0.000 | 16.12 | |
Certified Robustness
Certified robustness develops formal guarantees that model predictions remain reliable under specified input or system perturbations.
See all 84 papers