FIDE: Fiber-Informed Differentiable Experimental Design for Reference-Relative Law Dynamics
Organizations: Department of Civil and Systems Engineering Johns Hopkins University Baltimore, MD, USA
Abstract
Aggregate measurements generally leave an evolving population law underdetermined, so different measurement systems can be equally adequate for a scientific task while constraining different aspects of the law. We study how to resolve this residual design freedom in baseline-preserving settings, where an existing dynamical model remains the working baseline outside quantities explicitly valued by the task. Fiber-Informed Differentiable Experimental Design (FIDE) completes each candidate's aggregate constraints by information projection relative to a common frozen reference, then ranks scientifically adequate designs by the dynamical revision required to realize the resulting completed paths. The resulting Full action is the minimum mean-squared velocity correction needed to realize a completed path; equivalently, its square root is the sharp reference-relative expectation-rate discrepancy over a gradient-normalized Sobolev class. This defines a conditional minimum-revision principle for baseline-preserving design rather than a generic truth-recovery objective. Experiments show that this preference changes sensor selection, can help or harm withheld downstream predictions depending on baseline reliability, can be used prospectively from aggregate predictions, and remains computationally usable for a -dimensional configuration law.
Figures & tables
| Selector | Selection risk increase (%) | Held-out Full (cross-eval.) | Truth-relative hidden-law |
|---|---|---|---|
| Law | |||
| Tangent | |||
| Residual | |||
| Forward KL | |||
| Static | |||
| Full |
Appendix figures & tables22 assets
Supplementary material from the paper’s appendix.
Appendix
| Allowance | Full holdout risk | Risk increase (%) | Excess over allowance (pp) |
|---|---|---|---|
| 0.038777 | 0.4404 | ||
| 0.039016 | 1.0598 | ||
| 0.039289 | 1.7686 | ||
| 0.039531 | 2.3945 | ||
| 0.039950 | 3.4794 | ||
| 0.040538 | 5.0023 |
| Mean Full action | Reduction vs. Law (%) | |||||||
|---|---|---|---|---|---|---|---|---|
| Allowance | Law | Tangent | GlobalReaction | Full | Tangent | GlobalReaction | Full | Full interval (%) |
| 0.77523 | 0.76973 | 0.76652 | 0.74994 | 0.71 | 1.12 | 3.26 | ||
| 0.77523 | 0.76502 | 0.76205 | 0.73475 | 1.32 | 1.70 | 5.22 | ||
| 0.77523 | 0.75927 | 0.75660 | 0.72193 | 2.06 | 2.40 | 6.88 | ||
| 0.77523 | 0.75296 | 0.75043 | 0.71029 | 2.87 | 3.20 | 8.38 | ||
| 0.77523 | 0.74635 | 0.74397 | 0.69936 | 3.72 | 4.03 | 9.79 | ||
| Frequency | Moment lower bound | Static I-projection | Restricted dynamic | Reduction (%) |
|---|---|---|---|---|
| Study | Allowance | Risk increase (%) | Simultaneous upper | Conclusion |
| Gaussian | 0.516 | Unresolved | ||
| Gaussian | 0.656 | Below cap | ||
| Gaussian | 0.656 | Below cap | ||
| Gaussian | 0.656 | Below cap | ||
| Gaussian | 0.656 | Below cap | ||
| Gaussian | 0.656 | Below cap |
| Criterion | Scientific risk | Own objective | Full action |
|---|---|---|---|
| Law | 0.066186 | 0.066186 | 30.2016 |
| Tangent | 0.066511 | 2.10920 | 38.0653 |
| Full | 0.066586 | 19.71935 | 19.7193 |
| Residual | 0.066478 | 52.50258 | 36.5877 |
| Forward KL | 0.066387 | 0.235235 | 33.1209 |
| Static | 0.066387 | 0.134317 | 33.1209 |
| Evaluator | Law action | Full action | Reduction (%) | Paired Full Law interval |
|---|---|---|---|---|
| 1.50697 | 1.16113 | 22.95 | ||
| 1.50973 | 1.16290 | 22.97 | ||
| 1.51070 | 1.16352 | 22.98 | ||
| Bandwidth | 1.63096 | 1.24506 | 23.66 | |
| Bandwidth | 1.38646 | 1.08121 | 22.02 | |
| PCG tolerance | 1.50697 | 1.16113 | 22.95 |
| Frequency | Relative error at | Empirical spatial order |
|---|---|---|
| Predictor condition | Feasible | Risk-rank | Held-out risk change (%) | Held-out action reduction (%) |
|---|---|---|---|---|
| Unperturbed | 246 | 1.000 | 2.030 | 24.324 |
| Mean bias, local SD | 16 | 0.327 | ||
| Mean bias, local SD | 1 | 0.000 | 0.000 | |
| Sampling covariance | 246 | 1.000 | 2.030 | 24.324 |
| Sampling covariance | 246 | 1.000 | 2.279 | 23.133 |
| QoI-target bias, scale | 224 | 0.800 | 26.747 |
| Risk allowance | Base | Fourier-400 | Fourier-560 | Interaction-416 |
|---|---|---|---|---|
| 1% | 3.51 | 3.51 | 3.52 | 3.53 |
| 2% | 6.91 | 6.92 | 6.93 | 6.95 |
| 3% | 9.38 | 9.40 | 9.41 | 9.43 |
| 4% | 9.38 | 9.40 | 9.41 | 9.43 |
| 5% | 12.22 | 12.25 | 12.28 | 12.31 |
| Design | Base ( ) | Fourier-560 ( ) | Increase (%) |
|---|---|---|---|
| Law | |||
| Full ( allowance) |
| Allowance | |||
|---|---|---|---|
| 3.02 | 3.26 | 2.97 | |
| 4.79 | 5.22 | 4.95 | |
| 6.27 | 6.88 | 6.59 | |
| 7.61 | 8.38 | 8.09 | |
| 8.85 | 9.79 | 9.49 |
| Move / Full (%) | Reaction / Full (%) | Hidden / Full (%) | Full vs. Tangent (%) | Full vs. GlobalReaction (%) | |
|---|---|---|---|---|---|
| 0.25 | 21.99–22.65 | 77.35–78.01 | 43.15–43.80 | 1.95–6.12 | 2.23–6.28 |
| 1 | 23.97–24.21 | 75.79–76.03 | 64.58–65.51 | 2.57–6.30 | 2.16–6.00 |
| 4 | 38.79–39.33 | 60.67–61.21 | 73.51–74.62 | 2.27–5.62 | 1.76–5.20 |
| Study | Information available during selection | Information introduced after design freeze |
|---|---|---|
| Gaussian mixture | Analytic target law, target-derived moments and covariances, noisy finite-sample observations, population-risk screen, and one frozen endpoint-trained reference. | Fresh target draws, particle sampling, and detector noise from the same analytic family. The reference is unchanged. |
| Retrospective double-gyre | Frozen microscopic target simulation bank and three endpoint-trained references; candidate observations and scientific-risk quantities are evaluated directly from the target bank. | Fresh particle resampling and detector noise, conditional on the same target bank and reference ensemble. |
| Prospective double-gyre | Endpoint ensembles, one frozen endpoint-trained reference, and fixed aggregate sensor-response means, cross-sensor covariances, and scientific-QoI predictions. These aggregate fields are precomputed from a separate microscopic simulation bank and its intermediate particles are not exposed to the optimizer. | A separately seeded evaluation reference trained from the same endpoint dataset, together with new microscopic validation trajectories, sampling, and detector noise for action and scientific-risk validation. |
| Skyrmions | A fixed development set of interacting configurations, one frozen endpoint-trained permutation-equivariant reference, aggregate sensor observations, and the nine permutation-invariant scientific features used to evaluate development risk. | A separate set of fresh paired measurement trials for scientific-risk and action validation. The reference model and selected sensor geometries remain frozen. Richer potential dictionaries, leave-one-pair-out analyses, and larger reference banks are introduced only as post-selection numerical sensitivity checks. |
| Unbalanced Gaussian | A fixed analytical reference and finite-measure simulator, together with development observations and simulator truth used for scientific-risk evaluation. | A fresh bank of paired trials with new physical nuisances, particle observations, detector noise, and log-mass noise. The same frozen bank is reused across the sensitivity analysis. |
| Component | Configuration |
|---|---|
| Operating system | Ubuntu 24.04.3 LTS under WSL2 |
| Linux kernel | 6.6.87.2-microsoft-standard-WSL2 |
| Processor | Intel Core Ultra 9 275HX (24 cores, up to 5.4 GHz) |
| GPU | NVIDIA GeForce RTX 5090 Laptop GPU |
| GPU memory | 24 GB GDDR7 |
| NVIDIA driver | 581.57 |