The Information Limits of Neural Controlled Differential Equations Under Sparse Observations
Organizations: Applied AI Institute.
Abstract
Neural controlled differential equations (Neural CDEs) evolve hidden states along continuous paths constructed by interpolating discrete observations. Sparse measurements leave the input between observation times undetermined, and admissible continuous paths consistent with the same data can produce different terminal states. We characterize this ambiguity for planar drivers with bounded speed. The set of compatible terminal states admits a leading-order zonotopic approximation determined by feasible signed areas and transported Lie brackets. Its projection onto a scalar prediction yields a computable, target-specific ambiguity certificate. We also study the number of measurements needed to reduce the remaining uncertainty. For nondegenerate planar CDEs, the optimal worst-case radius over deterministic adaptive sampling policies scales as when speed is bounded and when both speed and acceleration are bounded, where is the number of observation intervals. Synthetic experiments assess the certificate using admissible continuous completions and examine the role of path regularity.
Figures & tables
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| Observations | Median rel. error | ||
|---|---|---|---|
| 5 | 5.775 | 5.401 | 5.49% |
| 9 | 2.769 | 2.684 | 2.55% |
| 17 | 1.358 | 1.334 | 1.79% |
| 33 | 0.678 | 0.668 | 1.69% |
| Observations | Speed only | Acceleration aware | Searched spread |
|---|---|---|---|
| 5 | 1.7844 | 0.4591 | 0.09966 |
| 9 | 0.8547 | 0.0869 | 0.00935 |
| 17 | 0.4174 | 0.0183 | 0.00090 |
| 33 | 0.2061 | 0.0042 | 0.00010 |
| Policy | Radius AUC | Final / initial |
|---|---|---|
| One-step look-ahead oracle | 3.626 | 0.391 |
| Largest local ambiguity | 3.633 | 0.387 |
| Predicted midpoint reduction | 3.633 | 0.387 |
| Area budget only | 3.749 | 0.401 |
| Longest gap | 3.823 | 0.400 |
| Random gap | 4.544 | 0.603 |
| 5 observations | 9 observations | |||
|---|---|---|---|---|
| Target | Model | Target | Model | Target |
| Signed area | 0.2712 | 0.2903 | 0.0686 | 0.0705 |
| Nonlinear CDE | 0.2034 | 0.2154 | 0.0517 | 0.0557 |
| Endpoint only | 0.0058 | 0.0000 | 0.0012 | 0.0000 |
Neural Controlled Differential Equations
Neural controlled differential equations model continuous-time dynamics driven by observed data paths, especially for irregular and asynchronous sequences.
See all 11 papers