Revisiting Ground-Truth Synthesis from High-Speed Video: Exact Validity Conditions and an Audited Consumer Capture Corpus
Organizations: Department of Computer Science and Engineering Khulna University of Engineering & Technology, Khulna, Bangladesh
Abstract
Motion-deblurring datasets are commonly synthesised by averaging consecutive high-frame-rate frames and labelling the result with the central frame. We show that this label is unbiased for every capture timing only when the window is odd and the frames' sample durations are equal. An even window shifts every label by a fixed fraction of the blur length, even under perfect timing. Unequal durations are subtler: their mean misalignment is zero, so dataset statistics cannot reveal them, yet when the offset cannot be read from the blur they convolve the supervision rather than adding noise to it. Auditing 51 smartphone clips recorded at a nominal 240 fps, we find 19 captured near 176 fps, a behaviour recorded only in the container's timing tables. In a controlled test the parity choice costs a fitted linear deblurring filter far more than these timing irregularities do, and interpolation labels, unlike blur labels, can be repaired with the true frame times. We provide a tool that checks both conditions without decoding, and will release the clips and their timing tables.
Figures & tables
| Violation | Blur length | Cost (dB) | Learned shift |
|---|---|---|---|
| Even window, random direction | 16–32 px | none: offset becomes blur | |
| Even window, random direction | 32–48 px | none | |
| Even window, direction fixed | 16–32 px | 1.08 of the 1.72-px offset | |
| Real hold patterns | 8–48 px | to | none |
| Uniform | Affected | |
|---|---|---|
| Clips / duration / frames | 32 / 26.8 min / 385,263 | 19 / 33.7 min / 356,656 |
| Sample durations (ticks) | ||
| Share at one / two nominal slots | 100.00% / — | 64.16% / 35.82% |
| Effective rate | 239.90 fps | 174–179 fps |
| Linear-fit residual (ticks) | 0.52–0.53 | 47.97–417.26 |
| Hypothesis | It predicts | The corpus shows | Verdict |
|---|---|---|---|
| Padded stream | repeated, near-empty frames | near-duplicates; no frame under of median size; post-hold frames no smaller (ratio ) | excluded |
| Mislabelled durations | clock disagreement; motion ratio 1 | clock agrees to 2 ms; motion across holds normal (IQR – , nine clips with flow above px at 480-px width, threshold set post hoc) | excluded |
| Drift within a clip | held fraction changes | to by decile (Wilcoxon ) | no detectable drift |
| Thermal build-up | rises with duration, recovers | none over 15.4–301.9 s; after a 46-hour gap | not supported |
| Low light (Auto FPS) | affected clips darker | mean luminance (affected) vs (uniform) on a 0–255 scale (Mann–Whitney ) | not supported |
| Visible to a builder | headers or frames differ | identical headers, metadata, codec; sharpness median in both | not detectable |
| Population | Stride | signed mean | sd | p50 | p75 | p95 |
|---|---|---|---|---|---|---|
| affected | 4 | 0.0680 | 0.0385 | 0.0833 | 0.1364 | |
| affected | 8 | 0.0856 | 0.0833 | 0.1087 | 0.1364 | |
| affected | 16 | 0.0346 | 0.0322 | 0.0455 | 0.0581 |