AircraftWitness: How Often Aircraft Can Locate Recordings
Organizations: New York University, New York, USA
Abstract
Aircraft overhead can reveal where an outdoor recording was made. Propellers and rotors leave Doppler curves in audio, and public ADS-B archives log equipped aircraft. We measure how often, blind and against chance. Our main test was registered and timestamped before any audio, and its two amendments came before any answer was read. It covers 24 new places, with the recorders' own clocks, a 300 s slack and a 20 km square. The best of three locators places clear-pass clips within 1 km at 4 places, where a uniform guess predicts 0.57 (p = 0.0065 after correcting for the pick). With the wrong time or swapped audio it places none. The other two hit 1 and 2. On 360 clips from 7 places of a GPS-timed network, two locators place 6% and 8% within 1 km. By place, a unit chosen after that run, they hit 4 and 5 of 7 where a uniform guess predicts 2.3. On 1,600 random public recordings, picked and cut without the truth in a time-bounded run, the three locators answer at most 20 times and place at most 2. We release AircraftWitness, a benchmark, and pass labels for 11.7 million recordings.
Figures & tables
| Set | Entry | Recordings | Answered | Hits | Chance | Recorders |
|---|---|---|---|---|---|---|
| Test set | reference | 360 | 98 | 21 | 2.83 | 13 |
| dopplerprint † | 157 | 29 | 13 | |||
| Unheard | 92 | 12 | 9 | |||
| square’s centre † | 360 | 1 | 1 | |||
| Test set, date only | Unheard | 360 | 309 | 2 | 0.11 | 2 |
| Batch 4 | reference | 99 | 16 | 6 | 0.78 | 4 |
Appendix figures & tables13 assets
Supplementary material from the paper’s appendix.
Appendix
| Set | Cases | Confirmed | Shifted | Right |
|---|---|---|---|---|
| Livermore, true clock | 39 | 18 | 0 | 18 |
| Livermore, clock shifted | 195 | 0 | 19 | 19 |
| xeno-canto, detector finds a pass | 715 | 18 | 1 | |
| expected by chance, from its decoys | 715 | 1.0 | 5.0 | |
| Held-out decoys, pooled, observed | 908 | 1 | 7 |
| Arm | Plan | Answers | Hits (recorders) | Chance (recorders) | |
|---|---|---|---|---|---|
| Stated time | registered | 98 | 21 (13) | 2.7 | |
| Start stated 5 min late | registered | 46 | 1 (1) | 2.7 | 0.94 |
| Start stated 5 min early | registered | 61 | 2 (2) | 2.7 | 0.76 |
| Start stated 2 h late | registered | 31 | 0 (0) | 2.7 | 1 |
| Another site’s audio | post hoc | 73 | 1 (1) | 2.7 | 0.94 |
| Square’s centre | post hoc | 360 | 1 (1) | 2.7 | 0.94 |
| Test | Registered | Timestamped | Pre-registered | Amendments | After first run |
|---|---|---|---|---|---|
| Eclipse, time known | 42 min before | git only | no | 5 | 4 |
| Eclipse, date only | 2.2 h before | git only | no | 10 | 5 |
| A2O batch 1 | 23 min before | 2.3 h after | no | 8 | 6 |
| A2O batch 2 | 1.8 h before | 2 min after | no | 2 | 2 |
| A2O batch 3 | 75 min before | 72 min before* | yes | 13 | 7 |
| Later xeno-canto | 45 min before | 44 min after | no | 3 | 2 |
| Listed recordings | 11,727,009 |
|---|---|
| Labelled recordings | 11,698,054 |
| with a pass | 1,956,202 |
| with no aircraft archived within 50 km that day | 1,805,595 |
| Passes | 5,243,380 |
| in an assumed 300 s window | 1,245,429 |
| Sources | 21 |
| Set | Entry | Recordings | Answered | Hits | Chance | Recorders |
|---|---|---|---|---|---|---|
| Development, batch 1 | Unheard, date only | 295 | 268 | 5 | 0.09 | 3 |
| square’s centre † | 295 | 2 | 2.32 | 2 | ||
| Development, Eclipse | Unheard, date only | 187 | 139 | 0 | 0.06 | 0 |
| square’s centre † | 187 | 0 | 1.47 | 0 | ||
| Live streams | reference | 80 | 63 | 0 | 0.01 | 0 |
| reference | dopplerprint | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Square, slack | chance | hits | answered | moments | hits | answered | moments | ||
| 20 km, 60 s (as run) | 2.8 | 21 | 98 | 17 | 29 | 157 | 23 | ||
| 20 km, 5 s | 2.8 | 36 | 86 | 26 | 41 | 147 | 30 | ||
| 20 km, 300 s | 2.8 | 17 | 130 | 15 | 18 | 177 | 15 | ||
| 10 km, 60 s | 11.3 | 28 | 80 | 23 | 32 | 133 | 25 | ||
| 5 km, 60 s | 45.2 | 29 | 70 | 22 | 0.99 | 38 | 117 | 30 | 0.99 |
| Processing | Passes found |
|---|---|
| None | 30/35 |
| ffmpeg afftdn | 28/35 |
| ffmpeg afftdn, strong | 20/35 |
| ffmpeg arnndn (cb) | 26/35 |
| ffmpeg arnndn (sh) | 26/35 |
| Opus 16 kb/s | 23/35 |