Global-Local and Window-Concatenated Functional Random Forests: Early and Late Fusion of Window-Specific Functional Principal Components
Organizations: Department of Economics, Statistics and Business, Faculty of Technological and Innovation Sciences, Universitas Mercatorum, Piazza Mattei 10, 00186 Rome, Italy. · Department for the Promotion of Human Science and Quality of Life, San Raffaele University, Via di Val Cannuta 247, 00166 Rome, Italy · IRCCS San Raffaele Roma, Via della Pisana 235, 00163 Rome, Italy.
Abstract
Functional random forests built on a single functional principal component decomposition of the whole domain may dilute features confined to short intervals, whose location is rarely known in advance. We propose two random forests based on window-specific functional principal components. The global-local functional random forest (GL-FRF) is a late-fusion method that stacks a tuned full-curve forest and one forest per window with penalised convex weights; it contains the full-curve forest as a feasible solution, and its weights indicate which parts of the domain drive the prediction. The window-concatenated functional random forest (WC-FRF) is an early-fusion method that trains a single tuned forest on the concatenated window-specific scores. On twenty UCR datasets, GL-FRF improved on a tuned full-curve forest with the same number of trees on 16, with Brier score reductions of up to 0.21, significantly after Holm adjustment. No method was best on more than six datasets. WC-FRF was more accurate than GL-FRF on 13 datasets but failed when the signal required the full curve, whereas GL-FRF had the smallest mean and maximum excess over the best method across all 32 simulated and real settings, which makes it the safer choice when the location of the signal is unknown.
Figures & tables
| Scenario | Class signal | Expected behaviour |
|---|---|---|
| S1 Global | global signal | |
| S2 LocalEarly | early transient | |
| S3 LocalLate | late transient | |
| S4 OppositePatches | two opposite transients | |
| S5 CrossWindowXOR | cross-window interaction | |
| S6 Null | no signal |
| Competitor | Datasets | Median diff. | GL-FRF better/worse | |||
|---|---|---|---|---|---|---|
| G-tuned-bud | 20 | 0.0146 | 16/ 4 | 186 | 0.001 | 0.006 |
| Scr-stack | 20 | 0.0153 | 16/ 4 | 181 | 0.003 | 0.009 |
| WC-FRF | 20 | -0.0071 | 7/13 | 65 | 0.143 | 0.286 |
| IF-TSF | 20 | 0.0019 | 12/ 8 | 121 | 0.571 | 0.571 |
| Stack-0 | 20 | 0.0015 | 14/ 6 | 170 | 0.014 | – |
| WC-0 | 20 | -0.0042 | 7/13 | 84 | 0.452 | – |
| Group (settings) | GL-FRF | WC-FRF | Stack-0 | Scr-stack | G-tuned-bud | IF-TSF | FkNN |
|---|---|---|---|---|---|---|---|
| Simulation (12) | 0.003 ( 0.013 ) | 0.127 (0.416) | 0.003 (0.016) | 0.004 (0.022) | 0.003 (0.027) | 0.132 (0.298) | 0.112 (0.287) |
| UCR (20) | 0.031 (0.187) | 0.021 ( 0.112 ) | 0.035 (0.187) | 0.067 (0.366) | 0.073 (0.399) | 0.033 (0.156) | 0.100 (0.446) |
| All (32) | 0.021 ( 0.187 ) | 0.060 (0.416) | 0.023 ( 0.187 ) | 0.043 (0.366) | 0.047 (0.399) | 0.070 (0.298) | 0.105 (0.446) |
Random Forest
Random forests are ensembles of randomized decision trees used for prediction, feature analysis, and causal or structured-data modeling.
See all 40 papers