We study trail-weighted pruning of evidence for Bayesian-network prediction. A traversal enumerates the active trails from each evidence node to the outcome, scores each trail by the product of its edge strengths, and drops evidence whose score falls below a threshold. For collider-free networks (chains and forks) over binary variables, we show that the trail score equals the exact correlation between a trail's endpoints, that a chain and a fork with equal edge strengths have identical joint distributions, and that the pruned posterior is within a computable sum of per-trail terms of the exact posterior when each dropped trail lies in its own branch of the outcome node. We prove this bound, check it exhaustively on all small trees, and show that it fails when dropped trails share a branch. In simulations on random trees, thresholding trail scores gives 1.4 to 13 times lower error than random pruning of the same size. We also apply the score, as an unproven heuristic, to seven bnlearn networks with colliders and loops. Keeping the top half of the active evidence by trail score gives lower error than random pruning on all seven, but it is not clearly better than a mutual-information ranking, and scoring costs more than the inference it saves on six of the seven, so we show no speedup. Models trained on trail, graph and information features and tested on networks they never saw do not beat the trail score or mutual information, but trail features carry most of what they use and clearly outperform generic graph features. A bound for general networks is left to future work.
Figures & tables
Figure 1: Mean posterior error (total variation) against threshold τ on 14-node trees (3,000 trials, seed 12345), on a log scale. Factors give random error divided by trail-score error. With τ=0 (d-separation only) the error is zero and is not shown.
Regime
Dropped trails
Pairs ( τ>0 )
Violations
Largest error/bound
12-node trees
each alone in its branch
19,681
0
below 1
12-node trees
share a branch
4,319
5
1.085
14-node trees
each alone in its branch
15,606
0
below 1
14-node trees
share a branch
2,394
0
below 1
Table 1: Violations of ∣p−q∣≤B(D) by whether the isolation condition holds.
Network
Nodes
Edges
Evidence per query
Active evidence (mean)
Queries
Asia
8
8
4
4.00
300
Sachs
11
17
4
4.00
300
Child
20
25
8
6.28
300
Insurance
27
52
10
9.20
300
Alarm
37
46
14
7.92
300
Hailfinder
56
66
14
9.37
100
Table 2: Benchmark networks and queries.
Figure 2: Left: mean KL divergence from the exact posterior when keeping 50% of the active evidence, on a log scale. Right: Spearman correlation between each score and the true relevance, with standard errors. Seed 12345; 300 queries per network, 100 for Hailfinder and Andes.
Network
Random
Hop distance
Mutual information
Trail score
Reference
Asia
0.0609
0.0326
0.0093
0.0087
9.9×10−4
Sachs
0.0988
0.0523
0.0573
0.0557
0.0140
Child
0.0983
0.0226
0.0123
0.0104
0.0085
Insurance
0.0994
0.0273
0.0076
0.0032
0.0025
Alarm
0.1220
0.0164
0.0148
0.0102
0.0119
Hailfinder
0.1363
0.0382
0.0344
0.0303
0.0036
Table 3: Mean KL divergence from the exact posterior when keeping 50% of the active evidence.
Network
Hop distance
Mutual information
Trail score
Asia
0.52
0.73
0.61
Sachs
0.69
0.45
0.37
Child
0.51
0.62
0.63
Insurance
0.45
0.44
0.62
Alarm
0.59
0.47
0.61
Hailfinder
0.51
0.47
0.55
Table 4: Spearman correlation between each score and the true relevance.
Network
Exact
Trail
MI
Half
Edges (once)
Asia
0.66 (0.14)
0.08 (0.07)
0.06 (0.35)
0.58 (0.14)
10
Sachs
0.68 (0.18)
0.34 (0.40)
0.08 (0.40)
0.49 (0.16)
10
Child
1.21 (0.32)
0.93 (1.11)
0.56 (1.24)
0.79 (0.26)
17
Insurance
2.04 (0.51)
24.3 (28.0)
1.61 (3.31)
1.53 (0.66)
69
Alarm
2.12 (0.59)
2.44 (2.40)
2.43 (3.54)
1.63 (0.72)
48
Hailfinder
3.04 (1.11)
6.23 (4.21)
11.1 (8.84)
2.35 (1.42)
84
Table 5: Time in milliseconds, mean (standard deviation over queries). Exact: exact inference with all evidence. Trail: trail scoring. MI: mutual-information scoring. Half: inference with half of the active evidence kept. Edges: edge strengths, computed once per network.
Figure 3: Left: mean KL( P(Y∣E)∥ pruned) keeping 50% of the active evidence, per held-out network (log scale). The leave-one-out reference is not an upper bound. Right: ten largest mean absolute SHAP values of the gradient boosting model.
Network
MI
Trail
Ridge
MLP
RF
GB
Ref
Asia
.00732
.00709
.0175
.0162
.0206
.0210
.00056
Sachs
.0780
.0929
.0674
.0769
.0861
.0689
.0325
Child
.0137
.0154
.0131
.0151
.0216
.0166
.0116
Insurance
.00554
.00317
.00434
.0159
.0125
.00545
.00247
Alarm
.00858
.00499
.00681
.0107
.00752
.00875
.00458
Hailfinder
.00929
.00594
.00462
.00945
.00652
.00636
.00299
Table 6: Mean KL at 50% kept for models trained on the other six networks. Mean is the equal-weight average over networks. Ref: leave-one-out reference.
Features
Mean KL, 50% kept
Spearman
All 37
0.0181
0.55
Trail + query
0.0192
0.53
Graph + query
0.0340
0.36
Information + query
0.0187
0.47
Graph + information + query
0.0200
0.46
Trail + graph + query
0.0189
0.52
Table 7: Gradient boosting on feature subsets, leave-one-network-out.
Feature
Meaning
SHAP
Higher value
t_best_rho_nocoll
Best product score, active trails without collider