Geometric Relevance Is Not Sufficient: Evaluating Focused Post-Training Supervision in Diffusion Docking
Organizations: University of Central Florida, Orlando, FL, USA
Abstract
Diffusion-based molecular docking requires learning a corrective score field across a broad corruption distribution, yet individual pose errors can differ substantially in their structural consequences. This creates a post-training conflict between preserving broad score-field coverage and concentrating supervision on corrections that appear more relevant to docking geometry. Using DiffDock, a fixed-budget study compares broad continuation with torsional supervision focused on Cartesian consequence or conditional target consistency, and with a broad/focused mixture. Evaluation separates fixed score fidelity, generated-pose quality, best-of-10 sampling capacity, and confidence-selected Top-1 docking performance. At <5 Angstrom, broad continuation had the highest mean Top-1 success among trained policies, and focused or mixed supervision showed no consistent advantage under the tested budget. The starting model had better fixed score fidelity, whereas the evaluated broad-continuation model had higher mean Top-1 success with the same aggregate best-of-10 recovery. Focusing supervision on structurally consequential or more consistently specified corrections did not consistently improve returned-pose success over broad continuation.
Figures & tables
| Policy | Fixed loss | Generated Å | Best-of-10 Å | Top-1 Å |
|---|---|---|---|---|
| Starting model | 1.6034 | 45.76 | 86.87 | 34.34 |
| Broad intrinsic | 1.6546 | 47.14 | 86.87 | 40.07 |
| Broad Cartesian | 1.6559 | 46.84 | 85.86 | 38.38 |
| Count-matched intrinsic | 1.6532 | 47.10 | 87.21 | 37.37 |
| Count-matched Cartesian | 1.6538 | 46.90 | 85.52 | 38.05 |
| Consistent intrinsic | 1.6519 | 46.84 | 85.86 | 38.38 |
Appendix figures & tables15 assets
Supplementary material from the paper’s appendix.
Appendix
| Policy | Allocation | Torsional form or objective | Role in the comparison |
|---|---|---|---|
| Starting model | none | none | Unchanged reference model |
| Broad intrinsic | all torsions | Broad continuation | |
| Broad Cartesian | all torsions | Cartesian weighting without selection | |
| Count-matched intrinsic | permuted subset | Generic sparse-allocation control | |
| Count-matched Cartesian | permuted subset | Sparse Cartesian control | |
| Consistent intrinsic | consistency mask | Target-consistency allocation |
| Slice | Spearman | Baseline bad | High-tail bad | Risk difference | |
|---|---|---|---|---|---|
| PDBBind train | 1000 | 0.171 | 0.555 | 0.900 | 0.345 |
| PDBBind validation | 197 | 0.253 | 0.579 | 0.850 | 0.271 |
| PDBBind test, no receptor overlap | 48 | 0.164 | 0.521 | 0.800 | 0.279 |
| MOAD train | 1000 | 0.155 | 0.607 | 0.880 | 0.273 |
| Signal use | PDBBind train | PDBBind val | PDBBind test | MOAD train |
|---|---|---|---|---|
| Standalone tail energy | 0.171 | 0.253 | 0.164 | 0.155 |
| Contextual fusion | 0.238 | 0.293 | 0.127 | 0.233 |
| Translation-gated fusion | ||||
| Rotation-gated fusion |
| Direction choice | Component | Mean cosine | Positive fraction | |
|---|---|---|---|---|
| Direct finite difference | Translation | 1,574 | 0.147 | 59.6% |
| Direct finite difference | Rotation | 1,548 | 46.1% | |
| Energy-ranked | Translation | 1,574 | 0.118 | 59.8% |
| Energy-ranked | Rotation | 1,548 | 46.3% | |
| Score-aligned axis reference | Translation | 1,574 | 0.599 | 92.2% |
| Score-aligned axis reference | Rotation | 1,548 | 0.496 | 84.7% |
| Gate cutoff | Reference score loss | Global cosine | Rotation-head cosine | Batches |
|---|---|---|---|---|
| 2.0 | Rotation component | 0.026 | 20 | |
| 2.0 | Full score loss | 20 | ||
| 3.0 | Rotation component | 0.026 | 20 | |
| 3.0 | Full score loss | 20 |
| Consistent row | Inconsistent row | |
|---|---|---|
| High Cartesian consequence | 349 | 279 |
| Low Cartesian consequence | 645 | 339 |
| Source | Processed | Multi-torsion | Metric states | Direction tests | Graph failures |
|---|---|---|---|---|---|
| PDBBind | 192 | 173 | 1656 | 13248 | 0 |
| Contrast | Generated | Best-of-10 | Top-1 |
|---|---|---|---|
| Broad starting | |||
| All-G All-I | |||
| Count-G Count-I | |||
| Consistent-I Count-I | |||
| Consistent-G Count-G | |||
| Consistent-G Consistent-I |
| Policy | Stratum | Generated | Best-of-10 | Top-1 | |
|---|---|---|---|---|---|
| Starting model | all | 99 | 45.76 | 86.87 | 34.34 |
| Broad intrinsic | all | 99 | 47.14 | 86.87 | 40.07 |
| Mixture | all | 99 | 46.94 | 86.20 | 39.06 |
| Starting model | – torsions | 64 | 53.91 | 90.63 | 42.19 |
| Broad intrinsic | – torsions | 64 | 56.35 | 92.19 | 47.92 |
| Mixture | – torsions | 64 | 56.20 | 92.19 | 50.00 |
| Policy | Generated | Best-of-10 | Top-1 |
|---|---|---|---|
| Starting model | 17.98 | 49.49 | 14.14 |
| Broad intrinsic | 18.99 | 48.82 | 14.81 |
| Broad Cartesian | 19.12 | 49.16 | 15.15 |
| Count-matched intrinsic | 18.89 | 49.16 | 14.14 |
| Count-matched Cartesian | 19.02 | 49.49 | 15.49 |
| Consistent intrinsic | 18.92 | 49.49 | 15.15 |
| Policy | Threshold | Random reference | Confidence Top-1 | Top-1 minus reference |
|---|---|---|---|---|
| Starting model | 17.98 | 14.14 | ||
| Broad intrinsic | 18.99 | 14.81 | ||
| Starting model | 45.76 | 34.34 | ||
| Broad intrinsic | 47.14 | 40.07 |