cs.LGAug 24, 2026

When More Modalities Hurt: Modality Dropout for Heavy-Duty Vehicle Engine Diagnostics

Authors: Adeel Zafar, Slawomir Nowaczyk, Hamid Sarmadi, Saeed Gholami Shahbandi

Organizations: Center for Applied Intelligent Systems Research, Halmstad University, Sweden

Abstract

Heavy-duty vehicle diagnostics generate three disconnected data modalities: unstructured multi- lingual service complaints, high-dimensional sensor telemetry with over 80% missing values, and Diagnostic Trouble Codes (DTCs). We investigate whether fusing these modalities improves engine component classification on a proprietary dataset from a major truck manufacturer. Through 5-fold cross-validation across multiple model configurations spanning three model families on five engine component classes (885 samples, the full cross-database matched population for this manufacturer), we find that naive fusion provides modest gains over text alone (65.3%). However, modality dropout during training, which randomly disables entire modalities per batch, forces the network to exploit weaker inputs and achieves 68.8% accuracy on text+DTC fusion (weighted F1: 0.67), a 3.5-point improvement over text-only (65.3%, weighted F1: 0.64) and the best result across all methods including logistic regression and gradient-boosted trees. Per-class analysis shows that the dominant modality varies by fault type: text describes symptoms, DTCs encode structured fault signals, and sensors measure physical state. On intake/exhaust faults, sensors alone reach 93% where text achieves 80%. On fuel system faults, fusion with modality dropout nearly triples accuracy from 15% to 38% over text alone. To our knowledge, this is the first application of three-way modality fusion combining text, sensors, and fault codes in industrial vehicle diagnostics.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. UniMod: Enhancing Multi-Modal Medical Diagnosis through Cross-Modality and Within-Modality Alignment

    Aug 10, 2026Zijian Gu, Weikai Lin, Shuang Zhou +2Medical DiagnosisCross-Modal Alignment

  2. Context-driven Missing-Modality Learning for Robust Medical Diagnosis with Image-Tabular Data

    May 25, 2026Tianling Liu, Lequan Yu, Tong Han +1Missing-Modality LearningMultimodal Robustness

  3. Sensor Diagnosis for Fuel and Emissions Monitoring in Heavy-Duty Diesel Vehicles

    Oct 15, 2026Tejas Dahiya, Saurabh Kumar GuptaFault DiagnosisFault Detection