Multispectral Object Detection

Ask about this topic

Overview

Multispectral object detection studies how to combine complementary sensor bands—such as RGB, thermal infrared, near-infrared, and hyperspectral imagery—to detect objects that may be hard to see in any one band. Common approaches use dual-stream detectors with feature fusion, cross-modal attention, learned alignment, or reliability-aware routing; newer work also adapts vision-language and pretrained vision models to spectral inputs. Benchmarks such as FLIR, LLVIP, M3FD, and DroneVehicle test performance in settings including night-time driving, aerial imagery, and small-object detection. A central challenge is that sensors can be misaligned, noisy, or unavailable, while richer fusion can increase computation and still fail to generalize across datasets and conditions.

Latest papers

CardsList

43 papers4 papers in the last four weeks, down 33% on the four weeks before. 0.0% of all new papers.

  1. SGLDet: Spectral-aware Global-Local Dynamic Modeling for Multispectral Aerial Object Detection

    Oct 20, 2026Peng Zhang, Shuaihao Han, Tingfa Xu +1Multispectral Object DetectionObject Detection

    Beijing Institute of Technology, Beijing 100081, China · Beijing Institute of Technology, Beijing 100081, China, and also with Chongqing Innovation Center, Beijing Institute of Technology, Chongqing 401135, China

  2. S3^3E-Det: A Strict Spatial-Spectral Equivariant Detector for Multispectral Object Detection

    Oct 20, 2026Peng Zhang, Tingfa Xu, Jinrui Sui +2Multispectral Object DetectionObject Detection

    Beijing Institute of Technology, Beijing 100081, China. · Big Data and Artificial Intelligence Laboratory, Beijing Institute of Technology Chongqing Innovation Center, Chongqing 401135, China.

  3. Stereo LWIR-RGB Automatic Labeling for Low-Light Camera-Based VRU Detection

    Oct 16, 2026Dimitrios Bouzoulas, Pyry Jäppinen, Pejman Habibiroudkenar +2Autonomous Driving PerceptionObject Detection

    Energy and Mechanical Engineering, Aalto University, Espoo, Finland

  4. Analysis of SWIR Imaging Detection Performance Under Adverse Environmental Conditions for Autonomous Driving Systems

    Oct 5, 2026Rohan Mehra, Alexandre Riffard, Yannis Loumouamou +1Multispectral Object DetectionInfrared Object Detection

    Université Clermont Auvergne, Clermont Auvergne INP, CNRS, Institut Pascal, F-63000 Clermont-Ferrand, France

  5. FoCal: Frequency-Oriented Cross-Modal Interaction and Spectral Calibration for Aerial Visible-Infrared Object Detection

    Sep 24, 2026Ben Liang, Chao Sui, Junqi Bai +4Multispectral Object DetectionInfrared Object Detection

    School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China · 28th Institute of China Electronics Technology Group Corporation, Nanjing 210007, China · School of Electronic Science and Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China +1

  6. Stealthy in Semantics, Antagonistic in Space: Attacking Visible-Infrared Object Detectors via Object-Level Misalignment

    Sep 16, 2026Yueqi Zhu, Qi Ming, Guo Cheng +6Physical Adversarial AttacksAdversarial Patch Attacks

    Beijing University of Technology · Peking University · National Key Laboratory of Space Integrated Information System, Institute of Software, Chinese Academy of Sciences +1

  7. Aligned Consensus Teaching for Label-Efficient Oriented Object Detection in Weakly-Aligned Visible-Infrared Imagery

    Sep 16, 2026Qi Ming, Xiaxin Yuan, Jiahuan Zhou +6Object DetectionInfrared Object Detection

    Beijing University of Technology · University of Science and Technology of China · Peking University +5

  8. Aligned Radiometric RGB-Thermal Fusion for UAV Facade Anomaly Screening

    Sep 11, 2026Yuan Yang, Shulei Li, Haobo LiangThermal ImagingInfrared-Visible Image Fusion

    Hong Kong Center for Construction Robotics, Hong Kong SAR, China

  9. Residual Optimal Transport-Based Experts Collaboration Towards Modality-Aware Infrared-Visible Object Detection

    Sep 3, 2026Yue Zhao, Hua Yu, Yukun Zhao +6Missing-Modality LearningMultimodal Robustness

    School of Electronic Engineering, Key Laboratory of Collaborative Intelligence Systems, Ministry of Education, Xidian University, Xi’an 710071, China · College of Computing and Data Science, Nanyang Technological University, Singapore · School of Electronics and Communication Engineering, Sun Yat-sen University, Guangzhou 510275, China +3

  10. Seeing the Unseen: Camouflaged Object Detection Beyond the Visible Spectrum

    Aug 31, 2026Avi Gupta, Trasha GuptaMultispectral Object DetectionUnsupervised Camouflaged Object Detection

    Indraprastha Institute of Information Technology, Delhi · Delhi Technological University, Delhi

  11. Uncertainty-Aware Multimodal Anti-UAV Detection via Evidential Fusion and Conflict-Discounted Belief Aggregation

    Aug 29, 2026Sharanda Suttorp, Seyed Sahand Mohammadi Ziabari, Ali Mohammed Mansour AlsahagUncertainty-Aware Multimodal FusionAerial Object Detection

    University of Amsterdam Amsterdam, The Netherlands · Department of Computer Science and Technology, SUNY Empire State University Saratoga Springs, NY, USA

  12. A2DINOv3: Rethinking Multi-Modal Object Detection via Socialized Collaboration

    Aug 21, 2026Jiekang Feng, Zhihe Fan, Yunqi Zhu +6Multispectral Object DetectionInfrared Object Detection

    School of Artificial Intelligence, Tianjin University · School of Sports Training, Tianjin University of Sport · School of Computer Science and Engineering, University of New South Wales +2

  13. SuppreSensing: Expert-Guided Feature Recalibration and Discrepancy Augmentation for Multimodal Object Detection

    Aug 21, 2026Xin Wu, Zhenyu Gao, Qiankun Zhang +1Multimodal Object DetectionObject Detection

    Beijing University of Posts and Telecommunications Beijing, China

  14. ProtoHGF-Net: Prototype HyperGraph Fusion with Intra-modal Calibration for RGBT Object Detection

    Aug 12, 2026Xiangqi Chen, Xiuling Zhang, Chengzhuan Yang +7Multispectral Object DetectionMultimodal Fusion

    Zhejiang Normal University Jinhua, Zhejiang, China · Zhejiang Key Laboratory of Intelligent Education Technology and Application, Zhejiang Normal University · National University of Defense Technology Changsha, Hunan, China +2

  15. InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detection

    Aug 11, 2026Qi Ming, Zihan Yang, Shaoguang Huang +6Multispectral Object DetectionInfrared Object Detection

    Beijing University of Technology · Southwest University · China University of Geosciences Wuhan +5

  16. Bridging Severe Cross-Modal Misalignment: End-to-End Visible-Infrared Object Detection via Explicit Feature-Domain Affine Registration

    Aug 11, 2026Qi Ming, Yuyang Wang, Mingjing Zhao +7Multispectral Object DetectionCross-Modal Alignment

    Beijing University of Technology, China · Central South University, China · Beijing Electronics Science & Technology Institute +4

  17. Deep Learning based Detection of Fishing Vessels and Fishing Monitoring using Nightlight Images

    Aug 10, 2026Shantakar Mohanty, Prasun Kumar Gupta, Raian Vargas MarettoRemote Sensing Image UnderstandingMaritime Surveillance

    Indian Institute of Remote Sensing, ISRO, Dehradun, India · University of Twente, Faculty of Geo-Information Science and Earth Observation (ITC), Enschede, The Netherlands

  18. CFGPNet: Cross-Attention-Based Fused Gradient Programmed Network Framework for Multispectral Object Detection

    Aug 6, 2026Nima Hatami, Karim Faez, Saeed Sharifian +1Multispectral Object DetectionEfficient Object Detection

    Department of Electrical Engineering, Amirkabir University of Technology, 15914, Tehran, Iran

  19. DRPFNet: Dual-domain Residual Progressive Fusion Network for RGB-Thermal Object Detection

    Aug 4, 2026Zian Wang, Changchun LiMultispectral Object DetectionInfrared Object Detection

    College of Computer Science and Technology, Jilin University, China

  20. G-MAD: A Game-Based Data Generation Framework for Multi-View RGB-T Aerial Object Detection

    Jul 22, 2026Yechan Kim, JongHyun Park, Dongho Yoon +2Multispectral Object DetectionSynthetic Data Generation

    LIG Defense&Aerospace Republic of Korea · Gwangju Institute of Science and Technology Republic of Korea

  21. LDFE: Laplacian Decoupled Feature Enhancement Block for Dual-Stream CNN-based RGB-IR Object Detection

    Jul 9, 2026Wenhao Dong, Xiaoyan Luo, Linlin Yang +4Multispectral Object DetectionInfrared Object Detection

    Beihang University, Beijing, 102206, China · State Key Laboratory of High-Efficiency Reusable Aerospace Transportation Technology, The School of Astronautics, Beihang University, Beijing, 102206, China · The National Key Laboratory of Integrated Air-Ground Navigation Technologies, The School of Astronautics, Beihang University, Beijing, 102206, China +7

  22. Fully Rotation-Equivariant Spectral-Spatial Learning for Multispectral Object Detection

    Jul 6, 2026Peng Zhang, Tingfa Xu, Shuaihao Han +1Multispectral Object DetectionEquivariant Neural Networks

    Beijing Institute of Technology, Beijing, China

  23. InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detection

    Jul 4, 2026Zichao Feng, Haodong Zhu, Jingying Yang +8Efficient Multimodal InferenceMultimodal Robustness

    Beihang University, Beijing, China · Zhongguancun Academy, Beijing, China · Communication University of China, Beijing, China +1

  24. Descriptor: LYNRED Mobility Dataset Multimodal Detection Subset (LYNRED-MDS)

    Jul 2, 2026Loïc Arbez, Jessy Matias, Xavier Brenière +2Autonomous Driving DatasetsAutonomous Driving Benchmarks

    Thoth · INRIA center at University Grenoble Alpes, 38330 Montbonnot-Saint-Martin, France · Lynred, 38113, Veurey-Voroize, France +2

  25. Dual Sparse Aggregation Transformer for Multispectral Object Detection

    Jun 30, 2026Wencong Wu, Xiuwei Zhang, Hanlin Yin +2Multispectral Object DetectionDetection Transformer

    School of Computer Science, Northwestern Polytechnical University, Xi’an 710072, China · School of Computer Science, the Shaanxi Provincial Key Laboratory of Speech and Image Information Processing and the National Engineering Laboratory for Integrated Aerospace-Ground-Ocean Big Data Application Technology, Northwestern Polytechnical University, Xi’an 710072, China · School of Cybersecurity, Northwestern Polytechnical University, Xi’an 710072, China

  26. Efficient RGB-T Object Detection via Sparse Cross-Modality Fusion

    Jun 29, 2026Chao Tian, Zikun Zhou, Chao Yang +2Multispectral Object DetectionEfficient Object Detection

    Harbin Institute of Technology, Shenzhen, Guangdong, China

  27. Progressive Pixel-Neighborhood Deformable Cross-Attention for Multispectral Object Detection

    Jun 23, 2026Tian Qiu, Jifeng Shen, Xin ZuoCross-Modal AttentionCross-Modal Alignment

    School of Electrical and Information Engineering, Jiangsu University, Zhenjiang, 212013, China · School of Computer Science and Engineering, Jiangsu University of Science and Technology, Zhenjiang, 212003, China

  28. Augmentation techniques for video surveillance in the visible and thermal spectral range

    Jun 11, 2026Vanessa Buhrmester, Ann-Kristin Grosselfinger, David Munch +1Multimodal RobustnessData Augmentation

    Fraunhofer IOSB, Gutleuthausstraße 1, 76275 Ettlingen, Germany

  29. FreqKD: Frequency-Decoupled Cross-Modal Knowledge Distillation for Infrared Object Detection

    Jun 10, 2026Keval Thaker, Venkatraman Narayanan, Abdalmalek Aburaddaha +1Cross-Modal Knowledge DistillationMultispectral Object Detection

    University of Michigan-Dearborn 4901 Evergreen Rd Dearborn, MI 48128, USA

  30. Reusing Fusion-Time Spectral Reliability for Adaptive Fusion and Expert Routing in RGB-Infrared Object Detection

    May 31, 2026Yefeng WuMultimodal RobustnessAdaptive Model Routing