Multimodal Classification

Follow this topic Ask about this topic

Momentum

23 papers in the last four weeks, up 360% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 134

All topics

RSJEV: Discriminative Remote Sensing Scene Classification with Multimodal Large Language Models
Oct 6, 2026Dongchen Si, Di Wang, Mingzhen Xu +3Remote Sensing Image Understanding Efficient Multimodal Inference
School of Computer Science, Wuhan University, Wuhan 430072, China · State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China
Multimodal Knowledge Distillation for Gastric Adenocarcinoma Classification from Whole-Slide Images
Oct 6, 2026Shrihari Dumbre, Bikash SantraCross-Modal Knowledge Distillation Multimodal Classification
Indian Institute of Technology, Jodhpur
Efficient Multimodal Inference through Adaptive Acquisition and Sequential Fusion
Oct 5, 2026Payal Mohapatra, Haodong Yang, Yueyuan Sui +3Efficient Multimodal Inference Multimodal Classification
Arm Inc., USA · Northwestern University, USA
Anatomy-aware Fine-grained Multimodal Fusion for Laryngopharyngeal Cancer T-Staging Prediction Using CT and Radiology Report
Oct 5, 2026Xingyue Zhao, Yanzhou Su, Fang Zhang +12Radiology VLMs Multimodal Classification
DAMO Academy, Alibaba Group · Department of Neurosurgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China · Hupan Laboratory, Hangzhou, China +6
Mutual Equilibrium: Multimodal Representation Learning through Reciprocal Feedback
Sep 30, 2026Ho-min Park, Byungkon KangMultimodal Grounding Multimodal Embedding
Data Science Center, Texas Children’s Hospital Baylor College of Medicine Houston, Texas 77030, USA · Department of Computer Science SUNY Korea Incheon, Republic of Korea
OmniMed-Jev: Calibrating LVLM Confidence for Trustworthy Medical Multimodal Decisions via System One
Sep 30, 2026Luyao Tang, Cheng ChenProbability Calibration Multimodal Classification
Department of Electrical and Computer Engineering The University of Hong Kong, Hong Kong SAR, China
Detail in Context: A Dual-Scale Machine Learning Framework for Mycosis Fungoides Detection
Sep 29, 2026Mohamed Hazem, Tarek Waleed, Omar Khaled +8Computational Pathology Medical Diagnosis
Faculty of Engineering, Cairo University, Giza, Egypt · Dermatology Department, Faculty of Medicine, Cairo University, Cairo, Egypt
Paired Multimodal Scaling Laws
Sep 28, 2026Marcus Ma, Shrikanth NarayananMultimodal Classification Scaling Laws
University of Southern California
MERID: Multimodal Exploration via Recursive Self-Improvement Agents for Major Depression Analysis
Sep 28, 2026Lei Liu, Zhaokang Liang, Qingcheng Zeng +4Depression Detection Multimodal Classification
Yale University · Zhejiang University · Northwestern University +3
A Multimodal Autonomic Sensing Framework for Objective Assessment of Patient Responses to Dental Pulp Stimulation
Sep 28, 2026Youngsun Kong, Yubin Choi, Dongjin Song +3Multimodal Classification Multimodal Sensor Fusion
Department of Biomedical Engineering, University of Connecticut, Storrs, CT 06269 USA · Department of Endodontics, University of Connecticut Health, Farmington, CT 06030 USA · School of Computing, University of Connecticut, Storrs, CT 06269 USA
MAD-Guard: Controlled Study of Autoregressive Generation versus Direct Decision Interfaces for Closed Multimodal Forensic Tasks
Sep 27, 2026Hao ChenEfficient Multimodal Inference Image Forgery Detection
School of Cyber Security, Guangdong Polytechnic Normal University, Guangzhou, China
GraphSelect for Budgeted Representation Selection in Multimodal Graph Inference
Sep 27, 2026Xu Wang, Xunkai Li, Yinlin Zhu +1Efficient Multimodal Inference Multimodal Classification
School of Airspace Science and Engineering, Shandong University, Weihai, China · Department of Computer Science, Beijing Institute of Technology, Beijing, China · School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China
Confidence Falls Short: Asymmetric Certainty Gains from Optimization Hinder Multimodal Classification
Sep 23, 2026Longfei Huang, Xiangyu Wu, Yang YangModality Imbalance Multimodal Optimization
Nanjing University of Science and Technology · Alibaba Group
Small Cues, Big Consequences: Learning Pivotal Cues for Multimodal Meme Classification
Sep 22, 2026Akshit Sharma, Prashant W. PatilMultimodal Robustness Cross-Modal Alignment
CVPR Lab, MFSDSAI Indian Institute of Technology Guwahati
GeoBalance: Geometry-Aware Monitoring and Reconstruction with Asymmetric Optimization for Balanced Multimodal Learning
Sep 20, 2026Zechang Xiong, Da Li, Rong Yin +7Modality Imbalance Geometric Representation Learning
Beihang University, Beijing, China · Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · Amap, Alibaba Group, Beijing, China +3
Efficient Unified Multimodal Understanding (EUMU): Winning Solution for the MUMU Track at the 8th LSVOS Challenge
Sep 16, 2026Dayoung Kil, Seong-heum KimOpen-Vocabulary Object Detection Efficient Multimodal Inference
Department of Intelligent Semiconductors, Soongsil University, Seoul, Republic of Korea
Generalist-Specialist Mixture-of-Experts for Rare Pathology Detection in Multimodal Imaging
Sep 16, 2026Johannes Kaiser, Florian Braunmiller, Daniel Rückert +1Multimodal Classification Mixture-of-Experts Models
Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital, Munich, Germany · Hasso Plattner Institute for Digital Engineering, University of Potsdam, Potsdam, Germany · Department of Computing, Imperial College London, UK
Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM
Sep 15, 2026Ahmed Ammar Kubba, Manar Abu Talib, Iman Ibrahim +1Multimodal Classification Cultural Heritage
Department of Computer Science University of Sharjah Sharjah, UAE · Department of Applied Design University of Sharjah Sharjah, UAE · Department of Computer Engineering University of Sharjah Sharjah, UAE
Hub-Spectral Activation of Latent Multimodal Knowledge
Sep 15, 2026Ying Guo, Haidong Chen, Linrui Xu +7Cross-Modal Representation Learning Cross-Modal Alignment
Beijing Key Laboratory of Key Technologies for AI+ Domain Applications, North China University of Technology, Beijing 100144, China · School of Geosciences and Info-Physics, Central South University, Changsha 410083, China · NExT++ Research Centre, National University of Singapore, Singapore +2
Multimodal Emergency Vehicle Classification via Audio-Visual Transformers and Knowledge Distillation
Sep 15, 2026Vijay John, Amar DabajaMultimodal Robustness Multimodal Classification
Department of Mathematics and Computer Science Lawrence Technological University, Southfield, MI, USA
A multimodal large language model for evidence-based autism spectrum disorder screening
Sep 15, 2026Jun Chen, Qi Zhao, Yunliang Jiang +8Autism Spectrum Disorder Multimodal Large Language Models
National Special Education Resource Center for Children with Autism, Zhejiang Normal University, China · School of Computer Science and Technology, Zhejiang Normal University, China · School of Mathematics and Statistics, Xi’an Jiaotong University, China +5
Through the Eyes of the Beholder: Biometric and Demographic Conditioning for Multimodal Sexism Detection
Sep 14, 2026Ana-Maria Luisa Mocanu, Sebastian Mocanu, Ciprian-Octavian Truică +1Multimodal Classification Multimodal Learning
National University of Science and Technology POLITEHNICA Bucharest, Splaiul Independenţei 313, Bucureşti 060042, Romania · Academy of Romanian Scientists, Ilfov 3, Bucharest, 050044, Romania
A Multimodal Explainable Deep Learning Framework for Alzheimer's Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data
Sep 14, 2026Yusuf Brima, Marcellin Atemkeng, Lakshmana Rao Namamula +13D Medical Imaging Multimodal Classification
Computer Vision, Institute of Cognitive Science, Osnabrück University, Germany. · Department of Mathematics, Rhodes University, South Africa. · National Institute for Theoretical and Computational Sciences (NITheCS), Stellenbosch, 7600, South Africa. +2
DINO-Med: A Unified Patch-Based Adaptation Framework for Multi-Modal Medical Image Analysis Applied to Liver Fibrosis Staging
Sep 11, 2026Boya Wang, Ruizhe Li, Chao Chen +1Medical Imaging Foundation Models Multimodal Classification
School of Computer Science, University of Nottingham, UK · Nottingham Biomedical Research Centre (BRC), School of Medicine, University of Nottingham, UK
OmniMed-FL: A Robust Multimodal Federated Learning Framework for Clinical Diagnosis
Sep 9, 2026Ayush Debnath, Ruelia Saha, Sudip MisraMultimodal Federated Learning Medical Diagnosis
Indian Institute of Technology Kharagpur, India · KTH Royal Institute of Technology, Sweden · SRM University-AP, India +1
Morphological Decoupling-Based Skeletal Classification for Clinical Assessment of Malocclusion
Sep 9, 2026Zhichun Jin, Zhicheng He, Hao Xu +4Graph Neural Networks Occlusion Reasoning
The Affiliated Stomatological Hospital of Nanjing Medical University, Nanjing, China · State Key Laboratory Cultivation Base of Research, Prevention and Treatment for Oral Diseases, Nanjing Medical University, Nanjing, China · Jiangsu Province Engineering Research Center of Stomatological Translational Medicine, Nanjing, China +1
TeMo: Temperature Modulation for Multimodal Contrastive Learning
Sep 7, 2026Dhimitrios Duka, Bernt Schiele, Hilde Kuehne +1Cross-Modal Retrieval Multimodal Classification
MPI for Informatics, SIC · Tuebingen AI Center/University of Tuebingen · MIT-IBM Watson AI Lab
Towards reliable multimodal disaster severity assessment through preference optimization and explainable vision-language reasoning
Sep 1, 2026Yuanjun Zhang, Fuzel Ahamed Shaik, Suvojit Acharjee +2Disaster Damage Assessment Multimodal Classification
Centre for Machine Vision & Signal Processing, University of Oulu, Pentti Kaiteran katu 1, PO Box 8000, Oulu, 90570, Finland · Department of CSE and Institute of Engineering and Management, 120 SDF Building, Saltlake Electronics Complex, Kolkata, 700091, India
MMDS-Bench: Benchmarking Multimodal Large Language Models on Dynamic Stance in Social Media Interactions
Aug 31, 2026Yuzhe Ding, Kang He, Li Zheng +5Multimodal Large Language Models Multimodal Reasoning
School of Cyber Science and Engineering, Wuhan University · Shanghai Innovation Institute
Whole-Body MRI Classification via Prompt-Based Clinical Conditioning
Aug 31, 2026Laura Daza, Marta Hasny, Cristina González +1Missing-Modality Learning Multimodal Classification
Institute of Machine Learning in Biomedical Imaging, Helmholtz Munich, Germany · School of Computation, Information and Technology, Technical University of Munich, Germany · School of Biomedical Engineering & Imaging Sciences, King’s College London, UK +1

Oct 6, 2026, cs.CVJ/K move · Enter open · S save

RSJEV: Discriminative Remote Sensing Scene Classification with Multimodal Large Language Models

Dongchen Si, Di Wang, Mingzhen Xu, Jing Zhang+2

School of Computer Science, Wuhan University, Wuhan 430072, China · State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China

Remote Sensing Image Understanding Efficient Multimodal Inference Multimodal Large Language Models Multimodal Classification

Open paper AskPDF arXiv

Remote sensing scene classification is a fundamental task in Earth observation and geospatial analysis. Existing approaches mainly follow three paradigms: task-specific visual classification, vision-language similarity matching, and autoregressive multimodal generation. However, visual classifiers rely on predefined label spaces, CLIP-based methods perform recognition through static image-text alignment, and multimodal large language models (MLLMs) introduce unnecessary token-level generation for classification tasks with explicit candidate categories. To address these limitations, we propose RSJEV, a one-pass multimodal decision framework for remote sensing scene classification. Unlike conventional MLLMs that formulate classification as autoregressive text generation, RSJEV reformulates scene classification as a candidate-conditioned multimodal discriminative decision process, where visual representations, task instructions, and candidate category semantics are jointly modeled. Specifically, we introduce a OnePass Decider that extracts multimodal decision states and directly estimates category probabilities within the candidate category space, eliminating autoregressive decoding while preserving vision-language interactions. Extensive experiments on three widely used remote sensing scene classification benchmarks, including UC Merced, AID, and NWPU-RESISC45, demonstrate that RSJEV achieves superior classification performance compared with representative CNN-, Transformer-, Mamba-, CLIP-, and MLLM-based methods. Moreover, RSJEV significantly reduces inference costs and achieves a better accuracy-efficiency trade-off with only a compact 0.8B-parameter model. These results demonstrate the effectiveness of state-conditioned multimodal decision making for efficient remote sensing image understanding. The code will be available at https://github.com/Dongtcs/RSJEV.

Momentum

Related topics

Latest papers 134