Multimodal

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

65 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-14

18 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-07

26 new papers

A weekly snapshot of new work published in Multimodal.

Inside this field

Focused directions

1,965 papers

Latest in Multimodal

Browse all topics →
CardsList

  1. MedPMC: A Systematic Framework for Scaling High-Fidelity Medical Multimodal Data for Foundation Models

    Jul 8, 2026Hyunjae Kim, Dain Kim, Pan Xiao +25Multimodal Clinical DataMultimodal Foundation Model

  2. HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models

    Jul 8, 2026Feng He, Zhenting Wang, Qifan Wang +4Large Vision Language ModelsHallucinations

  3. GReFEM: Multimodal LLMs as Zero-Shot Semantic Assistants for Physics-Guided 3D Mesh Refinement

    Jul 8, 2026Kartik Bali, Mahish K. Guru, Christian J Cyron +1Finite Element MethodMeshes

  4. Two-Stage Multi-Modal Fusion with Adaptive Alignment for Action Quality Assessment

    Jul 8, 2026Kanglei Zhou, Ruizhi Cai, Xinning Wang +4Multimodal FusionMultimodal Evaluation

  5. BUS: Brain-Inspired Unsupervised Self-Reflection via Backward Prediction for Multimodal Reasoning

    Jul 8, 2026Jiacheng Yang, Tongying Xiao, Yunkai Dang +7Large Vision Language ModelsMultimodal Reasoning

  6. Tree-of-Thoughts Reasoning for Text-to-Image In-Context Learning

    Jul 8, 2026Stepanida Alekseeva, Jenifer Kalafatovich, Seong-Whan LeeText-To-ImageIn-Context Learning

  7. Multimodal Spatiotemporal-Frequency Fusion with Peak Enhancement for Cellular Traffic Forecasting

    Jul 8, 2026Qingzhong Li, Yue Hu, Hui Ma +4Accurate Traffic Forecasting3D Encoder

  8. Ego-Human Motion Prediction with 3D-Aware LLM

    Jul 8, 2026Yujin Bae, Jaewoo Jeong, Hyeonseong Kim +1Human Motion PredictionEgocentric Vision

  9. Rethinking Multimodal Time-Series Forecasting Evaluation

    Jul 8, 2026Haoxin Liu, Yichen Zhou, Rajat Sen +2Zero-Shot ForecastingTime Series

  10. GemNav: Discrete-Token Visual Robot Navigation using a Multimodal Large Language Model

    Jul 8, 2026Peter Bohm, Saimunur Rahman, Abdelwahed Khamis +3Vision-Language NavigationSocial Robot Navigation

  11. Ensemble Deep Learning Approaches for AI-Altered Video Detection

    Jul 8, 2026Laiba Khan, Hung-Mao Wu, Wei Lin +3Explainable Deepfake DetectionDeep Learning

  12. Do You Remember? Toward Memory-Centric Multimodal AI

    Jul 7, 2026Xuguang Yu, Weigang Zheng, Minyue YuMulti-Modal Large Language ModelsMultimodal Artificial Intelligence

  13. Vision as Unified Multimodal Generation

    Jul 7, 2026Xiaoyang Han, Jianhua Li, Kewang Deng +14Multimodal GenerationComputer Vision

  14. Hierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMs

    Jul 7, 2026Zhenyu Liu, Xuanyu Zhang, Yunxin Li +10Full-Duplex Speech ModelsFull-Duplex Dialogue

  15. POPS: Recovering Unlearned Multi-Modality Knowledge in MLLMs with Prompt-Optimized Parameter Shaking

    Jul 7, 2026Zhangheng LI, Jianing Zhu, Junyuan Hong +4Large Language Model UnlearningMulti-Modal Large Language Models

  16. HoloCount: A Holistic Visual Counting Benchmark for MLLMs

    Jul 7, 2026Jinhong Deng, Limeng Qiao, Guanglu WanMulti-Modal Large Language ModelsCounting

  17. Precise Video-to-Audio Generation with Cross-Modal Alignment in Latent Space

    Jul 7, 2026Thanh V. T. Tran, Ngoc-Son Nguyen, Luong Tran +4Joint Audio-Video GenerationAudio Latent

  18. Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliability

    Jul 7, 2026Alicia Parrish, Rajat Shinde, Sanket Badhe +57Multilingual SafetyMultilingual Benchmark

  19. Overview of the NLPCC 2026 Shared Task 1: Difficulty-Aware Multilingual and Multimodal Medical Instructional Video Understanding Evaluation

    Jul 7, 2026Shenxi Liu, Kan Li, Mingyang Zhao +2Medical Visual Question AnsweringCross-Modal Learning

  20. Music I Care About: Automated Multimodal Benchmarking of LLM Music Perception Skills on (Almost) Any Music

    Jul 7, 2026Tomáš Sourada, Katia Vendrame, Jan HajičMusic UnderstandingMultimodal Benchmarks

  21. Propose and Attend: Training-free MLLM Grounding Confidence via Multi-Token Localized Attention

    Jul 7, 2026Daniel Shalam, Emanuel Ben Baruch, Avi Ben Cohen +1Vision-Language Model GroundingCross-Modal Attention

  22. SearchEyes: Towards Frontier Multimodal Deep Search Intelligence via Search World Simulation

    Jul 7, 2026Zhengbo Jiao, Yiming Cheng, Yilei Jiang +15Multimodal Search AgentsMultimodal Reasoning Benchmarks

  23. Audio Sentiment Analysis via Distillation and Cross-Modal Integration of Generated Multilingual Transcripts

    Jul 7, 2026Andrei-George Durdun, Victor Constantinescu, Radu Tudor IonescuMultilingual Automatic Speech RecognitionSentiment Analysis

  24. Segmentation before Answering: Pixel Grounding for MLLM Visual Reasoning

    Jul 7, 2026Yake Wei, Yuan Wang, Fengyun Rao +2Multi-Modal Large Language ModelsPixels

  25. REVIVE: A Multi-Modal Framework for Vandalism Detection and Recovery in Autonomous Vehicles

    Jul 6, 2026Abdullah Tariq Choudhry, Tapadhir DasAutonomous DrivingUnified Multimodal Models

  26. Cross-Contextual Vision-Language Adaptation with LoRA for Personalized Severe Adverse Event Detection in Clinical Wound Monitoring

    Jul 6, 2026Aditi Naiknaware, Jian Sun, Aminreza Khandan +4Multimodal Wound AnalysisMultimodal Clinical Data

  27. Bumblebee: Interleaved Mixed-Layer Building Blocks for Large-Scale Recommendation Systems

    Jul 6, 2026David Bauer, Cancan Zhang, Wenshun Liu +13Multimodal RecommendationSequence Modeling

  28. Light-Omni: Reflex over Reasoning in Agentic Video Understanding with Long-Term Memory

    Jul 6, 2026Chang Nie, Jiaju Wei, Junlan Feng +2Agentic Video GenerationMultimodal Memory

  29. Evaluating and Understanding Model Editing for Medical Vision Language Models

    Jul 6, 2026Guli Zhu, Chenwei Wu, Liyue ShenMedical Vision-Language ModelsMultimodal Benchmarks

  30. A Multimodal Reasoning Typology for Grounding Chart-Image Coherence in Science Communication

    Jul 6, 2026Avina Nakarmi, Sohom Sen, Xun Song +2ChartMultimodal Reasoning

  31. Video-Text Temporal Localization via Multi-Scale Convolution and Dynamic Routing

    Jul 6, 2026Gengtian Shi, Jinze Yu, Chenhao Wu +5Temporal Action LocalizationCross-Modal Alignment

  32. Beyond Modality Fusion: Deep Ensembles for Multimodal Classification

    Jul 6, 2026Ilya Burenko, Dmitry VetrovMultimodal ClassificationMultimodal Fusion

  33. LP-SFT: Local-Preserving Supervised Fine-Tuning via Multimodal Entropy Structure

    Jul 6, 2026Yueyang Wang, Baolong Bi, Shuo Lu +1Supervised Fine-TuningFinetuning

  34. UniSkip-Mamba: A Frequency-Aware State Space Model for Audio-Visual Temporal Forgery Localization

    Jul 5, 2026Cangjin Qiu, Quan Zhang, Dan Jiang +1Frequency-Aware Structural AggregationAudio Latent

  35. EVAS: Efficient Multimodal Temporal Forgery Localization via Audio-Visual Synergy and Steered Boundary Calibration

    Jul 5, 2026Shen Shen, Quan Zhang, Dan Jiang +1Face Forgery DetectionVideo Temporal Grounding

  36. Transferability Between Understanding and Generation in Unified Multimodal Models

    Jul 5, 2026Jiwon Kang, Heeji Yoon, Jaewoo Jung +5Unified Multimodal ModelsMultimodal Diffusion Transformers

  37. One Framework for All: Cross-Modal Membership Inference for Generative Models

    Jul 5, 2026Dayong Ye, Tainqing Zhu, Kun Gao +6Membership InferenceMembership Inference Attacks

  38. Seeing Once is Enough? Online Geometry-Aware Token Pruning for 3D Question Answering

    Jul 5, 2026Ruei-Chi Lai, Bolivar Solarte, Chin-Hsuan Wu +23D Scene UnderstandingMulti-Modal Large Language Models

  39. Full Glyph Images Beat Token Embeddings: A Controlled Study for Transformers

    Jul 4, 2026Shuyang Xiang, Hao GuanGraph Language ModelsTransformer Architectures

  40. Cross-Modal Fusion of OCT and OCT angiography enface for Improved Diagnostics of Diabetic Retinopathy

    Jul 4, 2026Rashadul Hasan Badhon, Atalie Carina Thompson, Jennifer I. Lim +2Interpretable Diabetic Retinopathy GradingOptical Coherence Tomography

  41. Q-TriM: Question-Guided Tri-Modal Attention for Audio-Visual Question Answering

    Jul 4, 2026SungHun Kim, SeungJun BaekAudio-Visual ReasoningCross-Modal Attention

  42. Bridging Interleaved Multi-Modal Reasoning as a Unified Decision Process

    Jul 4, 2026Zican Hu, Xuyang Hu, Yiming Liu +10Multimodal Reasoning

  43. Triple-Phase Multimodal Knowledge Aggregation Framework for Microbial Keratitis Subtype Diagnosis on Slit-Lamp Photography

    Jul 4, 2026Yiqing Wang, Maria A. Woodward, Ziyun Yang +11Skin Lesion ClassificationOphthalmology

  44. Attending to Multimodal Generation One Token at a Time

    Jul 4, 2026Varun Gupta, Vineet Gandhi, Makarand TapaswiMulti-Modal Large Language ModelsMultimodal Generation

  45. From Geometric Labels to Semantic Understanding of Indoor Building Components Using Multimodal Large Language Models

    Jul 4, 2026Shuju Jing, Chao YinMulti-Modal Large Language ModelsMllm-Based

  46. ViPo-MLLM: Visual-Pose Multimodal LLM for Gloss-Free Sign Language Translation

    Jul 4, 2026Ahmed Abul Hasanaath, Bicheng Xu, Mir Rayat Imtiaz Hossain +2Sign Language RecognitionVideo Multimodal Large Language Models

  47. Moonstone: A Multimodal Foundation Model and Benchmark for Lunar Remote Sensing

    Jul 3, 2026Ayush Prasad, Swarnalee MazumderRemote SensingMultimodal Foundation Model

  48. RADIO1D: Elastic Representations for Condensed Vision Modeling

    Jul 3, 2026Greg Heinrich, Mike Ranzinger, Collin McCarthy +6Vision Foundation ModelsComposed Image Retrieval

  49. Responsibility Distribution Estimation in Ego-View Accident Videos with Multimodal Large Language Models

    Jul 3, 2026Ryosei Tamura, Andrew ShinAccidentsMultimodal Learning

  50. WorldBagel: Uncovering the Power of Unified Multimodal Models for Vision-Language-Action-World Modeling

    Jul 3, 2026Zelin Zhao, Min Shi, Bo Yuan +5Vision-Language-Action ModelsWorld Models

  51. Modality Relevance is not Modality Utility: Post-hoc Selective Modality Escalation for Cost-Aware Multimodal RAG

    Jul 3, 2026Xue Li, Yiming GaiMulti-Source Retrieval-Augmented GenerationInput Modality

  52. PedestrianDiffusion: Multimodal Generative Denoising and Dense State Estimation for Inertial Navigation

    Jul 3, 2026I-Hao Lu, Dongsoo HanInertial Navigation SystemsInertial Measurement Units

  53. OmniLayout: A Schematic-Coupled Multimodal Benchmark for Constraint-Aware Geometric Reasoning in PCB Layout

    Jul 3, 2026Taiting Lu, Kaiyuan Lin, Mingjia Wang +12Electronic Design AutomationSpatial Reasoning

  54. OpenGlass: A Sensing-Computing Split Architecture for Local MLLM-Driven Real-Time Visual Assistance

    Jul 3, 2026Mengzhang Li, Yuan YaoMulti-Modal Large Language ModelsMllm-Based

  55. BVS: Bayesian Visual Search with Multimodal Large Language Model for Fine-grained Perception

    Jul 3, 2026Geng Li, Yuxin PengFine-Grained PerceptionMultiple Vision Tasks

  56. C3C^3ASD: Multi-Level Consistency-Driven Representation Learning

    Jul 3, 2026Jin Hong, Jisoo Park, Junseok KwonDiscrete Speech RepresentationsAudio-Visual Consistency

  57. GuideMe: Multi-Domain Task Guidance and Intervention in Streaming Video

    Jul 3, 2026Fang Liu, Jinpeng Chen, Ke Xu +7Video Multimodal Large Language ModelsVideo Understanding

  58. MORE: A Multilingual Document Parsing Benchmark and Evaluation

    Jul 3, 2026Long Xu, Binghong Wu, Tinghao Yu +6Multilingual BenchmarkMultilingual

  59. CoFEND: A Cross-Modal Fusion End-to-End Network for Cold-Start Drug-Drug Interaction Prediction

    Jul 3, 2026Di Wu, Hongyi Sun, Haichao Xu +3Drug-Drug InteractionsClinical Prediction

  60. Learning Taxonomic Trees with Hierarchical Representation Regularization for Large Multimodal Models

    Jul 3, 2026Hulingxiao He, Zhi Tan, Yuxin PengTaxonomyMultimodal Learning