Multimodal Model

Ask about this topic

Momentum

22 papers in the last four weeks, up 267% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 133

All topics
CardsList

  1. Gestalt: Large Multimodal Interplay Model

    Sep 30, 2026Zequn Yang, Yu Miao, Haotian Ni +8Multimodal ModelMultimodal Diffusion Models

    Gaoling School of Artificial Intelligence, Renmin University of China · Beijing Key Laboratory of Research on Large Models and Intelligent Governance · Beihang University +3

  2. UniEvo-VL: An On-policy Self-Distillation Training Recipe for Multimodal Model Self-improvement

    Sep 30, 2026Fang Wu, Da Xing, Yanjie Huang +16Multimodal ModelSelf-Evolution

    Stanford University · Johns Hopkins University · Independent Researcher +7

  3. Beyond Layers: Position-Resolved Gradient Conflict and Position-Aware Modulation for Unified Multimodal Models

    Sep 29, 2026Shuyang Jiang, Fucheng Deng, Yuchuan Luo +1Multimodal ModelAutoregressive Image Generation

    University of California, Los Angeles · Aimakj · College of Computer Science and Technology National University of Defense Technology +1

  4. VISTA-Bench: Benchmarking Multilingual Image Translation with Image-Specific Rubrics

    Sep 29, 2026Bo Lv, Mao Zheng, Zheng Li +3Multimodal BenchmarksUnpaired Image-To-Image Translation

    Foundation Model Department, Tencent

  5. Reliability Testing of Medical Model Performance under Distributed Deployment

    Sep 29, 2026Yifei Wang, Xiaohan Zhang, Youtao Ding +4Model EvaluationPre-Deployment Safety Assessments

    Shanghai Jiao Tong University, China · Beihang University, China · Nanyang Technological University, Singapore +1

  6. Mutually Adversarial Self-Training with Evolving Data for Unified Multimodal Models

    Sep 28, 2026Wentao Zhou, Weijie Gan, Jiayun WangMultimodal ModelAdversarial Training

    Georgia Institute of Technology · Washington University in St. Louis

  7. Learning Native Reflection in Unified Models with Interleaved Reinforcement Learning

    Sep 28, 2026Yijia Fan, Ziqi Huang, Zhongang Cai +5Multimodal ModelRenderer

    Nanyang Technological University · Shanghai Jiao Tong University · The University of Tokyo

  8. SegBanana: Steering Unified Multimodal Models into Medical Segmenters

    Sep 28, 2026Xiaoye Liang, Ye Yan, Mingze Yin +5Semi-Supervised Medical Image SegmentationMultimodal Model

    Beihang University · Zhongguancun Academy · Zhejiang University

  9. PhysFieldBench: Can Multimodal Models Understand Physical Fields?

    Sep 28, 2026Yuezhou Ma, Huikun Weng, Jialong Wu +5Multimodal Large Language ModelsMultimodal Model

    School of Software, BNRist, Tsinghua University, China

  10. ARCH-B: Architectural Representation, Comprehension and Hierarchy Benchmark

    Sep 28, 2026Kieran Sagar Parikh, Jose Luis Garcia del Castillo y LopezMultimodal BenchmarksBuilding Information Modeling

    Harvard University · Northeastern University

  11. SkinAgent AI: A Safety-Grounded Multimodal Agentic Framework for Non-Diagnostic Skincare Support

    Sep 24, 2026Muhammad Muhtasim Shahriar, Abdullah Mohammad Sayem, Tze Hui Liew +2Agentic FrameworkMultimodal Agents

    Department of Computer Science, International Islamic University Chittagong, Chittagong, Bangladesh · Centre for Intelligent Cloud Computing, Centre of Excellence for Advanced Cloud, Faculty of Information Science and Technology, Multimedia University, Melaka, Malaysia · Multimedia University, Jalan Ayer Keroh Lama, 75450 Bukit Beruang, Melaka, Malaysia +1

  12. Virtual Encoders in Multimodal Transformers

    Sep 22, 2026Katsuya Ogata, Yuta NakashimaDetection TransformerVision Encoders

    The University of Osaka

  13. Grounded Product Understanding in Livestream Videos

    Sep 17, 2026Xinyu Zhang, Junjie Chen, Jiawei Ge +4Streaming VideoMultimodal Model

    Kuaishou Technology · Institute of AI for Industries, Chinese Academy of Sciences

  14. From Models to Systems: A Comprehensive Survey of Efficient Multimodal Learning

    Sep 16, 2026Pan Wang, Siwei Song, Hui Ji +12Multimodal LearningMultimodal Model

    University of Pittsburgh · New York University · Carnegie Mellon University +6

  15. RegRet: Enhancing Region-Level Retrieval in Large Multimodal Models

    Sep 15, 2026Xun Liang, Honghui Yang, Weihang Pan +6Multimodal RetrievalLarge Multimodal Models

    State Key Lab of CAD&CG, Zhejiang University · Xiaohongshu Inc. · School of Software Technology, Zhejiang University

  16. What Do Hallucinations Reveal About Multimodal Reasoning? Diagnosing Visual Grounding Failures via Contrastive Decoding Probes

    Sep 15, 2026Zhipeng Zhao, Wenxu Wang, Peishun Liu +1Weak Visual GroundingMultimodal Reasoning

    1Ocean University of China

  17. Physics as the label for measuring and correcting materials reasoning in multimodal models

    Sep 14, 2026Hasan Kurban, Rasul Khanbayov, Mustafa KurbanMaterialsPhysics-Aware Models

    College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar · Ankara University, Ankara, Turkey

  18. One Model, Two Physical Stories: Auditing Misalignment in Multi-Modal World Modeling

    Sep 13, 2026Geigh Zollicoffer, Minh Vu, Rajiv Ranasinghe +1Cross-Modal ConflictsMultimodal Model

    1Theoretical Division, Los Alamos National Laboratory · 2Computing and Artificial Intelligence Division, Los Alamos National Laboratory · 3Earth and Environmental Sciences Division, Los Alamos National Laboratory

  19. SenseNova-U1.5: Towards Native Unified Visual Intelligence

    Sep 11, 2026Haiwen Diao, Jiahao Wang, Chenjing Ding +62Multimodal ModelVisual Representations

  20. Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Models

    Sep 8, 2026Ke Hao, Yuanzhi Liang, Tingxi Chen +5Multimodal GenerationMultimodal Model

    Shanghai Jiao Tong University, Shanghai, China · Institute of Artificial Intelligence, China Telecom (TeleAI), Shanghai, China · University of Science and Technology of China, Hefei, China

  21. Where Should Language Sit in a Multimodal Model? Lessons from What Language Does to Human Perception and Cognition

    Sep 7, 2026Peng Xie, Amr AlanwarLanguage ModelingMultimodal Model

    TUM School of Computation, Information and Technology, Department of Computer Engineering, Technical University of Munich

  22. Whose record is this? Diagnosing and authorizing record use in personalized multimodal models

    Sep 7, 2026Xinyu Mao, Junsi Li, Chenyang Liu +2Reference-Guided Multimodal In-Context VerificationWitnesses

    University of Electronic Science and Technology of China

  23. SocialReasonBench: A Video-QA Benchmark for Social Reasoning with Counterfactual Narrative Videos

    Aug 31, 2026Zheyu Huang, Zijing Shi, Haozhe Luo +4Social ReasoningReasoning Benchmark

    AAII, University of Technology Sydney · Northeastern University · Fudan University +1

  24. GUIDE: Guiding Internal Evidence with Language Instructions

    Aug 31, 2026Soyeon Caren Han, Hyunsuk Chung, Jinwoo Kim +2Multimodal ModelGuidance

    School of Computing and Information Systems, The University of Melbourne, Melbourne, Australia · Department of Computer Science and Engineering, Korea University, Seoul, Republic of Korea · Brain Science Institute, Korea Institute of Science and Technology, Seoul, Republic of Korea +1

  25. Accelerating Unified Multimodal Models with Core-Expansion Routing and Unified Computation Scheduling

    Aug 29, 2026Wengyi Zhan, Chenqian Yan, Songwei Liu +2Multimodal ModelFast Inference

    1Xiamen University · 2ByteDance

  26. Do You See What You Draw? A Semantic Closed-Loop Framework for Holistic Evaluation of Unified Multimodal Models

    Aug 12, 2026Hao Zhang, Jiaxin Qi, Zhijiang Tang +1Multimodal ModelVisual Generation

    Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences · Computer Network Information Center, Chinese Academy of Sciences

  27. Qwen-MusicAVQA-7B: A Multimodal Model for Music Audio-Visual QA

    Aug 11, 2026Maryam DehdashtiAudio-Visual ReasoningDance-To-Music Generation

    Inference Matter Labs

  28. Multimodal Model Diffing for Feature Discovery and Control

    Aug 10, 2026Hunar Batra, Lachin Naghashyar, Ashkan Khakzar +4Multimodal Large Language ModelsMultimodal Model

    University of Oxford · Microsoft

  29. UniSpace: Unified Visual Representation and Scalable Multimodal Modeling

    Aug 9, 2026Jinbo Yan, Limeng Qiao, Jie Qin +3Vision EncodersSelf-Supervised Vision Transformers

    Meituan

  30. ToolArtist: Tool-Using Unified Multimodal Models for Agentic Image Generation

    Aug 5, 2026Jiahao Zhao, Xiaomin Yu, Zhongxiang Sun +5Image GenerationMultimodal Generation

    1RUC · 2HKUST(GZ) · 3NUS +1

  31. Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing

    Aug 3, 2026Junliang Ye, Kenkun Liu, Guocun Wang +13High-Fidelity 3D Generation3D Generation

    Tencent Hunyuan

  32. Learning Where to Look and How to Judge: Resolution-agnostic Image Quality Assessment with Quality-aware Saliency

    Aug 3, 2026Hakan Emre Gedik, Shashank Gupta, Alan BovikImage Quality AssessmentSaliency

    The University of Texas at Austin · University of Colorado Boulder

  33. Where did the ambiguity go? Examining how multimodal models interpret polysemous words

    Aug 1, 2026Jasin Cekinmez, Addison J. Wu, Raja Marjieh +1Multimodal ModelVision-Language Foundation Models

    Princeton University

  34. Talked Out of the Truth: Sycophancy in the Reasoning Chains of Multimodal Models

    Jul 30, 2026Mahir Numayeer Islam, Gakuto Okuyama, Nikolaus Siauw +3SycophancyReasoning Chain

    Adelaide University · Akita International University · RNA Tech +2

  35. See2Think: Do Multimodal Models Really Use Intermediate Visual States?

    Jul 29, 2026Siyu Yan, Zhuoran Yan, Haiying Xu +10Large Multimodal ModelsMultimodal Model

    1The Hong Kong University of Science and Technology · 3Shanghai AI Laboratory · 2Central South University +4

  36. Do Unified Multimodal Models Think in One Space? A Lens Through Cross-Branch Steering

    Jul 29, 2026Yu Wang, Sharon LiMultimodal ModelRepresentational Collapse

    Department of Computer Sciences, University of Wisconsin-Madison

  37. DynaBridge: Dynamic Summary-Guided Cross-Task Multimodal Fusion for DASS-Structured Mental Health Assessment

    Jul 28, 2026Shiyu Teng, Haichen Yu, Jiaqing Liu +6Multimodal Clinical DataMental Health

    College of Information Science and Engineering Ritsumeikan University Ibaraki, Osaka, Japan · College of Computer Science and Technology Zhejiang University Hangzhou, Zhejiang, China

  38. MATS: A novel multi-modality multi-task learning framework for 3D perception in autonomous driving

    Jul 27, 2026Junchen Huo, Wanming Hao, Song Wang +3Autonomous Driving PerceptionMulti-Sensor Fusion

    School of Electrical and Information Engineering, Zhengzhou University, Zhengzhou 450001, China · Tianping College of Suzhou University of Science and Technology, Suzhou 215009, China · department of computer science, Toronto Metropolitan University, Toronto M5B2K3, Canada

  39. Do Visual Features Improve Other-Initiated Repair Detection? A Dyadic Multimodal Approach

    Jul 26, 2026Anh Ngo, Nicolas Rollet, Catherine Pelachaud +1Multimodal ModelNonverbal Cues

    ALMAnaCH, INRIA Paris ISIR, Sorbonne University Paris, France · ALMAnaCH, INRIA Paris Télécom Paris, SES, Institut Polytechnique de Paris, I3-CNRS Paris, France · CNRS, ISIR, Sorbonne University Paris, France +1

  40. Medical-Checklist: Assessing the Comprehension of Medical Images by Multimodal Models

    Jul 24, 2026Bannapol Limanond, Masanori Suganuma, Takayuki OkataniMultimodal Clinical DataMedical Vision-Language Models

  41. Attention from Above: A Multimodal Model for Drone-Based Object Localization

    Jul 20, 2026Hyun-Ki JungDrone DetectionYolo26

    University of Seoul, Seoul, South Korea

  42. OrientSAM: Mitigating Camera-Centric Shortcut in Multimodal Spatial Reasoning via Orientation-Aware Spatial Alignment

    Jul 20, 2026Wenxiao Fan, Hang Yin, Kan LiSpatial SupervisionSpatial Reasoning

    School of Computer Science, Beijing Institute of Technology

  43. STBridge: Shared-Target Alignment for Bridging Understanding and Generation in UMMs

    Jul 19, 2026Ye Wang, Hongjun Wang, Hao Fang +7Multimodal ModelBridging Language

    Jilin University · Tencent YouTu Lab

  44. WeedExpert-R1: Incentivizing Botanical Reasoning in MLLMs with Reinforcement Learning for Precision Weed Grounding

    Jul 17, 2026Zonglin Yang, Wei-Zhen Liang, Nevin Lawrence +4Precision AgricultureMultimodal Large Language Models

    aDepartment of Biological Systems Engineering, University of Nebraska-Lincoln, Lincoln, NE, USA · bPanhandle Research and Extension Center, University of Nebraska-Lincoln, Scottsbluff, NE, USA · cDepartment of Agronomy and Horticulture, University of Nebraska-Lincoln, Lincoln, NE, USA +1

  45. VLT: A Vision-Language-Time Series Multimodal Foundation Model for Industrial Intelligence

    Jul 16, 2026Haiteng Wang, Jingheng Yan, Xiaokang Wang +1Multimodal Foundation ModelMultimodal Model

  46. Semantic Audio-driven Understanding for Dynamic Humanoid Whole Body Control

    Jul 15, 2026J. M. A. Marcelo, M. Brienza, E. Bugli +4Full-Body Humanoid ControlWhole-Body

    Dept. of Computer, Control, and Management Engineering Sapienza University of Rome, Rome (Italy) · Dept. of International Humanities and Social Sciences, International University of Rome, Rome (Italy)

  47. Towards Spatial Supersensing in the Wild

    Jul 15, 2026Tianjun Gu, Tianyu Xin, Kuan Zhang +12Multimodal Model

    Tsinghua University · NVIDIA · Stanford University

  48. Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoning

    Jul 10, 2026Wenxi Gao, Guanxi Lu, Didi Zhu +5Multimodal ReasoningVisual Generation

    Imperial College London · Tsinghua University

  49. Blind-Spots-Bench: Evaluating Blind Spots in Multimodal Models

    Jul 9, 2026Matteo Santelmo, Xiuying Wei, Israa Fakih +5Artificial Intelligence BenchmarksArtificial Intelligence Models

    Ecole Polytechnique Fédérale de Lausanne (EPFL), Switzerland

  50. Audio Sentiment Analysis via Distillation and Cross-Modal Integration of Generated Multilingual Transcripts

    Jul 7, 2026Andrei-George Durdun, Victor Constantinescu, Radu Tudor IonescuMultimodal Sentiment AnalysisSpeech Translation

    Department of Computer Science, University of Bucharest, 15G Iuliu Maniu, Bucharest 061075, Romania · Department of Data Science, PPC Romania, 30 Mircea Voda, Bucharest 030667, Romania

  51. Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards

    Jul 6, 2026Tianhao Niu, Ziyu Han, Qiguang Chen +5Visual AnalyticsMultimodal Model

    Research Center for Social Computing and Interactive Robotics Harbin Institute of Technology, China

  52. UniTac: A Unified Multimodal Model for Cross-Sensor Tactile Understanding and Generation

    Jun 30, 2026Jiahang Tu, Fengyu Yang, Chenyang Ma +8TactileMultimodal Model

    Zhejiang University · Yale University · UNIX AI +3

  53. Learning to Deny: Action Denial in Multimodal Large Language Models

    Jun 30, 2026Raiyaan Abdullah, Shehreen Azad, Yogesh Singh RawatVideo Multimodal Large Language ModelsMultimodal Large Language Models

    Institute of Artificial Intelligence, University of Central Florida, USA

  54. Traffic-CBM: A Structurally Interpretable Multimodal Framework for Encrypted Traffic Classification

    Jun 29, 2026Honglei Jin, Wenshuo Chen, Shaofeng Liang +6Network TrafficMultimodal Model

    HKUST (GZ) Guangzhou, China · Shandong University Qingdao, China

  55. GPTNT: Benchmarking Real-Time Collaboration Between Multimodal Agents on Keep Talking And Nobody Explodes

    Jun 26, 2026Amit Parekh, Sabrina McCallum, Kareem Al-Hasan +3CollaborationMultimodal Agents

    Heriot-Watt University · University of Edinburgh

  56. Unison: Benchmarking Unified Multimodal Models via Synergistic Understanding and Generation

    Jun 25, 2026Jinyu Liu, Xincheng Shuai, Henghui Ding +1Multimodal ModelSynergy

    Institute of Trustworthy Embodied AI, Fudan University, Shanghai, China · Shanghai Key Laboratory of Multimodal Embodied AI, Shanghai, China · Institute of Big Data, College of Computer Science and Artificial Intelligence, Fudan University, Shanghai, China

  57. Can AI Draw Science? A Benchmark for Evaluating Scientific Figure Generation by Text-to-Image and Multimodal Models

    Jun 24, 2026Davie ChenScientific FigureText-To-Image

  58. UniTranslator: A Unified Multi-modal Framework for End-to-end In-Image Machine Translation

    Jun 23, 2026Jiahao Lyu, Pei Fu, Zhenhang Li +6Unpaired Image-To-Image TranslationImage-Text Alignment

    Institute of Information Engineering, Chinese Academy of Science, China · MiLM Plus, Xiaomi Inc, China · School of Cyber Security, University of Chinese Academy of Science, China +2

  59. Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving

    Jun 22, 2026Zisheng Chen, Yuping Qiu, Jianhua Han +6Autonomous DrivingAutonomous Hard Drive Disassembly

    Sun Yat-sen University · HKUST(GZ) · Yinwang Intelligent Technology Co. Ltd.

  60. Fursee: Hybrid YOLO-DINOv3 Framework for Fursuit Identity Retrieval and Clustering

    Jun 22, 2026Jundi WuDinov3Visual Embeddings

    Shandong University Qingdao, China