Modalities

Ask about this topic

Momentum

33 papers in the last four weeks, up 154% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 217

All topics
CardsList

  1. Omni-Embed-Mini: Binding Modalities Without Forgetting via Dense Distillation

    Oct 1, 2026Mohammed Irfan Kurpath, Jaseel Muhammad Kaithakkodan, Sahal Shaji Mullappilly +2Multimodal EmbeddingsOmni-Modal

    Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI)

  2. SIEVE: Selective attention-value Suppression for Vision-Language Models Unlearning

    Oct 1, 2026Si Qi Goh, Cap Dang Xuan Kiet, Tat-Jen Cham +1Exact UnlearningForgetting

    Digital Trust Centre, Nanyang Technological University, Singapore · College of Computing and Data Science, Nanyang Technological University, Singapore

  3. When Integral Meets Decomposition: A Signal-Level Self-Supervised Feature Decompose Paradigm for Multi-Modal Image Fusion

    Sep 30, 2026Zeyu Wang, Jiayu Wang, Haiyu Song +1Multimodal FusionVisible Image Fusion

    College of Computer Science and Engineering, Dalian Minzu University, Dalian, China · School of Artificial Intelligence and Robotics, Hunan University, Hunan, China · Department of Automation, Tsinghua University, Beijing, China

  4. Beyond Spatial-Domain Supervision: A Relation Constrained Space for Multi-Modal Image Fusion

    Sep 30, 2026Zeyu Wang, Mingyu Ge, Haiyu Song +1Visible Image FusionSpatial Supervision

    College of Computer Science and Engineering Dalian Minzu University · Department of Automation Tsinghua University

  5. Prototype-guided Bilateral Alignment Multimodal Federated Learning

    Sep 30, 2026Tianchi Liao Tianchi_Liao, Lele Fu, Sheng Huang +3Heterogeneous Federated LearningMultimodal Alignment

    Department of Computer Science, Hong Kong Baptist University, Hong Kong SAR, China · School of Computer Science and Engineering, Sun Yat-Sen University, Guangzhou, China

  6. What Comes Next? Omni-StoryBench for Evaluating Story-Grounded Omnimodal Generation

    Sep 29, 2026Sieun Hyeon, Yejoon Lee, Mintaek Lim +3Omni-ModalMultimodal Generation

    AIDAS Laboratory, 1ECE & 2IPAI, Seoul National University

  7. End-to-End Self-Supervised RGB-T Tracking without Modality Misleading

    Sep 29, 2026Shenglan Li, Rui Yao, Kunyang Sun +4Rgb-Event Object TrackingRgb-Thermal

    School of Computer Science and Technology / School of Artificial Intelligence, China University of Mining and Technology, China. · Mine Digitization Engineering Research Center of the Ministry of Education, China. · University of Auckland, Auckland, New Zealand. +1

  8. Multimodal Detection of Higher-Order Behavioral Constructs: Self-Compassion in Structured Reflective Interaction

    Sep 29, 2026Siddhant Jain, Dimitra TsovaltziEmpathyReflections

    Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) Saarbrücken, Saarland, Germany · Universität des Saarlandes Saarbrücken, Saarland, Germany

  9. OmniRoute: Mapping Temporal Semantic Evidence to Audio-Visual Token Budgets for Efficient Omnimodal Large Language Models

    Sep 29, 2026Yuchen Deng, Zidang Cai, Feidiao Yang +4Omni-ModalAudio-Visual Reasoning

    Shenzhen International Graduate School, Tsinghua University, China · Pengcheng Laboratory, China

  10. Proofs Without Nominals: Gödel's Ontological Argument, its Shallow Embedding, and the Open Questions of the Monatshefte Notes

    Sep 28, 2026Christoph BenzmüllerFirst-Order LogicAxiom

    AI Systems Engineering, Otto-Friedrich-Universität Bamberg, Germany · Faculty of Mathematics and Computer Science, Freie Universität Berlin, Germany

  11. Render Before Reading: Visual Rendering as a Prompt Injection Defense

    Sep 28, 2026Jie Zhang, Andrei Baroian, Jan N. van Rijn +2Indirect Prompt InjectionMultimodal Large Language Models

    ETH Zurich · Leiden University

  12. Multimodal Target Speaker Extraction: Towards Unified Speaker Cues Across Modalities

    Sep 28, 2026Xinyuan Qian, Yanghao Zhou, Ziyang Jiang +10Target Speaker ExtractionSpeaker

    School of Computer and Communication Engineering, University of Science and Technology Beijing, 100083, China · Department of Computer Science and Technology, Beijing Institute of Technology, China · The Chinese University of Hong Kong, Shenzhen, China +5

  13. Structured Latent Modeling for Supervised Multimodal Information Decomposition

    Sep 28, 2026Wanting Huang, Sanvesh Srivastava, Weiran WangMultimodal LearningMultimodal Classification

    Department of Computer Science University of Iowa · Department of Statistics University of Iowa

  14. Do Emotion Concepts Generalize Across Sources, Modalities, and Architectures in Vision-Language Models?

    Sep 28, 2026Bohao Xing, Xin Liu, Kaishen Yuan +5Emotion RecognitionEmotion

    Lappeenranta-Lahti University of Technology LUT · Shanghai Jiao Tong University · The Hong Kong University of Science and Technology (Guangzhou) +3

  15. Binding Multiple Modalities via Multimodal Wasserstein Barycenter

    Sep 27, 2026Xiaole Tang, Jiayi Xu, Xiang Gu +2Multimodal AlignmentComplementary Modalities

    Xi’an Jiaotong University

  16. MoGround: Measuring and Mitigating Modality Distraction in Vision-Language Models

    Sep 27, 2026Luca Zhou, Bo Zhao, Rose Yu +2ModalitiesMultimodal Query

    Sapienza University of Rome · Harvard University · UC San Diego +2

  17. All modalities are equal, but video is more equal: Closing the Cross-Attention Gap in Joint Video Generation

    Sep 23, 2026Ohad Rahamim, Dvir Samuel, Idan Schwartz +1Cross-Modal AttentionAudio-Visual Consistency

    Bar-Ilan University · NVIDIA

  18. VCMM: Variance-Calibrated Momentum for Multimodal Learning

    Sep 23, 2026Zhongjing Gu, Chenyang Huang, Yufa Feng +3Multimodal LearningModalities

  19. PhyMo: A Physical-Field Modality for Multimodal AI4Physics

    Sep 23, 2026Henan Sun, Haitao Hu, Jin Liu +4Multimodal RepresentationsModalities

    The Hong Kong University of Science and Technology (Guangzhou) · Huawei Noah’s Ark Lab · Tencent HY +1

  20. Displacement Geometry Captures Platonic Shared Reality Across Models and Modalities

    Sep 21, 2026Chenming Shang, Yujin Tang, Jun Jie Ou Yang +3Representation SpaceModalities

    Department of Computer Science, DARTMOUTH COLLEGE

  21. GeoBalance: Geometry-Aware Monitoring and Reconstruction with Asymmetric Optimization for Balanced Multimodal Learning

    Sep 20, 2026Zechang Xiong, Da Li, Rong Yin +7Multimodal LearningMultimodal Classification

    Beihang University, Beijing, China · Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · Amap, Alibaba Group, Beijing, China +3

  22. CSC: Calibrated Simplicity for Conflict-Aware Social Bot Detection in the LLM Era

    Sep 20, 2026Yipeng Qian, Pengjie Zhao, Chaoxi NiuAi-Generated Content DetectionCamouflage

    Minzu University of China Beijing, China · City University of Macau Macau, China

  23. The Unbearable Weight: Scaling Models and Methods for UAV Audio Classification

    Sep 15, 2026Andrew P. Berg, Qian Zhang, Mia Y. WangDrone DetectionUnmanned Aerial Vehicles

    Department of Computer Science, College of Charleston, Charleston SC, USA. · Department of Engineering, College of Charleston, Charleston SC, USA.

  24. LatentVerse: A Framework for Understanding Shared and Modality-Specific Information in Multimodal Latent Representations

    Sep 14, 2026Majd Alafrange, Samuel Friedman, John Kitonyo +2ModalitiesRepresentation Quality

    Machine Learning for Health (ML4H), Broad Institute of MIT and Harvard, Cambridge, Massachusetts, USA · Massachusetts Institute of Technology, Cambridge, Massachusetts, USA · The Schmidt Center, Broad Institute of MIT and Harvard, Cambridge, Massachusetts, USA

  25. ChitraMiti: Benchmarking Visual Grounding and Modality Reliance in Bengali Geometric Reasoning

    Sep 14, 2026Khan Raiyan Ibne Reza, Sanjana Aktar Maria, Sumaiya Tabassum Nimi +1Multimodal Reasoning BenchmarksMathematical Reasoning Benchmarks

    North South University

  26. Func-R1: Incentivizing Mathematical Function Reasoning in Multimodal Large Language Models

    Sep 13, 2026Mingze Yin, Xiaohan Wang, Dian Li +8Mathematical ReasoningMultimodal Large Language Models

    College of Computer Science and Technology, Zhejiang University · Tencent 3AI Thrust, HKUST (GZ) · Zhongguancun Academy +3

  27. Prototype Matters: Modality-unified Prototype Self-distillation for Unsupervised Visible-infrared Person Re-identification

    Sep 11, 2026Menglin Wang, Xiaojin GongRe-IdentificationCross-Modality

    Nanjing Normal University Nanjing, China · Zhejiang University Hangzhou, China

  28. Predictive Multi-Landmark OCT Tracking for Increased Motion Robustness

    Sep 11, 2026Konrad Reuter, Suresh Guttikonda, Chaitali Uday Karekar +2Multi-Object TrackingMotion Estimation

    Department of Otorhinolaryngology, Head and Neck Surgery and Oncology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany

  29. The Illusion of Balanced Multimodal Sentiment Analysis: Beyond the Limits of Optimization-Based Methods

    Sep 11, 2026Ioanna Kaffeza, Efthymios Georgiou, Alexandros PotamianosMultimodal Sentiment AnalysisModalities

    PERSEE Center, Mines Paris-PSL University, Sophia-Antipolis, France · National Technical University of Athens, Athens, Greece · University of Bern, Bern, Switzerland +2

  30. UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation

    Sep 11, 2026Danning Zhang, Yijing Lin, Shuhan Zhuang +4Multimodal GenerationMulti-Reference Image Generation

    University of Science and Technology of China · Independent Rsesearcher · Shenzhen University +1

  31. When Fusion Fails: Corruption-Aware Rebalanced Fusion for Multi-Modal Medical Image Segmentation

    Sep 9, 2026Yuchen Pei, Xiaoyu Hu, Yixiong Zou +5Semi-Supervised Medical Image SegmentationMultimodal Fusion

    Central China Normal University Wuhan, China · Huazhong University of Science and Technology Wuhan, China · Guangzhou University of Chinese Medicine Guangzhou, China +2

  32. Multimodal Emotion Recognition in Conversations via Class-Wise Adaptive Modality Fusion and Affective Geometry

    Sep 9, 2026Oriol Marín, Roger Marí, Gloria Haro +1Emotion RecognitionMultimodal Fusion

    Eurecat, Centre Tecnològic de Catalunya, Barcelona, Spain · Universitat Pompeu Fabra, Barcelona, Spain · Serra Húnter Fellow Programme, Universitat Pompeu Fabra, Barcelona, Spain

  33. I Don't Miss You, but I Do: Self-Explanation Faithfulness of Modality Missingness in Vision-Language Models

    Sep 7, 2026Aydin Javadov, Daniel Schoess, Florian von WangenheimModalitiesMissing Modalities

    ETH Zurich

  34. SimpleDesign: A Joint Model for Protein Sequence and Structure Codesign

    Sep 3, 2026Jiarui Lu, Yuyang Wang, Yizhe Zhang +4Protein DesignGenerative Models

    Mila, Université de Montréal, Apple · Apple

  35. Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policies

    Sep 2, 2026Yue Yang, Diego Romeres, Chiori Hori +3Sensory FeedbackModalities

    Department of Computer Science, University of North Carolina at Chapel Hill · 2Mitsubishi Electric Research Laboratories (MERL)

  36. Slow to See, Slow to Suppress: Understanding the Effects of Modality in Context-Memory Conflicts

    Aug 31, 2026Athulith Paraselli, Etha Tianze Hua, Ellie PavlickModalitiesFactual Recall

    Brown University

  37. Do VLMs Share Safety Neurons Across Modalities?

    Aug 31, 2026Jiaxuan Li, Jiahao Zhang, Duc Minh Vo +3Multimodal BenchmarksNeurons

    SB Intuitions Corp., Tokyo, Japan

  38. Modality Disentangled Learning for Incomplete Multimodal Emotion Recognition: A Primitive Memory Distillation Perspective

    Aug 31, 2026Jiaqi Zhang, Zheng Pang, Mengting Li +9Multimodal LearningEmotion Recognition

    Jiangsu University · Griffith University · National University of Singapore +8

  39. TAKE 85: Testing Audiovisual filmmaKer's intEnt across 85 Hours of Film

    Aug 30, 2026Kaishuu Shinozaki-Conefrey, Olivier Pascaud, Robin Courant +3FilmsDramadirector

    LIX, Ecole Polytechnique, IP Paris, Palaiseau, France · New York University, New York, NY, USA · Ecole nationale supérieure Louis-Lumière, Saint-Denis, France +1

  40. P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation

    Aug 13, 2026Yi Shi, Huichao Xie, Yuqing Wang +7Infrared-Visible Image FusionAdm-Fusion

    Northwestern Polytechnical University, Xi’an, China · Hefei University of Technology, Hefei, China · Rocket Force University of Engineering, Xi’an, China +1

  41. Dual Anchors, Do It Better: Hierarchical Group Merging for Zero-Shot Anomaly Detection

    Aug 12, 2026Jimin Roh, DongKyu Kim, Suk-Ju KangSparse Spatial AnchorsModalities

    Sogang University · LG Electronics · NAVER Cloud

  42. Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpening

    Aug 12, 2026Pengwei Xie, Fei Zhu, Jiajun Li +4Hyperspectral ImageMultimodal Diffusion Models

    School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China · School of GeoAI and Hinton STAI Institute, and the Key Laboratory of Geographic Information Science (Ministry of Education), East China Normal University, Shanghai 200241, China · Peking University, Beijing 100871, China +3

  43. TimeRoute: Time-Aware Modality Routing and Diffusion for Multi-Modal Recommendation

    Aug 11, 2026Pengyu Zhang, Yangqin Jiang, Klim Zaporojets +2Multimodal Recommendation ModelModalities

    University of Amsterdam Amsterdam, The Netherlands · University of Hong Kong Hong Kong, China · Aarhus University Aarhus, Denmark

  44. DINO-A: Adapting Self-Distillation Vision Transformers to General Audio Representation Learning

    Aug 11, 2026Tomasz Radzikowski, Mateusz Modrzejewski, Przemysław RokitaNeural AudioDino

    Warsaw University of Technology, Warsaw, Poland

  45. Sequential Modality Dropout for Robust Multi-Modal Sequential Recommendation

    Aug 10, 2026Guanqun Yang, Wenlong ZhangMultimodal Recommendation ModelModalities

    Stevens Institute of Technology Hoboken, NJ, USA

  46. Multimodal Federated Learning under Dual-Axis Modality Missingness

    Aug 10, 2026Adiba Orzikulova, Jaehyun Kwak, Jaemin Shin +5Federated LearningMissing Modalities

    1KAIST · 2CUHK · 3HKUST

  47. Learning Deep Modality-Shared Self-Expressiveness for Image Clustering with Textual Information

    Aug 9, 2026Xianghan Meng, Wei He, Zhiyuan Huang +1Multimodal RepresentationsModalities

    School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, P.R. China

  48. Conformal Fusion Under Missing Modalities

    Aug 7, 2026Alireza MoayedikiaMissing ModalitiesMultimodal Fusion

    Department of Business Technology and Entrepreneurship Swinburne University of Technology Hawthorn, VIC 3122, Australia

  49. LMM Modality Transfer: A Pre-requisite for Autonomous GIS Agents

    Aug 7, 2026Ivan Majic, Zexian Huang, Franziska Hübl +5Large Multimodal ModelsSpatial Reasoning

    Graz University of Technology, Austria · University of Vienna, Austria · University of Liverpool, UK

  50. Dual-Space Modality Consistency Learning for Universal Cross-Modal Re-Identification

    Aug 7, 2026Yujian Zhao, Yukang Zhao, Hankun Liu +4Re-IdentificationModalities

  51. AnyTrack: Unifying Visual Object Tracking with Any Modalities

    Aug 7, 2026Hao Li, Yunzhi Zhuge, Wenning Hao +4Multi-Object TrackingModalities

    Army Engineering University of PLA Nanjing, China · Dalian University of Technology Dalian, China · National University of Defense Technology Nanjing, China

  52. What Current AI Benchmarks Leave Unmeasured: Modality, Search, Citations, and Implications (for Safety Evaluations)

    Aug 6, 2026Ro Encarnación, Tina Behzad, Emma Lurie +1Artificial Intelligence BenchmarksArtificial Intelligence Safety

    University of Pennsylvania · Stony Brook University

  53. C3^3PO: Evaluating Cross-Modal Composition and Counterfactual Performance in Omnimodal Models

    Aug 5, 2026Swapnanil Mukherjee, Agyeya Negi, Tanuja Ganu +1Cross-Modal ConflictsCross-Modal

    Microsoft Research India · IIIT Hyderabad, India

  54. SmartMage: Dynamic Modality Orchestration for 3D Scene Understanding

    Aug 5, 2026Yue Zhang, Yingzhao Jian, Yunqiu Xu +23D Scene UnderstandingMultimodal Reasoning

    Zhejiang University Hangzhou, Zhejiang, China · Stanford University Stanford, California, USA

  55. OPD-V: Visual On-Policy Self-Distillation with Modality Balance

    Aug 5, 2026Aniri, Jinhe Bi, Peng Liao +5Multimodal Large Language ModelsRecent Vision-Language Models

    2Ludwig Maximilian University of Munich · 3Munich Center for Machine Learning · 1National University of Singapore +1

  56. Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and Recipes

    Aug 5, 2026Junlin Han, Shengbang Tong, David Fan +4Multimodal PretrainingComplementary Modalities

    1FAIR · University of Oxford · 2Reality Labs

  57. UG-UMRE: Uncertainty-Guided Modality Augmentation and Distributional Calibration for Unified Multimodal Relation Extraction

    Aug 5, 2026Bo Kong, Liruiz Jia, Yi Liang +5Cross-ModalModalities

    Xinjiang University · Urumqi, China · Chongqing Jiaotong University +1

  58. Visual Anchoring in Diffusion: Multimodal Zero-Shot Skeleton Action Recognition

    Aug 5, 2026Zehao Bao, Shujun Guo, Bruce X. B. YuSkeleton-Based Action RecognitionZero-Shot

    The University of Hong Kong Hong Kong SAR, China · Zhejiang University Hangzhou, China

  59. CARGO-VL: Counterfactual Arbitration with Risk-Constrained Group Optimization for Vision-Language Models

    Aug 5, 2026De Jiang, Zhengyang Zhang, Kehong Yuan +1ArbitrationModalities

  60. AI-Based Sound Effect Generation: A Narrative Review of Generative Models Across Input Modalities

    Aug 4, 2026Sandy Abdo, Bill Kapralos, Priyamvada Tripathi +2Modern Generative Audio ModelsGenerative Artificial Intelligence

    Ontario Tech University, Oshawa, ON, Canada · Durham College, Oshawa, ON, Canada · Carleton University, Ottawa, ON, Canada