Modalities

Ask about this topic

Momentum

33 papers in the last four weeks, up 154% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 217

All topics
CardsList

  1. Mapping the Methodological Space of Classroom Interaction Research: Scale, Duration, and Modality in an Age of AI

    Apr 30, 2026Dorottya Demszky, Edith Bouton, Alison Twiner +2ClassroomsMethodology

    Stanford Graduate School of Education, 485 Lasuen Mall, Stanford, CA, 94305 · Lausen Mall, Stanford, CA 94305 · Hebrew University of Jerusalem, Mount Scopus, Jerusalem 9190501, Israel +2

  2. Report of the 5th PVUW Challenge: Towards More Diverse Modalities in Pixel-Level Understanding

    Apr 28, 2026Chang Liu, Henghui Ding, Nikhila Ravi +40Fine-Grained Video UnderstandingVideo Object Segmentation

  3. GraphPL: Leveraging GNN for Efficient and Robust Modalities Imputation in Patchwork Learning

    Apr 28, 2026Xingjian Hu, Zuoyu Yan, Jianhua Zhu +3Multimodal LearningFederated Graph Learning

    Wangxuan Institute of Computer Technology, Peking University, Beijing · Weill Cornell Medicine, Cornell University, New York · Biomedical Informatics, Stony Brook University, New York

  4. minAction.net: Energy-First Neural Architecture Design -- From Biological Principles to Systematic Validation

    Apr 27, 2026Martin G. FraschNeural Architecture SearchNeuromorphic Computing

    Institute on Human Development and Disability, University of Washington, Seattle, WA 98195, USA · Health Stream Analytics, LLC, Seattle, WA, USA

  5. Source-Modality Monitoring in Vision-Language Models

    Apr 23, 2026Etha Tianze Hua, Tian Yun, Ellie PavlickModalities

    Department of Computer Science, Brown University

  6. Multi-modal Test-time Adaptation via Adaptive Probabilistic Gaussian Calibration

    Apr 21, 2026Jinglin Xu, Yi Li, Chuxiong Sun +3ModalitiesConditional Distribution

    Institute of Software Chinese Academy of Sciences · University of Chinese Academy of Sciences · National Defense University

  7. Back into Plato's Cave: Examining Cross-modal Representational Convergence at Scale

    Apr 20, 2026A. Sophia Koepke, Daniil Zverev, Shiry Ginosar +1ModalitiesRidge

    UC Berkeley · Technical University Munich, MCML · University of Tübingen, Tübingen AI Center +1

  8. Learning Invariant Modality Representation for Robust Multimodal Learning from a Causal Inference Perspective

    Apr 20, 2026Sijie Mai, Shiqin HanMultimodal LearningModalities

    School of Computer Science, South China Normal University

  9. Multiplication in Multimodal LLMs: Computation with Text, Image, and Audio Inputs

    Apr 20, 2026Samuel G. Balter, Ethan Jerzak, Connor T. JerzakMultimodal Large Language ModelsModalities

    University of Texas at Austin · National University of Singapore (NUS)

  10. MM-JudgeBias: A Benchmark for Evaluating Compositional Biases in MLLM-as-a-Judge

    Apr 20, 2026Sua Lee, Sanghee Park, Jinbae ImLlm-As-A-JudgeMultimodal Large Language Models

    Seoul National University · NAVER Cloud AI · KAIST AI

  11. Where to Focus: Query-Modulated Multimodal Keyframe Selection for Long Video Understanding

    Apr 19, 2026Shaoguang Wang, Weiyu Guo, Ziyang Chen +2Video UnderstandingKeyframe Selection

    Thrust of Artificial Intelligence, HKUST (Guangzhou) Guangzhou, China · Department of CSE, HKUST Hong Kong SAR, China

  12. Test-Time Adaptation for EEG Foundation Models: A Systematic Study under Real-World Distribution Shifts

    Apr 18, 2026Gabriel Jason Lee, Jathurshan Pradeepkumar, Jimeng SunElectroencephalography Foundation ModelsTest-Time Adaptation

    University of Illinois Urbana-Champaign, Urbana, IL, USA

  13. Beyond Text-Dominance: Understanding Modality Preference of Omni-modal Large Language Models

    Apr 18, 2026Xinru Yan, Boxi Cao, Yaojie Lu +4Multimodal Large Language ModelsOmni-Modal

    University of Chinese Academy of Sciences, Beijing, China · Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences, Beijing, China

  14. Information Router for Mitigating Modality Dominance in Vision-Language Models

    Apr 17, 2026Seulgi Kim, Mohit Prabhushankar, Ghassan AlRegibCross-Modal AttentionCross-Modal

    OLIVES at the Center for Signal and Information Processing CSIP, School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA

  15. Do Vision-Language Models Truly Perform Vision Reasoning? A Rigorous Study of the Modality Gap

    Apr 17, 2026Yige Xu, Yongjie Wang, Zizhuo Wu +3Recent Vision-Language ModelsMultimodal Reasoning

    College of Computing and Data Science, Nanyang Technological University, Singapore · Alibaba-NTU Global e-Sustainability CorpLab (ANGEL) · Tongyi Lab, Alibaba Group, China

  16. Integrating Graphs, Large Language Models, and Agents: Reasoning and Retrieval

    Apr 17, 2026Hamed Jelodar, Samita Bai, Mohammad Meymani +3Graph-Llm IntegrationsKnowledge Graphs

    Canadian Institute for Cybersecurity, Faculty of Computer Science, University of New Brunswick, Fredericton, NB E3B 9W4, Canada

  17. Robust Multispectral Semantic Segmentation under Missing or Full Modalities via Structured Latent Projection

    Apr 17, 2026Irem Ulku, Erdem Akagündüz, Ömer Özgür TanrıöverAmodal SegmentationComplementary Modalities

    Department of Computer Engineering, Ankara University, Ankara, Türkiye · Department of Modeling and Simulation, Graduate School of Informatics, METU, Ankara, Türkiye

  18. Cross-Modal Generation: From Commodity WiFi to High-Fidelity mmWave and RFID Sensing

    Apr 17, 2026Zhixiong Yang, Long Jing, Yao Li +3Millimeter WaveWireless Communications

    Tsinghua University Beijing, China

  19. Reasoning Dynamics and the Limits of Monitoring Modality Reliance in Vision-Language Models

    Apr 16, 2026Danae Sánchez Villegas, Samuel Lewis-Lim, Nikolaos Aletras +1Large Reasoning ModelsVisual Evidence

    University of Copenhagen, Department of Computer Science · University of Sheffield, School of Computer Science

  20. OmniGCD: Abstracting Generalized Category Discovery for Modality Agnosticism

    Apr 16, 2026Jordan Shipard, Arnold Wiliem, Kien Nguyen Thanh +2Generalized Category DiscoveryModality-Specific Encoders

    SAIVT, QUT, Australia · Shield AI, Australia · La Trobe University, Australia

  21. Chain of Modality: From Static Fusion to Dynamic Orchestration in Omni-MLLMs

    Apr 16, 2026Ziyang Luo, Nian Liu, Junwei HanMultimodal FusionModalities

    Northwestern Polytechnical University Xi’an, Shaanxi, China

  22. Rethinking Multimodal Fusion for Time Series: Text Modalities Need Constrained Fusion

    Mar 23, 2026Seunghan Lee, Jun Seo, Jaehoon Lee +7Multimodal FusionMulti-Stream Temporal Fusion

    LG AI Research Seoul, South Korea

  23. Overcoming the Modality Gap in Context-Aided Forecasting

    Mar 12, 2026Vincent Zhihao Zheng, Étienne Marcotte, Arjun Ashok +4Retrieval-Augmented ForecastingData Augmentation

    ServiceNow AI Research, Montréal, Canada · Department of Civil Engineering, McGill University, Montréal, Canada · DIRO, Université de Montréal, Montréal, Canada +1

  24. Speech Codec Probing from Semantic and Phonetic Perspectives

    Mar 11, 2026Xuan Shi, Chang Zeng, Tiantian Feng +3Audio TokenizersNeural Speech Codecs

    University of Southern California, USA · Dolby Laboratories, USA

  25. Taming Text-to-Sounding Video Generation via Advanced Modality Condition and Interaction

    Oct 3, 2025Kaisi Guan, Xihua Wang, Zhengfeng Lai +5Audio-Video GenerationVideo Generation

    1Renmin University of China · 2Apple

  26. FairSSL: Fair Multimodal Self-Supervised Learning

    Aug 22, 2025Jiaee Cheong, Abtin Mogharabin, Paul Liang +2Multimodal LearningSelf-Supervised Learning

    Harvard University · University of Cambridge · Middle East Technical University +1

  27. EGRA:Toward Enhanced Behavior Graphs and Representation Alignment for Multimodal Recommendation

    Aug 22, 2025Xiaoxiong Zhang, Xin Zhou, Zhiwei Zeng +2Multimodal Recommendation ModelModality Alignment

    College of Computing and Data Science, Nanyang Technological University, Singapore

  28. No Data Wasted: A Semi-supervised Generative Model for Incomplete Multi-view Data Integration with Missing Labels

    Aug 15, 2025Yiyang Shen, Weiran WangMulti-ViewUnlabeled Data

    Department of Computer Science, University of Iowa, Iowa City, Iowa, USA

  29. VGGSounder: Audio-Visual Evaluations for Foundation Models

    Aug 11, 2025Daniil Zverev, Thaddäus Wiedemer, Ameya Prabhu +3Recent Vision Foundation ModelsMultimodal Classification

    Technical University of Munich, MCML · University of Tübingen · Tübingen AI Center +1

  30. ADMC: Attention-based Diffusion Model for Missing Modalities Feature Completion

    Jul 8, 2025Yuhan Li, Wei Zhang, Juan Chen +3Missing ModalitiesCross-Modal

    National University of Defense Technology · The Fifth Electronic Research Institute of MIIT · University of Chinese Academy of Sciences +2

  31. CanadaFireSat: Toward high-resolution wildfire forecasting with multiple modalities

    Jun 10, 2025Hugo Porta, Emanuele Dalsasso, Jessica L. McCarty +1Wildfire PredictionMultimodal Deep Learning

    EPFL, Route des Ronquos 86, Sion, 1950, Wallis, Switzerland · Université Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK, Grenoble, 38000, France · NASA Ames Research Center, Earth Science Division„ Moffett Field, California, 94035, USA

  32. Purify then Guide: Rethinking Domain Generalization for Multimodal Face Anti-Spoofing

    May 14, 2025Yingjie Ma, Xun Lin, Zitong Yu +7Face Forgery DetectionSpoofing

    College of Computer Science and Software Engineering, Shenzhen University · School of Computing and Information Technology, Great Bay University · The Chinese University of Hong Kong +5

  33. Structured-Noise Masked Modeling for Video, Audio and Beyond

    Mar 20, 2025Aritra Bhowmik, Carlos Hinojosa, Fida Mohammad Thoker +2Noise-AwareNeural Audio

    University of Amsterdam · King Abdullah University of Science and Technology

  34. Unexplainability of Artificial Intelligence Judgments and Functional Implementation in Kant's Perspective

    Jul 12, 2024Jongwoo SeoHuman JudgmentEpistemology

    Busan, South Korea

  35. Modular Sensory Stream for Integrating Physical Feedback in Vision-Language-Action Models

    Date pendingJimin Lee, Huiwon Jang, Myungkyu Koo +2Diffusion-Based Vision-Language-ActionsSensory Feedback

    KAIST · RLWRLD

  36. MAD: Modality-Adaptive Decoding for Mitigating Cross-Modal Hallucinations in Multimodal Large Language Models

    Date pendingSangyun Chung, Se Yeon Kim, Youngchae Chee +1Multimodal Large Language ModelsModality-Specific Encoders

    Integrated Vision Language Lab, KAIST, South Korea

  37. Early Intervention for VFM-based Multimodal Medical Image Classification

    Date pendingQijie Wei, Hailan Lin, Xirong LiMedical Image ClassificationMedical Images

    Renmin University of China, Beijing 100872, China