Audio-Visual Reasoning

Ask about this topic

Momentum

16 papers in the last four weeks, up 433% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 77

All topics
CardsList

  1. LeAVJEPA: A Minimalist Architecture for Audio-Visual Self-Supervised Learning

    Oct 5, 2026Benjamin Robson, Santeri Mentu, Wenshuai Zhao +1Audio-Visual ReasoningNeural Audio

    ELLIS Institute Finland Aalto University

  2. OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning

    Oct 1, 2026Haibo Wang, Jiteng Mu, Jialu Li +5Audio-Visual ReasoningOmni-Modal

    University of California, Davis · Adobe Research

  3. AVSD-Scenes: A Dataset for Audio-Visual Description of Urban Scenes

    Oct 1, 2026Dhanunjaya Varma Devalraju, Arshdeep Singh, Mark D. PlumbleyAudio-Visual ReasoningMultimodal Dataset

    IIT Madras, India · King’s College London, United Kingdom

  4. MAV-C: A Framework for the Joint Objective Estimation of Audio-Visual Complexity in Immersive Virtual Environments

    Sep 30, 2026Luca Resti, Amelia Gully, Michael McLoughlin +2Audio-Visual ReasoningVirtual Reality

    Department of Computer Science, University of York, UK · AudioLab, School of Physics, Engineering and Technology, University of York, UK · Department of Language and Linguistic Science, University of York, UK

  5. LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perception

    Sep 30, 2026Juyi Lin, Zhiqiang Lao, Jiali Cui +9Audio-Visual ReasoningLong Video Question Answering

    Northeastern University · Futurewei Technologies

  6. OmniReasoning: Pushing the Limits of Audio-Visual Joint Reasoning

    Sep 30, 2026Junming Lin, Yuxuan Wang, Zhenxin Lei +11Audio-Visual ReasoningOmni-Modal

    School of Intelligence Science and Technology, Peking University · State Key Laboratory of General Artificial Intelligence, Peking University · Alibaba Token Hub, Alibaba Group

  7. OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning

    Sep 30, 2026Xingming Shui, Dapeng Chen, Bowei Liu +5Audio-Visual ReasoningProbe-Logit Distillation

    Tsinghua Shenzhen International Graduate School, Tsinghua University · Independent Researcher

  8. OmniRoute: Mapping Temporal Semantic Evidence to Audio-Visual Token Budgets for Efficient Omnimodal Large Language Models

    Sep 29, 2026Yuchen Deng, Zidang Cai, Feidiao Yang +4Omni-ModalAudio-Visual Reasoning

    Shenzhen International Graduate School, Tsinghua University, China · Pengcheng Laboratory, China

  9. SyncRA: Learning Temporal Correspondence in Omni-Modal Models

    Sep 28, 2026Zelong Xu, Yan Li, Wenhe Hu +1Audio-Visual ReasoningAudio-Visual Consistency

    University of Wisconsin–Madison · University of Alberta · Arizona State University

  10. Uncovering Ordinal-Matching Bias in Audio-Visual LLMs

    Sep 28, 2026Jihoo Jung, Youngjoon Jang, Hyebin Cho +2Audio-Visual ReasoningLarge Audio Language Models

    Korea Advanced Institute of Science and Technology, South Korea · University of Oxford, United Kingdom

  11. Less is More: Encoder-only Audio-Visual Segmentation

    Sep 24, 2026Ilpo Viertola, Vladimir Iashin, Sophie Tötterström +1Video Object SegmentationVision Encoders

    Tampere University

  12. OmniEcho: Audio-Visual Spatial Understanding for Omni-Modal Embodied Agents

    Sep 20, 2026Ruixun Liu, Yuxuan Wang, Jiacheng Xie +10Spatial AudioAudio-Visual Reasoning

    School of Intelligence Science and Technology, Peking University · State Key Laboratory of General Artificial Intelligence, Peking University · Alibaba Token Hub, Alibaba Group +1

  13. AVTrace: Diagnosing Audio-Visual Temporal Reasoning in Omni Models

    Sep 17, 2026Longyin Zhang, Parth Sakhare Mahendra, Chengwei Wei +4Audio-Visual ReasoningOmni-Modal

    Institute of Advanced Intelligence and Computing (IAIC), A*STAR, Singapore · Centre for Frontier AI Research (CFAR), A*STAR, Singapore

  14. Video-HolmesV2: Can MLLMs Reason with Spatio-Temporal Audio-Visual Evidence in Long Videos?

    Sep 15, 2026Zhaoyang Wei, Zipeng Wang, Yushe Cao +10Audio-Visual ReasoningVideo Understanding

    University of Chinese Academy of Sciences, China · Tsinghua University, China · Tencent, China

  15. Audio-Visual Turn-taking Prediction in Cocktail Party Scenarios

    Sep 15, 2026Long-Vu Hoang, Naomi HarteTurn-TakingAudio-Visual Reasoning

    Sigmedia Group, School of Engineering, Trinity College Dublin, Ireland

  16. Omni-Streaming Thinking

    Sep 14, 2026Enjun Du, Siyi Liu, Ziyu Zheng +4Omni-ModalAudio-Visual Reasoning

    1The University of Hong Kong · 2The Hong Kong University of Science and Technology (Guangzhou) · University of Sussex +2

  17. Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs

    Sep 9, 2026Killian Steunou, Yannis Tevissen, Mounîm A. El YacoubiAudio-Visual ReasoningVision Encoders

    SAMOVAR Laboratory, T´el´ecom SudParis, Institut Polytechnique de Paris, Palaiseau, France · Moments Lab, Paris, France

  18. Reasoning for Social Audio-Visual Question Answering: Where Do We Stand?

    Aug 13, 2026Koen P. de Vries, Xavier Alameda-Pineda, Estefanía Talavera +1Audio-Visual ReasoningVideo Multimodal Large Language Models

    Inria at Univ. Grenoble Alpes, CNRS, LJK, France · University of Twente, The Netherlands

  19. Qwen-MusicAVQA-7B: A Multimodal Model for Music Audio-Visual QA

    Aug 11, 2026Maryam DehdashtiAudio-Visual ReasoningDance-To-Music Generation

    Inference Matter Labs

  20. Listen, See and Track: Spatio-Temporal Audio-Visual Sound Event Reasoning for Omni-Modal Language Models

    Aug 10, 2026Zhi Zeng, Cheng Zhang, Zesheng Yang +9Audio-Visual ReasoningSpatial Audio

    Xi’an Jiaotong University · The Hong Kong Polytechnic University · National University of Singapore +2

  21. Deferred Audio Pruning with Local Audio-Visual Dynamics for Omni-LLMs

    Aug 9, 2026Kyeongyoon Lee, Hongyeob Kim, Youngeun Kim +1Audio-Visual ReasoningOmni-Modal

    Sungkyunkwan University · AWS AI Labs

  22. SCoPE: Training-Free Audio-Visual Event Perception via Sparse Cross-Modal Prior Exchange

    Aug 8, 2026Jaemo Jeong, Junho Yoon, Hyunju Kim +1Audio-Visual ReasoningFine-Grained Video Understanding

    KAIST

  23. OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Models

    Aug 4, 2026Wanshun Su, Yang Shi, Feihu Liu +10Token CompressionOmni-Modal

    Northwestern Polytechnical University · Peking University · Alibaba Group +1

  24. Omni-Prune: Query-Aware Unified Token Pruning for Efficient Omnimodal Large Language Models

    Jul 26, 2026Yiming Zhong, Chang Nie, Caifeng ShanVisual Token PruningAudio-Visual Reasoning

    1Nanjing University

  25. OmniReasoner: Thinking with Long Audio-Video via Native Tool Use

    Jul 21, 2026Yu Chen, Caorui Li, Ziyu Xiong +8Audio-Visual ReasoningOmni-Modal

    University of Chinese Academy of Sciences · Institute of Automation, CAS · Southeast University +3

  26. Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos

    Jul 17, 2026Sreyan Ghosh, Arushi Goel, Kaousheik Jayakumar +19Audio-Visual ReasoningLarge Audio Language Models

    1NVIDIA, USA · University of Maryland, USA

  27. AVSCap: Orchestrating Audio-Visual Synergy for Omni-modal Video Captioning

    Jul 14, 2026Yanghai Wang, Jiahao Wang, Jiafu Tang +9Audio-Visual ReasoningVideo Captioning

    NJU-LINK Team, Nanjing University · Kling Team, Kuaishou Technology · Institute of Automation, Chinese Academy of Sciences

  28. A Hybrid Mamba for Audio-Visual Navigation

    Jul 14, 2026Yi Wang, Yinfeng YuAudio-Visual ReasoningObject Goal Navigation

    School of Computer Science and Technology, Xinjiang University, Urumqi 830017, China. · Joint Research Laboratory for Embodied Intelligence, Xinjiang University. · Joint International Research Laboratory of Silk Road Multilingual Cognitive Computing, Xinjiang University.

  29. Simple Features and Honest Calibration for Ambivalence and Hesitancy Recognition in Video

    Jul 13, 2026Vikas Kumar, Aditya Mishra, Haroon R. LoneAffective ComputingAudio-Visual Reasoning

    Indian Institute of Science Education and Research Bhopal, India

  30. Empowering Long-form Omni-modal Understanding with Robust Audio Perception

    Jul 11, 2026Kaiying Yan, Luoyi Sun, Xiao Zhou +1Audio-Visual ReasoningOmni-Modal

    SAI, Shanghai Jiao Tong University, shanghai, China · Zhejiang University, Hangzhou, Zhejiang, china · Shanghai AI Lab, shanghai, China

  31. Uncovering Latent Depression Severity for Binary Depression Detection via Advantage-weighting Ranking

    Jul 7, 2026Manning Gao, Tingyi Liu, Leheng Zhang +3DepressionMultimodal Deep Learning

    South China Normal University, China · Sun Yat-sen University, China

  32. Q-TriM: Question-Guided Tri-Modal Attention for Audio-Visual Question Answering

    Jul 4, 2026SungHun Kim, SeungJun BaekAudio-Visual ReasoningCross-Modal Attention

    Dept. of Computer Science and Engineering Korea University Seoul, South Korea

  33. OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Models

    Jul 3, 2026Shijie Cao, Qingyu Zhang, Boxi Yu +6Token CompressionAudio-Visual Reasoning

    School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences · Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences · University of Limerick +1

  34. C3C^3ASD: Multi-Level Consistency-Driven Representation Learning

    Jul 3, 2026Jin Hong, Jisoo Park, Junseok KwonDiscrete Speech RepresentationsAudio-Visual Reasoning

    Chung-Ang University, Seoul, Republic of Korea

  35. MuseBench: Benchmarking Intent-Level Audiovisual Arts Understanding in MLLMs

    Jun 29, 2026Yuxuan Fan, Gyusik Seo, Jing Hao +3Artistic OwnershipAudio-Visual Reasoning

    1NTU Singapore · 2The University of Hong Kong · 3Johns Hopkins University +2

  36. MJEPA: A Simple and Scalable Joint-Embedding Predictive Architecture for Audio-Visual Learning

    Jun 23, 2026Revant Teotia, Adrien Bardes, Michael Rabbat +3Video Joint Embedding Predictive ArchitectureAudio-Visual Reasoning

    1FAIR at Meta · 2New York University

  37. AVOC: Enhancing Hour-Level Audio-Video Understanding in Omni-Modal LLMs via Retrieval-Inspired Token Compression

    Jun 23, 2026Yijing Chen, Wenhui Tan, Xiaoyi Yu +7Audio-Visual ReasoningLarge Audio Language Models

    Gaoling School of Artificial Intelligence, Renmin University of China · Huawei Inc.

  38. Unlocking Spatial Grounding in Large Audio-Visual Retrieval models

    Jun 22, 2026Hugo Malard, Michel Olvera, Sanjeel Parekh +3Audio-Visual ReasoningSound Source Localization

    LTCI, Télécom Paris, Institut Polytechnique de Paris, France · Meta, Reality Labs Research · NVIDIA, France +1

  39. READ More than What You See: Reinforcement Learning for Accurate and Coherent Audio Description Generations

    Jun 22, 2026Bo Fang, Xinyao Zhang, Yuxin Song +3Audio-Visual ReasoningMultimodal Generation

    City University of Hong Kong · Baidu Inc · Tsinghua University

  40. OmniVideo-100K: A Dataset for Audio-Visual Reasoning through Structured Scripts and Evidence Chains

    Jun 12, 2026Xinyue Cai, Chaoyou Fu, Yi-Fan Zhang +2Audio-Visual ReasoningLong Video Question Answering

    1Nanjing University · 2CASIA

  41. Audio-Visual Exchange-Aware Token Pruning for Efficient Audio-Visual Captioning

    Jun 9, 2026Zihan Meng, Dexiang Hong, Weidong Chen +3Visual Token PruningAudio-Visual Reasoning

    University of Science and Technology of China

  42. Hierarchical Semantic-Constrained Heterogeneous Graph for Audio-Visual Event Localization

    Jun 5, 2026Zhe Yang, Ruyi Zhang, Hongtao Chen +4Audio-Visual ReasoningFine-Grained Video Understanding

    Faculty of Computing, Harbin Institute of Technology, Harbin 150001, China · Peng Cheng Laboratory, Shenzhen 518000, China · Harbin Institute of Technology Suzhou Research Institute, Suzhou 215000, China

  43. M2S-AVSR: Modality-aware Multi-view Self-supervised Representation for Robust Audio-Visual Speech Recognition

    Jun 4, 2026Fei Su, Cancan Li, Ming Li +1Audio-Visual ReasoningMulti-View

    School of Artificial Intelligence and the School of Computer Science, Wuhan University, China · School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen, China · School of Artificial Intelligence, Wuhan University, China

  44. AVI-Bench: Toward Human-like Audio-Visual Intelligence of Omni-MLLMs

    Jun 1, 2026Yaoting Wang, Ziyi Zhang, Wenming Tu +10Audio-Visual ReasoningMultimodal Benchmarks

    Institute of Big Data, College of Computer Science and Artificial Intelligence, Fudan University, Shanghai, China · Huazhong University of Science and Technology · Shanghai Jiaotong University +5

  45. AVTrack: Audio-Visual Tracking in Human-centric Complex Scenes

    Jun 1, 2026Yaoting Wang, Yun Zhou, Zipei Zhang +1Audio-Visual ReasoningAutomatic Speaker Verification

    Institute of Big Data, College of Computer Science and Artificial Intelligence, Fudan University, Shanghai, China.

  46. SVHalluc: Benchmarking Speech-Vision Hallucination in Audio-Visual Large Language Models

    May 31, 2026Chenshuang Zhang, Kyeong Seon Kim, Chengxin Liu +1Large Language Model HallucinationObject Hallucination

    KAIST

  47. Beyond the Mouth: Upper-Face Affective Cues in Audiovisual Sentence Recognition under Acoustic Uncertainty

    May 30, 2026Zhou Yang, Yueyi YangFacial Expression RecognitionAudio-Visual Reasoning

    Faculty of Education and Psychology, University of Oulu, Finland · Center for Machine Vision and Signal Analysis, University of Oulu, Finland

  48. Your Multimodal Speech Model Says I Have a Face for Radio

    May 28, 2026Maya K. Nachesa, Vlad Niculae, Vagrant GautamAudio-Visual Reasoning

    Language Technology Lab University of Amsterdam · Heidelberg Institute for Theoretical Studies

  49. Agentic Active Omni-Modal Perception for Multi-Hop Audio-Visual Reasoning

    May 27, 2026Ke Xu, Yuhao Wang, Ziyang Cheng +3Omni-ModalAudio-Visual Reasoning

    Shanghai Jiao Tong University

  50. OmniRetriever: Any-to-Any Audio-Video-Text Retrieval via Fusion-as-Teacher Distillation

    May 26, 2026Yunze Liu, Chi-Hao Wu, Enmin Zhou +1Multimodal Retrieval Augmented GenerationAudio-Visual Reasoning

    Memories.ai Research

  51. O-MARC: Omni Memory-Augmented Compression Distillation for Efficient Video Understanding

    May 26, 2026Peiran Wu, Yunze Liu, Chi-Hao Wu +2Audio-Visual ReasoningVideo Understanding

    University of Bristol · Memories.ai Research · University of Central Florida

  52. StreamOV: Streaming Omni-Video Understanding via Evidence-Guided Memory and Response Triggering

    May 25, 2026Ming Xie, Zizheng Huang, Xudong Tan +6Streaming Video UnderstandingStreaming Video

    Shanghai Innovation Institute · Fudan University · Nanjing University +2

  53. LatentOmni: Rethinking Omni-Modal Understanding via Unified Audio-Visual Latent Reasoning

    May 21, 2026Yifan Dai, Zhenhua Wu, Bohan Zeng +18Audio-Visual ReasoningOmni-Modal

    School of AI, Shanghai Jiao Tong University · 2Kling Team, Kuaishou Technology · 3Peking University +5

  54. EMO-BOOST: Emotion-Augmented Audio-Visual Features for Improved Generalization in Deepfake Detection

    May 19, 2026Aritra Marik, Marcel Klemt, Anna RohrbachDeepfake DetectionAi-Generated Video Detection

    Technical University of Darmstadt · ELIZA

  55. OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video Understanding

    May 18, 2026Ruixiang Zhao, Jie Yang, Zijie Xin +4Omni-ModalAudio-Visual Reasoning

    Renmin University of China · WeChat Vision, Tencent Inc.

  56. OmniSelect: Dynamic Modality-Aware Token Compression for Efficient Omni-modal Large Language Models

    May 18, 2026Morunliu Yang, Ruotao Xu, Le Li +6Visual Token PruningModality-Specific Encoders

    1Soochow University · Peking University

  57. When Vision Speaks for Sound

    May 13, 2026Xiaofei Wen, Wenjie Jacky Mo, Xingyu Fu +6Audio-Visual ReasoningVideo Multimodal Large Language Models

    dUniversity of California, Davis · pPrinceton University · wUniversity of Wisconsin–Madison +1

  58. OmniRefine: Alignment-Aware Cooperative Compression for Efficient Omnimodal Large Language Models

    May 12, 2026Yuchen Deng, Zidang Cai, Hai-Tao Zheng +3Token CompressionAudio-Visual Reasoning

    Tsinghua Shenzhen International Graduate School, Tsinghua University · Pengcheng Laboratory

  59. Keep What Audio Cannot Say: Context-Preserving Token Pruning for Omni-LLMs

    May 12, 2026Chaeyoung Jung, Kyeongha Rho, Joon Son ChungAudio-Visual ReasoningOmni-Modal

    Korea Advanced Institute of Science and Technology (KAIST)

  60. Separate First, Fuse Later: Mitigating Cross-Modal Interference in Audio-Visual LLMs Reasoning with Modality-Specific Chain-of-Thought

    May 11, 2026Xuanchen Li, Yuheng Lu, Chenrui Cui +6Audio-Visual ReasoningLLM Reasoning Strategies

    Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin University, Tianjin, China · Tencent, China · Huiyan Technology Company, Ltd., Tianjin, China +1