Audio-Visual Representation Learning

Ask about this topic

Momentum

1 paper in the last four weeks, with none the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 19

All topics
CardsList

  1. PVSync: A Unified Lip-Sync Expert for Timing and Articulation

    Oct 6, 2026Kevin Stephen, Varun Menon, Timo Mertens +1Audio-Visual SynchronizationAudio-Visual Representation Learning

    University of Southern California · Cantina Inc.

  2. LeAVJEPA: A Minimalist Architecture for Audio-Visual Self-Supervised Learning

    Oct 5, 2026Benjamin Robson, Santeri Mentu, Wenshuai Zhao +1Audio-Visual Representation LearningJoint-Embedding Predictive Architecture

    ELLIS Institute Finland Aalto University

  3. SyncRA: Learning Temporal Correspondence in Omni-Modal Models

    Sep 28, 2026Zelong Xu, Yan Li, Wenhe Hu +1Audio-Visual Representation LearningAudio-Visual Synchronization

    University of Wisconsin–Madison · University of Alberta · Arizona State University

  4. A Hybrid Mamba for Audio-Visual Navigation

    Jul 14, 2026Yi Wang, Yinfeng YuMambaEmbodied Navigation

    School of Computer Science and Technology, Xinjiang University, Urumqi 830017, China. · Joint Research Laboratory for Embodied Intelligence, Xinjiang University. · Joint International Research Laboratory of Silk Road Multilingual Cognitive Computing, Xinjiang University.

  5. Uncovering Latent Depression Severity for Binary Depression Detection via Advantage-weighting Ranking

    Jul 7, 2026Manning Gao, Tingyi Liu, Leheng Zhang +3Representation LearningLearning to Rank

    South China Normal University, China · Sun Yat-sen University, China

  6. EVAS: Efficient Multimodal Temporal Forgery Localization via Audio-Visual Synergy and Steered Boundary Calibration

    Jul 5, 2026Shen Shen, Quan Zhang, Dan Jiang +1Audio-Visual Representation LearningDigital Forensics

    Soochow University · Tsinghua University

  7. C3C^3ASD: Multi-Level Consistency-Driven Representation Learning

    Jul 3, 2026Jin Hong, Jisoo Park, Junseok KwonMultimodal RobustnessAudio-Visual Representation Learning

    Chung-Ang University, Seoul, Republic of Korea

  8. MJEPA: A Simple and Scalable Joint-Embedding Predictive Architecture for Audio-Visual Learning

    Jun 23, 2026Revant Teotia, Adrien Bardes, Michael Rabbat +3Audio-Visual Representation LearningJoint-Embedding Predictive Architecture

    1FAIR at Meta · 2New York University

  9. Unlocking Spatial Grounding in Large Audio-Visual Retrieval models

    Jun 22, 2026Hugo Malard, Michel Olvera, Sanjeel Parekh +3Multimodal GroundingAudio-Visual Understanding

    LTCI, Télécom Paris, Institut Polytechnique de Paris, France · Meta, Reality Labs Research · NVIDIA, France +1

  10. Listen, Look, and Learn: Learning Without Forgetting through SAM-Audio

    Jun 9, 2026Avi Gupta, Nilotpal Sinha, Vishnu Raj +4Class-Incremental LearningAudio-Visual Representation Learning

    IIIT Delhi · Dolby Laboratories · IIT Kanpur +1

  11. M2S-AVSR: Modality-aware Multi-view Self-supervised Representation for Robust Audio-Visual Speech Recognition

    Jun 4, 2026Fei Su, Cancan Li, Ming Li +1Multimodal RobustnessAudio-Visual Representation Learning

    School of Artificial Intelligence and the School of Computer Science, Wuhan University, China · School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen, China · School of Artificial Intelligence, Wuhan University, China

  12. TB-AVA: Text as a Semantic Bridge for Audio-Visual Parameter Efficient Finetuning

    May 12, 2026Seongah Kim, Dinh Phu Tran, Hyeontaek Hwang +3Audio-Visual UnderstandingAudio-Visual Representation Learning

    AI2 Lab, KAIST

  13. Towards multi-modal forgery representation learning for AI-generated video detection and localization

    May 8, 2026Dat Le, Khoa Nguyen, Xin Wang +1Audio-Visual Representation LearningDeepfake Detection

    Purdue University, West Lafayette · University at Albany, SUNY, New York

  14. Delayed Commitment for Representation Readiness in Stage-wise Audio-Visual Learning

    May 3, 2026Xinmeng Xu, Haoran Xie, S. Joe Qin +3Audio-Visual UnderstandingAudio-Visual Representation Learning

    Division of Artificial Intelligence, Lingnan University, Tuen Mun, Hong Kong SAR · School of Computer Science and Artificial Intelligence, Wuhan University of Technology, Wuhan, China · School of Mathematics, Physics and Computing, University of Southern Queensland, Toowoomba, Australia +1

  15. OmniEncoder: See, Hear, and Feel Continuous Motion Like Humans With One Encoder

    May 2, 2026Detao Bai, Shimin Yao, Weixuan Chen +4Cross-Modal LearningVideo Understanding

    1Tongyi Lab Alibaba Group · Shenzhen University of Advanced Technology

  16. AViS-Mamba: Adaptive Visual Steering of Audio State-Space Dynamics for Violence Detection

    Apr 2, 2026Damith Chamalke Senadeera, Dimitrios Kollias, Gregory SlabaughAudio-Visual UnderstandingAudio-Visual Representation Learning

    Queen Mary University of London, UK · Digital Environment Research Institute (DERI), London, UK

  17. Bootstrapping Audiovisual Speech Recognition in Zero-AV-Resource Scenarios

    Mar 9, 2026Pol Buitrago, Javier HernandoSynthetic Data AugmentationAudio-Visual Representation Learning

    Barcelona Supercomputing Center (BSC), Spain · Universitat Polit`ecnica de Catalunya (UPC), Spain

  18. Delayed Bidirectional Alignment via Disentangled Audio Semantics for Audio-Visual Segmentation

    Dec 23, 2025Jingqi Tian, Yiheng Du, Haoji Zhang +6Audio-Visual UnderstandingAudio-Visual Representation Learning

    Tsinghua Shenzhen International Graduate School, Tsinghua University, China · Peking University, China

  19. TACO: Training-free Sound Prompted Segmentation via Semantically Constrained Audio-visual CO-factorization

    Dec 2, 2024Hugo Malard, Michel Olvera, Stephane Lathuiliere +1Image SegmentationAudio-Visual Representation Learning

    LTCI, Télécom Paris, Institut Polytechnique de Paris