Audio-Visual QA

QA: Question Answering

Overview

AVQA studies how models use synchronized audio, video, and a question to identify relevant evidence and answer about what happens, what is heard, and how the modalities relate. Common approaches include pretrained audio and video encoders, question-guided attention or cross-modal fusion, and methods that retrieve or temporally ground evidence before reasoning. Benchmarks range from music and sound-event questions to long videos, spatial reasoning, and tests of whether answers truly depend on both modalities. Models are improving, but benchmark shortcuts, cross-modal interference, long-context costs, and reliable spatial and temporal grounding remain open challenges.

Latest papers

CardsList

31 papers3 papers in the last four weeks, down 62% on the four weeks before. 0.0% of all new papers.

  1. Do Modern Video-LLMs Need to Listen? A Benchmark Audit and Scalable Remedy

    Sep 22, 2025Geewook Kim, Minjoon SeoVLM EvaluationAudio-Visual Understanding