cs.CVMar 24, 2026

A Synchronized Audio-Visual Multi-View Capture System

Authors: Xiangwei Shi, Gara Dorta, Ruud de Jong, Ojas Shirekar, Chirag Raman

Organizations: Delft University of Technology, Netherlands

Abstract

Multi-view capture systems have been an important tool in research for recording human motion under controlling conditions. Most existing systems are specified around video streams and provide little or no support for audio acquisition and rigorous audio-video alignment, despite both being essential for studying conversational interaction where timing at the level of turn-taking, overlap, and prosody matters. In this technical report, we describe an audio-visual multi-view capture system that addresses this gap by treating synchronized audio and synchronized video as first-class signals. The system combines a multi-camera pipeline with multi-channel microphone recording under a unified timing architecture and provides a practical workflow for calibration, acquisition, and quality control that supports repeatable recordings at scale. We quantify synchronization performance in deployment and show that the resulting recordings are temporally consistent enough to support fine-grained analysis and data-driven modeling of conversation behavior.

Figures & tables

Explore similar work

CardsList
  1. AV-SyncBench: Decoupled Benchmarking of Temporal and Semantic Audio-Visual Synchronization

    Jul 1, 2026Tianhong Zhou, Mingyang Han, Boyu Li +8Audio-Visual SynchronizationAudio-Visual Alignment

  2. Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning

    Jul 2, 2026Chen Zhao, Jiajun Ma, Qilong Huang +6Audio-Visual UnderstandingVideo Captioning

  3. SyncReward: Human-Aligned Synchronization Reward for Audio-Visual Generation

    Oct 12, 2026Kaisi Guan, Ying Ba, Wenjing Wang +4Audio-Visual SynchronizationAudio-Video Generation