eess.SYNov 2, 2026

When Music Needs Meaning: Semantic Communication as a Transformative Enabler for the Musical Metaverse

Authors: Ali Al Housseini, Jaime Llorca, Cristina Rottondi, Luca Turchet, Tiziano Leidi, Omran Ayoub

Organizations: University of Applied Sciences and Arts of Southern Switzerland, Lugano, Switzerland · University of Trento, Trento, Italy · Centre Tecnologic de Telecomunicacions de Catalunya (CTTC/CERCA), Castelldefels, Spain. · New York University, New York, USA. · 

Abstract

The Musical Metaverse (MM) enables geographically distributed musicians, audiences, sound engineers, and AI agents to interact through synchronized audio, visual, kinematic, and haptic streams, imposing latency, synchronization, bandwidth, and scalability requirements that are difficult to satisfy with conventional bit-level communication. This paper argues that semantic communication, understood here as the transmission of musically meaningful information rather than raw audio-visual-haptic samples, provides a principled communication paradigm for the MM. We define the MM from a communication perspective and derive modality-specific require ments; propose a three-pillar framework for musical semantic communication comprising semantics extraction, semantic-aware orchestration, and cross-modal semantic synchronization; survey representative work across semantic communication, music AI and edge orchestration, identifying the gaps that prevent their integration; and propose a semantic-first reference architecture based on device-side semantic encoders, edge semantic routers, and cross-modal semantic synchronization. The resulting framework positions the MM as a concrete and demanding use case for 6G semantic communication.

Figures & tables

Explore similar work

CardsList
  1. MusicSem: A Semantically Rich Language--Audio Dataset of Natural Music Descriptions

    Feb 19, 2026Rebecca Salganik, Teng Tu, Fei-Yueh Chen +8Music Information RetrievalMultimodal Model Evaluation

  2. From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity

    Sep 9, 2026Yu Ma, Zhen Gao, Li Qiao +11Semantic Communication6G Networks