Semantic Description
Semantic description focuses on representing and understanding the meaning of data, aiming to bridge the gap between raw data and its inherent meaning for various applications. Current research emphasizes integrating semantic information with other modalities (e.g., geometric, visual, temporal) using techniques like transformer networks, generative models (e.g., diffusion models, NeRFs), and Siamese architectures, often within a parameter-efficient fine-tuning framework. This work is significant for improving the accuracy and efficiency of tasks ranging from robot-human interaction and image processing to natural language understanding and information retrieval, ultimately leading to more robust and interpretable AI systems.
Papers
WikiMuTe: A web-sourced dataset of semantic descriptions for music audio
Benno Weck, Holger Kirchhoff, Peter Grosche, Xavier Serra
FedSSA: Semantic Similarity-based Aggregation for Efficient Model-Heterogeneous Personalized Federated Learning
Liping Yi, Han Yu, Zhuan Shi, Gang Wang, Xiaoguang Liu, Lizhen Cui, Xiaoxiao Li
SAM-CLIP: Merging Vision Foundation Models towards Semantic and Spatial Understanding
Haoxiang Wang, Pavan Kumar Anasosalu Vasu, Fartash Faghri, Raviteja Vemulapalli, Mehrdad Farajtabar, Sachin Mehta, Mohammad Rastegari, Oncel Tuzel, Hadi Pouransari
"Why Should I Review This Paper?" Unifying Semantic, Topic, and Citation Factors for Paper-Reviewer Matching
Yu Zhang, Yanzhen Shen, Xiusi Chen, Bowen Jin, Jiawei Han