Trajectory Word Alignment
Trajectory word alignment focuses on analyzing and modeling the relationships between word meanings and their evolution over time or across different spatial contexts, such as in videos. Current research explores methods for aligning trajectories of word meanings in semantic spaces, as well as aligning visual trajectories (e.g., object movement in videos) with corresponding textual descriptions, often employing novel attention mechanisms within transformer-based architectures. These advancements improve the accuracy of video-language tasks and offer insights into the dynamics of semantic change across languages, contributing to a deeper understanding of both language evolution and multimodal information processing.
Papers
April 23, 2024
January 5, 2023