Contrastive Alignment
Contrastive alignment is a self-supervised learning technique aiming to learn robust representations by aligning features from different modalities (e.g., image and text, video frames, or multiple sensor data) or from different views of the same data. Current research focuses on applying contrastive alignment within various architectures, including transformers and graph neural networks, to improve tasks such as multimodal information extraction, domain adaptation, and recommendation systems. This approach enhances model performance and robustness, particularly in scenarios with noisy data, limited annotations, or domain shifts, impacting diverse fields from computer vision and natural language processing to medical image analysis and spatio-temporal forecasting.
Papers
When do Contrastive Word Alignments Improve Many-to-many Neural Machine Translation?
Zhuoyuan Mao, Chenhui Chu, Raj Dabre, Haiyue Song, Zhen Wan, Sadao Kurohashi
A Robust Contrastive Alignment Method For Multi-Domain Text Classification
Xuefeng Li, Hao Lei, Liwen Wang, Guanting Dong, Jinzheng Zhao, Jiachi Liu, Weiran Xu, Chunyun Zhang