Contrastive Learning
Contrastive learning is a self-supervised machine learning technique that aims to learn robust data representations by contrasting similar and dissimilar data points. Current research focuses on applying contrastive learning to diverse modalities, including images, audio, text, and time-series data, often within multimodal frameworks and using architectures like MoCo and SimCLR, and exploring its application in various tasks such as object detection, speaker verification, and image dehazing. This approach is significant because it allows for effective learning from unlabeled or weakly labeled data, improving model generalization and performance across numerous applications, particularly in scenarios with limited annotated data or significant domain shifts.
Papers
APAM: Adaptive Pre-training and Adaptive Meta Learning in Language Model for Noisy Labels and Long-tailed Learning
Sunyi Chi, Bo Dong, Yiming Xu, Zhenyu Shi, Zheng Du
Spectral Augmentations for Graph Contrastive Learning
Amur Ghose, Yingxue Zhang, Jianye Hao, Mark Coates
Linking data separation, visual separation, and classifier performance using pseudo-labeling by contrastive learning
Bárbara Caroline Benato, Alexandre Xavier Falcão, Alexandru-Cristian Telea
Hybrid Contrastive Constraints for Multi-Scenario Ad Ranking
Shanlei Mu, Penghui Wei, Wayne Xin Zhao, Shaoguo Liu, Liang Wang, Bo Zheng
Cluster-aware Contrastive Learning for Unsupervised Out-of-distribution Detection
Menglong Chen, Xingtai Gui, Shicai Fan
Rethinking Robust Contrastive Learning from the Adversarial Perspective
Fatemeh Ghofrani, Mehdi Yaghouti, Pooyan Jamshidi
CIPER: Combining Invariant and Equivariant Representations Using Contrastive and Predictive Learning
Xia Xu, Jochen Triesch
Adversarial Learning Data Augmentation for Graph Contrastive Learning in Recommendation
Junjie Huang, Qi Cao, Ruobing Xie, Shaoliang Zhang, Feng Xia, Huawei Shen, Xueqi Cheng
Spatiotemporal Decouple-and-Squeeze Contrastive Learning for Semi-Supervised Skeleton-based Action Recognition
Binqian Xu, Xiangbo Shu
Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective
Chenyu You, Weicheng Dai, Yifei Min, Fenglin Liu, David A. Clifton, S Kevin Zhou, Lawrence Hamilton Staib, James S Duncan
SCCAM: Supervised Contrastive Convolutional Attention Mechanism for Ante-hoc Interpretable Fault Diagnosis with Limited Fault Samples
Mengxuan Li, Peng Peng, Jingxin Zhang, Hongwei Wang, Weiming Shen
Style Feature Extraction Using Contrastive Conditioned Variational Autoencoders with Mutual Information Constraints
Suguru Yasutomi, Toshihisa Tanaka
Searching Large Neighborhoods for Integer Linear Programs with Contrastive Learning
Taoan Huang, Aaron Ferber, Yuandong Tian, Bistra Dilkina, Benoit Steiner
Contrastive Learning with Consistent Representations
Zihu Wang, Yu Wang, Zhuotong Chen, Hanbin Hu, Peng Li