Mutual Learning

Mutual learning, a machine learning paradigm, focuses on improving multiple models by enabling them to learn from each other's strengths, thereby surpassing the performance of individually trained models. Current research emphasizes applications across diverse fields, employing various architectures including Bayesian neural networks, transformer models, and deep learning frameworks tailored for specific tasks like image segmentation, natural language processing, and robotic control. This approach holds significant promise for enhancing model accuracy and robustness in various applications, particularly where data is scarce or heterogeneous, and for fostering more effective human-AI collaboration.

Papers

November 19, 2023

ML-LMCL: Mutual Learning and Large-Margin Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding
Xuxin Cheng, Bowen Cao, Qichen Ye, Zhihong Zhu, Hongxiang Li, Yuexian Zou
Contrastive Learning Automatic Speech Recognition Speech Recognition Spoken Language Understanding Mutual Learning Margin Contrastive

November 17, 2023

3D-TexSeg: Unsupervised Segmentation of 3D Texture using Mutual Transformer Learning
Iyyakutti Iyappan Ganapathi, Fayaz Ali, Sajid Javed, Syed Sadaf Ali, Naoufel Werghi
Mutual Learning Unsupervised Segmentation 3D G 3D Texture Diverse Texture

November 14, 2023

Learning Mutually Informed Representations for Characters and Subwords
Yilin Wang, Xinyi Hu, Matthew R. Gormley
Language Model Vision Language Model Character Persona Mutual Learning Subword Tokenization Sub Word Subword Level Model

November 11, 2023

An Intelligent Social Learning-based Optimization Strategy for Black-box Robotic Control with Reinforcement Learning
Xubo Yang, Jian Gao, Ting Wang, Yaozhen He
Reinforcement Learning Mutual Learning Social Learning Autonomous Software Agent Intelligent Control

October 20, 2023

A Human-Robot Mutual Learning System with Affect-Grounded Language Acquisition and Differential Outcomes Training
Alva Markelius, Sofia Sjöberg, Zakaria Lemhauori, Laura Cohen, Martin Bergström, Robert Lowe, Lola Cañamero
Mutual Learning Cognitive Behavioral Therapy Human Learning

October 8, 2023

Cross-head mutual Mean-Teaching for semi-supervised medical image segmentation
Wei Li, Ruifeng Bian, Wenyi Zhao, Weijin Xu, Huihua Yang
Semi Supervised Semi Supervised Medical Image Segmentation Mutual Learning Consistency Training

July 27, 2023

R-Block: Regularized Block of Dropout for convolutional networks
Liqi Wang, Qiya Hu
Neural Network Convolutional Neural Network Convolutional Layer Structured Dropout Mutual Learning

July 15, 2023

Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition
Mengyuan Liu, Hong Liu, Tianyu Guo
Contrastive Learning Collaborative Learning Mutual Learning Self Supervised Action Joint Adversarial

July 12, 2023

Correlation-Aware Mutual Learning for Semi-supervised Medical Image Segmentation
Shengbo Gao, Ziji Zhang, Jiechao Ma, Zihao Li, Shu Zhang
Medical Image Segmentation Semi Supervised Learning Semi Supervised Medical Image Segmentation Semi Supervised Segmentation Mutual Learning Atrial Segmentation

June 16, 2023

Structured Cooperative Learning with Graphical Model Priors
Shuangtong Li, Tianyi Zhou, Xinmei Tian, Dacheng Tao
Graphical Model Mutual Learning Cooperative Learning Graphical Model Prior Cooperation Graph

June 8, 2023

Population-Based Evolutionary Gaming for Unsupervised Person Re-identification
Yunpeng Zhai, Peixi Peng, Mengxi Jia, Shiyong Li, Weiqiang Chen, Xuesong Gao, Yonghong Tian
Person Re Identification Mutual Learning Evolutionary Game Multi Population

May 11, 2023

EAML: Ensemble Self-Attention-based Mutual Learning Network for Document Image Classification
Souhail Bakkali, Ziheng Ming, Mickael Coustaty, Marçal Rusiñol
Information Retrieval Diverse Ensemble Mutual Learning Fusion Module Document Image Classification

May 3, 2023

Unsupervised Mutual Transformer Learning for Multi-Gigapixel Whole Slide Image Classification
Sajid Javed, Arif Mahmood, Talha Qaiser, Naoufel Werghi, Nasir Rajpoot
Computational Pathology Whole Slide Image Mutual Learning Unsupervised Classification Instance Level Label Cancer Subtype WSI Classification

April 17, 2023

MELT: Mutual Enhancement of Long-Tailed User and Item for Sequential Recommendation
Kibum Kim, Dongmin Hyun, Sukwon Yun, Chanyoung Park
Sequential Recommendation Sequential Recommender System Mutual Learning Item Popularity Long Tailed Problem

March 17, 2023

Uncertainty-informed Mutual Learning for Joint Medical Image Classification and Segmentation
Kai Ren, Ke Zou, Xianjie Liu, Yidi Chen, Xuedong Yuan, Xiaojing Shen, Meng Wang, Huazhu Fu
Segmentation Based Approach Medical Image Analysis Evidential Deep Learning Mutual Learning Joint Classification

March 4, 2023

Federated Semi-Supervised Learning with Annotation Heterogeneity
Xinyi Shang, Gang Huang, Yang Lu, Jian Lou, Bo Han, Yiu-ming Cheung, Hanzi Wang
Semi Supervised Mutual Learning Selective Annotation Unsupervised Alignment

January 29, 2023

Unsupervised Domain Adaptation on Person Re-Identification via Dual-level Asymmetric Mutual Learning
Qiong Wu, Jiahan Li, Pingyang Dai, Qixiang Ye, Liujuan Cao, Yongjian Wu, Rongrong Ji
Domain Adaptation Source Domain Mutual Learning Player Re Identification Domain Adaptive Person Re Identification Asymmetric Learning

January 10, 2023

Semi-Supervised Learning with Pseudo-Negative Labels for Image Classification
Hao Xu, Hui Xiao, Huazheng Hao, Li Dong, Xiaojie Qiu, Chengbin Peng
Semi Supervised Learning Image Classification Semi Supervised Mutual Learning MNIST Canadian Institute for Advanced Negative Pseudo Label

December 6, 2022

Leveraging Different Learning Styles for Improved Knowledge Distillation in Biomedical Imaging
Usma Niyaz, Abhishek Singh Sambyal, Deepti R. Bathula
Knowledge Distillation Medical Imaging Mutual Learning Learning Style Learning Preference

November 7, 2022

Polite Teacher: Semi-Supervised Instance Segmentation with Mutual Learning and Pseudo-Label Thresholding
Dominik Filipiak, Andrzej Zapała, Piotr Tempczyk, Anna Fensel, Marek Cygan
Pseudo Label Mutual Learning Noisy Pseudo Label Anchor Free Detector Semi Supervised Instance Segmentation

Mutual Learning

Papers

ML-LMCL: Mutual Learning and Large-Margin Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding

3D-TexSeg: Unsupervised Segmentation of 3D Texture using Mutual Transformer Learning

Learning Mutually Informed Representations for Characters and Subwords

An Intelligent Social Learning-based Optimization Strategy for Black-box Robotic Control with Reinforcement Learning

A Human-Robot Mutual Learning System with Affect-Grounded Language Acquisition and Differential Outcomes Training

Cross-head mutual Mean-Teaching for semi-supervised medical image segmentation

R-Block: Regularized Block of Dropout for convolutional networks

Cross-Model Cross-Stream Learning for Self-Supervised Human Action Recognition

Correlation-Aware Mutual Learning for Semi-supervised Medical Image Segmentation

Structured Cooperative Learning with Graphical Model Priors

Population-Based Evolutionary Gaming for Unsupervised Person Re-identification

EAML: Ensemble Self-Attention-based Mutual Learning Network for Document Image Classification

Unsupervised Mutual Transformer Learning for Multi-Gigapixel Whole Slide Image Classification

MELT: Mutual Enhancement of Long-Tailed User and Item for Sequential Recommendation

Uncertainty-informed Mutual Learning for Joint Medical Image Classification and Segmentation

Federated Semi-Supervised Learning with Annotation Heterogeneity

Unsupervised Domain Adaptation on Person Re-Identification via Dual-level Asymmetric Mutual Learning

Semi-Supervised Learning with Pseudo-Negative Labels for Image Classification

Leveraging Different Learning Styles for Improved Knowledge Distillation in Biomedical Imaging

Polite Teacher: Semi-Supervised Instance Segmentation with Mutual Learning and Pseudo-Label Thresholding