Self-Training

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, up 67% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 28

All topics

Decoupled Optimization for Teacher-Student Semi-Supervised Learning via a Pioneer Student
Oct 7, 2026Haorong Han, Jidong Yuan, Chixuan Wei +1Semi-Supervised Learning Teacher-Student Learning
School of Computer Science and Technology Beijing Jiaotong University · School of Data Science and Intelligent Media Communication University of China
RBMatch: Dual-Level Class Rebalancing for Semi-Supervised Building Footprint Extraction
Oct 6, 2026Akil Ahmad Taki, Shaikh Anowarul FattahClass-Imbalanced Learning Remote Sensing Image Segmentation
Department of EEE, Bangladesh University of Engineering and Technology(BUET) · Department of EEE, University of Asia Pacific
Robust Surgical Robotic Instrument Tracking via Sequential Multi-Cue Fusion and Sim-to-Real Self-Training
Oct 4, 2026Hanyang Hu, Zekai Liang, Florian Richter +1Self-Training Sim-to-Real Transfer
Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA 92093 USA.
Improving Generative Model Self-Training with Geometrically Modified Outputs
Sep 28, 2026Patrick Batsell, Thomas Walker, Richard BaraniukSelf-Training
Department of Electrical and Computer Engineering Rice University Houston, TX 77005, USA
Re:Cognize -- Open-Set Comic Character Re-Identification
Sep 27, 2026Aaditya Baranwal, Madhav Kataria, Yogesh S Rawat +1Self-Training Open-Set Recognition
Institute of Artificial Intelligence, University of Central Florida, Orlando, FL, USA · University of Central Florida
OREO: Fidelity Alignment in 3D Generation via On-the-fly Rendering-Editing Optimization
Sep 24, 2026Zhiyuan Ma, Wenbo Hu, Wang Zhao +33D Asset Generation Self-Training
The Hong Kong Polytechnic University · Tencent ARC Lab
MAST: Label-Efficient, Robust, and Generalizable Sound Detection for Biodiversity Monitoring via Masked Audio Pretraining and Self-Training
Sep 14, 2026Tianyi Xu, Daniel Pimentel-Alarcón, Zuzana Buřivalová +1Self-Training Sound Event Detection
University of Wisconsin–Madison
An Ensemble-Based Self-Taught Learning Approach for Parking Space Classification Under Limited Data
Sep 3, 2026Lucas de Oliveira Cunha, Joelton Deonei Gotz, Paulo Lisboa de Almeida +1Ensemble Learning Autonomous Parking
Universidade Federal do Paraná, Department of Informatics, Curitiba, Paraná, Brazil · Pontifícia Universidade Católica do Paraná, Graduate Program in Informatics (PPGIa), Curitiba, Paraná, Brazil
Generalizable Brain Tumor Segmentation with Self-Training and Tumor-Aware Deformations
Sep 2, 2026Henrique Zan Grande, Jeovane Honorio Alves, Rayson Laroca +1Brain Tumor Segmentation BraTS
Pontifícia Universidade Católica do Paraná (PUCPR), Programa de Pós-Graduação em Informática (PPGIa), Curitiba, Paraná, Brazil · University of Luxembourg, SEDAN - SnT, Luxembourg, Luxembourg
Cheap Verifiers, Large Blind Spots: Measuring the Reliability Cost of Cost-Saving Cascades
Sep 1, 2026Dushyant Rajput, Nirdesh Chauhan, Siddharth KosarajuLLM Inference Efficiency LLM Answer Verification
AltSlate Labs LLP
Domain-Division based Progressive Learning for Source-Free Domain Adaptation
Jul 31, 2026Pan Liu, Jing Li, Meng Zhao +3Source-Free Domain Adaptation Unsupervised Domain Adaptation
School of Computer Science and Engineering, Tianjin University of Technology, Tianjin 300384, China
CVKD-UDA: Cross-View Knowledge Distillation for 3D Unsupervised Domain Adaptive Segmentation
Jul 11, 2026Zhimin Yuan, Ming Cheng, Shangshu Yu +43D Point Cloud Segmentation Unsupervised Domain Adaptation
School of Artificial Intelligence, Nanyang Normal University, Nanyang 473061, China · Fujian Key Laboratory of Sensing and Computing for Smart Cities, School of Informatics, Xiamen University, Xiamen 361005, China · School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China
STEAM: Stable Self-Training with Elastic Matching and Adaptive Purification
Jul 10, 2026Shaoxiang Wang, Kejia Zhang, Haiwei Pan +1Cross-View Geo-Localization Self-Training
Harbin Engineering University, School of Computer Science and Technology Harbin, China · Northeast Forestry University, School of Computer and Artificial Intelligence Harbin, China
BAT3R: Bootstrapping Articulated 3D Reconstruction from 2D Image Collections
Jul 4, 2026Jakub Zadrozny, Oisin Mac Aodha, Hakan BilenArticulated Object Reconstruction Synthetic Data Generation
University of Edinburgh
SemiScope: Disentangling Classifier Tuning and Joint Optimization in Semi-Supervised Security Classification
Jun 30, 2026Rui Shu, Tianpei Xia, Jingzhu HeSelf-Training Cybersecurity
North Carolina State University · ShanghaiTech University
Real-Time Source-Free Object Detection
Jun 30, 2026Sairam VCR, Varun Gopal, Poornima Jain +2Source-Free Domain Adaptation Self-Training
1IIT Hyderabad, India · 2Microsoft Research · 3MBZUAI
Domain Adaptive Object Detection via Dual-Stream Bilevel-Cycle Optimization
Jun 30, 2026Yannan Chen, Wei Wang, Wenqiang Wang +5Unsupervised Domain Adaptation Self-Training
School of Cyber Science and Technology, Sun Yat-sen University, Shenzhen Campus, Guangdong 518107, China · PC Laboratory, Shenzhen, Guangdong 518055, China · University of Chinese Academy of Sciences, Beijing 100049, China +1
When AI Reviews Its Own Code: Recursive Self-Training Collapse in Code LLMs
Jun 26, 2026Xinyuan Song, Zekun Cai, Liang ZhaoSelf-Training Model Collapse
Emory University, Atlanta, GA, USA · The University of Tokyo, Tokyo, Japan · LocationMind, Tokyo, Japan
Data Selection Through Iterative Self-Filtering for Vision-Language Settings
Jun 22, 2026Andrei Liviu Nicolicioiu, Sarvjeet Singh Ghotra, Morgane M. Moss +1Vision-Language Models Training Data Curation
Mila, Université de Montréal
Spatially Selective Self-Training for Unsupervised Building Change Detection
Jun 9, 2026Wafaa I. M. Hussin, Zhi Lu, Anas M. I. Mohammed +3Self-Training Remote Sensing Change Detection
School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China · Laboratory of Intelligent Collaborative Computing, University of Electronic Science and Technology of China, Chengdu 611731, China · School of Civil Engineering, University of Khartoum, Khartoum, Sudan +2
Teacher-Free Self-Training Amplifies but Does Not Compound: A Pass@ $K$ Crossover on a Free-Verifier Domain
Jun 5, 2026Igor Lima StrozziSelf-Training for Language Models Self-Training
Applied Mathematics Department Federal University of Rio de Janeiro
When and How Human Curation Backfires: Preference Alignment under Multi-Model Self-Consuming Loop
May 28, 2026Yang Zhang, Xiukun Wei, Xueru ZhangLLM Alignment Self-Training
Department of Computer Science and Engineering, The Ohio State University, Columbus, Ohio.
RISE: Reliable Improvement in Self-Evolving Vision-Language Models
May 20, 2026Chaoran Xu, Yingmao Miao, Pengfei Zhang +3Vision-Language Models VLM Adaptation
AMAP, Alibaba Group
EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistant
May 11, 2026Zichen Wen, Boxue Yang, Junlong Ke +5Streaming Video Understanding Self-Training
EPIC Lab, Shanghai Jiao Tong University · Tsinghua University · The Hong Kong University of Science and Technology (Guangzhou) +1
RemoteZero: Geospatial Reasoning with Zero Human Annotations
May 6, 2026Liang Yao, Fan Liu, Shengxiang Xu +4Self-Training Remote Sensing
1Hohai University · 2Southeast University
Unpaired Image Deraining Using Reward-Guided Self-Reinforcement Strategy
May 1, 2026Yinghao Chen, Yeying Jin, Xiang Chen +3Self-Training Image Restoration
1National University of Defense Technology · National University of Singapore · 3Nanjing University of Science and Technology +2
Survival is the Only Reward: Sustainable Self-Training Through Environment-Mediated Selection
Jan 18, 2026Jennifer Dodgson, Alfath Daryl Alhajir, Michael Joedhitya +6Self-Training Self-Improving Agents
See, Think, Learn: A Self-Taught Multimodal Reasoner
Dec 2, 2025Sourabh Sharma, Sonam Gupta, SadbhawnaSelf-Training VLM Reasoning
Malaviya National Institute of Technology Jaipur · IBM Research

Oct 7, 2026, cs.LGJ/K move · Enter open · S save

Decoupled Optimization for Teacher-Student Semi-Supervised Learning via a Pioneer Student

Haorong Han, Jidong Yuan, Chixuan Wei, Yongqi Sun

School of Computer Science and Technology Beijing Jiaotong University · School of Data Science and Intelligent Media Communication University of China

Semi-Supervised Learning Teacher-Student Learning Self-Training Deep Learning Optimization

Open paper AskPDF arXiv

Semi-supervised learning (SSL) relies on two core mechanisms: self-training under the Teacher-Student (T-S) framework and joint optimization of labeled and unlabeled losses. Despite their effectiveness, we find both mechanisms introduce distinct optimization pathologies. First, parameter coupling enforces strict synchronization between teacher and student, where strong regularization on the student degrades the teacher's fitting ability, thereby limiting the permissible generalization intensity. Second, the imbalance in gradient update consistency between labeled and unlabeled losses drives the shared parameters to prematurely converge to labeled-dominated local minima, creating a bottleneck for global optimization. To address both issues, we propose the Pioneer Student (PiS), an auxiliary branch that operates in an independent parameter space and periodically transfers accumulated knowledge back to the T-S model. Extensive experiments show that PiS is a universal plug-and-play module that consistently improves mainstream SSL methods.

Momentum

Related topics

Latest papers 28