Consistency Regularization

Ask about this topic

Overview

Consistency regularization trains a model to agree when inputs or conditions should preserve the same meaning, helping it learn from unlabeled data and remain stable under change. Common approaches align predictions with KL losses or pseudo-labels across augmented views, use teacher–student or cross-model agreement, and enforce cycle, temporal, or latent-dynamics consistency. These methods appear in semi-supervised segmentation, domain adaptation, robustness, continual learning, and scientific modeling, with evaluation ranging from image benchmarks to shifted environments and long-horizon predictions. A central tension is that agreement can improve stability yet also reinforce shared errors, suppress meaningful variation, or even amplify undesirable behaviors.

Latest papers

CardsList

46 papers5 papers in the last four weeks, down 29% on the four weeks before. 0.0% of all new papers.

  1. LatticeRank: Spacing-Ranked Consistency for Native-Grid 3D Medical Image Segmentation

    Oct 20, 2026Jingjia Yan, Yue Zhuo, Zhonghua XieMedical Image Segmentation3D Medical Image Segmentation

    Huizhou University, Huizhou 516007, Guangdong, China

  2. Same Target, Different Origins: Aligning Latent Rollout for Consistent PDE Emulation

    Oct 15, 2026Xinying Li, Jing Xu, Wenjun Wang +4Neural PDE SolversPDE Operator Learning

    Fudan University · Shanghai Academy of AI for Science

  3. Frozen History: When Temporal Losses Stop Accumulation in Learned Real-Time Supersampling

    Oct 11, 2026Hao Yu, Guoying ZhaoImage Super-ResolutionConsistency Regularization

    ELLIS Institute Finland · CMVS, University of Oulu, Finland

  4. VIGOR: Zero-Shot Visual Generalization via Latent-Space Consistency in Model-Based Reinforcement Learning

    Oct 2, 2026Mingyu Park, Samyeul Noh, Hyun Myung +1Latent-Space RegularizationGeneralization in RL

    Robotics Program KAIST, ETRI · Electrical Engineering KAIST

  5. WhiteCon: Semi-Supervised Domain Adaptation Regression Through Whitening Transform and Dual Consistency

    Sep 28, 2026Se Jin Sim, Seoung Bum KimDomain AdaptationFeature Whitening

    School of Industrial and Management Engineering Korea University, Seoul, Republic of Korea

  6. Derivative-Informed Training of Neural Operators On-the-Fly via Sketched Tangent Consistency

    Sep 26, 2026Xinhan Yang, Lu Lu, Shancong MouNeural OperatorsPhysics-Informed Neural Operators

    Department of Industrial and Systems Engineering, University of Minnesota Minneapolis, MN 55455 · Department of Statistics and Data Science, Yale University New Haven, CT 06511, USA

  7. Robust Adversarial Reinforcement Learning with Risk Sensitivity and Critic Consistency Regularization

    Sep 23, 2026Jiaxi Wu, Tiantian Zhang, Yuxing Wang +2Reinforcement LearningRisk-Sensitive RL

    Shenzhen International Graduate School, Tsinghua University Shenzhen, China

  8. ICM: Intra-class Mixing for Domain Adaptation in Adverse Weather

    Sep 23, 2026Boying Li, Chang Liu, Britta Ayano Wilde +4Unsupervised Domain AdaptationDomain Adaptation

  9. Multi-Appliance Non-Intrusive Load Monitoring via Label-Preserving Aggregate Recomposition and Prediction Consistency

    Sep 16, 2026Jiangfeng Liu, Yanfang FanNon-Intrusive Load MonitoringData Augmentation

    School of Electrical Engineering, Xinjiang University, Urumqi, Xinjiang 830047, China

  10. MC-DeTra: Motion-Consistent Joint Object Detection and Socially-Aware Trajectory Forecasting in Bird's-Eye-View Images

    Sep 10, 2026Vladislav Diuzhev, Dmitry YudinMulti-Agent Trajectory PredictionAutonomous Driving

    Moscow Institute of Physics and Technology, Moscow, Russia · Artificial Intelligence Research Institute, Moscow, Russia

  11. VICAL: Vicinal Consistency Alignment for Long-Tailed Visual Recognition

    Sep 4, 2026Jiangang Zhu, Zheng Wang, Bin Zhu +2Long-Tailed ClassificationEnsemble Learning

    Institute of Trustworthy Embodied AI, Fudan University, Shanghai, China · Shanghai Key Laboratory of Multimodal Embodied AI, Shanghai, China · Zhejiang University of Technology, Hangzhou, China +2

  12. SAUF-Net: Structure--Appearance Representation Learning with Uncertainty Feedback for Semi-Supervised Medical Image Segmentation

    Sep 2, 2026Qin Lu, Zheyang Jing, Yujie Yang +3Semi-Supervised Medical Image SegmentationConsistency Regularization

    Nanchang Hangkong University, Nanchang, China

  13. CD-LoRA: Consistency-Driven Low-Rank Adaptation for Multi-Task Fine-Tuning

    Aug 22, 2026Qian Zha, Jinda Liu, Yuan Wu +1LLM Fine-TuningLow-Rank Adaptation

    School of Artificial Intelligence, Jilin University · Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, MOE, China · International Center of Future Science, Jilin University

  14. Ontology-Driven Structural Regularization for Document-Level Relation Extraction

    Aug 21, 2026Laura Menotti, Stefano Marchesin, Gianmaria SilvelloRelation ExtractionConsistency Regularization

    Department of Information Engineering, University of Padua, Italy

  15. Cycle-Consistent and Uncertainty-Aware Neural Surrogates for Tokamak Edge Plasmas

    Jul 23, 2026Abdourahmane Diaw, Sebastian De Pascuale, Jae-Sun Park +3Neural Surrogate ModelingPDE Surrogate Modeling

    Fusion Energy Division, Oak Ridge National Laboratory, Oak Ridge, TN 37932, USA · DIFFER - Dutch Institute for Fundamental Energy Research, De Zaale 20, 5612 AJ Eindhoven, the Netherlands

  16. Multi-Horizon Consistency as Geometry: When Latent Dynamics Contract, and When They Do Not

    Jul 21, 2026Kavya Bhand, Aadi JoshiLatent Dynamics ModelingLatent World Models

    Department of Computer Engineering Vishwakarma Institute of Technology, Pune, India

  17. C2^{2}R: Cross-sample Consistency Regularization Mitigates Feature Splitting and Absorption in Sparse Autoencoders

    Jun 29, 2026Haoran Jin, Xiting Wang, Shijie Ren +2LLM InterpretabilityRepresentation Disentanglement

    University of Science and Technology of China · State Key Laboratory of Cognitive Intelligence · Gaoling School of Artificial Intelligence, Renmin University of China

  18. Dual Agreement Consistency Learning for Semi-Supervised Fetal Ultrasound Segmentation

    Jun 24, 2026Fangyijie Wang, Guénolé Silvestre, Ziyang Wang +1Ultrasound Image SegmentationSemi-Supervised Medical Image Segmentation

    Research Ireland Centre for Research Training in Machine Learning · School of Medicine, University College Dublin, Dublin, Ireland · School of Computer Science, University College Dublin, Dublin, Ireland +1

  19. Triangular Consistency as a Universal Constraint for Learning Optical Flow

    Jun 18, 2026Yi Xiao, Carlos Rodriguez Coronel, Jing Zhan +3Optical FlowConsistency Regularization

    Louisiana State University, Baton Rouge, LA 70803, USA · University of California, Los Angeles, Los Angeles, CA 90025, USA · Yale University, New Haven, CT 06520, USA

  20. When Context Returns: Toward Robust Internalization in On-Policy Distillation

    Jun 10, 2026Xun Wang, Ruishuo Chen, Zhuoran Li +2On-Policy DistillationContext Distillation

    1IIIS, Tsinghua University

  21. Constrained Paraphrase Consistency for LLM Hallucination Detection

    Jun 6, 2026Shanshan Lin, Dongsheng Hong, Sibo Ju +3LLM ReliabilityLLM Hallucination Detection

    1Fuzhou University · 2Harbin Institute of Technology (Shenzhen) · 3Beijing University of Posts and Telecommunications

  22. Constraint-Aware Optimization for Robust Protein Stability Prediction

    Jun 6, 2026A Shivram, Aneesh S. Chivukula, Manik Gupta +1OOD GeneralizationProtein Language Models

    Department of Computer Science and Information Systems, Birla Institute of Technology and Science Pilani, Hyderabad Campus, Hyderabad, 500078, Telangana, India · Department of Biological Sciences, Birla Institute of Technology and Science Pilani, Hyderabad Campus, Hyderabad, 500078, Telangana, India

  23. Two-Way Is Better Than One: Bidirectional Alignment with Cycle Consistency for Exemplar-Free Class-Incremental Learning

    Jun 4, 2026Hongye Xu, Bartosz KrawczykClass-Incremental LearningPrototype-Based Classification

    Chester F. Carlson Center for Imaging Science · Rochester Institute of Technology

  24. Consistency Training Can Entrench Misalignment

    Jun 2, 2026David Demitri Africa, Arathi ManiLLM Safety AlignmentEmergent Misalignment

    1UK AI Security Institute

  25. Consistency Training while Mitigating Obfuscation via Rate Matching

    Jun 1, 2026Sohaib Imran, Prakhar Gupta, Jannes Elstner +1LLM SycophancyLanguage Model Robustness

    Independent · University of Michigan · UK AI Security Institute

  26. Hierarchical Consistency Learning for Test-time Adaptation in Camouflage Perception

    May 25, 2026Mingfeng Zha, Tianyu Li, Guoqing Wang +5Test-Time AdaptationConsistency Regularization

    Center for Future Media and School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China · School of Computer Science and Technology, Tongji University, Shanghai 201804, China · Peng Cheng Laboratory, Shenzhen 518066, China

  27. RoVLA: Multi-Consistency Constraints for Robust Vision-Language-Action Models

    May 19, 2026Jingzhou Luo, Yifan Wen, Yongjie Bai +3VLM RobustnessLanguage-Conditioned Robot Manipulation

    Sun Yat-sen University, China · Peng Cheng Laboratory · Guangdong Key Laboratory of Big Data Analysis and Processing +1

  28. Reducing cross-sample prediction churn in scientific machine learning

    May 13, 2026Gordan Prastalo, Kevin Maik JablonkaEnsemble LearningClassification

    Helmholtz-Zentrum Berlin für Materialien und Energie GmbH, Hahn-Meitner-Platz 1, 14109 Berlin, Germany · HIPOLE Jena (Helmholtz Institute for Polymers in Energy Applications Jena), Lessingstrasse 12–14, 077432026 Jena, Germany · Laboratory of Organic and Macromolecular Chemistry (IOMC), Friedrich Schiller University Jena, Humboldtstrasse 10, 07743 Jena, Germany +2

  29. PairDropGS: Paired Dropout-Induced Consistency Regularization for Sparse-View Gaussian Splatting

    May 12, 2026Hantang Li, Qiang Zhu, Xiandong Meng +33D Gaussian SplattingSparse-View 3D Reconstruction

    School of Computer Science, Harbin Institute of Technology, Shenzhen, China · Pengcheng Laboratory, Shenzhen, China · Smart Coding Institute, Pengcheng Laboratory, Shenzhen, China +1

  30. Martingale-Consistent Self-Supervised Learning

    May 12, 2026Moritz Gögl, Hanwen Xing, Christopher YauSelf-Supervised LearningSelf-Supervised Time Series Representation Learning

    University of Oxford · Health Data Research UK