Consistency Regularization

Overview

Consistency regularization trains a model to agree when inputs or conditions should preserve the same meaning, helping it learn from unlabeled data and remain stable under change. Common approaches align predictions with KL losses or pseudo-labels across augmented views, use teacher–student or cross-model agreement, and enforce cycle, temporal, or latent-dynamics consistency. These methods appear in semi-supervised segmentation, domain adaptation, robustness, continual learning, and scientific modeling, with evaluation ranging from image benchmarks to shifted environments and long-horizon predictions. A central tension is that agreement can improve stability yet also reinforce shared errors, suppress meaningful variation, or even amplify undesirable behaviors.

Latest papers

CardsList

51 papers6 papers in the last four weeks, down 14% on the four weeks before. 0.0% of all new papers.

  1. Back to the Question: Tracing Visual Distraction Through Text Tokens

    Nov 11, 2026Marie Amale Huynh, Regev Cohen, Serena Yeung-Levy +1VLM RobustnessReasoning for VLMs

  2. Domain Generalization for Style-Debiased Object Detection via Label-Consistent Training across Multiple Styles

    Nov 6, 2026Chaoran Zhang, Shirshak Bhusal, Zhilin Gao +2Object DetectionDataset Bias

  3. Echoes of Error: Residual-Directional Local Rollout Consistency for Timeseries Forecasting

    Nov 5, 2026Zheng Wang, Kaixuan Zhang, Xiaonan Lu +1Time Series ForecastingRobust Time Series Forecasting

  4. XuanJian-DINOSAR: A SAR Foundation Model Based on Global and Local Semantic Consistency

    Nov 4, 2026Chunxiao Wu, Huixin Huang, Jialei Pan +9Self-Supervised Visual Representation LearningSynthetic Aperture Radar

  5. Cross-Primitive Consistency in Jev

    Oct 28, 2026Xu Liu, Guikun Chen, Kanzhi Wu +1LLM EvaluationConsistency Regularization

  6. LatticeRank: Spacing-Ranked Consistency for Native-Grid 3D Medical Image Segmentation

    Oct 20, 2026Jingjia Yan, Yue Zhuo, Zhonghua XieMedical Image Segmentation3D Medical Image Segmentation

  7. Same Target, Different Origins: Aligning Latent Rollout for Consistent PDE Emulation

    Oct 15, 2026Xinying Li, Jing Xu, Wenjun Wang +4Neural PDE SolversPDE Operator Learning

  8. Frozen History: When Temporal Losses Stop Accumulation in Learned Real-Time Supersampling

    Oct 11, 2026Hao Yu, Guoying ZhaoImage Super-ResolutionConsistency Regularization

  9. VIGOR: Zero-Shot Visual Generalization via Latent-Space Consistency in Model-Based Reinforcement Learning

    Oct 2, 2026Mingyu Park, Samyeul Noh, Hyun Myung +1Latent-Space RegularizationGeneralization in RL

  10. WhiteCon: Semi-Supervised Domain Adaptation Regression Through Whitening Transform and Dual Consistency

    Sep 28, 2026Se Jin Sim, Seoung Bum KimDomain AdaptationFeature Whitening

  11. Derivative-Informed Training of Neural Operators On-the-Fly via Sketched Tangent Consistency

    Sep 26, 2026Xinhan Yang, Lu Lu, Shancong MouNeural OperatorsPhysics-Informed Neural Operators

  12. Robust Adversarial Reinforcement Learning with Risk Sensitivity and Critic Consistency Regularization

    Sep 23, 2026Jiaxi Wu, Tiantian Zhang, Yuxing Wang +2Reinforcement LearningRisk-Sensitive RL

  13. Multi-Appliance Non-Intrusive Load Monitoring via Label-Preserving Aggregate Recomposition and Prediction Consistency

    Sep 16, 2026Jiangfeng Liu, Yanfang FanNon-Intrusive Load MonitoringData Augmentation

  14. MC-DeTra: Motion-Consistent Joint Object Detection and Socially-Aware Trajectory Forecasting in Bird's-Eye-View Images

    Sep 10, 2026Vladislav Diuzhev, Dmitry YudinMulti-Agent Trajectory PredictionAutonomous Driving

  15. VICAL: Vicinal Consistency Alignment for Long-Tailed Visual Recognition

    Sep 4, 2026Jiangang Zhu, Zheng Wang, Bin Zhu +2Long-Tailed ClassificationEnsemble Learning

  16. CD-LoRA: Consistency-Driven Low-Rank Adaptation for Multi-Task Fine-Tuning

    Aug 22, 2026Qian Zha, Jinda Liu, Yuan Wu +1LLM Fine-TuningLow-Rank Adaptation

  17. Ontology-Driven Structural Regularization for Document-Level Relation Extraction

    Aug 21, 2026Laura Menotti, Stefano Marchesin, Gianmaria SilvelloRelation ExtractionConsistency Regularization

  18. Cycle-Consistent and Uncertainty-Aware Neural Surrogates for Tokamak Edge Plasmas

    Jul 23, 2026Abdourahmane Diaw, Sebastian De Pascuale, Jae-Sun Park +3Neural Surrogate ModelingPDE Surrogate Modeling

  19. Multi-Horizon Consistency as Geometry: When Latent Dynamics Contract, and When They Do Not

    Jul 21, 2026Kavya Bhand, Aadi JoshiLatent Dynamics ModelingLatent World Models

  20. C2^{2}R: Cross-sample Consistency Regularization Mitigates Feature Splitting and Absorption in Sparse Autoencoders

    Jun 29, 2026Haoran Jin, Xiting Wang, Shijie Ren +2LLM InterpretabilityRepresentation Disentanglement

  21. Dual Agreement Consistency Learning for Semi-Supervised Fetal Ultrasound Segmentation

    Jun 24, 2026Fangyijie Wang, Guénolé Silvestre, Ziyang Wang +1Ultrasound Image SegmentationSemi-Supervised Medical Image Segmentation

  22. Triangular Consistency as a Universal Constraint for Learning Optical Flow

    Jun 18, 2026Yi Xiao, Carlos Rodriguez Coronel, Jing Zhan +3Optical FlowConsistency Regularization

  23. Constrained Paraphrase Consistency for LLM Hallucination Detection

    Jun 6, 2026Shanshan Lin, Dongsheng Hong, Sibo Ju +3LLM ReliabilityLLM Hallucination Detection

  24. Constraint-Aware Optimization for Robust Protein Stability Prediction

    Jun 6, 2026A Shivram, Aneesh S. Chivukula, Manik Gupta +1protein mutation effect predictionOOD Generalization

  25. Two-Way Is Better Than One: Bidirectional Alignment with Cycle Consistency for Exemplar-Free Class-Incremental Learning

    Jun 4, 2026Hongye Xu, Bartosz KrawczykClass-Incremental LearningPrototype-Based Classification

  26. Consistency Training Can Entrench Misalignment

    Jun 2, 2026David Demitri Africa, Arathi ManiLLM Safety AlignmentEmergent Misalignment

  27. Consistency Training while Mitigating Obfuscation via Rate Matching

    Jun 1, 2026Sohaib Imran, Prakhar Gupta, Jannes Elstner +1LLM SycophancyLanguage Model Robustness