Dataset Distillation

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-14

8 new papers

A weekly snapshot of new work published in Dataset Distillation.

Period ending 2026-09-07

13 new papers

A weekly snapshot of new work published in Dataset Distillation.

Inside this field

Focused directions

493 papers

Latest in Dataset Distillation

Open your feed →
CardsList

  1. Efficient Video Dataset Distillation via Cluster-Guided Prototype Blending

    Aug 4, 2026Chongle Ren, Guang Li, Wenbo Huang +3Video DatasetDataset Distillation

  2. Self-Supervised Representation-Guided Generative Dataset Distillation

    Aug 4, 2026Mingzhuo Li, Guang Li, Linfeng Ye +4Dataset DistillationSelf-Supervised Representations

  3. Accelerating Human-Aware Robot Trajectory Generation via Diffusion and Consistency Distillation

    Aug 4, 2026Byeong-Il Ham, Hyun-Bin Kim, Kyung-Soo KimRobot TrajectoriesEnd-Effector Pose

  4. CROSS: Cascaded Distillation and Dual-Constraint Grounding for Remote Sensing Referring Segmentation

    Aug 4, 2026Tingzhang Luo, Ruizhong Liu, Yichao Liu +3Remote Sensing Image SegmentationAdaptive Shape Refinement

  5. Channel-wise Dynamic Knowledge Distillation via Adaptive Sample Generation for Action Recognition

    Aug 4, 2026Ping Li, Chenhao Ping, Jie Song +1Open-Vocabulary Action RecognitionHeterogeneous Knowledge Distillation

  6. DiverseDiT++: Quantifying, Analyzing, and Promoting Representation Diversity in Diffusion Transformers

    Aug 4, 2026Binglei Li, Mengping Yang, Zhiyu Tan +4Diffusion TransformersDataset Distillation

  7. CMuon: Accelerating and Stabilizing Diffusion Transformer Training via Chunked Momentum Orthogonalization

    Aug 3, 2026Chuyan Chen, Peng Sun, Kun YuanDiffusion TransformersMuon

  8. Stuck on "A": Diagnosing and Repairing Interface Injury in Attention-to-KDA Linearization of a 0.6B Language Model

    Aug 3, 2026Ronglong BaoDataset DistillationQwen3

  9. Towards Compact Unified Multimodal Tracking: Synergizing Knowledge Distillation with Structural Pruning

    Aug 2, 2026Yuqi Li, Yuedong Tan, Huiran Duan +7Cross-Modal Knowledge DistillationDataset Distillation

  10. WAM-Diff2: Hierarchical AR-to-Diffusion Distillation for Highly Efficient Autonomous Driving VLA

    Aug 2, 2026Zhihao Zhu, Hanlin Shang, Mingwang Xu +6Autonomous DrivingDiffusion-Based Vision-Language-Actions

  11. LUT: Latent Utility Training for Visual Reasoning

    Aug 1, 2026Jiaxuan Kang, Siyu Chen, Mingda Li +6Latent Visual ReasoningVisual Reasoning

  12. RHEA: Reliability-Harmonized Reconstruction and Assignment for Robust Multimodal-Attributed Graph Clustering

    Aug 1, 2026Yinlin Zhu, Di Wu, Ziyu Han +4Multimodal GraphText Modality

  13. Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languages

    Aug 1, 2026Sean Gip Lim, William Chandra Tjhi, Hai Leong ChieuLLM Reasoning MethodsCross-Lingual Consistency

  14. Light-Loco-Parkour: Versatile Perceptive Whole-Body Locomotion via Multi-Skill Distillation

    Aug 1, 2026Hongming Chen, Zhuoran Li, Hongxi Wang +9LocomotionWhole-Body Controllers

  15. Progressive^2: A Teacher-Student Progressive Co-Evolving Knowledge Distillation Method for Substantial Model Compression

    Jul 31, 2026Tiancong Cheng, Ying Zhang, Zhiwen Yu +2Confidence-Gated Closed-Loop Distillation FrameworkModel and Context Compression

  16. MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillation

    Jul 31, 2026Hang Yan, Zhangxuan GU, Beitong Zhou +5Graphical User Interface AgentsOn-Policy Distillation

  17. Distill What RGB Can Recover: Privileged 3D Evidence for RGB-Only Vision-Language Models

    Jul 31, 2026Yanbin Hu, Jin Cui, Jun Ye +43D Scene UnderstandingRed-Green-Blue

  18. Faster but Different: Diagnosing and Controlling Content Drift in Accelerated Multimodal Diffusion Language Models

    Jul 31, 2026Yaoxuan Dou, Yang ShuDiffusion Language ModelsTraining-Inference Mismatch

  19. Outcome-Guided Distillation: A Teacher-Student Framework to Advance VLM Reasoning in Autonomous Driving

    Jul 31, 2026Zeyu Dong, Yimin Zhu, Yu Wu +1Vision-Language Model ReasoningAutonomous Driving

  20. VAD: Attributing Visual Evidence for Target Reconstruction in Multimodal On-Policy Distillation

    Jul 30, 2026Kangning Zhang, Yixing Li, Shuai Shao +9On-Policy DistillationDataset Distillation

  21. Private Face Recognition Training Dataset Publication via Identity-Decoupled and Geometry-Preserving Face Distillation

    Jul 30, 2026Shuhuan Chen, Xiangyu Zhu, Weisong Zhao +6Cross-Spectral Through-Glass Face DatasetFace Recognition Systems

  22. Improving the Robustness/Accuracy Tradeoff Against Adversarial Attacks Using Information Bottleneck Distillation Through Dual Teachers

    Jul 30, 2026Vincent Ryusuke Takahashi, Yoshinari Takeishi, Jun'ichi Takeuchi +1Adversarial TransferabilityMulti-Teacher Distillation

  23. Shared Semantic Codebook Distillation for Unpaired Cross-Modal Medical Classification

    Jul 29, 2026Dillan Imans, Phuoc-Nguyen Bui, Duc-Tai Le +1Cross-Modal Knowledge DistillationCross-Modality

  24. CoCaRS: Correlation Calibration-Based Redundancy Suppression for Heterogeneous Knowledge Distillation

    Jul 29, 2026Fengming Yu, Haiwei Pan, Kejia Zhang +3Heterogeneous Knowledge DistillationTeacher-Student Model Pairs

  25. DistillAlign: Coordinating Mode Covering and Mode Seeking in Autoregressive Video Distillation

    Jul 29, 2026Jiaxing Li, Kai Zou, Cindy Zhou +7Distribution Matching DistillationVideo Diffusion Models

  26. FedTopo: Relation-Level Topology Sharing for Model-Heterogeneous Federated Learning

    Jul 29, 2026Zhaoyang Ma, Zhihao Wu, Xin Gao +3Federated Learning FrameworkTopological Learning

  27. Long-Tailed 3D Point Cloud Dataset Distillation

    Jul 29, 2026Jiahao You, Xu Han, Jinfeng Xu +1Point CloudsLong-Tailed Distribution

  28. Anchoring and Steering Diffusion: Enhancing the Faithfulness of Text-to-Image Generation at Inference Time

    Jul 29, 2026Xinyi Wang, Yuyang Huang, Yalin Su +4Text-To-Image Diffusion ModelsVideo-Text Alignment

  29. Parallel Decoding Distillation for Fast Image and Video Generation

    Jul 28, 2026Neta Shaul, Chao Liu, Arash Vahdat +1Video Diffusion ModelsFew-Step Generation

  30. OrthKD: Extracting Generalized Clinical Knowledge from Heterogeneous Teachers for Lightweight Deployment

    Jul 28, 2026Yi Xu, Cheng Chen, Mufan CaoRetinal ImagingMulti-Teacher Distillation

  31. CoTinyVLA: Chain-of-Thought Distillation for a Sub-Billion-Parameter Vision-Language-Action Model

    Jul 28, 2026Minhyeok Lee, Chiyoung Kim, Chanhoe Gu +5Robot ActionsDataset Distillation

  32. Dataset Distillation Based on Saliency-Driven Prototype Alignment

    Jul 28, 2026Yawen Zou, Wenqi Cai, Guang Li +3Dataset DistillationLearnable Prototypes

  33. TabRank: Chain-of-Thought Distillation for Table Re-Rankers

    Jul 28, 2026Adarsh Singh, Kushal Raj Bhandari, Jianxi Gao +2Generative Reasoning Re-RankersDataset Distillation

  34. Amortising Trajectory Optimisation for Residual MPC via Implicit Contact Differentiation

    Jul 27, 2026Daniel Layeghi, Thomas Corbères, Calum Arnott +4Gradient-Based Trajectory OptimizationEdge-Sdf Contacts

  35. Test-Time Adaptation via Dual Distillation for Videos Under Severe Distribution Shifts

    Jul 27, 2026André Sacilotti, Samuel Felipe dos Santos, Jurandy AlmeidaTest-Time AdaptationVision-Language Model Adaptation

  36. MAViE: A Multi-scale Adaptive Vision Encoder for Fine-grained Visual Perception and Efficient Multimodal Reasoning

    Jul 27, 2026Shaofei LeiVision EncodersVisual Tokens

  37. Source-Free Controlled Adaptation of Teachers for Continual Test-Time Adaptation

    Jul 26, 2026Anurag Roy, Riddhiman Moulick, Vinay Kumar Verma +2Test-Time AdaptationParameter-Efficient Adaptation

  38. UltraViT: Latency-Optimized On-device Vision Encoder for Large Vision-Language Models

    Jul 25, 2026Ioannis Maniadis Metaxas, Adrian Bulat, Alberto Baldrati +4Vision EncodersExtreme Ultraviolet

  39. SPRKD: Effective Knowledge Distillation for Deep Neural Networks via Saddle Region Approximation

    Jul 25, 2026Aditya Dewan, Arjun Yogeswaran, Benjamin FedorukHeterogeneous Knowledge DistillationDeep Neural Network

  40. Context-Aware Concept Distillation for Trustworthy Flood Prediction

    Jul 25, 2026Eli Levinkopf, Efrat Morin, Claudia V. GoldmanAccurate Flood PredictionForward-Looking Fault-Risk Prediction

  41. Generative Video Compression with Adaptive Score Distillation

    Jul 24, 2026Naifu Xue, Zhaoyang Jia, Haosen Li +7Video Diffusion ModelsModel and Context Compression

  42. Visual Contrastive Self-Distillation

    Jul 23, 2026Yijun Liang, Yunjie Tian, Yijiang Li +4Unsupervised On-Policy Self-DistillationDataset Distillation

  43. Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Driving

    Jul 23, 2026Mengshi Qi, Xiaoyang Bi, Xianlin Zhang +1Depth EstimationMulti-Sensor Fusion

  44. Ms. Forcing: Efficient Streaming Video Generation with Multi-Scale Patchification and Attention

    Jul 23, 2026Zekun Li, Xiaoyan Cong, Hongyu Li +5Video Diffusion ModelsCinematic Video Generation

  45. When Does Knowledge Distillation Hurt? Reliability-Aware Distillation for Low-Resource Language Summarization

    Jul 22, 2026Dipto Sumit, Ankan Kumar Roy Srizon, Sadia Khair Rodela +4Heterogeneous Knowledge DistillationSummarization

  46. StrokeSeg2: Stroke Lesion Segmentation in Clinical Research Workflows

    Jul 22, 2026Youwan Mahé, Axel Plessis, Stéphanie Leplaideur +3Brain Tumor SegmentationStroke

  47. Privileged Lesion-Context Relational Distillation for Mask-Free Skin Lesion Classification

    Jul 21, 2026Abu Mukaddim Rahi, Md Mithun Hossain, Md Zulficar Hasan Joy +2Skin Lesion ClassificationLesion

  48. Rationale-Guided Knowledge Distillation for Cross-Lingual Stance Detection

    Jul 21, 2026Qiuli Zhou, Jingyuan Yao, Shengeng Tang +3Tweet-Level Stance DetectionLarge Language Model Alignment

  49. Dataset Distillation by Influence Matching

    Jul 18, 2026Haoru Tan, Wang Wang, Sitong Wu +5Dataset DistillationFull-Context Baselines

  50. IoU-PD: IoU-Aware Privileged Distillation for Visual Grounding with Multimodal Large Language Models

    Jul 17, 2026Xiuyuan Zhu, Ke Lu, Hao Wu +4Vision-Language Model GroundingVisual Grounding

  51. Pretraining Multiple Instance Learning Networks with Multi-Teacher Distillation from Pathology Slide Foundation Models

    Jul 16, 2026Mingxi Fu, Jiawen Li, Renao Yan +4Multiple Instance LearningPathology Foundation Models

  52. Symbiosis-Inspired Knowledge Distillation for Incremental Object Detection

    Jul 15, 2026Mingyue Zeng, De Cheng, Zhipeng Xu +3Heterogeneous Knowledge DistillationObject-Centric Learning

  53. Domain-Incremental Remote Sensing Change Detection via Difference-Guided Adaptation and Frequency-Decoupled Distillation

    Jul 14, 2026Daifeng Peng, Yaning Li, Haiyan GuanChange DetectionHeterogeneous Knowledge Distillation

  54. MobileSAM2: Lightweight Segment Anything for Spatial Intelligence

    Jul 14, 2026Kai Jiang, Jiaxing Huang, Jingyi Zhang +5Heterogeneous Knowledge DistillationSam2

  55. Single-Teacher View Augmentation: Enhancing Knowledge Distillation with Student-Guided Perturbations

    Jul 13, 2026Xuyi Yu, Yaohua Liu, Ziming Song +3Heterogeneous Knowledge DistillationMulti-Teacher Distillation

  56. Temporal Feature Distillation for Label-Efficient Precise Event Spotting in Sports Videos

    Jul 13, 2026Hao Xu, Xinyu Wei, Sam Wells +1Feature Pyramid NetworksOpen-Vocabulary Action Recognition

  57. Answer-Conditioned Chain-of-Thought Distillation for Few-Shot Industrial Vision with Small VLMs

    Jul 12, 2026Shubham RaoRecent Vision-Language ModelsDataset Distillation

  58. BucketKD: A Safety-Aware Bucket-Based Knowledge Distillation Framework for End-to-End Motion Planning

    Jul 12, 2026Md Nahidul Islam, Mohd Hasan Ali, Dipankar Dasgupta +1Safe Motion PlanningAutonomous Driving

  59. TVT-PAPD: Pathology-Aware Prototype Distillation for Self-Supervised Whole Slide Image Classification

    Jul 11, 2026Ramesh Naidu Laveti, Jaya Sreevalsan-Nair, T K SrikanthWhole-Slide Image AnalysisLesion Segmentation

  60. CVKD-UDA: Cross-View Knowledge Distillation for 3D Unsupervised Domain Adaptive Segmentation

    Jul 11, 2026Zhimin Yuan, Ming Cheng, Shangshu Yu +4Unsupervised Domain AdaptationU-Net