Dataset Distillation

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-14

8 new papers

A weekly snapshot of new work published in Dataset Distillation.

Period ending 2026-09-07

13 new papers

A weekly snapshot of new work published in Dataset Distillation.

Inside this field

Focused directions

493 papers

Latest in Dataset Distillation

Open your feed →
CardsList

  1. CoDiMAD: Diffusion-Based Privileged Distillation for Communication-Free Multi-Robot Coordination

    Jul 10, 2026Jiyue Tao, Shunheng Xin, Tongsheng Shen +2Multi-Robot SystemsDiffusion Policies

  2. Shortcut Trajectory Planning for Efficient Offline Reinforcement Learning

    Jul 10, 2026Guanquan Wang, Yoshimasa TsuruokaDiffusion PlanningOffline Safe Reinforcement Learning

  3. IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generation

    Jul 10, 2026Yiting Wang, Jingyi Zhang, Wenhu Zhang +4Text-To-ImageClassifier-Free Guidance

  4. ZipDepth: Bringing Lightweight Zero-Shot Monocular Depth Anywhere, on Any Device

    Jul 9, 2026Fabio Tosi, Luca Bartolomei, Matteo Poggi +1Monocular Depth EstimationZero-Shot Benchmark

  5. AutoAnchor: Stable Diffusion Unlearning Using Cross-Attention as a Manifold Surrogate

    Jul 9, 2026Siyuan Wen, Jiahao Zeng, Ningning DingText-To-Image Diffusion ModelsMachine Unlearning

  6. Compete Then Collaborate: Frontier AI Teachers Build a Verifiable Curriculum to Improve a Coding Student Beyond Imitation

    Jul 9, 2026Miseong Shawn KimCurriculumMulti-Teacher Distillation

  7. Understanding Layer Patching in Model Size Interpolation

    Jul 9, 2026Sara Kangaslahti, Jonathan Geuter, Nihal V. Nayak +3Asymmetric Distillation

  8. SQuaD-SQL: Efficient Text-to-SQL with Small Language Models via LLM-Guided Knowledge Distillation

    Jul 9, 2026Wangyu Wu, Xiaojian Lin, Rong Fu +4Text-To-SqlSmall Large Language Models

  9. TILDE: TILt-based Distributional Erasure for Concept Unlearning

    Jul 7, 2026Naveen George, Naoki Murata, Yuhta Takida +2Text-To-Image Diffusion ModelsConcept Erasure

  10. Bridging Diffusion Pruning and Step Distillation with Teacher-Aligned Repair

    Jul 7, 2026Jincheng Ying, Li Wenlin, Minghui Xu +1Dataset DistillationDiffusion Models

  11. Few-Medoids: An Embarrassingly Simple Coreset Selection Method for Few-Shot Knowledge Distillation

    Jul 7, 2026Cemil-Andrei Dilmac, Florinel-Alin Croitoru, Radu Tudor IonescuGeometry-Aware Uncertainty CoresetsHeterogeneous Knowledge Distillation

  12. ArtisanCAD: An Industrial-Level CAD Agent with Expert-Grounded Knowledge Distillation

    Jul 7, 2026Yunhan Xu, Qifeng Wu, Xunjin Li +10Text-To-CadComputer-Aided Design

  13. Erasing Without Collateral Damage: Precise Concept Removal in Diffusion Models

    Jul 6, 2026Parth Upman, Nishita Jain, Shreyank N GowdaConcept ErasureText-To-Image Diffusion Models

  14. Context-Constrained Transfer Learning for Tabular Foundation Models via Data Distillation

    Jul 6, 2026Yijun Lin, Sai LiTabular Foundation ModelsTransfer Learning

  15. Learning 4D Geometric Priors for Inference-Efficient World Action Models

    Jul 6, 2026Jianjun Zhang, Jian Zhu, Taiyi Su +4Action-Conditioned World ModelingWorld Models

  16. Covert Trait Propagation Is Representation Alignment: Mechanistic Evidence from Hidden-Channel Distillation

    Jul 5, 2026Kargi Chauhan, Aditya ShahDataset DistillationGeometry-Aware Distillation

  17. Quantize the Target, Quantize the Drafter: Efficient Inference with Qwen3.5-4B

    Jul 5, 2026Jaeyeon Kim, Jewon Lee, Bo-Kyeong KimLLM Inference EfficiencyQwen3

  18. Hierarchical Multi-to-Single-Modal Knowledge Distillation for Disruption Prediction in EAST

    Jul 5, 2026Qiang Chen, Xiao Wang, Hao Si +9Cross-Modal Knowledge DistillationHeterogeneous Knowledge Distillation

  19. CritiqueDriveVLM: From Verifier-Guided Reinforcement Learning to Latent Thought Distillation for Autonomous Driving

    Jul 5, 2026Zhaohong Liu, Hao Ye, Xianlin Zhang +1Vision-Language Model ReasoningAutonomous Driving

  20. Reward Lightning: Fast Video Generation via Homologous Preference Distillation

    Jul 4, 2026Jiaxiang Cheng, Bing Ma, Xuhua Ren +4Video Diffusion ModelsCinematic Video Generation

  21. ContiStain: Cross-Domain Relation-Preserving Distillation for Continual Multi-Domain Virtual IHC Staining

    Jul 4, 2026Fuqiang Chen, Yifeng Wang, Hongpeng Wang +1Digital PathologyEfficient Continual Learning

  22. Self-Improving Diffusion Classifiers with Minority Preference Optimization

    Jul 4, 2026Hyunsoo Kim, Jungmyung Wi, Soobin Um +2Diffusion ModelsMinority

  23. DistillH-Mamba: A Hypergraph-Mamba-Based Knowledge Distillation Model for Efficient Impact Fall Detection

    Jul 3, 2026Tresor Y. Koffi, Youssef Mourchid, Mohammed Hindawi +1Mamba-Based ModelsHeterogeneous Knowledge Distillation

  24. Awakening Diffusion Transformers: Eliciting Stronger Generation and Understanding via Massive Activation Modulation

    Jul 3, 2026Chaofan Gan, Zicheng Zhao, Yuanpeng Tu +6Diffusion TransformersDataset Distillation

  25. SFKD: Spatial--Frequency Joint-Aware Heterogeneous Knowledge Distillation via Multi-Level Wavelet Spectral Interaction

    Jul 2, 2026Cuipeng Wang, Haipeng WangHeterogeneous Knowledge DistillationDiscrete Wavelet Transform

  26. Multi-Resolution Flow Matching: Training-Free Diffusion Acceleration via Staged Sampling

    Jul 2, 2026Xingyu Zheng, Xianglong Liu, Yifu Ding +4Contrastive Flow MatchingDataset Distillation

  27. Hawk: Harnessing Hardware-Aware Knowledge for High-Performance NPU Kernel Generation

    Jul 2, 2026Junyi Wen, Ruiyan Zhuang, Yongjia Xu +7Graphics Processing Unit KernelsNeural Processing Units

  28. Post-Training Pruning for Diffusion Transformers

    Jul 1, 2026Chengzhi Hu, Xuewen Liu, Jing Zhang +3Diffusion TransformersDataset Distillation

  29. Condensing Large-Scale Datasets Directly with Minimal Information Loss

    Jul 1, 2026Xinyi Shang, Peng Sun, Bei Shi +2Dataset DistillationImagenet

  30. Token-level Response-visual Attention Guidance for Multimodal LLMs Knowledge Distillation

    Jul 1, 2026Jaehyun Jang, Eunseop Yoon, Hee Suk Yoon +3Heterogeneous Knowledge DistillationLarge Multimodal Models

  31. OnPoint: Offline-to-Online Multi-Level Distillation for Point-Supervised Online Temporal Action Localization

    Jul 1, 2026Sakib Reza, Gauri Jagatap, Mohsen Moghaddam +2Temporal Action LocalizationDataset Distillation

  32. TallyTrain: Communication-Efficient Federated Distillation

    Jun 30, 2026Radhakrishna Achanta, Will ReedDataset Distillation

  33. Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification

    Jun 30, 2026Aizierjiang AiersilanPoint CloudsHeterogeneous Knowledge Distillation

  34. Cross-Space Distillation: Teaching One-Step Students with Modern Diffusion Teachers

    Jun 30, 2026Anh Nguyen, Ngan Nguyen, Duc Vu +11Dataset DistillationDiffusion Models

  35. Scalable Behaviour Cloning on Browser Using via Skill Distillation

    Jun 30, 2026Kaisen Yang, Zheng Jiang, Yuzhao Peng +11Browser AgentBehavior Cloning

  36. Holonic Active Distillation for Scalable Multi-Agent Learning in Multi-Sensor Systems

    Jun 30, 2026Dani Manjah, Tim Bary, Benoît Macq +1Decentralized Multi-Agent SystemGeometry-Aware Distillation

  37. SwiftAudio: Data-Efficient Caption-Only Distillation for One-Step Text-to-Audio Diffusion-based Generation

    Jun 30, 2026Binh Mai, Tran Quoc Bao Le, Hung Dinh +1Text-To-AudioAudio Generation and Processing

  38. Discovering Collaboration from Novelty: Random Network Distillation for Clustered Federated Learning

    Jun 29, 2026Davide Domini, Gianluca Aguzzi, Ivana Dusparic +2Robust Federated LearningOne-Shot Federated Learning

  39. Building Multi-Task Agentic LLMs via Two-Phase Distillation

    Jun 29, 2026Huaijie Wang, Shusheng Xu, Yi Wu +1On-Policy DistillationAgentic Reinforcement Learning

  40. Variance Reduction on the Camera Axis: Multi-View Score Distillation for 3D

    Jun 29, 2026Marian Lupascu, Mihai Sorin Stupariu, Ionut MironicaMulti-View Diffusion ModelScore-Based Diffusion Model

  41. DuoMem: Towards Capable On-Device Memory Agents via Dual-Space Distillation

    Jun 29, 2026Peyman Hosseini, Ondrej Bohdal, Ahmed Alajrami +6Agent MemoryDataset Distillation

  42. ARKD: Adaptive Reinforcement Learning-Guided Bidirectional KL Divergence Distillation for Text Generation

    Jun 29, 2026Zilong Liu, Xuewen Zhang, Jinrui Xing +3Dataset DistillationKullback-Leibler Divergence

  43. KbSD: Knowledge Boundary aware Self-Distillation for Behavioral Calibration in Agentic Search

    Jun 29, 2026Tao Feng, Xinke Jiang, Chao WuAgentic Reinforcement LearningHeterogeneous Knowledge Distillation

  44. Robust Trajectory Distillation: Hybrid Reweighting Meets Teacher-Inspired Targets

    Jun 29, 2026Kaifeng Chen, Lechao Cheng, Jiyang Li +6Dataset DistillationNoisy Labels

  45. SAFE-DiT: Semantics-Aware Fast-path Execution for High-Resolution Diffusion Transformers

    Jun 28, 2026Xuanhua Yin, Yuxuan Jia, Chuanzhi Xu +1Diffusion TransformersSelf-Supervised Vision Transformers

  46. Beyond Trajectory Matching: Reflow with Marginal Distribution Alignment

    Jun 28, 2026Chen Wang, Peiran Yun, Pan Xie +1Distribution Matching DistillationFlow-Matching Loss

  47. Adaptive Block Diffusion: Resolving Training-Inference Mismatch in Diffusion Language Models

    Jun 28, 2026Gagan JainDiffusion Language ModelsTraining-Inference Mismatch

  48. Few-Step Boltzmann Generators via Scalable Likelihood Flow Maps

    Jun 27, 2026RuiKang OuYang, Hanlin Yu, Xinyue Ai +7Generative Flow NetworksBoltzmann Distributions

  49. Adaptive Spectrum-Aware Feature Disentangled Network for Small Object Detection

    Jun 27, 2026Yang Guo, Zihan Yang, Feifei Kou +3Feature Pyramid NetworksSpectra

  50. Labeling Training Data for Entity Matching Using Large Language Models

    Jun 27, 2026Aaron Steiner, Christian BizerNatural Language DatasetsTraining Data

  51. SATB-VR: Training Few-Step Video Restoration Diffusion Model using SNR-Aware Trajectory Blending

    Jun 27, 2026Haoran Bai, Xiaoxu Chen, Xiaoyu Liu +4Photorealistic Video RestorationVideo Diffusion Models

  52. Optimizing Teacher-Student Partitioning for Scalable Knowledge Distillation on HPC Systems

    Jun 26, 2026Adrian P. Dieguez, Victor Conchello Vendrell, Alex Batlle +3Heterogeneous Knowledge DistillationPartitioning

  53. LearniBridge: Learnable Calibration of Feature Caching for Diffusion Models Acceleration

    Jun 25, 2026Xuyue Huang, Zhe Chen, Wang Shen +1Diffusion TransformersDiffusion Models

  54. Knowledge Cascade: Reverse Knowledge Distillation on Nonparametric Multivariate Functional Estimation

    Jun 24, 2026Luyang Fang, Haoran Lu, Yongkai Chen +2Heterogeneous Knowledge DistillationExponential Family

  55. Distill on a Diet: Efficient Knowledge Distillation via Learnable Data Pruning

    Jun 24, 2026Yifan Wu, Yiqi Wang, Xichen Ye +5Heterogeneous Knowledge DistillationDataset Distillation

  56. Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation

    Jun 24, 2026Xiaopei Wu, Yuenan Hou, Junkai Xu +7Cross-Modal Knowledge DistillationMulti-Modal Fusion

  57. What Does It Mean to Break a Distillation Defense?

    Jun 23, 2026Lena Libon, Pura Peetathawatchai, Michael Aerni +2Threat ModelsGeometry-Aware Distillation

  58. Scaling Laws for Task-Specific LLM Distillation

    Jun 23, 2026Lavinia Ghita, Dhruv Desai, Ioana BoierLarge Language Model CompressionDataset Distillation

  59. Heterogeneous Knowledge Distillation via Geometry Decoupling and Momentum-Aware Gradient Regulation

    Jun 23, 2026Wuming Yang, Xiang Zhang, Hongmin ZhaoHeterogeneous Knowledge DistillationAsymmetric Distillation

  60. Boosting Text-Driven Video Segmentation via Geometry-Aware Distillation

    Jun 23, 2026Tianyu Zhu, Yingping Liang, Hesong Li +1Video Object SegmentationVideo Instance Segmentation