Data Valuation

Ask about this topic

Overview

Data valuation studies how much training examples, datasets, clients, or generated trajectories contribute to a model’s performance, helping practitioners select useful data, detect harmful or mislabeled records, and allocate rewards. Common approaches include cooperative-game values such as Shapley and Banzhaf, gradient- and influence-based estimates, and distributional or learning-agnostic measures; locality, proxies, and online updates help reduce computation. Applications range from language-model post-training and synthetic-data curation to time-series learning, federated training, and data markets. A central tension is that values can be expensive to compute and depend on the learner, validation data, and task, while privacy and resistance to manipulation can conflict with fine-grained attribution.

Latest papers

CardsList

43 papers6 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. DRIVE: Fine-tuning via Data Contribution- and Diversity-aware Weighting with Prior Regularization

    Oct 23, 2026Qing Liu, Xinrui Chen, Yi Du +2Fine-TuningInstance Reweighting

    Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, China · Computer Network Information Center, Chinese Academy of Sciences, Beijing, China · School of Mathematics, Tianjin University, Tianjin, China

  2. When Thoughts Become Memory: Unifying In-Context Learning and Fine-Tuning

    Oct 21, 2026Leon Chlon, Julie HuangIn-Context LearningData Valuation

    Hassana Labs.

  3. The Data Differentiator Framework (DDF): Quantifying Marginal Data Value with Information-Theoretic and Game-Theoretic Measures in an Agentic Evaluation Pipeline (SDSAE)

    Oct 20, 2026Sukesh Kumar, Dilip SinghData ValuationData Analysis Agents

    Equifax Inc.

  4. CAVA: Complementary-Label-Aware Data Valuation

    Oct 19, 2026Tan-Ha Mai, Hsuan-Tien Lin, Vu NguyenData ValuationLearning with Noisy Labels

    National Taiwan University · Amazon

  5. Effective Synthetic Data Curation Requires Group-Level Signals

    Sep 30, 2026Cathy Jiao, Chenyan XiongSynthetic Data PretrainingTraining Data Curation

    Language Technologies Institute, Carnegie Mellon University

  6. Not All Rollouts Are Worth Learning: On Trajectory Valuation for Post-Training Reinforcement Learning

    Sep 28, 2026Xuesong Jia, Ziao Yang, Zhanhe Huang +1RL Post-TrainingData Valuation

    Department of Computer Science, Brandeis University

  7. Let Training Guide Selection: Online Synthetic Data Filtering via Real-Anchored Utility

    Sep 24, 2026Yanran Wu, Sana Lakdawala, Renzo Tassara Miller +6Data ValuationSynthetic Data Selection

    Purdue University · Work done at Meta. · Meta

  8. Useful to Whom? The Easy-versus-Coverage Boundary Moves with the Learner

    Sep 22, 2026Yangze Liu, Xiao-Long Yin, Zhongyi HanTraining Data SelectionCoreset Selection

    Shandong University · Nanjing University

  9. Beyond Non-IID: Learner--Client Distribution Mismatch in Federated Learning

    Aug 27, 2026Yiming Xie, Lili Su, Ningfang MiClient Selection in Federated LearningNon-IID Federated Learning

    Department of Electrical and Computer Engineering Northeastern University, Boston, MA, USA

  10. FrameScope: Temporal Data Valuation for Stream Active Learning in Autonomous Vehicle Systems

    Aug 24, 2026Yuheng Zhu, Man-Ki YoonActive LearningData Valuation

    Department of Computer Science North Carolina State University Raleigh, NC, USA

  11. From Detrimental to Beneficial: Dynamic Influence-based Valuation and Editing

    Aug 23, 2026Adrian Nyakairu, Hongfu LiuTraining Data CurationData Valuation

    Department of Computer Science, Brandeis University

  12. Guixu: Valuation-Driven Data Discovery for Autonomous AI Agents with On-Chain Attestation

    Aug 8, 2026Yifan Wu, Yuchen Peng, Jiaqi Chai +4Active Information GatheringData Valuation

    Zhejiang University · The State Key Laboratory of Blockchain and Data Security; Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security

  13. First-Order In-Context Shapley: Scalable Data Auditing for LLM Alignment and Evaluation

    Jul 24, 2026Yunting Song, Matthew Watson, Moustafa Farid Alzantot +2LLM Safety BenchmarksLLM Auditing

    Google Mountain View, CA 94043

  14. WaveCommitments: Private and Verifiable Speech-Agent Marketplaces

    Jul 16, 2026Oguzhan Baser, Kaan Kale, Sriram Vishwanath +1Privacy-Preserving Speech ProcessingData Valuation

    †The University of Texas at Austin, Austin, TX, USA · ‡Georgia Institute of Technology, Atlanta, GA, USA

  15. NodeImport: Imbalanced Node Classification with Node Importance Assessment

    Jul 15, 2026Nan Chen, Zemin Liu, Bryan Hooi +3Class-Imbalanced LearningGraph Neural Networks

    Johns Hopkins University Baltimore, Maryland, USA · Zhejiang University Hangzhou, Zhejiang, China · National University of Singapore Singapore, Singapore +1

  16. Validation-Induced Shapley Shifts: How Validation Structure Distorts Data Valuation

    Jul 4, 2026Yinan Shen, Ziao Yang, Hongfu LiuShapley Value AttributionData Valuation

    Adobe Waltham, MA 02451, USA · Department of Computer Science Brandeis University Waltham, MA 02453-2728, USA

  17. Efficient Decentralized Multi-task Dataset Valuation via Model Merging

    Jul 3, 2026Mohammadsajad Alipour, Mohammad Mohammadi AmiriData Valuation

    Department of Computer Science Rensselaer Polytechnic Institute Troy, NY 12180, USA

  18. What's a Credit Worth? A Market Framework for Attribution-Aware Compensation in Generative Music

    Jul 1, 2026Luyang Zhang, Xirui Jiang, Junwei Deng +3Mechanism DesignData Valuation

    Carnegie Mellon University · University of Michigan, Ann Arbor · University of Illinois Urbana-Champaign

  19. Online Data Selection for Instruction Tuning via Gaussian Processes

    Jun 29, 2026Jun Wang, Quoc Phong Nguyen, Julien Monteil +1Instruction-Tuning Data SelectionInstruction Tuning

    Amazon

  20. TimeLAVA: Learning-Agnostic Valuation for Time Series Data

    Jun 17, 2026Wenqin Liu, Weizhi Quan, Aoqi Zuo +5Data Valuation

    School of Mathematics and Statistics, The University of Melbourne · School of Mathematics and Statistics, University of Sydney · Responsible AI Research Centre, Australian Institute for Machine Learning +3

  21. AME: A Multi-Type Contributor Attribution Framework in Generative AI Markets

    Jun 15, 2026Yang Shi, Songwen Pei, Yang Gao +1Authorship AttributionData Valuation

    University of Shanghai for Science and Technology, Shanghai, China · Shanghai Institute of Technology, Shanghai, China

  22. How Much Is a Dataset Worth? Scaling Laws, the Vendi Score, and Matrix Spectral Functions

    May 28, 2026Jeff A. Bilmes, Gantavya Bhatt, Arnav M. DasSubmodular OptimizationNeural Scaling Laws

    Department of Electrical & Computer Engineering 2Paul G. Allen School of Computer Science & Engineering University of Washington, Seattle Seattle, WA 98195

  23. Efficient Banzhaf-Based Data Valuation for kk-Nearest Neighbors Classification

    May 20, 2026Guangyi Zhang, Lutz Oettershagen, Lixu Wang +1Dynamic ProgrammingData Valuation

    Shenzhen Technology University Shenzhen, China · University of Liverpool Liverpool, United Kingdom · Nanyang Technological University Singapore +1

  24. Dynamic Shapley Computation

    May 20, 2026Xuan Yang, Hsi-Wen Chen, Ming-Syan Chen +1Shapley Value AttributionData Valuation

    1Duke University · 2National Taiwan University

  25. Convex Dataset Valuation for Post-Training

    May 15, 2026Siqi Zeng, Christopher Jung, Rui Li +7LLM Post-TrainingData Valuation

    Department of Computer Science, University of Illinois Urbana-Chamapign, Urbana, IL, USA · Meta, Menlo Park, CA, USA

  26. Is Data Shapley Not Better than Random in Data Selection? Ask NASH

    May 11, 2026Xiao Tian, Jue Fan, Rachael Hwee Ling Sim +3Data SelectionTraining Data Selection

    Department of Computer Science, National University of Singapore, Singapore · Agency for Science, Technology and Research (A*STAR), Singapore

  27. Quotient Semivalues for False-Name-Resistant Data Attribution

    May 8, 2026Florian A. D. Burnat, Brittany I. DavidsonCybersecurityShapley Value Attribution

    School of Management, University of Bath, UK.

  28. Efficient Data Selection for Multimodal Models via Incremental Optimization Utility

    May 8, 2026Jinhao Jing, Qiannian Zhao, Chao Huang +1Data ValuationMultimodal Learning

  29. First-Order Efficiency for Probabilistic Value Estimation via A Statistical Viewpoint

    May 4, 2026Ziqi Liu, Kiljae Lee, Yuan Zhang +1Value Function EstimationShapley Value Attribution

    Department of Statistics & Data Science, Carnegie Mellon University. · Department of Statistics, The Ohio State University.

  30. Temporal-Decay Shapley: A Time-Aware Data Valuation Framework for Time-Series Data

    May 4, 2026Chuwen Pang, Bing Mi, Kongyang ChenShapley Value AttributionData Valuation

    School of Artificial Intelligence, Guangzhou University, Guangzhou 510006, China · School of Public Finance and Taxation, Guangdong University of Finance and Economics, Guangzhou 510320, China