cs.AINov 12, 2026

From More to Better: Causal Inference and Digital Experimentation in the Age of AI

Authors: Winston Chou, Mårten Schultzberg, Lo-Hua Yuan, Wenjing Zheng, Avi Feller, David Holtz, Widad Machmouchi, Sven Schmit, 

Organizations: Netflix · Spotify · Independent · Roblox · 

Abstract

Artificial intelligence (AI) is quickly expanding the capacity of organizations to produce and analyze data. We argue that this expansion shifts the leverage of data scientists from performing individual analyses to assessing the credibility and importance of findings and determining when evidence generalizes across contexts. Drawing on a roundtable of academic researchers and industry practitioners, we examine three ways in which data scientists who work on causal inference and experimentation can help organizations turn more analytical capacity into better decisions: preserving and accumulating the learning value of experimentation beyond individual tests; choosing and combining experimental, observational, and synthetic evidence; and ensuring evaluation keeps pace with AI as its capabilities and uses evolve. In each area, we distinguish established practice from open questions. We conclude with implications for the training and practice of data science and for organizations.

Explore similar work

CardsList
  1. Beyond One-shot: AI Agents for Learning in Field Experiments

    Jun 1, 2026Junjie Luo, Ritu Agarwal, Gordon GaoTool-Using AgentsAutonomous Experimentation

  2. CausalDS: Benchmarking Causal Reasoning in Data-Science Agents

    Jul 9, 2026Andrej Leban, Theo Saarinen, Yuekai SunStructural Causal ModelsAI Agent Benchmarks

  3. CausaLab: A Scalable Environment for Interactive Causal Discovery Toward AI Scientists

    May 25, 2026Junlin Yang, Dylan Zhang, Xiangchen Song +7Structural Causal ModelsLLM Agent Evaluation