A/b Testing

Ask about this topic

Momentum

6 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 21

All topics
CardsList

  1. Incentive Alignment in Online Experimentation

    Oct 5, 2026Ermis Soumalias, Richard Mudd, Abbas ZaidiCausal Effect EstimationA/b Testing

    Meta Platforms, Inc.

  2. Always-On Experimentation

    Sep 30, 2026Ricardo J. Sandoval, David Arbour, Avi Feller +1FDR ControlA/b Testing

    University of California, Berkeley · Adobe Research · Inria, Paris

  3. From Offline Proxies to Online Decisions: A Layered Engagement Evaluation Framework for Conversational AI

    Sep 21, 2026Xuanyi Li, Vaskar Nath, Hossein Amirkhani +2A/b TestingMulti-Turn Dialogue Evaluation

    Meta Platforms, Inc. Menlo Park, California, USA

  4. Augmented Hypothesis Testing with Persona-Based LLM Simulations

    Sep 21, 2026Ziyad Benomar, Aymen Al Marjani, Paul Missault +1A/b TestingLearning-Augmented Algorithms

    Amazon Luxembourg, Luxembourg · Amazon Barcelona, Spain

  5. Odds-Ratio Thompson Sampling: A Specification and Design Guide for Contrast-Based Multi-Armed Bandits

    Sep 17, 2026Sulgi KimThompson SamplingMulti-Armed Bandits

    Independent researcher

  6. DeltaSelect: Affordable A/B Testing for Coding Agents

    Sep 17, 2026Nicholas J. ConnAI Coding AgentsBenchmark Design

    Conn Castle Studios

  7. BAFF: Bid-Aware Filter Family for Mitigating Training Data Interference in RTB A/B Tests

    Sep 8, 2026Jeonglyul Oh, Ikkyu Choi, Inseop Youn +1Data SelectionA/b Testing

    Dable Inc. · Seoul, Republic of Korea

  8. Data-Driven Persona-Conditioned Agents for A/B Test Simulation

    Sep 1, 2026Ziyad Benomar, Weronika Łajewska, Leonardo Perelli +1Human Behavior SimulationA/b Testing

    Amazon · Luxembourg, Luxembourg · Barcelona, Spain

  9. Fast A/B/n Testing: Exact Multi-Policy Comparison via Tree-Coupled Feedback Sharing

    Aug 13, 2026Yuxiao WenPolicy EvaluationA/b Testing

    Courant Institute of Mathematical Sciences, New York University

  10. The Price of Isolation: Estimating the Ecosystem Cost of Symmetric Two-Sided A/B Testing

    Aug 5, 2026Yuanyuan Shen, Yiren Yan, Wenjie Li +1A/b Testing

    Snap Inc. New York, NY, USA · Snap Inc. Palo Alto, CA, USA

  11. Can AI Agents Simulate A/B Test Outcomes? A Validation Framework for Agentic Experimentation

    Aug 3, 2026Stefan Hut, Lorenzo MasoeroCausal Effect EstimationAI Agent Evaluation

    Amazon

  12. Offline-to-Online Creative Optimization with Generative Models and Adaptive Testing

    Jul 26, 2026Kevin Lee, Benjamin Letham, Zhiyuan Jerry Lin +5Online AdvertisingGenerative Modeling

    University of Michigan · USA · Meta

  13. Accelerating A/B-Tests with Counterfactual Estimation: Reducing Variance through Policy Overlap

    Jul 16, 2026Olivier JeunenCausal Effect EstimationA/b Testing

    Independent Researcher Antwerp, Belgium

  14. A More Accurate Algorithm Comparison through A/B Testing using Offline Evaluation Methods

    Jul 2, 2026Koki Konishi, Masataka Ushiku, Yuta SaitoAlgorithm SelectionA/b Testing

    Hakuhodo DY Holdings Inc. Minato City, Tokyo, Japan · Cornell University Ithaca, New York, United States

  15. Ensuring Trustworthy Online A/B Testing: Addressing Five Key Questions on CUPED

    Jun 17, 2026Yu Zhang, Bokui Wan, Yongli Qin +2Causal Effect EstimationA/b Testing

    ByteDance Beijing, China

  16. Statistical Foundations of LLM-based A/B Testing: A Surrogacy Framework for Human Causal Inference

    Jun 15, 2026Joel Persson, Mårten Schultzberg, Sebastian AnkargrenSurrogate ModelingA/b Testing

    Spotify USA, Inc. New York, NY, USA · Spotify AB Stockholm, Sweden

  17. Variance Reduction for Heavy-Tailed Monetization Metrics in Ranking Experiments via Post-Stratification

    Jun 2, 2026Neeti Pokharna, Olivier Jeunen, Yatharth Saraf +1Causal Effect EstimationA/b Testing

    ShareChat · Bengaluru, Karnataka, India · Aampe +3

  18. When prompt perturbations break your A/B test: A valid statistical test for generative surveying

    May 26, 2026Hayden Helm, Carey PriebePrompt SensitivityA/b Testing

    Helivan · Johns Hopkins University

  19. SimGym: A Framework for A/B Test Simulation in E-Commerce with Traffic-Grounded VLM Agents

    May 19, 2026Han Li, Vibhor Malik, Zahra Zanjani Foumani +17Tool-Using Vision-Language AgentsA/b Testing

    Shopify, Bellevue, Washington, USA

  20. Robust Sequential Experimental Design for A/B Testing

    May 13, 2026Qianglin Wen, Xiangkun Wu, Chengchun Shi +4Causal Effect EstimationModel Misspecification

    Yunnan Key Laboratory of Statistical Modeling and Data Analysis, Yunnan University, Kunming, China · School of Mathematical Sciences, Zhejiang University, Hangzhou, China · Department of Statistics, London School of Economics and Political Science, London, United Kingdom +3

  21. Efficient Multi-Cohort Inference for Long-Term Effects and Lifetime Value in A/B Testing with User Learning

    Apr 22, 2026Dario Simionato, Andrea Tonon, Mingxue Wang +3Causal Effect EstimationA/b Testing

    Huawei Ireland Research Centre Dublin, Ireland · Huawei Nanjing R&D Center Nanjing, China