Automated Software Testing

Ask about this topic

Momentum

5 papers in the last four weeks, up 25% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 93

All topics
CardsList

  1. Multi-Label Perceptual Bug Detection in Video Games using Deep Learning on Gameplay Footage

    Oct 6, 2026Nahian Rifaat, Felix Morosov, Loutfouz ZamanAutomated Software TestingMulti-Label Classification

    Ontario Tech University Oshawa, Ontario, Canada · Universität Osnabrück Osnabrück, Niedersachsen, Germany

  2. FastCI: Efficient GPU-Intensive CI for LLM Training Frameworks

    Oct 1, 2026Tianshuo Qiao, Naiqian Zheng, Xiaopeng Liu +4Automated Software Testing

    Peking University · ByteDance Seed

  3. Do Agent Benchmarks Do What They Say? An Executable-Contract Audit of Tool-Using Agent Environments

    Sep 29, 2026Rohith Reddy Bellibatlu, Zichong Wang, Wenbin ZhangTool-Use EvaluationAutomated Software Testing

    Florida International University, Miami, FL, USA

  4. Scenario-Driven Neuroevolution: Using Models to Guide Test Generation for Games

    Sep 23, 2026Gijs van Cuyck, Patric Feldmeier, Jan Tretmans +1Automated Software TestingAutomated Test Generation

    Radboud University, Institute iCIS, Nijmegen, The Netherlands · University of Passau, Germany · TNO-ESI, Eindhoven, The Netherlands

  5. FairTest: Search-Based Fairness Testing for Multi-Agent Reinforcement Learning Systems

    Sep 23, 2026Xiaotong Wang, Xuan XieAutomated Software TestingAlgorithmic Fairness

    School of Computer Science and Engineering, Macau University of Science and Technology, Macao SAR, China

  6. IWC-Bench: Evaluating Web Application Generation from a Software Testing Perspective

    Sep 14, 2026Chenxu Liu, Zilu Zou, Peizhong Gao +9Automated Software TestingWeb Application Generation

    Hunyuan Team, Tencent · Tsinghua University · Peking University

  7. The reach of a verification tool decides its value: A controlled study of verification surface, artifact quality, and cost in AI coding agents

    Aug 28, 2026Achint MehtaAutomated Software TestingAI Coding Agents

  8. LLM-Assisted Dynamic Threat Analysis for Attacker-Reachable Software Weaknesses in Autonomous Vehicles

    Aug 13, 2026Md Wasiul Haque, Sagar Dasgupta, Mizanur Rahman +1Automated Software TestingSoftware Vulnerability Detection

    Department of Civil, Construction & Environmental Engineering, The University of Alabama 2009 Smart Communities and Innovation Building (SCIB), 28 Kirkbride Lane, Tuscaloosa, AL 35487-0288 · Department of Computer Science, The University of Alabama 3017 Cyber Hall, 248 Kirkbride Lane, Tuscaloosa, AL 35487-0288

  9. A Contract-Grade Verifier for LLM-Generated GPU Kernels, and a Native Blackwell Backward for the Gated-Linear-Recurrence Family

    Aug 13, 2026Rishi Shah, Rishav ShresthaAutomated Software TestingFormal Verification

    E3A Healthcare

  10. Do Not Forget the Obvious - RISC: A Risk-Informed Slice-Coverage Protocol for Safe Autonomous Driving

    Aug 12, 2026Fabian HügerAutomated Software TestingAutonomous Driving Safety Evaluation

    CARIAD SE, 38440 Wolfsburg, Germany

  11. Directed Neuro-Symbolic Stochastic Execution for Verification of Distributed Parallel AI Programs

    Aug 8, 2026Gautham Koorma, Vikas Sharma, George Edwards +1Automated Software TestingFormal Verification

    Quandary Peak Research, Los Angeles, CA, USA

  12. WebGrader: Training LLMs for Web Development with Self-Evolving Programmatic Grader

    Aug 6, 2026Boshui Chen, Huiping Liu, Shaolei ZhangRL for Code GenerationAutomated Software Testing

    Beijing Institute of Technology, China · Beijing Jiaotong University, China · Renmin University of China, China

  13. IcFuzz: Fuzzing Isaac Sim with Semantic Stage Guidance and Multi-level Mutation

    Aug 6, 2026Zhixiang Chen, Zhuangbin Chen, Ruoxi Jia +4Automated Software TestingRobotics Simulation

    Sun Yat-sen University Zhuhai, China · Zhuhai Key Laboratory of Trusted Large Language Models, Sun Yat-sen University, Zhuhai, China · Nanyang Technological University Singapore, Singapore +1

  14. JTA: Joint Testability Architecture for Scenario-Based Validation of Safety-Critical Software

    Aug 6, 2026Wenyao Xue, Jiandi Wang, Yichen WangSoftware EngineeringAutomated Software Testing

    Beihang University, Beijing, China

  15. Can LLMs Test Terminal User Interfaces?

    Aug 4, 2026Chao Peng, Ruida Hu, Ajitha Rajan +3Automated Software TestingAutomated Test Generation

    University of Edinburgh · United Kingdom · Harbin Institute of Technology +3

  16. Coding Agents as Test-Suite Auditors: Finding What Official Suites Miss While Approaching What They Catch

    Aug 3, 2026Shuyang Xie, Shuxiao Xie, Feng Zhu +2Automated Software TestingBenchmark Auditing

    Harbin Institute of Technology · Fudan University · Sun Yat-sen University

  17. Validation Evidence in LLM Repair Agents: How Much of What Passes Actually Tests the Bug?

    Jul 30, 2026Xiaonan Xu, Wenjing WuAutomated Software TestingAutomated Program Repair

    College of Computing, Georgia Institute of Technology, Atlanta, GA, 30332, USA. · Department of Computer Science, University of Colorado Boulder, Boulder, CO, 80309, USA.

  18. DragonCrawl: A Generative, Intent-Based Framework for Scalable Mobile End-to-End Testing

    Jul 30, 2026Sowjanya Puligadda, Mengdie Zhang, Ali Zamani +3Mobile GUI AutomationAutomated Software Testing

    Uber Technologies, Inc. San Francisco, CA, USA

  19. Agentic Method for Deterministic Validation of Legacy Code Migration

    Jul 30, 2026Andras Ferenczi, Jordan Docherty, Mariya Bessonov +2Code TranslationAutomated Software Testing

    American Express

  20. Evaluating VLMs for Autonomous Agent-Driven Geometry Clipping Detection in Video Game QA

    Jul 28, 2026Carlos Celemin, Benedict Wilkins, Adrián Barahona-Ríos +2VLM EvaluationVLM Robustness

    Sony Interactive Entertainment, London, United Kingdom

  21. KQFuzz: Knowledge-Guided Fuzzing for Quantum Libraries via Large Language Models

    Jul 28, 2026Fuyuan Xia, Qixin Zhang, Chenhao Ying +5Automated Software TestingLLMs for Cybersecurity

    1Shanghai Jiao Tong University · 2Nanyang Technological University · 3Hong Kong University of Science and Technology +1

  22. Adversarial Test-Hardening for AI-Written Code: An Instrument Autopsy and a Pre-Registered Causal Estimate of the Critic Loop

    Jul 25, 2026Jeff OttersonAutomated Software TestingLLM Auditing

    W. P. Carey School of Business, Arizona State University

  23. Do Coverage and Mutation Scores of LLM-Generated Test Suites Correlate with Their Effectiveness? (Replicability Study)

    Jul 24, 2026Junda Zhao, Shurui Zhou, Eldan CohenLLM EvaluationAutomated Software Testing

    University of Toronto, Department of Mechanical and Industrial Engineering, Toronto, Canada · University of Toronto, Department of Electrical and Computer Engineering, Toronto, Canada

  24. From Resource Flow to Executable Tests: Petri-Net-Guided LLM Test Generation for Concurrent Stateful Rust APIs

    Jul 23, 2026Kaiwen Zhang, Guanjun LiuAutomated Software TestingLLM-Based Program Synthesis

    Tongji University Shanghai,China

  25. Test Case Prioritization for DNNs via Neural Collapse Instability

    Jul 22, 2026Chunyu Liu, Mingyuan Li, Yang Li +4Automated Software Testing

    State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, China · National Engineering Research Center of Disaster Backup and Recovery, Beijing University of Posts and Telecommunications, China · Information Security Center, Beijing University of Posts and Telecommunications, China

  26. Beyond Fail-to-Pass: Iterative Hardening of Co-Generated Bug Reproduction Tests and Fixes

    Jul 22, 2026Yuhao Tan, Zhibang Yang, Fangkai Yang +9Automated Software TestingAutomated Program Repair

    1Nanjing University · 2Peking University · 3Microsoft

  27. Integrating High-Level Requirements to Low-Level Tests with Machine-Readable V&V Specifications

    Jul 20, 2026Mansur Arief, Nur Ahmad Khatim, Ali Akarma +1Requirements EngineeringAutomated Software Testing

    Industrial and Systems Engineering, King Fahd University of Petroleum and Minerals (KFUPM), Saudi Arabia · Division of Information Science, Nara Institute of Science and Technology (NAIST), Japan · Faculty of Computer and Information Systems Islamic University of Madinah Madinah, Saudi Arabia +1

  28. Faithful Autoformalization of Natural Language Assertions

    Jul 14, 2026Hongyi Liu, Madhusudan Parthasarathy, Adithya MuraliAutomated Software TestingLLM-Based Program Synthesis

    University of Wisconsin-Madison · University of Illinois at Urbana-Champaign

  29. Fail-Aware and Explainable Test Oracle Prediction

    Jul 13, 2026Yue Zhao, Binish Tanveer, Jelena ZdravkovicAutomated Software TestingFault Detection

    Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden

  30. An Empirical Study for Android-to-OpenHarmony GUI Test Migration

    Jul 13, 2026Yakun Zhang, Xinjia Chen, Yiyun Chen +6Mobile GUI AutomationAutomated Software Testing

    Harbin Institute of Technology, Shenzhen, China · Beijing Institute of Technology, China · Beihang University, China +1

  31. Reward-Adaptive Iterative Discovery: A Case Study on Automated Game Testing for NHL26

    Jul 8, 2026Florian Fuchs, Jessy Gosselin-Grant, Boris Skuin +5Automated Software TestingReinforcement Learning

    Electronic Arts (EA)

  32. Specification Grounding Drives Test Effectiveness for LLM Code

    Jul 7, 2026Amin Haeri, Mahdi GhelichiLLM GroundingAutomated Software Testing

    Model Development Innovation TD Bank, Toronto, Canada

  33. LLM-Based Test Oracles: Source-of-Authority Taxonomy -- A Systematic Literature Review

    Jul 6, 2026Ali Hassaan Mughal, Muhammad BilalSoftware EngineeringAutomated Software Testing

    Independent Researcher, USA · Technical University of Munich, Germany

  34. An Exploration of Agentic Information Fusion for Test Maintenance Prediction

    Jul 6, 2026Jingxiong Liu, Nasser Mohammadiha, Gregory GayAutomated Software TestingPredictive Maintenance

    Chalmers University of Technology and University of Gothenburg · Ericsson AB

  35. Flow-A11y: Flow-Aware Accessibility Testing

    Jul 3, 2026Nasr Eddine Fliti, Leisan Kokorina, Florian Tambon +1Automated Software TestingAutomated Evaluation

    University of Luxembourg Luxembourg, Luxembourg

  36. TestEvo-Bench: An Executable and Live Benchmark for Test and Code Co-Evolution

    Jul 2, 2026Jiale Amber Wang, Kaiyuan Wang, Pengyu NieAutomated Software TestingBenchmark Design

    University of Waterloo · 2Google

  37. Beyond Pixel Diffs: Benchmarking Image Change Captioning for Web UI Visual Regression Testing

    Jul 2, 2026Licheng Zhang, Bach Le, Pengtao Zhao +1Image CaptioningAutomated Software Testing

    School of Computing and Information Systems, University of Melbourne, Melbourne, Australia

  38. MAS-Lab: A Specification-Driven Validation Framework for Reliable Multi-Agent Systems

    Jun 29, 2026Jordan Augé, Giovanna Carofiglio, Giulio Grassi +1Multi-Agent LLM SystemsAutomated Software Testing

    Cisco Systems Paris, France

  39. Test-Input Generation for Tensor Programs: What Actually Finds Kernel Bugs

    Jun 23, 2026Dipankar SarkarAutomated Software TestingBenchmark Design

    Arizona State University, USA

  40. MANGO: Automated Multi-Agent Test Oracle Generation for Vision-Language-Action Models

    Jun 23, 2026Pablo Valle, Shaukat Ali, Aitor Arrieta +1Automated Software TestingVision-Language-Action Models

    Mondragon University, Guipuzcoa, Spain · Simula Research Laboratory, Oslo, Norway · University of Ottawa, Ottawa, ON K1N 6N5, Canada +1

  41. Detecting and Understanding Vulnerabilities in Fully Homomorphic Encryption Frameworks

    Jun 21, 2026Yiteng Peng, Dongwei Xiao, Zhibo Liu +2Automated Software TestingSoftware Vulnerability Detection

    The Hong Kong University of Science and Technology · State Key Laboratory of Novel Software Technology, Nanjing University · Nara Institute of Science and Technology

  42. All Green, Still Broken: Real-Flow Verification Lessons from an LLM-Integrated, Multi-Market Web Application

    Jun 21, 2026Muhammad Bilal, Ali Hassaan MughalAutomated Software Testing

    Technical University of Munich · Technical University of Munich, Germany · Independent Researcher +1

  43. Load Testing for Machine Learning Model Serving Systems at Scale

    Jun 20, 2026Amr S. Abdelfattah, Nakul Tirumalai, Indu Mohanan +4Automated Software Testing

    Meta Inc., Menlo Park, USA

  44. Context-Aware Generative AI for Automated Telecom Test Script Generation

    Jun 19, 2026Gautam Prasad, Chandramohan T. N., Joy BoseAutomated Software TestingAutomated Test Generation

    Ericsson R&D Bangalore

  45. The Correctness Illusion in LLM-Generated GPU Kernels

    Jun 18, 2026Dipankar SarkarAutomated Software TestingDifferential Testing

    Arizona State University, USA

  46. Library-Aware Doubles and Iterative Repair for Large Language Model-Generated Unit Tests in OpenSIL Firmware

    Jun 18, 2026Ma Toan Bach, Yuchi Zheng, Haingo Razafindranto +4Automated Software TestingAutomated Program Repair

    School of Software Design and Data Science Seneca Polytechnic Canada · Advanced Micro Devices Canada

  47. Code-Augur: Agentic Vulnerability Detection via Specification Inference

    Jun 17, 2026Zhengxiong Luo, Mehtab Zafar, Dylan Wolff +1Automated Software TestingSoftware Vulnerability Detection

    National University of Singapore

  48. All Smoke, No Alarm: Oracle Signals in Agent-Authored Test Code

    Jun 16, 2026Dipayan Banik, Kowshik Chowdhury, Shazibul Islam ShamimAutomated Software TestingAI Coding Agents

    Danovo Energy Solutions · Raleigh, North Carolina, USA · Kennesaw State University +1

  49. Cluster-Aware Dual-Level Test Specification Generation for Large-Scale Automotive Software Requirements

    Jun 15, 2026Hazem Ayman, Menna Sedik, Kareem Mostafa +3Requirements EngineeringAutomated Software Testing

    CairoMotive Cairo, Egypt

  50. Auditing Reward Hackability in Code RL Training Environments

    Jun 14, 2026Shreshth RajanRL for Code GenerationReward Hacking

  51. AIChilles: Automatically Uncovering Hidden Weaknesses in AI-Evolved Systems

    Jun 14, 2026Yajie Zhou, Ao Li, Ashwin Silla +2Automated Software TestingDifferential Testing

    University of Maryland, College Park · Carnegie Mellon University

  52. Governance Controls for AI-Generated Test Artifacts in Autonomous Software Testing

    Jun 7, 2026Dimple Bajaj, Deepak KhetanAutomated Software TestingAI Governance

  53. AI-Augmented Closed-Loop Quality Engineering: A Reference Architecture for Continuous Software Quality Intelligence

    Jun 7, 2026Dimple BajajSoftware EngineeringAutomated Software Testing

  54. AI-Driven Test Case Generation from Natural Language Requirements: A Survey of Techniques and Research Gaps

    Jun 4, 2026Orimoloye Folorunsho, Hassan RezaAutomated Software TestingAutomated Test Generation

    School of Electrical Engineering and Computer Science University of North Dakota, Grand Forks, ND 58201, USA

  55. WebRISE: Requirement-Induced State Evaluation for MLLM-Generated Web Artifacts

    Jun 2, 2026Yuxin Meng, Yuhan Suo, Junjie Wang +9Automated Software TestingAutomated Evaluation

    Tsinghua University · Huawei Noah’s Ark Lab · East China Normal University +2

  56. Before the Model Learns the Bug:Fuzzing RLVR Verifiers

    May 31, 2026Jaideep RayReward HackingAutomated Software Testing

  57. FVSpec: Real-World Property-Based Tests as Lean Challenges

    May 31, 2026Quinn Dougherty, Max von Hippel, Simon Henniger +2Automated Software TestingAutomated Theorem Proving

    Forall R&D, work completed at Galois Inc · work completed at Galois Inc · Some work completed at Benchify +2

  58. Inferring Code Correctness from Specification

    May 28, 2026Tambon Florian, Papadakis MikeAutomated Software TestingCode Generation Evaluation

    University of Luxembourg Luxembourg, Luxembourg

  59. Multi-Agent LLM-based Metamorphic Testing for REST APIs

    May 27, 2026Shehroz Khan, Abdullah Mughees, Gaadha Sudheerbabu +2Automated Software TestingMetamorphic Testing

    Abo Akademi University Turku, Finland

  60. HTMLCure: Turning Browser Experience into State Guided Repair for Interactive HTML

    May 26, 2026Jiajun Wu, Jian Yang, Tuney Zheng +4Automated Software TestingAutomated Program Repair

    1Beihang University · 2IQuest Research · 3Peking University