cs.AISep 18, 2026

AutoRecLab: Describe the Experiment, Get the Code!

Authors: Moritz Baumgart, Philipp Meister, Justus Krell, Michael Schmidt, Bela Gipp, Joeran Beel

Organizations: University of Siegen Siegen, Germany · University of Göttingen Göttingen, Germany

Abstract

Empirical evaluation is central to recommender-systems (RecSys) research, but turning experimental designs into executable code remains a manual and error-prone task. We present AutoRecLab, a Python-based autonomous RecSys lab that automates RecSys experiments from natural-language prompts. Given a research idea, AutoRecLab derives explicit experiment requirements, builds and validates a prototype, and iteratively expands it into the requested full experiment. The workflow combines retrieval-augmented generation (RAG) for documentation lookup, static type verification, and execution-steered tree search. In our demonstration, AutoRecLab autonomously implements an explicit-to-implicit feedback conversion study. In a baseline comparison across six algorithms and three datasets, 8 of 9 runs succeed at an average cost of approx- imately $1 per run with GPT-5.4-mini.

Figures & tables

Explore similar work

CardsList
  1. Auto-RecSys: Harnessing Autonomous Research Agents for Industry-Scale Recommender System

    Sep 10, 2026Ming Li, Dai Li, Xuying Ning +11Recommender SystemsLong-Horizon LLM Agents

  2. RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems

    Jul 31, 2026Haoran Ling, Yuecheng Li, Zeyu Song +5Large Language Model-Guided OptimizationAgent Harness Optimization