Autonomous Racing

Ask about this topic

Overview

Autonomous racing studies how vehicles can perceive a track and other racers, estimate their own dynamics, and plan and control motion near the limits of grip. Common approaches include minimum-time trajectory optimization and model predictive control, alongside reinforcement learning, learned dynamics models, and sensor fusion for localization and opponent tracking. Multi-agent work adds overtaking and defensive strategies, while benchmarks, simulators, and small-scale platforms help test methods before full-scale deployment. A central challenge is transferring performance from simulation to real cars without sacrificing safety or real-time reliability, especially as surfaces, opponents, and sensor conditions change.

Latest papers 57

3 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

All topics
CardsList
May 20, 2026

Anomaly-Informed Confidence Calibration for Vision-Based Safety Prediction

Reliable confidence estimates are important for safely deploying vision-based controllers in autonomous racing, where safety predictions must be derived from camera images, yet modern predictors become dangerously overconfident under test-time distribution shifts. We identify a critical perception-dynamics gap in existing anomaly signals: widely used scores, such as autoencoder reconstruction error, capture visual corruptions but miss dynamics anomalies (e.g., actuation bias, latency), where images remain plausible while the trajectory degrades. To address this, we propose an Anomaly-Informed Online Calibration approach that, without retraining any model component, fuses two complementary anomaly scores extracted from a world model: a perceptual score from reconstruction error and a dynamics score from epistemic uncertainty and control-stream statistics. Based on these fused scores, a lightweight temperature-scaling calibrator leverages test-time augmentation to selectively reduce overconfidence under shift while preserving nominal-condition performance. Experiments on a physical DonkeyCar under four real-world anomaly protocols unseen during training (darkness, blur, actuation bias, processing latency) reduce average expected calibration error from 0.184 to 0.116, a 37% improvement over the best baseline, without modifying the base safety predictor.

Zhenjiang Mao, Jiawen Wu, Gabriel Wagner +2

Trustworthy Engineered Autonomy (TEA) Lab, Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL 32611, USA

Post-Hoc CalibrationAutonomous RacingModel CalibrationVision-Based Robot ControlUncertainty CalibrationAnomaly Detection
AskPDF
May 19, 2026

Trajectory Planning and Control near the Limits: an Open Experimental Benchmark on the RoboRacer Platform

We present a modular framework to benchmark new and existing methods for trajectory planning and control in high-acceleration maneuvers that push autonomous driving to the limits. Our framework includes time-optimal raceline generation, online time-optimal velocity replanning, geometric path tracking controllers, and a new model-structured neural network (MS-NN) to learn the inverse dynamics for steering control. We deploy our framework on a 1:10-scale RoboRacer platform, using two circuits. Through several ablations with cautious and aggressive racelines, we study the performance of single modules and their combinations. We show that our MS-NN significantly improves tracking accuracy, decreases steering oscillations, and is physically interpretable. Moreover, online velocity replanning improves lap times by compensating for execution errors, and enables the vehicle to safely reach higher speeds and accelerations. To support future research, our code, datasets, videos and results are publicly available at https://roboracer-benchmark.github.io/planning_control_benchmark/.

Mattia Piccinini, Patrick Zambiasi, Aniello Mungiello +3

Professorship of Autonomous Vehicle Systems, Technical University of Munich, 85748 Garching, Germany; Munich Institute of Robotics and Machine Intelligence (MIRMI). · Avilus GmbH, Germany. · Department of Information Technology and Electrical Engineering (DIETI), University of Naples Federico II, Naples 80125, Italy. +1

Autonomous Driving BenchmarksRobot Trajectory TrackingTrajectory OptimizationTrajectory GenerationAutonomous RacingVehicle Dynamics+1
AskPDF
May 18, 2026

Transfer Learning for Customized Car Racing Environments

Transfer Learning, a technique where a model/agent can use the knowledge/expertise that it gained from one task and exploit that to solve another closely-related task, is often used in tackling problems in deep learning. Through this project, we explore transfer learning in the purview of deep reinforcement learning. Specifically, we want to use transfer learning to achieve the fast lap times in OpenAI's Car racing environment by training the agent on one circuit, and racing it on other customized target environments by zero-shot transfer or by additional fine-tuning. In addition, we compare the performance of model-based and model-free approaches, and observe that model-based approaches dominate in performance and converge faster than model-free approaches in this environment. We observe that transfer learning in most setups not only boosts the performance on the target domain, but also shows high performance ability during learning.

Benedict Florance Arockiaraj, Richard Chang, Wesley Yee

SEAS

Autonomous RacingCross-Domain Transfer LearningTransfer LearningModel-Based RL
AskPDF
May 8, 2026

DynSSM: A Physics-Aware State-Space Memory Framework for Learning Vehicle Dynamics

Accurate modeling of nonlinear vehicle dynamics is essential for high-speed autonomous racing, where controllers operate at the handling limits. Model-based methods are interpretable but rely on simplifying assumptions, while purely learned models capture nonlinearities yet often lack physical consistency, generalization, and adaptability to changing operating conditions. This paper presents DynSSM, a physics-aware state-space memory framework that combines learned temporal representations with a structured vehicle dynamics model. The proposed approach integrates state-space sequence modeling and recurrent encoders to capture long- and short-term dynamic behavior. It simultaneously adapts tire and vehicle-dynamics parameters within bounded ranges to preserve physical plausibility. A residual correction mechanism compensates for remaining unmodeled dynamics while preserving the underlying physics-based structure. DynSSM is evaluated on both simulated small-scale racing data and real-world full-scale autonomous Indy racecar data. When evaluated on an unseen real-world track, DynSSM reduces one-step prediction RMSE by up to 27.2%27.2\% in longitudinal velocity, 73.9%73.9\% in lateral velocity, and 88.8%88.8\% in yaw rate compared with the state-of-the-art (\sota{}) baselines. Component-wise ablation studies demonstrate the importance of temporal memory, parameter adaptation, and residual correction for predictive performance and robustness. Further, closed-loop simulations using nonlinear model predictive control demonstrate that DynSSM remains feasible across the evaluated tracks and achieves up to a 13.2% reduction in one-lap completion time compared with \sota{} baselines. These results indicate that combining temporal memory, bounded physics-guided parameter adaptation, and residual correction provides an accurate, interpretable, and control-ready dynamics model for autonomous racing.

Musabbir Ahmed Arrafi, Malik Ali, Nicholas M. Stiffler +1

University of Dayton, Dayton, OH 45469 USA

Autonomous RacingVehicle DynamicsPhysics-Informed MLState Space Models
AskPDF
May 1, 2026

Learning to Race in Minutes: Infoprop Dyna on the Mini Wheelbot

Reinforcement Learning (RL) has the potential to enable robots with fast, nonlinear, and unstable dynamics to reach the limits of their performance. However, most recent advances rely on carefully designed physics-based simulators and domain randomization to achieve successful sim-to-real transfer within reasonable wall-clock time. In this work, we bypass the need for such simulators and demonstrate that Infoprop Dyna, a state-of-the-art uncertainty-aware model-based reinforcement learning (MBRL) framework, can enable robots to learn directly from real-world interactions. Using Infoprop Dyna, the Mini Wheelbot, an underactuated unicycle robot, learns to race around a track within 11 minutes of real-world experience.

Devdutt Subhasish, Henrik Hose, Sebastian Trimpe

Institute for Data Science in Mechanical Engineering, RWTH Aachen University, 52062 Aachen

Robot Skill LearningAutonomous RacingRobotic RLData-Efficient Robot LearningRobot LocomotionRobot Learning+1
AskPDF
Apr 27, 2026

TEACar: An Open-Source Autonomous Driving Platform

Intelligent Transportation Systems (ITS) increasingly rely on vision-based perception and learning-based control, necessitating experimental platforms that support realistic hardware-in-the-loop validation. Small-scale platforms for autonomous racing offer a practical path to hardware validation, but often suffer from limited modularity, high integration complexity, or restricted extensibility. This paper presents TEACAR, a 1/14- to 1/16-scale autonomous driving platform designed with modular mechanical architecture, hardware abstraction, and ROS 2-based software. The system adopts a four-layer deck structure that physically decouples sensing, computation, actuation, and power subsystems, improving structural rigidity while simplifying reconfiguration. We constructed and comprehensively evaluated the prototype of TEACAR. Its mechanical stability, structural characteristics, and software performance were quantified based on three CNN-based steering controllers. Inference latency, power consumption, and system operating time were measured to evaluate computational capability and robustness. Our experiments demonstrated that TEACAR offers a scalable, modular, and cost-effective testbed for ITS research, education, and development. Our project repository is available on GitHub.

Zhongzheng Zhang, Maxwell Ruyle, Andrew Kappes +5

Trustworthy Engineered Autonomy (TEA) Lab, Department of Electrical and Computer Engineering, University of Florida

Intelligent Transportation SystemsAutonomous DrivingAutonomous Racing
AskPDF
Apr 16, 2026

Dual Pose-Graph Semantic Localization for Vision-Based Autonomous Drone Racing

Autonomous drone racing demands robust real-time localization under extreme conditions: high-speed flight, aggressive maneuvers, and payload-constrained platforms that often rely on a single camera for perception. Existing visual SLAM systems, while effective in general scenarios, struggle with motion blur and feature instability inherent to racing dynamics, and do not exploit the structured nature of racing environments. In this work, we present a dual pose-graph architecture that fuses odometry with semantic detections for robust localization. A temporary graph accumulates multiple gate observations between keyframes and optimizes them into a single refined constraint per landmark, which is then promoted to a persistent main graph. This design preserves the information richness of frequent detections while preventing graph growth from degrading real-time performance. The system is designed to be sensor-agnostic, although in this work we validate it using monocular visual-inertial odometry and visual gate detections. Experimental evaluation on the TII-RATM dataset shows a 56% to 74% reduction in ATE compared to standalone VIO, while an ablation study confirms that the dual-graph architecture achieves 10% to 12% higher accuracy than a single-graph baseline at identical computational cost. Deployment in the A2RL competition demonstrated that the system performs real-time onboard localization during flight, reducing the drift of the odometry baseline by up to 4.2 m per lap.

David Perez-Saura, Miguel Fernandez-Cortizas, Alvaro J. Gaona +1

Computer Vision & Aerial Robotics Group, Universidad Polit´ecnica de Madrid, Madrid, Spain · Automation and Robotics Group (ARG-SnT), University of Luxembourg – SnT, Luxembourg

Pose Graph OptimizationAutonomous RacingRobot Localization
AskPDF
Apr 13, 2026

EagleVision: A Multi-Task Benchmark for Cross-Domain Perception in High-Speed Autonomous Racing

High-speed autonomous racing presents extreme perception challenges, including large relative velocities and substantial domain shifts from conventional urban-driving datasets. Existing benchmarks do not adequately capture these high-dynamic conditions. We introduce EagleVision, a unified LiDAR-based multi-task benchmark for 3D detection and trajectory prediction in high-speed racing, providing newly annotated 3D bounding boxes for the Indy Autonomous Challenge dataset (14,893 frames) and the A2RL Real competition dataset (1,163 frames), together with 12,000 simulator-generated annotated frames, all standardized under a common evaluation protocol. Using a dataset-centric transfer framework, we quantify cross-domain generalization across urban, simulator, and real racing domains. Urban pretraining improves detection over scratch training (NDS 0.72 vs. 0.69), while intermediate pretraining on real racing data achieves the best transfer to A2RL (NDS 0.726), outperforming simulator-only adaptation. For trajectory prediction, Indy-trained models surpass in-domain A2RL training on A2RL test sequences (FDE 0.947 vs. 1.250), highlighting the role of motion-distribution coverage in cross-domain forecasting. EagleVision enables systematic study of perception generalization under extreme high-speed dynamics. The dataset and benchmark are publicly available at https://avlab.io/EagleVision

Zakhar Yagudin, Murad Mebrahtu, Ren Jin +5

Skolkovo Institute of Science, Intelligent Space Robotics Laboratory, Center for Engineering Systems and Sciences · Khalifa University, KUCARS-KU Center for Autonomous Robotic Systems, Department of Computer Science · Beijing Institute of Technology, Beijing Key Laboratory of UAV Autonomous Control

Autonomous RacingLidar-Based 3D Object DetectionCross-Domain Transfer LearningTrajectory Prediction
AskPDF
Apr 10, 2026

Physics-Informed Reinforcement Learning of Spatial Density Velocity Potentials for Map-Free Racing

Autonomous racing without prebuilt maps is a grand challenge for embedded robotics that requires kinodynamic planning from instantaneous sensor data at the acceleration and tire friction limits. Out-Of-Distribution (OOD) generalization to various racetrack configurations utilizes Machine Learning (ML) to encode the mathematical relation between sensor data and vehicle actuation for end-to-end control, with implicit localization. These comprise Behavioral Cloning (BC) that is capped to human reaction times and Deep Reinforcement Learning (DRL) which requires large-scale collisions for comprehensive training that can be infeasible without simulation but is arduous to transfer to reality, thus exhibiting greater performance than BC in simulation, but actuation instability on hardware. This paper presents a DRL method that parameterizes nonlinear vehicle dynamics from the spectral distribution of depth measurements with a non-geometric, physics-informed reward, to infer vehicle time-optimal and overtaking racing controls with an Artificial Neural Network (ANN) that utilizes less than 1% of the computation of BC and model-based DRL. Slaloming from simulation to reality transfer and variance-induced conservatism are eliminated with the combination of a physics engine exploit-aware reward and the replacement of an explicit collision penalty with an implicit truncation of the value horizon. The policy outperforms human demonstrations by 12% in OOD tracks on proportionally scaled hardware, by maximizing the friction circle with tire dynamics that resemble an empirical Pacejka tire model. System identification illuminates a functional bifurcation where the first layer compresses spatial observations to extract digitized track features with higher resolution in corner apexes, and the second encodes nonlinear dynamics.

Shathushan Sivashangaran, Apoorva Khairnar, Sepideh Gohari +2

Autonomous Robots and Vehicles Laboratory, College of Engineering, Virginia Commonwealth University, Richmond, VA 23284, USA. · Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA 24061, USA. · Robotics Department, University of Michigan, Ann Arbor, MI 48109, USA.

Autonomous RacingRL ControlPhysics-Informed RLRobot Dynamics Learning
AskPDF
Apr 9, 2026

RAGE-XY: RADAR-Aided Longitudinal and Lateral Forces Estimation For Autonomous Race Cars

In this work, we present RAGE-XY, an extended version of RAGE, a real-time estimation framework that simultaneously infers vehicle velocity, tire slip angles, and the forces acting on the vehicle using only standard onboard sensors such as IMUs and RADARs. Compared to the original formulation, the proposed method incorporates an online RADAR calibration module, improving the accuracy of lateral velocity estimation in the presence of sensor misalignment. Furthermore, we extend the underlying vehicle model from a single-track approximation to a tricycle model, enabling the estimation of rear longitudinal tire forces in addition to lateral dynamics. We validate the proposed approach through both high-fidelity simulations and real-world experiments conducted on the EAV-24 autonomous race car, demonstrating improved accuracy and robustness in estimating both lateral and longitudinal vehicle dynamics.

Davide Malvezzi, Nicola Musiu, Eugenio Mascaro +2

Vehicle DynamicsAutonomous RacingMultimodal Sensor Fusion
AskPDF
Apr 3, 2026

RAGE: A Tightly Coupled Radar-Aided Grip Estimator For Autonomous Race Cars

Real-time estimation of vehicle-tire-road friction is critical for allowing autonomous race cars to safely and effectively operate at their physical limits. Traditional approaches to measure tire grip often depend on costly, specialized sensors that require custom installation, limiting scalability and deployment. In this work, we introduce RAGE, a novel real-time estimator that simultaneously infers the vehicle velocity, slip angles of the tires and the lateral forces that act on them, using only standard sensors, such as IMUs and RADARs, which are commonly available on most of modern autonomous platforms. We validate our approach through both high-fidelity simulations and real-world experiments conducted on the EAV-24 autonomous race car, demonstrating the accuracy and effectiveness of our method in estimating the vehicle lateral dynamics.

Davide Malvezzi, Nicola Musiu, Eugenio Mascaro +2

Vehicle DynamicsAutonomous RacingRobot State Estimation
AskPDF
Mar 30, 2026

Dynamic Lookahead Distance via Reinforcement Learning-Based Pure Pursuit for Autonomous Racing

Pure Pursuit (PP) is a widely used path-tracking algorithm in autonomous vehicles due to its simplicity and real-time performance. However, its effectiveness is sensitive to the choice of lookahead distance: shorter values improve cornering but can cause instability on straights, while longer values improve smoothness but reduce accuracy in curves. We propose a hybrid control framework that integrates Proximal Policy Optimization (PPO) with the classical Pure Pursuit controller to adjust the lookahead distance dynamically during racing. The PPO agent maps vehicle speed and multi-horizon curvature features to an online lookahead command. It is trained using Stable-Baselines3 in the F1TENTH Gym simulator with a KL penalty and learning-rate decay for stability, then deployed in a ROS2 environment to guide the controller. Experiments in simulation compare the proposed method against both fixed-lookahead Pure Pursuit and an adaptive Pure Pursuit baseline. Additional real-car experiments compare the learned controller against a fixed-lookahead Pure Pursuit controller. Results show that the learned policy improves lap-time performance and repeated lap completion on unseen tracks, while also transferring zero-shot to hardware. The learned controller adapts the lookahead by increasing it on straights and reducing it in curves, demonstrating effectiveness in augmenting a classical controller by online adaptation of a single interpretable parameter. On unseen tracks, the proposed method achieved 33.16 s on Montreal and 46.05 s on Yas Marina, while tolerating more aggressive speed-profile scaling than the baselines and achieving the best lap times among the tested settings. Initial real-car experiments further support sim-to-real transfer on a 1:10-scale autonomous racing platform

Mohamed Elgouhary, Amr S. El-Wakeel

Lane Department of Computer Science and Electrical Engineering, West Virginia University, Morgantown, WV, USA.

Autonomous RacingRL ControlFeedback Control
AskPDF
Mar 28, 2026

Autonomous overtaking trajectory optimization using reinforcement learning and opponent pose estimation

Vehicle overtaking is one of the most complex driving maneuvers for autonomous vehicles. To achieve optimal autonomous overtaking, driving systems rely on multiple sensors that enable safe trajectory optimization and overtaking efficiency. This paper presents a reinforcement learning mechanism for multi-agent autonomous racing environments, enabling overtaking trajectory optimization, based on LiDAR and depth image data. The developed reinforcement learning agent uses pre-generated raceline data and sensor inputs to compute the steering angle and linear velocity for optimal overtaking. The system uses LiDAR with a 2D detection algorithm and a depth camera with YOLO-based object detection to identify the vehicle to be overtaken and its pose. The LiDAR and the depth camera detection data are fused using a UKF for improved opponent pose estimation and trajectory optimization for overtaking in racing scenarios. The results show that the proposed algorithm successfully performs overtaking maneuvers in both simulation and real-world experiments, with pose estimation RMSE of (0.0816, 0.0531) m in (x, y).

Matej Rene Cihlar, Luka Šiktar, Branimir Ćaran +1

University of Zagreb, Zagreb 10000, Croatia, Faculty of mechanical engineering and naval architecture

Autonomous DrivingAutonomous RacingRL for Autonomous DrivingAutonomous Driving Perception
AskPDF
Mar 14, 2026

LPV-MPC for Lateral Control in Full-Scale Autonomous Racing

Autonomous racing has attracted significant attention recently, presenting challenges in selecting an optimal controller that operates within the onboard system's computational limits and meets operational constraints such as limited track time and high costs. This paper introduces a Linear Parameter-Varying Model Predictive Controller (LPV-MPC) for lateral control. Implemented on an IAC AV-24, the controller achieved stable performance at speeds exceeding 160 mph (71.5 m/s). We detail the controller design, the methodology for extracting model parameters, and key system-level and implementation considerations. Additionally, we report results from our final race run, providing a comprehensive analysis of both vehicle dynamics and controller performance. A Python implementation of the framework is available at: https://tinyurl.com/LPV-MPC-acados

Hassan Jardali, Ihab S. Mohamed, Durgakant Pushp +1

Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN 47408 USA

Model Predictive ControlAutonomous DrivingAutonomous RacingVehicle Dynamics
AskPDF
Mar 13, 2026

Efficient Real-World Autonomous Racing via Attenuated Residual Policy Optimization

Residual policy learning (RPL), in which a learned policy refines a static base policy using deep reinforcement learning (DRL), has shown strong performance across various robotic applications. Its effectiveness is particularly evident in autonomous racing, a domain that serves as a challenging benchmark for real-world DRL. However, deploying RPL-based controllers introduces system complexity and increases inference latency. We address this by introducing an extension of RPL named attenuated residual policy optimization (αα-RPO). Unlike standard RPL, αα-RPO yields a standalone neural policy by progressively attenuating the base policy, which initially serves to bootstrap learning. Furthermore, this mechanism enables a form of privileged learning, where the base policy is permitted to use sensor modalities not required for final deployment. We design αα-RPO to integrate seamlessly with PPO, ensuring that the attenuated influence of the base controller is dynamically compensated during policy optimization. We evaluate αα-RPO by building a framework for 1:10-scaled autonomous racing around it. In both simulation and zero-shot real-world transfer to Roboracer cars, αα-RPO not only reduces system complexity but also improves driving performance compared to baselines - demonstrating its practicality for robotic deployment. Our code is available at: https://github.com/raphajaner/arpo_racing.

Raphael Trumpp, Denis Hoornaert, Mirco Theile +1

Technical University of Munich, Munich, Germany

Residual Policy LearningAutonomous RacingLearning Using Privileged Information
AskPDF
Mar 10, 2026

Vision-Augmented On-Track System Identification for Autonomous Racing via Attention-Based Priors and Iterative Neural Correction

Operating autonomous vehicles at the absolute limits of handling requires precise, real-time identification of highly non-linear tire dynamics. However, traditional online optimization methods suffer from "cold-start" initialization failures and struggle to model high-frequency transient dynamics. To address these bottlenecks, this paper proposes a novel vision-augmented, iterative system identification framework. First, a lightweight CNN (MobileNetV3) translates visual road textures into a continuous heuristic friction prior, providing a robust "warm-start" for parameter optimization. Next, a S4 model captures complex temporal dynamic residuals, circumventing the memory and latency limitations of traditional MLPs and RNNs. Finally, a derivative-free Nelder-Mead algorithm iteratively extracts physically interpretable Pacejka tire parameters via a hybrid virtual simulation. Co-simulation in CarSim demonstrates that the lightweight vision backbone reduces friction estimation error by 76.1 using 85 fewer FLOPs, accelerating cold-start convergence by 71.4. Furthermore, the S4-augmented framework improves parameter extraction accuracy and decreases lateral force RMSE by over 60 by effectively capturing complex vehicle dynamics, demonstrating superior performance compared to conventional neural architectures.

Zhiping Wu, Cheng Hu, Yiqin Wang +2

State Key Laboratory of Industrial, Zhejiang University, Hangzhou 310027, China

Nonlinear System IdentificationVehicle DynamicsAutonomous RacingResidual Dynamics Learning
AskPDF
Mar 10, 2026

Robust Spatiotemporal Motion Planning for Multi-Agent Autonomous Racing via Topological Gap Identification and Accelerated MPC

High-speed multi-agent autonomous racing demands robust spatiotemporal planning and precise control under strict computational limits. Current methods often oversimplify interactions or abandon strict kinematic constraints. We resolve this by proposing a Topological Gap Identification and Accelerated MPC framework. By predicting opponent behaviors via SGPs, our method constructs dynamic occupancy corridors to robustly select optimal overtaking gaps. We ensure strict kinematic feasibility using a Linear Time-Varying MPC powered by a customized Pseudo-Transient Continuation (PTC) solver for high-frequency execution. Experimental results on the F1TENTH platform show that our method significantly outperforms state-of-the-art baselines: it reduces total maneuver time by 51.6% in sequential scenarios, consistently maintains an overtaking success rate exceeding 81% in dense bottlenecks, and lowers average computational latency by 20.3%, pushing the boundaries of safe and high-speed autonomous racing.

Mingyi Zhang, Cheng Hu, Yiqin Wang +3

Department of Control Science and Engineering, Zhejiang University. · Center for Project-Based Learning, D-ITET, ETH Zurich.

Autonomous RacingMulti-Robot Motion PlanningConstrained Motion PlanningModel Predictive ControlDynamic Obstacle Avoidance
AskPDF
Mar 7, 2026

Efficient Trajectory Optimization for Autonomous Racing via Formula-1 Data-Driven Initialization

Trajectory optimization is a central component of fast and efficient autonomous racing. However practical optimization pipelines remain highly sensitive to initialization and may converge slowly or to suboptimal local solutions when seeded with heuristic trajectories such as the centerline or minimum-curvature paths. To address this limitation, we leverage expert driving behavior as a initialization prior and propose a learning-informed initialization strategy based on real-world Formula1 telemetry. To this end, we first construct a multi-track Formula1 trajectory dataset by reconstructing and aligning noisy GPS telemetry to a standardized reference-line representation across 17 tracks. Building on this, we present a neural network that predicts an expert-like raceline offset directly from local track geometry, without explicitly modeling vehicle dynamics or forces. The predicted raceline is then used as an informed seed for a minimum-time optimal control solver. Experiments on all 17 tracks demonstrate that the learned initialization accelerates solver convergence and significantly reduces runtime compared to traditional geometric baselines, while preserving the final optimized lap time.

Samir Shehadeh, Lukas Kutsch, Nils Dengler +2

University of Bonn, Germany · Lamarr Institute for Machine Learning and Artificial Intelligence and the Center for Robotics, Bonn, Germany

Trajectory OptimizationAutonomous Racing
AskPDF
Mar 6, 2026

Expert Knowledge-driven Reinforcement Learning for Autonomous Racing via Trajectory Guidance and Dynamics Constraints

Reinforcement learning has shown significant potential for autonomous racing, but it still faces challenges such as training instability, inefficient exploration, and unsafe action outputs in high-dynamic racing scenarios. This paper proposes a Trajectory guidance and Dynamics constraints Reinforcement Learning (TraD-RL) framework for autonomous racing. The proposed method incorporates expert prior knowledge into policy learning through Minimum Curvature Racing Line (MCRL) guidance, explicit vehicle dynamics constraints, and two-stage curriculum learning. MCRL provides global path and velocity references through observation augmentation and reward shaping, thereby improving exploration efficiency and racing performance. Yaw rate and sideslip angle constraints are introduced to characterize the vehicle dynamic safe operating envelope, and the corresponding stability costs are incorporated into policy optimization through Lagrangian relaxation. Moreover, the two-stage curriculum learning strategy enables a progressive transition from stable trajectory following to high-speed performance exploration. Experiments on two racetracks demonstrate that TraD-RL improves racing performance while maintaining a favorable balance between speed and dynamic stability. Further analyses of ablation, sensitivity, and robustness validate the effectiveness and stability of the proposed framework.

Bo Leng, Weiqi Zhang, Zhuoren Li +4

College of Automotive and Energy Engineering, Tongji University, Shanghai, 201804, China · School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, 639798, Singapore

Constrained RLAutonomous Racing
AskPDF
Mar 2, 2026

(hu)Man vs. Machine: In the Future of Motorsport, can Autonomous Vehicles Compete?

Motorsport has historically driven technological innovation in the automotive industry. Autonomous racing provides a proving ground to push the limits of performance of autonomous vehicle (AV) systems. In principle, AVs could be at least as fast, if not faster, than humans. However, human driven racing provides broader audience appeal thus far, and is more strategically challenging. Both provide opportunities to push each other even further technologically, yet competitions remain separate. This paper evaluates whether the future of motorsport could encompass joint competition between humans and AVs. Analysis of the current state of the art, as well as recent competition outcomes, shows that while technical performance has reached comparable levels, there are substantial challenges in racecraft, strategy and safety that need to be overcome. Outstanding issues involved in mixed human-AI racing, ranging from an initial assessment of critical factors such as system-level latencies, to effective planning and risk guarantees are explored. The crucial non-technical aspect of audience engagement and appeal regarding the changing character of motorsport is addressed. In the wider context of motorsport and AVs, this work outlines a proposed agenda for future research to 'keep pushing the possible', in the true spirit of motorsport.

Armand Amaritei, Amber-Lily Blackadder, Sebastian Donnelly +5

Autonomous Driving and Intelligent Transport Group, Oxford Brookes University, UK · School of Engineering, Computing & Mathematics, Oxford Brookes University, UK · Artificial Intelligence, Data Analysis and Systems Institute, Oxford Brookes University, UK

Autonomous RacingAutonomous Driving Planning
AskPDF
Feb 27, 2026

Curriculum Reinforcement Learning for Quadrotor Racing with Random Obstacles

Autonomous drone racing has attracted increasing interest as a research topic for exploring the limits of agile flight. However, existing studies primarily focus on obstacle-free racetracks, while the perception and dynamic challenges introduced by obstacles remain underexplored, often resulting in low success rates and limited robustness in real-world flight. To this end, we propose a novel vision-based curriculum reinforcement learning framework for training a robust controller capable of addressing unseen obstacles in drone racing. We combine multi-stage cu rriculum learning, domain randomization, and a multi-scene updating strategy to address the conflicting challenges of obstacle avoidance and gate traversal. Our end-to-end control policy is implemented as a single network, allowing high-speed flight of quadrotors in environments with variable obstacles. Both hardware-in-the-loop and real-world experiments demonstrate that our method achieves faster lap times and higher success rates than existing approaches, effectively advancing drone racing in obstacle-rich environments. The video and code are available at: https://github.com/SJTU-ViSYS-team/CRL-Drone-Racing.

Fangyu Sun, Fanxing Li, Yu Hu +4

School of Automation and Perception, Shanghai Jiao Tong University, China · Faculty of Aerospace Engineering, Delft University of Technology, The Netherlands

Autonomous RacingAerial RoboticsDynamic Obstacle AvoidanceCurriculum RLVision-Based Robot ControlRobust RL
AskPDF
Feb 26, 2026

Learning-based Multi-agent Race Strategies in Formula 1

In Formula 1, race strategies are adapted according to evolving race conditions and competitors' actions. This paper proposes a reinforcement learning approach for multi-agent race strategy optimization. Agents learn to balance energy management, tire degradation, aerodynamic interaction, and pit-stop decisions. Building on a pre-trained single-agent policy, we introduce an interaction module that accounts for the behavior of competitors. The combination of the interaction module and a self-play training scheme generates competitive policies, and agents are ranked based on their relative performance. Results show that the agents adapt pit timing, tire selection, and energy allocation in response to opponents, achieving robust and consistent race performance. Because the framework relies only on information available during real races, it can support race strategists' decisions before and during races.

Giona Fieni, Joschua Wüthrich, Marc-Philippe Neumann +1

Autonomous RacingMulti-Agent Reinforcement Learning
AskPDF
Feb 25, 2026

UNet-Based Keypoint Regression for 3D Cone Localization in Autonomous Racing

Accurate cone localization in 3D space is essential in autonomous racing for precise navigation around the track. Approaches that rely on traditional computer vision algorithms are sensitive to environmental variations, and neural networks are often trained on limited data and are infeasible to run in real time. We present a UNet-based neural network for keypoint detection on cones, leveraging the largest custom-labeled dataset we have assembled. Our approach enables accurate cone position estimation and the potential for color prediction. Our model achieves substantial improvements in keypoint accuracy over conventional methods. Furthermore, we leverage our predicted keypoints in the perception pipeline and evaluate the end-to-end autonomous system. Our results show high-quality performance across all metrics, highlighting the effectiveness of this approach and its potential for adoption in competitive autonomous racing systems.

Mariia Baidachna, James Carty, Aidan Ferguson +7

School of Computer Science, University of Glasgow, G12 8QQ, UK · Amazon, Edinburgh, UK

Autonomous Racing
AskPDF
Feb 24, 2026

Environment-Aware Learning of Smooth GNSS Covariance Dynamics for Autonomous Racing

Ensuring accurate and stable state estimation is a challenging task crucial to safety-critical domains such as high-speed autonomous racing, where measurement uncertainty must be both adaptive to the environment and temporally smooth for control. In this work, we develop a learning-based framework, LACE, capable of directly modeling the temporal dynamics of GNSS measurement covariance. We model the covariance evolution as an exponentially stable dynamical system where a deep neural network (DNN) learns to predict the system's process noise from environmental features through an attention mechanism. By using contraction-based stability and systematically imposing spectral constraints, we formally provide guarantees of exponential stability and smoothness for the resulting covariance dynamics. We validate our approach on an AV-24 autonomous racecar, demonstrating improved localization performance and smoother covariance estimates in challenging, GNSS-degraded environments. Our results highlight the promise of dynamically modeling the perceived uncertainty in state estimation problems that are tightly coupled with control sensitivity.

Y. Deemo Chen, Arion Zimmermann, Thomas A. Berrueta +1

Department of Computing and Mathematical Sciences, California Institute of Technology, Pasadena, CA.

Covariance EstimationRobot State EstimationAutonomous Racing
AskPDF
Feb 20, 2026

Learning to Tune Pure Pursuit in Autonomous Racing: Joint Lookahead and Steering-Gain Control with PPO

Pure Pursuit (PP) is widely used in autonomous racing for real-time path tracking due to its efficiency and geometric clarity, yet performance is highly sensitive to how key parameters-lookahead distance and steering gain-are chosen. Standard velocity-based schedules adjust these only approximately and often fail to transfer across tracks and speed profiles. We propose a reinforcement-learning (RL) approach that jointly chooses the lookahead Ld and a steering gain g online using Proximal Policy Optimization (PPO). The policy observes compact state features (speed and curvature taps) and outputs (Ld, g) at each control step. Trained in F1TENTH Gym and deployed in a ROS 2 stack, the policy drives PP directly (with light smoothing) and requires no per-map retuning. Across simulation and real-car tests, the proposed RL-PP controller that jointly selects (Ld, g) consistently outperforms fixed-lookahead PP, velocity-scheduled adaptive PP, and an RL lookahead-only variant, and it also exceeds a kinematic MPC raceline tracker under our evaluated settings in lap time, path-tracking accuracy, and steering smoothness, demonstrating that policy-guided parameter tuning can reliably improve classical geometry-based control.

Mohamed Elgouhary, Amr S. El-Wakeel

The authors are with the Lane Department of Computer Science and Electrical Engineering, West Virginia University, Morgantown, WV, USA

Autonomous RacingAdaptive ControlRL ControlFeedback Control
AskPDF
Feb 17, 2026

Spatially-Aware Adaptive Trajectory Optimization with Controller-Guided Feedback for Autonomous Racing

We present a closed-loop framework for autonomous raceline optimization that combines NURBS-based trajectory representation, CMA-ES global trajectory optimization, and controller-guided spatial feedback. Instead of treating tracking errors as transient disturbances, our method exploits them as informative signals of local track characteristics via a Kalman-inspired spatial update. This enables the construction of an adaptive, acceleration-based constraint map that iteratively refines trajectories toward near-optimal performance under spatially varying track and vehicle behavior. In simulation, our approach achieves a 17.38% lap time reduction compared to a controller parametrized with maximum static acceleration. On real hardware, tested with different tire compounds ranging from high to low friction, we obtain a 7.60% lap time improvement without explicitly parametrizing friction. This demonstrates robustness to changing grip conditions in real-world scenarios.

Alexander Wachter, Alexander Willert, Marc-Philip Ecker +1

Automation & Control Institute (ACIN), TU Wien, Vienna, Austria · AIT, Austrian Institute of Technology GmbH, Vienna, Austria

Trajectory OptimizationAutonomous RacingConstrained OptimizationAdaptive Control
AskPDF
Sep 21, 2025

End2Race: An End-to-End Learning Framework for Multi-Vehicle Autonomous Racing

Autonomous racing serves as a compelling testbed for advancing autonomous vehicle systems. The 1/10-scale F1Tenth platform is widely adopted for education and research, with annual competitions held worldwide. Yet, leading solutions in these tournaments remain dominated by rule-based approaches. While learning-based methods have been proposed, they focus primarily on single-vehicle settings, leaving challenging multi-vehicle interactions largely unexplored. To address this gap, we introduce End2Race, an end-to-end learning framework designed for head-to-head autonomous racing. Using this framework, we develop a computationally efficient policy network that achieves an inference latency below 1 ms on an F1Tenth onboard computer. Extensive evaluations show that the policy generalizes to both novel tracks and unseen opponent behaviors, demonstrating high racing speeds, robust safety, and adaptive overtaking maneuvers. These results substantially outperform both prior learning-based methods and rule-based baselines. Codebase is available at https://github.com/michigan-traffic-lab/End2Race.

Zhijie Qiao, Haowei Li, Zhong Cao +1

Department of Civil and Environmental Engineering, University of Michigan, Ann Arbor, MI 48109, USA · University of Michigan Transportation Research Institute, Ann Arbor, MI 48109, USA

End-to-End Autonomous DrivingMulti-Agent ControlAutonomous Racing
AskPDF