Visual RL

RL: Reinforcement Learning

Overview

Visual reinforcement learning studies how agents can learn control policies from images, video, or other visual observations rather than relying on fully specified state variables. Common approaches include learning compact task-relevant representations, building predictive world models for planning, and improving exploration or reward signals when feedback is sparse. Methods are tested on settings such as DeepMind Control Suite, Atari, Procgen, MetaWorld, visual navigation, and robotic manipulation, with sim-to-real transfer an important goal. A central challenge is balancing sample and compute efficiency with robustness to visual distractions and shifts between training and deployment environments.

Latest papers

CardsList

67 papers7 papers in the last four weeks, down 12% on the four weeks before. 0.1% of all new papers.

  1. What Makes a Good Move? Learning to Act from Experience in Visual Worlds

    Nov 16, 2026Cehao Yang, Ziyi He, Jing Yi +2Policy LearningVisual RL

  2. DeRep: Learning Depth Representations for End-to-End Navigation in Cluttered Environments

    Nov 10, 2026Hanyu Jin, Kenji ShimadaRepresentation LearningRobot Navigation

  3. TwinBridge: Digital Twin-Driven Policy and Reward Transfer for Real-World Reinforcement Learning in Laboratory Robotics

    Nov 4, 2026Shu'ang Sun, Yibo Qiu, Haoliang Ye +5Robotic RLSim-to-Real Transfer

  4. Computer Vision Navigation for an Autonomous Vehicle Model Using Reinforcement Learning

    Oct 24, 2026Dinis Fernandes, Tiago Ribeiro, António Ribeiro +3RL for Autonomous DrivingRL Control

  5. Dynamics-Aligned Representation Learning under Induced Partial Observability

    Oct 18, 2026SM Mazharul Islam, Manfred HuberModel-Based RLRepresentation Learning for RL

  6. AgentGarten: Code Worlds for Evolving Agents

    Oct 8, 2026Jiawei Chi, Shangchen Miao, Zhiyuan Shi +12Self-Evolving AgentsNeural Rendering

  7. FOCUS: From Privileged States to RGB-D with Controlled Modality Switching and Representation Alignment

    Oct 8, 2026Filip Grigorov, Kourosh Darvish, Nandita VijaykumarRobotic RLVisual RL

  8. Directed Temporal Representations for Offline Visual Control

    Oct 6, 2026Chenyang Yuan, Haoyu Wang, Zhuo Sun +1Visual RLTrajectory Representation Learning

  9. Same Reward, Different Skills: When Multimodal RL Learns to Look

    Oct 1, 2026Haocun Ye, Xinlong Jiang, Qile Chen +6Reinforcement Learning with Verifiable RewardsVisual Grounding

  10. Disagreement-Regularized Imitation Learning for Image-Based Continuous Control with Gaussian and Beta Policies

    Sep 29, 2026Irving Giovani Bronzatti Petrazzini, Eric Aislan AntoneloImitation LearningBehavior Cloning

  11. SCA: Spatial Credit Assignment for Reinforcement Learning of GUI Agents

    Sep 29, 2026Shengtian Yang, Ziyu Xiong, Kaibing Yang +6Reinforcement LearningRL for GUI Agents

  12. StarWM: Self-Supervised Trained Attention Routing for Robust World Models

    Sep 25, 2026Zeqiang Zhang, Fabian Wurzberger, Maximilian Otte +4Attention RoutingWorld Model Learning

  13. Intrinsic Robot Rewarding: Reusing VLA Representations for Autonomous Evaluation and Policy Improvement

    Sep 15, 2026Tobias Schaffer, Mohab Elkhayat, Daniela Nicklas +2RL for RoboticsIntrinsic Reward Methods

  14. LettuceVisSim: A Simulator That Generates Lettuce Image Time-series for Vision-Based Reinforcement Learning

    Sep 11, 2026Ziye Zhu, Bert van 't Ooster, Congcong Sun +2Synthetic Data GenerationImage Generation

  15. Learning to Fly: Stable Vision-Guided UAV Servoing with Compact Target-Centric Cues and Reinforcement Learning

    Sep 7, 2026Saurbh Singh Jamwal, Nived ChebroluVision-Based Robot ControlAerial Robotics

  16. Selective Agent Guidance via Entropy: Learning Autonomous Policies from Imperfect VLM Teachers

    Sep 1, 2026Giovanni Bonetta, Matteo Merler, Davide Zago +2Uncertainty SamplingVisual RL

  17. Integrating Novelty and Surprise for Experience Prioritization and Exploration in Image-Based Reinforcement Learning

    Aug 18, 2026Hoda Yamani, Henry Williams, Bruce A. MacDonaldPrioritized Experience ReplayReinforcement Learning

  18. FLEET: Token-Based Feature Extraction for Event Camera-based Reinforcement Learning

    Aug 17, 2026Tristan Gottwald, Maximilian Schier, Melanie Schaller +1Representation Learning for RLEvent-Based Vision

  19. Graph Neural Assisted Actor-Critic for Latency-Efficient Edge Vision System

    Aug 17, 2026Alam Noor, Luis Almeida, Kai Li +3Aerial RoboticsEdge Computing

  20. V-Simba: Unleashing the Architectural Potential of RL in Visual Continuous Control

    Aug 8, 2026Donghu Kim, Youngdo Lee, Hojoon Lee +6Reinforcement LearningVisual RL

  21. Aftab: A Progressive Design Study of Visual Encoders and Value Estimation for Replay-Free Parallelized Q-Learning

    Aug 7, 2026Taha Shieenavaz, Shabnam Zareshahraki, Loris NanniDeep Q-LearningQ-Learning

  22. TaskSense: Focusing on What Matters in World Models

    Aug 6, 2026SM Mazharul Islam, Manfred HuberWorld Model LearningWorld Models

  23. Observation-Grounded Self-Predictive Reinforcement Learning for Visual Continuous Control

    Aug 6, 2026Xinwei Liu, Junyuan Liang, Jianting Zhang +1Predictive Representation LearningContinuous Control

  24. Anticipatory Risk-Guided Reinforcement Learning for Safe Flight Through Dynamic Clutter

    Jul 26, 2026Yuchao Mei, Guohao Zhang, Luxia Ai +2Collision AvoidanceRisk-Sensitive RL