Navigating crowded urban environments requires robots to avoid pedestrians while adhering to social norms such as remaining on sidewalks. Existing approaches typically address either crowd avoidance or semantic path planning in isolation. We propose a reinforcement learning (RL) navigation policy that jointly reasons about semantic terrain and dynamic obstacles from a single semantically annotated bird's-eye-view (BEV) map, without relying on explicit human-state estimation. Our policy outperforms established crowd-navigation and semantic-aware baselines and transfers zero-shot to a legged robot, demonstrating socially compliant navigation in highly dynamic real-world scenarios.
Figures & tables
Figure 1: Real-world crowd navigation while following semantic clues with ANYmal-D. The policy avoids pedestrians that repeatedly cross the robot’s path while also adhering to the underlying semantic structure of the terrain. The robot-centric BEV maps (insets) show how semantics and dynamic obstacles are perceived. The commanded forward velocity (bottom) demonstrates the policy slowing down for approaching pedestrians, briefly reversing to avoid a collision.
Figure 2: Overview of our framework. (a) Training in procedurally generated environments with semantic terrain of varying risk, static obstacles, and SFM-driven pedestrians. (b) The actor observes a robot-centric semantic BEV map, proprioception, and the target vector. (c) CNN and MLP encoders feed a Gaussian action head. (d) A frozen locomotion policy tracks the generated velocity command. (e) PPO training with the rewards in Table 2 and an asymmetric critic with privileged observations (Table 1 ).
Table 3
Figure 3: Training environment: 4×8 tiles of 30×30 m with free paths , penalized low-risk and terminal high-risk semantic patches, static obstacles , SFM-driven pedestrians with walking direction , and robots sharing the terrain with recent paths .
Figure 4: Simulation snapshots. (a)–(d) Avoidance maneuvers in the benchmark settings. Past robot positions demonstrate how the policy navigates around crowds and static obstacles, while adhering to semantically traversability clues. (i)–(iv) Temporal sequence showing how the policy passes an oncoming group in a corridor bounded by high-risk terrain. t0 marks the closest approach. The inserts show the 5×5 m BEV observation of the policy (forward is up).
Robots navigating among pedestrians typically sense their surroundings with a 2D LiDAR mounted close to the ground. At that height, the sensor mostly sees moving legs rather than whole people, yet most learning-based navigation methods still treat pedestrians as simple shapes like circles. This paper addresses that gap with CALF (Convolutional Attention for Leg Features), an end-to-end neural architecture that combines convolutional layers, attention, and MLP to interpret leg motion directly from LiDAR scans and produce safe navigation commands. The CALF policy is trained using deep reinforcement learning algorithms within LegNav, a custom lightweight 2D simulator that combines 2D LiDAR ray tracing with a novel pedestrian gait model. The resulting policy is compared against classical and learning-based baselines in terms of navigation performance and social compliance. The approach is validated through real-world experiments via zero-shot deployment on a TurtleBot 4, yielding smooth and socially compliant trajectories. Written in JAX, the LegNav simulator enables the training of a deployment-ready CALF policy in under an hour on a single consumer GPU.
Alberto Vaglio, Andrea Garulli, Antonio Giannitrapani +2
Department of Information Engineering and Mathematics, University of Siena, Siena, Italy · Uninettuno University, Rome, Italy
Training robust social-navigation policies requires simulators with diverse scene layouts, terrain, and human motion, but constructing such environments and specifying pedestrian behavior is costly. We propose an efficient pipeline that converts ordinary monocular walking videos directly into closed-loop social-navigation training environments in the policy's state space. Our key observation is that local social navigation primarily depends on two types of information: where the robot can traverse and how nearby pedestrians move. We therefore represent the static scene as a metric traversability map, which can be rigidly transformed under counterfactual robot motion, while directly replaying the pedestrian trajectories recovered from the video over time. This abstraction allows us to define the forward dynamics directly in the policy's state space and efficiently simulate counterfactual robot states without reconstructing or rendering photorealistic observations. The resulting policy achieves 81.2% success in the independent Arena benchmark, compared with 75.0% for the strongest baseline, and succeeds in 19/20 real-robot trials without policy fine-tuning. Project page: https://jiaming.im/VideoSocNav
Jiaming Wang, Duc Thang Nguyen, Jizhuo Chen +4
National University of Singapore, Singapore · Singapore Management University, Singapore · The Chinese University of Hong Kong, Hong Kong SAR, China +1
Offline reinforcement learning (RL) holds significant potential for crowd robot navigation in human-robot coexistence applications. However, the inherent complexity of pedestrian motion renders the design of effective reward functions for promoting socially compliant robot behaviors a persistent challenge. This paper proposes a Social Preference Learning for Crowd Robot Navigation (SPLC) algorithm to eliminate the need for detailed reward design. Its core innovation lies in the introduction of a social preference feedback mechanism to automatically generate preference data through principled preference evaluation criteria. By explicitly accounting for the intricacies of pedestrian dynamics, the pipeline mitigates the reward bias and facilitates the systematic quantification of broad social norms, thereby fostering socially compliant behaviors. Extensive experiments integrating SPLC with offline RL methods demonstrate consistent improvements over state-of-the-art baselines across standard performance metrics. Furthermore, real-world experiments on the TurtleBot4 further validate the effectiveness of SPLC in practical human-robot coexistence settings. Our code and video demos are available at https://github.com/sklus949/SPLC.
Zixuan Chen, Hao Fu, Haiwen Hu +1
Wuhan University of Science and Technology, Wuhan, China · School of Computer Science and Technology, Wuhan University of Science and Technology and also with the Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan 430081, China