Causal inference has emerged as a powerful paradigm enabling robots to make safe, efficient decisions by reasoning about the ``why'' behind events. However, its real-world application is hindered by the difficulty of collecting causal data, especially in human-populated environments where training takes time, while users expect immediate operation. To this end, we tackle the challenge of transferring simulation-learnt causal relations to the real world with minimal effort. While retaining the invariant high-level causal structure, we empirically demonstrate the system adapts efficiently to real-world situations by updating only the causal model parameters with a limited set of new observations. Our results show that the parameter update enables rapid sim-to-real transfer. The framework runs efficiently onboard of a mobile robot and significantly outperforms a non-causal baselines navigating successfully and safely in complex human-shared scenarios.
Figures & tables
Figure 1: Framework overview.
Figure 2: Causal framework: A rapid sim-to-real adaptation calibrates only the conditional probability parameters (green vs. blue histograms), preserving the causal model learned in simulation and enabling efficient robot deployment.
Figure 4: [Left] Retrieved causal model with context (red) and system (green) variables; edge thickness/borders mark dependency strength, and numbers show time lags ( 0 if unlabelled). [Right] TIAGo avoiding an unexpected obstacle.
Figure 5: Navigation performance across 200 trials per method in the simulated Conference (a) and Airport (b) environments. (Top) Success and failure distributions for base, social, and causal planners. (Bottom) Human-robot proxemic compliance distributions across Hall’s proxemic zones Hall et al. (1968) : Intimate (red), Personal (orange), Social (blue), and Public (green).
Figure 6: MAE of Bayesian and causal battery predictions for varying obstacle probabilities.
Figure 7: Real-world experiments: (a) parameter update setup, (b) S1 corridor, and (c) S2 area. In each navigation column: [Top] Task map with Start (S) and Goal (G). [Middle] The baseline planner fails by cutting through crowded areas (blue paths). [Bottom] The causal planner anticipates congestion and takes an unobstructed detour.
Figure 8: [Top] Real-world proxemic compliance across Hall’s zones Hall et al. (1968) : Intimate, Personal, Social, and Public. [Bottom] Density prediction MAE ( D^ vs. D ) across sampling rates.
Causality in robotics aims to produce more interpretable and flexible robot behaviours by enabling robots to predict the consequences of their actions; however, deploying causal models with existing systems (e.g., navigation) operating in real environments remains understudied. This paper addresses the challenging problem of transferring causal models in real-robot experiments for a navigation scenario. We study this problem in two ways: (i) using the causal model as an offline evaluation module that predicts the competence of recorded real-robot navigation trajectories and relates it to quantitative navigation performance, and (ii) using the causal model as an online adaptation module that intervenes when the predicted competence of the default navigation is low. We validate our approach in a physical service robot that patrols around corridors. We show that the predicted competence correlates positively with path efficiency, and negatively with path irregularities (suboptimal behaviour). The model predictions also show strong agreement with human annotations (Cohen's kappa value of 0.88). In online experiments, the proposed method improves navigation performance in complex scenarios such as cornering and obstacle avoidance, yielding higher predicted competence and better navigation metrics than the default navigation baseline. In simpler scenarios, where the baseline already performs near-optimally, the causal adaptation provides limited benefit. These results indicate that causal models are particularly effective in enhancing navigation under increased task complexity. Overall, our results demonstrate that causal models developed for behavioural interpretation can be successfully integrated into real-robot navigation systems.
Zhitao Liang, Alex Mitrevski, Emmanuel Dean +1
Division for Systems and Control, Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden
Deploying robots in human-shared environments requires deciding not only how to navigate, but also when dedicated social signals are worth emitting. Classic observation-based inference can be misleading in such settings: confounding factors may bias the estimated relationship between a signal and the task outcome, leading to incorrect decisions. Causal inference provides a framework for disentangling these relationships by modelling the mechanisms linking observations, actions, and outcomes, and by estimating interventional effects after accounting for confounding paths. We study a human-robot interaction scenario in a corridor and use a causal model to estimate whether a social navigation signal causally improves transit success. We represent the interaction as a causal DAG involving robot action, pedestrian occupancy, available space, task outcome, and a controlled confounder (static obstacles). We compare the interventional estimate with the observational estimate obtained by conditioning only on the robot action, which does not explicitly model interventions. Our results show that accounting for confounding variables can reverse the conclusions drawn from naive observational analysis: the observational estimate wrongly suggests that the social signal is detrimental, whereas the causal estimate shows that it is beneficial. This discrepancy highlights how failing to account for confounding can lead to incorrect conclusions and demonstrates the importance of causal models for context-aware signalling decisions in social robot navigation.
Francesco Baldo, Luca Castri, Gloria Beraldo +1
Department of Information Engineering, University of Padua · Institute of Cognitive Sciences and Technologies, National Research Council of Italy
Generalizable embodied manipulation remains difficult to achieve through pretraining alone, due to unseen physical conditions in the real world. We argue that robots need to learn from their own physical interactions on the fly during real-world deployment and use this knowledge to inform subsequent actions. We present Zeva, the first framework that enables in-context learning from a robot's own physical interaction experience while keeping the policy model frozen. Zeva employs a Causal Interaction Extractor to encode an executed action and its induced state change into a causal interaction signal, which is stored in a dual-timescale causal memory. For subsequent actions, relevant causal interaction signals are retrieved from memory and injected into the frozen policy model as context. Experiments in simulation and real-world manipulation demonstrate that Zeva achieves the best performance among the compared frontier VLAs and WAMs and, more importantly, enables self-evolution during deployment without gradient updates. Its success rate continues to improve as the robot accumulates interaction experience. Furthermore, the acquired interaction experience can generalize across tasks.
Fu Chen, Xin Ding, Bingjia Huang +8
Institute for AI Industry Research (AIR), Tsinghua University