cs.RONov 16, 2026

AVD: A Multi-Sensor Teleoperated Wheelchair Platform with Safety-Aware Control

Authors: Namai Chandra, Madhur Thareja, Boby George

Organizations: Indian Institute of Technology Madras, Chennai 600036, India · Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai 600036, India

Abstract

Electric wheelchairs predominantly rely on manual joystick interfaces, which present critical barriers to independent mobility for individuals with severe motor and visual impairments. This paper presents AVD (Autonomous Vehicle Drive), a dependable teleoperation architecture for assistive mobility that unifies perception, communication, embedded control, and remote supervision in a single low-cost platform built entirely from commercially available hardware. The central engineering contribution is a safety-oriented design framework: control authority follows a static hierarchy, a manual emergency stop and the occupant's joystick pre-empt remote commands, and the on-board sensing layer has stop-only authority. The compute design partitions primary and safety functions and specifies a heartbeat-driven safe-state transition for the fault cases considered. The sensing stack this framework depends on is characterized against measured data: per-channel acquisition latency, a 2,025-scan LiDAR degradation campaign spanning five target configurations and a control under water mist, airborne dust, and direct aperture occlusion, and attitude measurements across static inclines to 47 degrees. The lowest pooled environmental-condition mean retained 76.6% of the clear-baseline forward-sector yield, and no scan lost the sector completely. A logged vibration-induced inertial dropout occurred while LiDAR and camera logging continued, illustrating complementary channel behavior. The result is a documented prototype and an explicit validation path for a deployable wheelchair implementation.

Figures & tables

Explore similar work

Jul 7, 2026

Towards Real-World Applications with an Autonomous Powered Wheelchair

Wheelchair users call for assistive mobility systems that provide active support, adapt to dynamic environments, and are intuitive and user-friendly. However, powered wheelchairs typically still provide limited autonomy and lack effective integration with advanced perception and navigation capabilities, particularly in complex real-world environments. This paper presents a preliminary study toward autonomous powered wheelchairs for real-world assistive mobility. We introduce a proof-of-concept prototype that integrates autonomous perception, gesture-based interaction, and navigation on a commercially available self-balancing powered wheelchair. The proposed system builds upon Genny Zero, a commercial self-balancing wheelchair that enables hands-free and intuitive operation through body-weight shifting. To extend its capabilities toward autonomous operation, we integrate an RGB-D camera for human-aware perception and interaction, together with a LiDAR sensor for localization and navigation. We demonstrate the integrated system in two assistive applications: (i) hailing, allowing users to call the wheelchair from a distance; and (ii) people-following, where the wheelchair follows a person using leader-follower strategies, including a constrained indoor navigation example. The results highlight the potential of combining autonomous robotics with assistive mobility platforms, while also showing the feasibility of the proposed integration and identifying the main technical challenges that must be addressed before moving toward user-ready, accessible, and intelligent mobility solutions. A video demonstrating the experimental setup and results is available at: https://youtu.be/LVAix_Qx7bM.
Oct 15, 2026

ChairNav: Cross-Embodiment Pre-training and Personalization for Long-Horizon Wheelchair Navigation

Developing autonomous electric wheelchairs capable of long-horizon sidewalk navigation is critical for accessible personal mobility, yet existing approaches either focus on indoor map-based navigation or rely on expensive, complex sensor stacks to achieve full autonomy. In this work, we propose to tackle outdoor sidewalk navigation by leveraging visual navigation foundation models and large-scale navigation datasets, which offer strong generalization using lightweight hardware. To this end, we present ChairNav, a novel framework that adapts a general visual navigation model into a personalized electric wheelchair navigation system using a three-stage data pyramid. To address the scarcity of in-domain data, ChairNav first pre-trains on large-scale cross-embodiment datasets transformed into the wheelchair domain, followed by mid-training on a small number of wheelchair demonstrations to eliminate remaining domain gaps. Finally, a post-training stage refines the deployed model from user interventions to personalize its behavior. We deploy ChairNav on a commercial electric wheelchair equipped with an RGB-D camera and an onboard NVIDIA Jetson compute module. Experimental results validate the effectiveness of each stage in our data pyramid: pre-training reduces lateral ADE by 18%, and post-training increases the mean distance between user interventions from 29.2 m to 57.4 m. Further evaluation on kilometer-scale urban sidewalk routes shows that our system operates autonomously for 93.4% of total driving time, demonstrating its potential for everyday accessible mobility. Demo video and more details are at https://vail.cs.ucla.edu/ChairNav/.
Mar 14, 2026

SAATT Nav: a Socially Aware Autonomous Transparent Transportation Navigation Framework for Wheelchairs

While powered wheelchairs reduce physical fatigue as opposed to manual wheelchairs for individuals with mobility impairment, they demand high cognitive workload due to information processing, decision making and motor coordination. Current autonomous systems lack social awareness in navigation and transparency in decision-making, leading to decreased perceived safety and trust from the user and others in context. This work proposes Socially Aware Autonomous Transparent Transportation (SAATT) Navigation framework for wheelchairs as a potential solution. By implementing a Large Language Model (LLM) informed of user intent and capable of predicting other peoples' intent as a decision-maker for its local controller, it is able to detect and navigate social situations, such as passing pedestrians or a pair conversing. Furthermore, the LLM textually communicates its reasoning at each waypoint for transparency. In this experiment, it is compared against a standard global planner, a representative competing social navigation model, and an Ablation study in three simulated environments varied by social levels in eight metrics categorized under Safety, Social Compliance, Efficiency, and Comfort. Overall, SAATT Nav outperforms in most social situations and equivalently or only slightly worse in the remaining metrics, demonstrating the potential of a socially aware and transparent autonomous navigation system to assist wheelchair users.