AVD: A Multi-Sensor Teleoperated Wheelchair Platform with Safety-Aware Control
Organizations: Indian Institute of Technology Madras, Chennai 600036, India · Department of Electrical Engineering, Indian Institute of Technology Madras, Chennai 600036, India
Abstract
Electric wheelchairs predominantly rely on manual joystick interfaces, which present critical barriers to independent mobility for individuals with severe motor and visual impairments. This paper presents AVD (Autonomous Vehicle Drive), a dependable teleoperation architecture for assistive mobility that unifies perception, communication, embedded control, and remote supervision in a single low-cost platform built entirely from commercially available hardware. The central engineering contribution is a safety-oriented design framework: control authority follows a static hierarchy, a manual emergency stop and the occupant's joystick pre-empt remote commands, and the on-board sensing layer has stop-only authority. The compute design partitions primary and safety functions and specifies a heartbeat-driven safe-state transition for the fault cases considered. The sensing stack this framework depends on is characterized against measured data: per-channel acquisition latency, a 2,025-scan LiDAR degradation campaign spanning five target configurations and a control under water mist, airborne dust, and direct aperture occlusion, and attitude measurements across static inclines to 47 degrees. The lowest pooled environmental-condition mean retained 76.6% of the clear-baseline forward-sector yield, and no scan lost the sector completely. A logged vibration-induced inertial dropout occurred while LiDAR and camera logging continued, illustrating complementary channel behavior. The result is a documented prototype and an explicit validation path for a deployable wheelchair implementation.
Figures & tables
| System | Operating paradigm | Sensing capability | Remote teleop. with live feedback | Safety and fault tolerance | Validation reported | Open source |
|---|---|---|---|---|---|---|
| [ 8 ] | Assisted autonomy | LiDAR, IMU, odometry, ultrasonic | None | Obstacle priority over user intent | 100% obstacle accuracy, prepared indoor scenes | No |
| [ 9 ] | Head-motion control | Head-worn inertial unit | None | Not reported | 90% directional accuracy at ; 1.87 km/h | No |
| [ 10 ] | Autonomous docking | LiDAR and vision | None | Not reported | Docking gap below 5 mm | No |
| [ 11 ] | Shared control | LiDAR and depth camera | None | Shared-control arbitration | Built-environment user trials | No |
| [ 12 ] | IoT multi-mode control | Gesture, GPS, inertial, LiDAR, environmental | App control, no live video | Not reported | Indoor functional evaluation | Not reported |
| [ 13 ] | Multi-mode intelligent wheelchair | Camera and indoor navigation sensors | Yes, camera feedback | User and caregiver priority ordering | Functional comparison of five operating modes | Not reported |
| Fault | Detection | Safe-state response | Status |
|---|---|---|---|
| Camera channel loss | Frame staleness at primary controller | Front-feed loss inhibits teleoperation; auxiliary-feed loss raises an alert; occupant control remains available | Specified |
| LiDAR loss | Scan staleness | Remote motion stops; occupant control remains available; alert raised | Specified |
| Inertial loss | Sample-gap watchdog, | Tip-hazard alerting suspended; teleoperator alerted | Fault observed; response specified † |
| Link loss or stale command | Sequence number and heartbeat timeout at safety controller | Neutral at ms, brake at ms | Specified |
| Primary controller crash, hang, or frozen process | missed 100 ms heartbeats ( ) | Motors disabled, servo centred, brake held, fault indicated | Specified |
| Safety controller crash or power loss | External watchdog and normally deasserted motor enable (required) | Drive de-energizes if enable drops; a frozen-high output remains a design gap | Design gap |
| Channel | Interface | Mean | Med. | SD | Rate | B/w | |
|---|---|---|---|---|---|---|---|
| (ms) | (ms) | (ms) | (Hz) | (kB/s) | |||
| Inertial | I 2 C, 400 kHz | 100 | 6.801 | 6.705 | 0.256 | 147.0 | 2.06 |
| LiDAR | USB serial | 30 | 89.744 | 89.674 | 0.270 | 10.78 | 23.2 |
| Camera | CSI (MIPI) | 20 | 48.028 | 49.871 | 7.075 | 20.8 | 890 |
| Scans | Index | Raw | Median | |
|---|---|---|---|---|
| (%) | (%) | (%) | ||
| By environmental condition, normalized to the clear baseline | ||||
| Clear baseline (reference) | 1136 | 100.0 | 76.58 | 77.78 |
| Water mist | 222 | 95.9 | 73.45 | 72.73 |
| Airborne dust | 116 | 92.6 | 70.93 | 70.45 |
| Occluded aperture (film) | 551 | 76.6 | 58.64 | 56.52 |
| Scenario | Roll ( ∘ ) | Pitch ( ∘ ) | LiDAR valid (%) |
|---|---|---|---|
| Flat, stationary | 68.2 | ||
| Static incline, nose-up | 73.6 | ||
| Static tilt, right | 64.8 | ||
| Moving, flat | 71.6 | ||
| Moving, inclined | 70.7 | ||
| Moving, rough | 74.8 |
Assistive Robotics
Assistive robotics develops robots and wearable devices that support mobility, daily activities, rehabilitation, and care.
See all 223 papers