Reactive collision avoidance in unknown, cluttered environments must perceive obstacles and correct motion within milliseconds. Existing methods rely on maps for high-rate collision queries, but their acceleration structures require pre- processing. That cost is amortized in long-horizon planning, where a map serves millions of queries; reactive planning, however, is a near-field, short-horizon problem with potentially only hundreds of queries per measurement, where building a map may not pay off. We propose a mapless, Graphics Processing Unit (GPU)-accelerated Euclidean Signed Distance Field (ESDF) query with negligible pre-processing that operates directly on posed depth images, with resolution set by pooling the image rather than by a voxel size. On an embedded GPU it is simultaneously more accurate and lower in total latency than every voxel-grid configuration we measured between 2 cm and 20 cm, at one to two orders of magnitude less memory at matched resolution. With our query integrated into a Model Predictive Controller (MPC), simulated runs in laser-scanned forests at up to 9 m/s collide in 0.4 % through dense branches, against 5.9 % with the best voxel grid and 5.5 % with the best mapless baseline at our resolution, whose failures we attribute to voxel resolution and total latency respectively. We deploy the system onboard at two forest sites and fly at commanded speeds of up to 4 m/s.
Figures & tables
Fig. 1 : We represent the environment as a set of posed depth images It and compute distances and gradients for a query in every image in parallel before merging them. The dense field in the background is illustrative only, since we evaluate the field at query points alone, and all algorithms work in 3D although we draw in 2D.
Fig. 2 : The robot’s surroundings divide into known free space F , the observed surface O , and unknown space U , and our representation lives in the image space of camera frame Ct .
Fig. 3 : Single-frame query and merging. (a) The truncation sphere of radius rmax around q projects to a box of pixels, and only the blocks it covers are searched. (b) Of these, a block is active when its stored depth range intersects [qz−rmax,qz+rmax] , and all other blocks are skipped. (c) Occlusion boundaries as ray segments from a pixel’s depth to that of its neighbor nearest to q , searched within dopti(q) for dcons(q) . (d) Max-pooling of ϕt(q) across views in the three cases of Sec. III-D , with only U views at q1 , mixed views at q2 , and only F views at q3 .
Fig. 4 : Benchmarks on the Orin NX with N=1 frame in (a) and N=5 in (b) and (c). (a) Median absolute distance error against a full-resolution reference, over voxel size for the grids and as dashed lines for our pooling levels p , whose coarse settings match the finest grid. (b) Total latency of 400 queries from the start of the last integration to the last answer, where every pooling level of ours lies below the fastest grid. (c) Total latency over the number of queries at each method’s finest setting (solid) and at 10cm or the matching pooling level (dashed). (d) Map memory over the integrated frames. ∗ FIESTA runs at 5cm at its finest setting, all other voxel grids at 2cm .
Fig. 5 : (a) Collision rate over commanded speed (lockstep- onboard ) at each method’s finest flyable setting (solid, NVBlox at 5cm ) and at about 10cm (dashed), blue for conservative and red for optimistic methods, ours at most 2% . (b) Branches and (c) trunks of a laser-scanned forest.
Figure 6
Fig. 8 : Our p=1 query blocked for ℓ after each measurement (lockstep- delayed ). Stops rise from 50ms on.
Fig. 9 : (a) Collision rate on noisy D455 depth over odometry noise of kcm and 0.1k\SIUnitSymbolDegree RMS, with and without the margin. The band spans the speeds. (b) The queried ESDF around 3D-printed letters, without (top) and with margin (bottom).
Fig. 10 : (a) Five trajectories per site, colored by speed, with the reference in blue and the onboard point cloud in gray. Line and point width encode height above ground. The MAV at several instants of a run through (b) the branches and (c) the trunks, with an approximate reference in blue.
Fig. 11 : Onboard latency from measurement to released plan over the 1240 planning loops of the ten flights, with N=5 and p=4 . Boxes span the quartiles, whiskers the 5th to 95th percentile, and stacked bars the median per stage.
UC San Diego, La Jolla, USA · Electrical and Computer Engineering Department, UC San Diego, 9500 Gilman Dr, La Jolla, 92093, CA, USA. · Shield AI, San Diego, USA +1