In-Situ Reconstruction of the International Space Station Using 3D Gaussian Splatting and Astrobee
Authors: Hudson Kim, Ryan Soussan, Brian Coltin, Jordan Kam
Organizations: Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, Berkeley, CA 94720, USA. · Intelligent Robotics Group (KBR Inc.), NASA Ames Research Center, Moffett Field, CA 94035, USA. · Graduate Aerospace Laboratories, California Institute of Technology, Pasadena, CA, 91125, USA.
This article presents a novel 3D reconstruction and mapping of the interior of the International Space Station (ISS) using 3D Gaussian Splatting (3DGS). Using existing grayscale images from the Astrobee free-flying robot dataset, we construct a full 3D splat of the ISS' Kibō or Japanese Experiment Module (JEM). 3DGS has in recent years shown promise in providing novel view synthesis of scenes captured from many images or videos, this article applies this approach to human spaceflight systems. We compare our 3DGS architecture to existing methods such as Nerfacto and TensoRF and show that reconstruction improves the state-of-the-art in both scene quality and rendering speed. We show that with as little as 500 in-situ images, a high-fidelity map can be constructed using Astrobee's Navigation Camera (NavCam) during free-flight in the JEM. These reconstructions could enable free-flyers to rapidly create and update interior maps for intra-vehicular habitats like the ISS.
Figures & tables
Fig. 1: Astrobee inside the ISS JEM Module with grayscale images and depth renders from in-situ NavCam images [ 5 , 4 ] .
Fig. 2: Pipeline Diagram. Five Astrobee survey flights are filtered to 5,000 frames. COLMAP takes these images and identifies features. GLOMAP uses these features to simultaneously recover cameras poses and a 3D point cloud. The SfM data is then used as priors for the 3DGS map to be created while adaptive density control ensures that the correct number of Gaussians are used and a learned appearance embedding accounts for lighting differences.
Fig. 3: Four novel views of the ISS Module corridor, Airlock hatch, Crew workstation, and Cargo stowage and their depth map from our 3DGS model.
% of imgs
SfM
Train
Total
PSNR ↑
SSIM ↑
LPIPS ↓
100% (4,375)
5.0 h
47 m
5.8 h
31.19
0.918
0.208
50% (2,189)
1.7 h
46 m
2.5 h
31.08
0.918
0.208
25% (1,095)
57 m
47 m
1.7 h
30.93
0.916
0.208
12.5% (549)
30 m
46 m
1.3 h
30.04
0.908
0.208
6.25% (277)
22 m
46 m
1.1 h
28.27
0.886
0.207
3.125% (140)
18 m
44 m
1.0 h
25.25
0.831
0.227
TABLE I: Evaluation of the effect the number of images has on reconstruction quality and overall timing.
Iterations
PSNR ↑
SSIM ↑
LPIPS ↓
Training Time
15,000
25.29
0.836
0.305
7.4 m
30,000
20.61
0.716
0.410
16.2 m
45,000
29.10
0.902
0.228
24.3 m
60,000
30.09
0.911
0.217
32.0 m
75,000
30.89
0.916
0.211
39.0 m
90,000
31.19
0.918
0.208
45.6 m
TABLE II: Evaluation of the effect the number of training iterations has on reconstruction quality and training time.
Fig. 4: Comparison with Splatfacto, Nerfacto, Instant-NGP, and TensoRF.
Micro aerial vehicles (MAVs) enable rapid indoor 3D reconstruction for inspection and time-critical situational awareness, but must operate under strict flight-time budgets and safety constraints that require explicit return-to-home (RTH) feasibility with a conservative margin. We present a topology-first active reconstruction framework that decouples high-fidelity rendering from navigation. A dense 3D Gaussian Splatting (3DGS) map is optimized as the reconstruction target, while a lightweight Truncated Signed Distance Field (TSDF)/occupancy scaffold supports conservative collision checking and online construction of a sparse 3D Voronoi skeleton roadmap. Since directly extracting roadmaps from TSDF geometry can be unstable under noisy and incomplete online fusion, we validate nodes and edges using carved free-space consistency and dense visibility checks, which suppress behind-wall phantom structure and stabilize planning. Viewpoints are selected on the roadmap using a flight-time-budget-aware objective and a lightweight receding-horizon lookahead to improve non-myopic exploration behavior. We evaluate on photorealistic indoor simulation benchmarks (ReplicaCAD, Gibson, and HM3D), reporting reconstruction coverage/error, RTH success, and computational cost. Results demonstrate improved or competitive performance relative to recent GS-based baselines under identical flight-time budgets.
Feed-forward 3D Gaussian Splatting methods reconstruct a scene from posed or pose-free images in a single forward pass, yet current approaches predict one Gaussian per input pixel, tying the representation budget to camera resolution rather than scene complexity. A flat wall and a richly textured object thus produce equally many Gaussians despite very different geometric needs. We propose ZipSplat, a token-based feed-forward model that decouples Gaussian placement from the pixel grid. A multi-view backbone extracts dense visual tokens, and k-means clustering compresses them into a compact set of scene tokens. Cross- and self-attention refine these tokens, and a lightweight MLP decodes each into a group of Gaussians with unconstrained 3D positions. Because clustering is applied at inference, a single trained model spans the quality-efficiency curve without retraining. ZipSplat operates without ground-truth poses or intrinsics, yet sets a new state of the art on DL3DV and RealEstate10K with ∼6× fewer Gaussians than pixel-aligned methods, surpassing the best pose-free baseline by 2.1dB and 1.2dB PSNR, respectively. It further generalizes zero-shot to Mip-NeRF360 and ScanNet++, outperforming all comparable baselines. Our project page is at https://veichta.com/zipsplat.
On-orbit inspection imagery is crucial as it enables characterization of non-cooperative resident space objects, providing the geometry and structural condition essential for active debris removal and on-orbit servicing mission planning. However, most existing neural implicit surface reconstruction methods have been confined to synthetic or hardware-in-the-loop data with known camera poses and controlled illumination. In this work, we present a pipeline for neural implicit surface reconstruction of non-cooperative space objects from monocular inspection imagery. We demonstrate it on publicly released ISS inspection footage from the STS-119 mission and publicly released on-orbit inspection footage of an H-IIA rocket upper stage. We find that segmentation-based background removal is essential for successful camera pose estimation from real on-orbit footage, where background variation between frames caused direct processing to fail entirely. We further incorporate photometric correction of per-frame exposure variations and analyze its behavior across datasets, finding that performance in shadowed regions varies with the illumination characteristics of the input footage.
Bala Prenith Reddy Gopu, Patrick Quinn, George M. Nehma +4
Department of Aerospace, Physics and Space Sciences, Florida Institute of Technology, 150 W University Blvd, Melbourne, 32901, FL, USA · Creare LLC, Hanover, 03755, NH, USA