cs.CVNov 17, 2026

Kolibri: Color Finds the Place, Refinement Sets the Pose for RGB-D Localization in Colored Point Clouds

Authors: Leonel Aguilar, Bartu Tuncay, Christoph Hoelscher

Organizations: Chair of Cognitive Science, ETH Zürich

Abstract

An agent or robot in a scanned building must locate its camera in rooms that no model saw during training. Point cloud registration methods can align each RGB-D frame with the building's colored point cloud, accurately but at a high cost. We observe that geometric refinement brings nearby initial poses to the same final pose, so the learned component only needs to find the place. Kolibri does this with a graph network of 55,712 parameters that describes 10 cm cubes of points, called cells, by their color, local shape and neighbors. With the same refinement, it matches GeDi on 96 unseen ScanNet rooms (81.4% against 80.3% within 5 cm and 5°) and on a held-out test of 10 further rooms, in 82 ms per frame on an RTX 2080 Ti. The saved time allows for search without a room label. In one point cloud of 100 rooms, Kolibri loses 1.3 points against knowing the room, while retrieving the room first loses 56.0. In a hospital emergency department scene from a real scan, it localizes 86.5% of the frames rendered from the scan in 384 ms each, where GeDi needs 91 minutes per frame on cubes of the scan for a similar recall. The method needs colors that agree between the frame and the point cloud. On gray frames and across cameras with different color responses, point cloud registration methods keep the lead.

Figures & tables

Appendix figures & tables10 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. GeGS-PCR: Effective and Robust 3D Point Cloud Registration with Two-Stage Color-Enhanced Geometric-3DGS Fusion

    Apr 20, 2026Jiayi Tian, Haiduo Huang, Tian Xia +2Point Cloud Registration

  2. ReFineR: Single image to dense point cloud registration at pixel level with point splatting

    Nov 12, 2026Ugo Insalaco, Jean-Emmanuel Deschaud, Pierre DellenbachPoint Cloud RegistrationCross-Modal Image Registration

  3. Register Anything Model for Generalizable and Robust Point Cloud Registration

    Oct 20, 2026Zheng Qin, Junhua Xi, Yan Huang +5Point Cloud RegistrationPoint Cloud Learning