cs.RONov 4, 2026

3D Pose Estimation in Projection Space via Pixel-level Visible Light Communication

Authors: Michikuni Eguchi, Takefumi Hiraki

Organizations: University of Tsukuba, 1-2 Kasuga, Tsukuba, Ibaraki 305-8550 Japan · Cluster Metaverse Lab, 8-9-5 Nishigotanda, Shinagawa, Tokyo 140-0031 Japan

Abstract

Projector-based augmented reality enables natural interaction between users and devices by overlaying digital information onto the physical world through projected imagery. A key technical requirement of such systems is accurate positional alignment between the projector and the devices. Pixel-level Visible Light Communication (PVLC) achieves this alignment without external sensing infrastructure by embedding invisible spatial codes into each projected pixel through high-speed brightness modulation that preserves image quality. However, the information that PVLC transmits is inherently planar. PVLC has therefore been limited to devices moving on a flat surface and cannot estimate the 3D pose of devices in three-dimensional space, such as aerial robots. To extend PVLC-based pose estimation to three dimensions, we formulate it as a Perspective-n-Point (PnP) problem. The 2D pixel positions that four coplanar photosensors on the device receive via PVLC serve as the image points, and their known 3D layout provides the object points. Experiments show that the proposed system estimates 3D pose with a latency of approximately 8ms and a 3D position RMSE of 19.2mm after Kalman filtering. These results confirm the first realization of real-time 3D pose estimation coordinated with high-quality projected image content without external sensing infrastructure.

Figures & tables

Explore similar work

CardsList
  1. PnP*: A certifiable solver for Perspective-n-Point

    Oct 22, 2026Bang-Shien Chen, Caitrin E. Eaton, David M. RosenCamera Pose EstimationConvex Relaxation

  2. VLM3: Vision Language Models Are Native 3D Learners

    May 28, 2026Zhipeng Cai, Zhuang Liu, Yunyang Xiong +3Camera Pose EstimationMonocular Depth Estimation

  3. High-Precision 6DOF Pose Estimation via Global Phase Retrieval in Fringe Projection Profilometry for 3D Mapping

    Mar 12, 2026Sehoon Tak, Keunhee Cho, Sangpil Kim +13D MappingObject Pose Estimation