cs.CVFeb 14, 2025

MITO: A Millimeter-Wave Dataset and Simulator for Non-Line-of-Sight Perception

Authors: Tara Boroushaki, Laura Dodds, Cusuh Ham, Fadel Adib

Organizations: Massachusetts Institute of Technology · Adobe Research · Cartesian Systems

Abstract

The ability to observe the world is fundamental to reasoning and making informed decisions on how to interact with the environment. However, optical perception can often be disrupted due to common occurrences like occlusions, which can pose challenges to existing vision systems. We present MITO, the first millimeter-wave (mmWave) dataset of diverse, everyday objects, collected using a UR5 robotic arm with two mmWave radars operating at different frequencies and an RGB-D camera. Unlike visible light, mmWave signals can penetrate common occlusions (e.g., cardboard boxes, fabric, plastic). MITO captures over 24 million mmWave frames and uses them to generate 550 high-resolution mmWave images in line-of-sight and non-light-of-sight (NLOS), as well as RGB-D images, segmentation masks, and raw mmWave signals, taken from 76 different objects. We develop an open-source simulation tool that can be used to generate synthetic mmWave images for any 3D triangle mesh. Finally, we establish benchmarks for NLOS segmentation and classification to demonstrate the utility of our dataset and simulator for enabling broader NLOS perception.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. RadarTwin: Scene-Specific mmWave Radar Simulation and Learning for Mobile Indoor Perception

    Jun 24, 2026Emily Bejerano, Federico Tondolo, Devang Gupta +5Sim-to-Real TransferMillimeter-Wave Radar

  2. WiCompass: Oracle-driven Data Scaling for mmWave Human Pose Estimation

    Feb 21, 2026Bo Liang, Chen Gong, Haobo Wang +8Human Pose EstimationOOD Generalization