Robotic Perception

Ask about this topic

Overview

Robotic perception studies how robots use sensory data to estimate what is around them, how it is arranged, and how it may change. Approaches include neural networks and vision-language models for recognition and segmentation; SLAM, depth estimation, and 3D maps for geometry; and fusion of cameras with LiDAR, radar, tactile, or proprioceptive sensors. Active viewpoint selection and interaction help resolve occlusion and ambiguity, while scene graphs and affordance models connect perception to navigation and manipulation. A central challenge is making systems reliable outside curated benchmarks—under changing lighting, clutter, unfamiliar environments, and tight limits on latency and onboard computing—while representing uncertainty well enough for safe action.

Latest papers 304

64 papers in the last four weeks, up 191% on the four weeks before. 0.4% of all new papers.

All topics
CardsList

  1. From Language to Navigation Goals: A Vision-Language Approach for Semantic Navigation of Mobile Robots Using RGB-D Perception

    Jul 15, 2026Jose Martínez-Fajardo, Pablo Pueyo, Fernando Caballero +1Robot NavigationVision-Language Navigation

    Univ. Pablo de Olavide

  2. Kepler-Encoder-v0.1: Towards a Multimodal Embedding Model for Robots

    Jul 15, 2026Ishneet Sukhvinder Singh, Dhanoosh Pooranakumaran, Alex Nguyen +1Cross-Modal Representation LearningMultimodal Embedding

    Menlo Research

  3. Infra-Swarm: Robust Vision-Based Multi-Robot Swarming via Near-Infrared Spectral Vision

    Jul 14, 2026Haoyu Chen, Qijin Li, Wanyu Xiang +3Multi-Robot SystemsSwarm Robotics

    WINDY Lab in the School of Engineering at Westlake University, Hangzhou, China · The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · Zhejiang University, Hangzhou, China

  4. See like a Robot: Robot-Centric Pointmaps for VLA Models

    Jul 13, 2026Byungkun Lee, Dongyoon Hwang, Dongjin Kim +4Visuomotor Policy LearningRobotic Manipulation

    KAIST AI · Holiday Robotics

  5. SensorPerch: Sense Wherever and Whenever it Matters

    Jul 12, 2026Zhanxin Wu, Ruofei Tong, Tapomayukh BhattacharjeeActive PerceptionRobotics

    Cornell University

  6. Robotic Contextual Awareness for Human-Robot Collaboration and Environmental Understanding

    Jul 11, 2026Federico RolloMobile RoboticsHuman-Robot Collaboration

    Università di Trento · Istituto Italiano di Tecnologia

  7. Differential Analysis of Multispectral Images for Terrain Identification

    Jul 10, 2026Omar Kashmar, Hemendra Arya, Fulvio MastrogiovanniRemote Sensing Image UnderstandingRobotic Perception

    University of Genoa, Italy · Indian Institute of Technology Bombay, Mumbai, India

  8. REMIND: RE-Identification with Memory for INDoor Navigation

    Jul 10, 2026Pablo Diaz-Pereda, Alejandro Rodriguez-Ramos, David Perez-Saura +1Robot NavigationRobotic Perception

    Computer Vision and Aerial Robotics Group at Centre for Automation and Robotics C.A.R. (UPM-CSIC), Universidad Politécnica de Madrid (CVAR-UPM), Calle Jose Gutierrez Abascal 2, 28006 Madrid, Spain.

  9. UAV-OVVIS: Unmanned Aerial Vehicles Also Need Open-Vocabulary Video Instance Segmentation

    Jul 9, 2026Mingyu Dou, Shi Qiu, Ming Hu +2Video Object SegmentationInstance Segmentation

    Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Institute of Artificial Intelligence (TeleAI), China Telecom +2

  10. ECO: Incremental Ego-Centric Octree Update for Point Streams

    Jul 6, 2026Jaemin Yu, Seongyoon Jeong, Kang-Wook Chon +1Robotic Perception

    Korea University of Technology and Education (KOREATECH), Cheonan, Republic of Korea

  11. ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI

    Jul 5, 2026ACE-Brain Team, :, Ziyang Gong +29Robot Foundation ModelsModel Merging

    ACE-Brain Team

  12. SurgAM: Surgical Affordance Map Prediction with Multimodal Feature Fusion for Robot Autonomy

    Jul 5, 2026Lei Song, Yonghao Long, Mengya Xu +3Robotic PerceptionSurgical Robotics

    Department of Computer Science and Engineering, The Chinese University of Hong Kong · Department of Thoracic Surgery, Peking University People’s Hospital, Beijing, China · Thoracic Oncology Institute, Peking University People’s Hospital, Beijing, China +3

  13. A Perception-Manipulation Robotics System for Food Cutting

    Jul 5, 2026Xinyuan Luo, Wenzhen YuanRobotic Tool UseRobotic Manipulation

    University of Illinois at Urbana-Champaign

  14. PreSIST: Vision-Language-Informed Object Persistence Prediction in Open-World Scenes

    Jul 4, 2026Amanda Adkins, Tarunvidyut Ravisankar, Joydeep BiswasRobotic Perception

    Department of Computer Science, The University of Texas at Austin, Austin, TX

  15. OP3DSG: Open-Vocabulary Part-Aware 3D Scene Graph Generation for Real-World Environments

    Jun 29, 2026Yirum Kim, Ue-Hwan Kim3D SGGRobotic Perception

    Gwangju Institute of Science and Technology (GIST), Gwangju, Republic of Korea

  16. Robotic Arm-Based Spectral Sensing for Strawberry Positioning and Non-Destructive Sweetness Measurement

    Jun 26, 2026Yi Yang, Mark Cardamis, Wen HuHand-Eye CalibrationRobotic Manipulation

  17. Physics-Guided Robotic Radiation Source Localization along Arbitrary Measurement Paths in Unstructured Environments

    Jun 26, 2026Hojoon Son, Kai Tan, Fan ZhangPhysics-Informed MLRobot Localization

    George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA, 30332-0405 USA

  18. OctoSense: Self-Supervised Learning for Multimodal Robot Perception

    Jun 25, 2026Anthony Bisulco, Jeremy Wang, Kostas Daniilidis +2Autonomous Driving DatasetsMasked Autoencoders

    1General, Robotics, Automation, Sensing and Perception (GRASP) Laboratory, University of Pennsylvania · Computer Science Department, Brown University

  19. Identifying the Unknown: Prompt-Free Open Vocabulary Anomaly Recognition for Robot-Object Interaction

    Jun 25, 2026Philipp Allgeuer, Jan-Gerrit Habekost, Stefan WermterOpen-Vocabulary Object DetectionRobotic Perception

    Knowledge Technology, Dept. of Informatics, University of Hamburg, Germany

  20. 1000 Rallies: An Event-Camera Dataset and Real-Time Learned Ball-State Estimation for Robotic Table Tennis

    Jun 24, 2026Raphaela Kreiser, Asude Aydin, Yin Bi +3Event-Based VisionRobotics

    Sony AI, Zurich

  21. An Integrated Hardware-Software Design for Low-Data Spatial Defect Detection in Robotic Visual Inspection with Hybrid Optoelectronic Neural Networks

    Jun 24, 2026Chaoqing Tang, Jiaxuan Li, Huanze Zhuang +4Robotic InspectionAnomaly Localization

    School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, 430074, China · China Belt and Road Joint Lab on Measurement and Control, Wuhan, 430074, China · School of Electric and Electrical Engineering, Chongqing University of Technology, Chongqing, 400054, China +1

  22. Pose Anything Anywhere:Model-free Object Poses from Arbitrary References

    Jun 22, 2026Hongli Xu, Jiaqi Hu, Junwen Huang +5Multi-View GeometryObject Pose Estimation

    Technical University of Munich · Siemens AG · Munich Center for Machine Learning (MCML) +2

  23. From Pixels to Concepts: Growing Rich 3D Semantic Scene Graph Forests utilizing Foundation Models

    Jun 22, 2026David Oberacker, Meike Deitersen, Niklas Spielbauer +33D SGGRobotic Perception

    FZI Research Center for Information Technology, 76131 Karlsruhe, Germany · Machine Intelligence and Robotics Lab (MaiRo), Karlsruhe Institute for Technology (KIT), Karlsruhe, Germany

  24. ShotcreteDepth: A Bi-modal Dataset for Robust Robotic Depth Perception in Shotcrete Construction Environments

    Jun 22, 2026Jakub Gregorek, Lars Arnold Dethlefsen, Patrick Schmidt +3Robotic ConstructionDepth Estimation

    1Technical University of Denmark, Department of Electrical and Photonics Engineering. · 2Pioneer Centre for AI, Copenhagen, Denmark. · 3Christiansen & Essenbæk A/S.

  25. Can Single-View Mesh Reconstruction Generalize to Robot Camera Rotation?

    Jun 22, 2026Yu Zhan, Guangcheng Chen, Hanjing Ye +4Monocular Depth Estimation3D Mesh Reconstruction

    Shenzhen Key Laboratory of Robotics and Computer Vision, Southern University of Science and Technology (SUSTech) · Pengcheng Laboratory

  26. Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI

    Jun 22, 2026Xianda Guo, Bohao Zhang, Chenwei Huang +6Sim-to-Real TransferSynthetic Data Generation for Robotics

    School of Computer Science, Wuhan University · †Work was done during an internship at D-Robotics. · D-Robotics +2

  27. Efficient Continuous Semantic Mapping based on Spatio-Temporal Awareness

    Jun 21, 2026My Le Pham, Dinh Trieu Duong, Xiem HoangVan +1Spatiotemporal Reasoning3D Semantic Segmentation

    University of Engineering and Technology, Vietnam National University, 10000, Hanoi, Vietnam. · School of Information Science, Japan Advanced Institute of Science and Technology, Nomi, 923-1211, Ishikawa, Japan.

  28. Geometric Reconstruction of Extrinsic Contact Trajectories using Tactile Sensing and Proprioception for Tool Manipulation

    Jun 20, 2026Seojung Min, Yoonjin Kim, Jeong-Jung Kim +1Tactile SensingRobotic Tool Use

    Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Republic of Korea · Department of AI Machinery, Korea Institute of Machinery and Materials, Daejeon 34141, Republic of Korea

  29. LOGOS: LiDAR-Only Gaussian Elevation Splatting for Unified Tiny Obstacle Segmentation

    Jun 19, 2026Nan Ming, Yeqiang Qian, Chunxiang Wang +13D Gaussian SplattingAutonomous Driving Perception

    School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai, 200240, China · Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, 200240, China

  30. A Human-Inspired Thumb-Index Robotic Hand with Strain Gauges Embedded in Soft Joints

    Jun 19, 2026Jonas Papenbrock, Shubhan Patni, Tomaso Lisini Baldi +4Robotic Hand DesignRobotic Grasping

    Department of Information Engineering and Mathematics - University of Siena. · Department of Cybernetics, Faculty of Electrical Engineering, Czech Technical University in Prague