cs.AIApr 9, 2026

IoT-Brain: Grounding LLMs for Semantic-Spatial Sensor Scheduling

Authors: Zhaomeng Zhou, Lan Zhang, Junyang Wang, Mu Yuan, Junda Lin, Jinke Song

Organizations: University of Science and Technology of China · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center · The Chinese University of Hong Kong · The Hong Kong University of Science and Technology

Abstract

Intelligent systems powered by large-scale sensor networks are shifting from predefined monitoring to intent-driven operation, revealing a critical Semantic-to-Physical Mapping Gap. While large language models (LLMs) excel at semantic understanding, existing perception-centric pipelines operate retrospectively, overlooking the fundamental decision of what to sense and when. We formalize this proactive decision as Semantic-Spatial Sensor Scheduling (S3) and demonstrate that direct LLM planning is unreliable due to inherent gaps in representation, reasoning, and optimization. To bridge these gaps, we introduce the Spatial Trajectory Graph (STG), a neuro-symbolic paradigm governed by a verify-before-commit discipline that transforms open-ended planning into a verifiable graph optimization problem. Based on STG, we implement IoT-Brain, a concrete system embodiment, and construct TopoSense-Bench, a campus-scale benchmark with 5,250 natural-language queries across 2,510 cameras. Evaluations show that IoT-Brain boosts task success rate by 37.6% over the strongest search-intensive methods while running nearly 2 times faster and using 6.6 times fewer prompt tokens. In real-world deployment, it approaches the reliability upper bound while reducing 4.1 times network bandwidth, providing a foundational framework for LLMs to interact with the physical world with unprecedented reliability and efficiency.

Figures & tables

Explore similar work

CardsList
  1. Deconstructing Spatial Complexity: Hierarchical Decomposition for LLM Spatial Reasoning

    May 27, 2026Yi Wang, Haojie Lu, Zhaofan Zhang +2Hierarchical PlanningRL for Language Model Reasoning

  2. OntoPlan: An Ontology-Grounded Scene Representation and Agentic Framework for Scalable Robot Task Planning

    Oct 6, 2026Hyeongwoo Nam, Woongje Cho, Juwon Kim +1Large Language Model-Based Robot PlanningRobot Task Planning

  3. Harnessing Large Language Models for Intelligent Resource Allocation in the Internet of Everything

    Jul 29, 2026Haijun Zhang, Zhuojun Duan, Zijun Wu +2Large Language Model-Guided OptimizationInternet of Things