cs.AINov 1, 2026

TriPhysBench: Evaluating Physical Intelligence for Embodied Agents

Authors: Zhongxiang Sun, Chenghao Yang, Haojie Ding, Boheng Zhang, Fan Yang, Qingsong Wen, Kun Wang

Organizations: Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China · School of Information Engineering, Zhongnan University of Economics and Law, Wuhan, China · Kuaishou Technology, Beijing, China · Squirrel AI Learning · 

Abstract

Embodied agents need physical intelligence to understand their surroundings through physical perception, physical knowledge retrieval, and physical reasoning. These capabilities must work together to interpret events and make quantitative judgments. Existing benchmarks advance physical understanding and general-purpose tool use, yet the coordination of these capabilities in physical scenarios remains insufficiently characterized. Inspired by Popper's Three Worlds, we introduce TriPhysBench, a benchmark of 410 questions from 200 videos that brings physical perception, physical knowledge retrieval, and physical reasoning into a shared evaluation setting. Its measurement-grounded and knowledge-grounded subtasks impose complementary demands on obtaining observations and acquiring external specifications, then applying them to quantitative problems. Among six representative vision-language models, the best achieves an answer accuracy of only 50.38%, revealing limited performance on tasks that require these capabilities to work together. We further introduce TriPhys, a framework that learns a unified policy for physical perception, knowledge retrieval, and quantitative reasoning from complete tool-integrated trajectories. The policy uses intermediate reasoning to guide retrieval and computation, then incorporates tool feedback into subsequent physical inference. On 110 questions from videos excluded from training, TriPhys improves answer and solution scores across three Qwen configurations, with a 17.7% relative gain in answer accuracy for TriPhys-27B over its Qwen3.6-27B backbone. This work provides a benchmark and a learning pathway toward embodied agents that move beyond recognizing events to understanding and reasoning about the physical processes behind them.

Figures & tables

Explore similar work

CardsList
  1. Beyond Description: Cognitively Benchmarking Fine-Grained Action for Embodied Agents

    Nov 24, 2025Dayong Liu, Chao Xu, Weihong Chen +5AI Agent EvaluationMultimodal Large Language Models

  2. PhysMind: From Video to Executable Worlds for Training-Free Physical Reasoning

    Aug 5, 2026Chen Yang, Shenxiang Zeng, Haoyang Zhao +6Counterfactual ReasoningPhysical Reasoning in Video

  3. HumanPhys: A Human-Centric Physical-World Perception Benchmark for Real-World Visual Reasoning

    Oct 10, 2026Yiming Zhang, Enzhi Zhou, Junan Lin +4Human Motion UnderstandingVLM Reasoning