Action-Conditioned World Models

Ask about this topic

Momentum

54 papers in the last four weeks, up 260% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 216

All topics
CardsList

  1. SyncWorld: Visual Calibration Enables World Models as Zero-Shot Simulators

    Sep 8, 2026Yuncong Yang, Zhengtao Han, Furkan Ozyurt +6World Model LearningWorld Models for Robotics

    UMass Amherst · UC Berkeley · NYU +1

  2. Earth System World Model for What-If Simulations: A Case Study for Terrestrial Ecosystems

    Sep 8, 2026Zhihao Wang, Ruichen Wang, Ruohan Li +6Surrogate ModelingWorld Model Learning

    University of Maryland · Rutgers University · University of Texas at Austin +1

  3. WorldAgen: Unified State-Action Prediction with Test-Time World Model Training

    Sep 8, 2026Chi Wan, Kangrui Wang, Yuan Si +2Test-Time AdaptationAction-Conditioned World Models

    Northwestern University

  4. CST-WM: A Causally Structured World Model for Embodied Visual Tracking

    Sep 5, 2026Junyi Hu, Shuaihang Yuan, Jiazhao Liang +1Causal World ModelsVisual Object Tracking

    New York University Abu Dhabi

  5. Toward Physically Grounded JEPA World Models for Goal-Conditioned Robotic Planning

    Sep 3, 2026Muyuan Liu, Yue Huang, Zheng Liang +1World Models for RoboticsWorld Model-Based Planning

    GENISOM AI, Beijing, China

  6. GPU-Accelerated Astrodynamics World Models for Spacecraft Rendezvous and Proximity Operations

    Sep 2, 2026Duncan Eddy, Isaac R. Ward, Grace Ra Kim +1Spacecraft Rendezvous and Proximity OperationsWorld Models

    Stanford University

  7. AGI Maze Prediction Datasets: A Compact Benchmark for Learning World Dynamics with Transformers

    Sep 2, 2026Alexey PotapovWorld ModelsAction-Conditioned World Models

    SingularityNET Foundation

  8. Belief-Calibrated Optimization: An Explicit World Model for Agentic Optimization

    Sep 1, 2026Yuhan Chen, Zhihua Tian, Mahavir Dabas +7Large Language Model-Guided OptimizationAction-Conditioned World Models

    1Virginia Tech · 2Amazon · 3Independent Researcher

  9. IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Training

    Aug 31, 2026Rongze Tang, Jianjie Fang, Zhaolu Wang +8World Model LearningAction-Conditioned World Models

    University of Science and Technology of China · 2Zhongguancun Academy · 3Tsinghua University +1

  10. CAER: Causal Action Effect Reweighting for World Model Training

    Aug 31, 2026Jianjie Fang, Xvyuan Liu, Ziyou Wang +9Action-Conditioned Video GenerationWorld Model Learning

    1Tsinghua University · University of Science and Technology of China · 2Manifold AI

  11. Can Video World Models Track Unobserved World States?

    Aug 31, 2026Joonghyuk Shin, Yicong Hong, Jaesik Park +1Action-Conditioned World ModelsLength Generalization

    Seoul National University · Roblox

  12. Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution

    Aug 29, 2026Mohammad Nazeri, Alexandyr Card, Samira Huber +6Kinodynamic Motion PlanningWorld Models for Robotics

    George Mason University · Kiel University · Ludwig Maximilian University Munich +1

  13. BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generation

    Aug 23, 2026Jiaqi Wang, Zhuo Zhang, Haining Guan +15Action-Conditioned World ModelsWorld Models for Autonomous Driving

    AFARI World Model Team

  14. ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models

    Aug 13, 2026Gehan Zheng, Matthew Johnson-Roberson, Weiming ZhiRobot Failure DetectionContact-Rich Robotic Manipulation

    College of Connected Computing, Vanderbilt University, USA. · School of Computer Science, The University of Sydney, Australia. · 3Australian Centre for Robotics, The University of Sydney, Australia.

  15. Diagnosing JEPA World Models with Action-Conditioned Predictive Consistency

    Aug 13, 2026Guo An, Zijing Wu, Honghua Dong +7World ModelsJoint-Embedding Predictive Architecture

    Huawei · University of Science and Technology of China · Zhejiang University +3

  16. FACT: Failure-Aware Causal Training for World-Action Models

    Aug 10, 2026Quanquan Peng, Yutong Liang, Rui Yan +2Causal World ModelsAction-Conditioned World Models

    University of California San Diego

  17. Rethink Before You Execute: Adaptive Execution for World Action Models

    Aug 10, 2026Feng Ye, Yiming Zhao, Yong Yu +5World Models for RoboticsLLM Planning

    Wangxuan Institute of Computer Technology, Peking University · Simplexity Robotics

  18. WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation

    Aug 10, 2026Peterson Co, Sicheng Hu, Chunxuan Jiao +17Robotics SimulationAction-Conditioned World Models

    State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University

  19. 4D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fields

    Aug 8, 2026Lishan Yang, Wenxuan Song, Xi Wang +14World Models for RoboticsAction-Conditioned World Models

    Adelaide University · HKUST(GZ) · Tsinghua University +3

  20. CausalNav: Reliability-Certified Causal World Models for Control under Physical-Parameter Shift

    Aug 7, 2026Yiyao Zhang, Diksha Goel, Hussain Ahmad +2Causal World ModelsWorld Models

    School of Computing and Information Technology, University of Wollongong, Wollongong, NSW, Australia · CSIRO’s Data61, Clayton, VIC, Australia · School of Computer Science and Information Technology, Adelaide University, Adelaide, SA, Australia

  21. SpikeWorld: Fast-State Adaptation for Frozen Spiking World Models

    Aug 7, 2026Ziqiao YuTest-Time AdaptationWorld Model Learning

    DiDi International Business Group

  22. Beyond Myopic World Models: Long-Horizon End-to-End Training for Direct Future Prediction

    Aug 7, 2026Xinyi Li, Zaishuo Xia, Chenjie Hao +1World Model LearningAction-Conditioned World Models

    University of California, Davis

  23. Is Forward Prediction Enough? Physical State Grounding for JEPA World Models

    Aug 7, 2026Haodong Yan, Jiaguan Zhu, Mingyuan Jia +12Physical ReasoningWorld Models for Robotics

    1The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · 2COCO Matrix

  24. Dueling World Models: Advantage-Style Action Channels for Common-Mode Distractor Rejection

    Aug 7, 2026Jiazhuo Li, Yiming Fei, Zhiruo Zhou +1Action-Conditioned World ModelsLatent World Models

    University of Michigan, Ann Arbor, MI, USA · Zhejiang University, Hangzhou, China · Wuhan University of Technology, Wuhan, China +1

  25. GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions

    Aug 6, 2026Chenghao Gu, Hanyang Yu, Jingbo Zhang +7Action-Conditioned World ModelsRobotic Policy Evaluation

    Shenzhen International Graduate School, Tsinghua University · Tencent Robotics X · The Hong Kong University of Science and Technology +1

  26. XEWorld: Can Action-Conditioned World Models Generalize to Unseen Robot Embodiments?

    Aug 6, 2026Yixiang Chen, Jiabing Yang, Yuan Xu +10World Model LearningAction-Conditioned World Models

    New Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · Shandong University +1

  27. DreamWAM: Beyond RGB Future Prediction for World Action Models

    Aug 5, 2026Shanglin Yuan, Weiheng Zhao, Xin Shi +6World Model LearningAction-Conditioned World Models

    Huazhong University of Science and Technology · D-Robotics · Wuhan University +1

  28. WorldCycle: Self-Verifiable Reinforcement Learning for Long-Horizon Video World Models

    Aug 5, 2026Bohai Gu, Yueyang Yuan, Taiyi Wu +9World Model-Based PlanningAction-Conditioned World Models

    1The Hong Kong University of Science and Technology · 2Wuhan University · 3AI Technology Center, Tencent Video, Tencent

  29. Overcoming Statistical Bias in Action-Controllable World Models

    Aug 5, 2026Yuhong Shi, Zhenhao Chu, Jie Wei +3World ModelsAction-Conditioned World Models

    Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China · China Mobile (Shanghai) Information and Communication Technology Co., Ltd., Shanghai, China · Zhongguancun Academy, Beijing, China

  30. Faster-WAM: Efficient Inference-Time Future Conditioning for Robust World Action Models

    Aug 5, 2026Weiheng Zhao, Haoyi Jiang, Xin Shi +5Action-Conditioned World ModelsEfficient VLA Model Inference

    Huazhong University of Science and Technology · D-Robotics · Horizon Robotics +1

  31. SG-WAM: Self-Guided World Modeling in Geometry-Aware Policy Space

    Aug 2, 2026Ruiteng Zhao, Zhengshen Zhang, Yue Su +6World Models for RoboticsAction-Conditioned World Models

    Advanced Robotics Centre, National University of Singapore · Singapore Institute of Manufacturing Technology, Agency for Science, Technology and Research (A*STAR) · MMLab, The University of Hongkong

  32. BWM: A Low-Cost High-Fidelity World Simulator for Robot Learning

    Jul 31, 2026BWM TeamWorld Models for RoboticsRobotics Simulation

  33. FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution

    Jul 31, 2026Peize Li, Ruimeng Zhang, Ru Zhang +3Flow MatchingWorld Models for Robotics

    DeepCybo · Zhongguancun Academy · Zhongguancun Institute of Artificial Intelligence +3

  34. AuricularWorld: Hierarchical Action-Guided World Modeling for Fine-Grained Auricular Structure Segmentation from CT Scans

    Jul 30, 2026Jingwen Yang, Senmao Wang, Luoyao Kang +6World Model LearningAction-Conditioned World Models

    Plastic Surgery Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, 100144, China · The Chinese University of Hong Kong, Hong Kong SAR, 999077, China · The Chinese University of Hong Kong (Shenzhen), Shenzhen, 518172, China

  35. ShadowDancer: Teaching Video World Models Any Action by Learning Unified Dynamics Representations from a Video and Its Shadow

    Jul 30, 2026Jin Cao, Zian Meng, Kaipeng ZhangLatent Action LearningAction-Conditioned World Models

    1Alaya Lab · 2Shanghai Innovation Institute

  36. World Action Planner: Generalizable Decision-Making with Action-Conditioned World Models

    Jul 30, 2026Xiangcheng Zhang, Yilun DuWorld Models for RoboticsWorld Model-Based Planning

    Harvard University

  37. StatePlay: State-Aware Game World Models for Mechanics-Consistent Generation

    Jul 29, 2026Zijun Lin, Zeqing Wang, Cheston Tan +2World ModelsAction-Conditioned World Models

    Tencent · Nanyang Technological University · Centre for Frontier AI Research, A*STAR +1

  38. ActSWM: Action-Sensitive World Models for Long-Horizon Planning in Open-World Games

    Jul 29, 2026Zhenfeng Gan, ZiTong Zeng, Jiajun Cheng +3Latent Action LearningWorld Model-Based Planning

  39. ContactFlow: A video action conditioning that transfers across embodiments

    Jul 29, 2026Sami Azirar, Enrico Pallotta, Jan Nogga +3Action-Conditioned Video GenerationContact-Rich Robotic Manipulation

    University of Bonn, Lamarr Institute

  40. CG-World: A Large-Scale World-State Dataset and Protocol for World Models

    Jul 29, 2026Yiming Cai, Fangjie Yu, Meiqing Yu +3World Model LearningWorld Models

    CGyear World Model Lab · Tsinghua University · University of New South Wales

  41. INTACT: Isomorphic Intent-to-Action Learning for Search-Free World Models

    Jul 28, 2026Junhan Sun, Hao Zhao, Guofeng ZhangWorld Model LearningWorld Model-Based Planning

    1State Key Laboratory of CAD&CG, Zhejiang University · Institute for AI Industry Research (AIR), Tsinghua University · 4RoboParty Lab +1

  42. Robot-Factored World Models via Robot Rendering

    Jul 24, 2026Byungjun Kim, Taeksoo Kim, Hyunsoo Cha +1Action-Conditioned World ModelsCross-Embodiment Robot Learning

    Seoul National University · RLWRLD

  43. On the Identifiability of Controlled World Models

    Jul 24, 2026Xiangteng Zhang, Yang Guan, Bo Zhang +3Parameter IdentifiabilityLatent Dynamics Modeling

    School of Vehicle and Mobility, Tsinghua University · 2Didi Voyager Labs, Didi Autonomous Driving · School of Computing and Data Science, The University of Hong Kong +2

  44. Music-JEPA: Learning a World Model of Sound from Action

    Jul 24, 2026Ziyu Wang, Kun Fang, Yann LeCunAudio Representation LearningWorld Model Learning

    Courant Institute, New York University · Schulich School of Music, McGill University · Centre for Interdisciplinary Research in Music Media and Technology (CIRMMT) +2

  45. Action-Conditioned World Model for Goal Plane Probe Guidance in Robotic Ultrasound

    Jul 24, 2026Siqi Fan, Mingcong Chen, Ran Liu +5World Model LearningAction-Conditioned World Models

    Department of Mechanical and Automation Engineering, Chinese University of Hong Kong, Hong Kong SAR · Centre for Artificial Intelligence and Robotics Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences, Hong Kong SAR · Department of Biomedical Engineering, City University of Hong Kong, Hong Kong SAR +3

  46. ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU

    Jul 21, 2026Fan Jiang, Zhaoxu Sun, Mengchao Wang +38Action-Conditioned Video GenerationLong-Horizon Video Generation

  47. WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning

    Jul 21, 2026Haisheng Su, Zongdai Liu, Xin Jin +13ICL for RoboticsWorld Model Learning

    Manifold AI · Tsinghua University · Shanghai Jiao Tong University

  48. DWM: Separating World Effects from Actions in Latent World Models

    Jul 21, 2026Yi-Ge Zhang, Tianqi Du, Qi Zhang +1World Model LearningLatent Dynamics Modeling

    Peking University

  49. SAGE: Subgoal-Conditioned Action Generation for Latent World Model Planning

    Jul 20, 2026Letian Cheng, Qi Zhang, Yisen WangWorld Model-Based PlanningAction-Conditioned World Models

    Peking University

  50. Test-Time Scaling for World Action Models via Zero-Shot Geometric Evaluation

    Jul 20, 2026Zesen Zhao, Minkyoung Cho, Hui shen +4World Models for RoboticsWorld Model-Based Planning

    University of Michigan · 2NVIDIA

  51. DSWorld: A Data Science World Model for Efficient Autonomous Agents

    Jul 17, 2026Zherui Yang, Fan Liu, Hao LiuWorld Model LearningWorld Models

    The Hong Kong University of Science and Technology (Guangzhou)

  52. DriftWorld: Fast World Modeling through Drifting

    Jul 16, 2026Susie Lu, Haonan Chen, Weirui Ye +1World Models for RoboticsWorld Model-Based Planning

    Massachusetts Institute of Technology · Harvard University

  53. Steering Robustness into World Action Models via Mechanistic Interpretability and Optimal Control

    Jul 16, 2026Jihoon Hong, Julian Skifstad, Qiyue Dai +2World Models for RoboticsAction-Conditioned World Models

    Georgia Institute of Technology

  54. From Pixels to States: Rethinking Interactive World Models as Game Engines

    Jul 15, 2026Zhen Li, Zian Meng, Shuwei Shi +4Action-Conditioned Video GenerationAction-Conditioned World Models

    1Alaya Lab

  55. GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch

    Jul 15, 2026GigaWorld Team, Angen Ye, Angyuan Ma +26Robot Policy LearningWorld Model Learning

    GigaAI Tsinghua University

  56. FlowWAM: Optical Flow as a Unified Action Representation for World Action Models

    Jul 14, 2026Yixiang Chen, Peiyan Li, Yuan Xu +13Action-Conditioned Video GenerationVideo Diffusion Models

    New Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · MBZUAI +2

  57. Causally Debiased Latent Action Model for Embodied Action Conditioned World Models

    Jul 10, 2026Yufan Wei, Kun Zhou, Lingjun Mao +9Latent Action LearningCausal Representation Learning

    Aether AI · University of California, San Diego

  58. EgoWAM: World Action Models Beyond Pixels with In-the-Wild Egocentric Human Data

    Jul 8, 2026Baoyu Li, Xinchen Yin, Mengying Lin +2World Models for RoboticsBimanual Robotic Manipulation

    Georgia Institute of Technology

  59. Multiplayer Interactive World Models with Representation Autoencoders

    Jul 6, 2026Anthony Hu, Václav Volhejn, Adrien Ramanana Rahary +24Action-Conditioned World ModelsLatent World Models

    1General Intuition · 2Kyutai · ‡École nationale des ponts et chaussées +1

  60. DSWAM: A Dual-System World Action Foundation Model for Fine-Grained Robot Manipulation

    Jul 6, 2026Jian Zhu, Jianjun Zhang, Taiyi Su +10Language-Conditioned Robot ManipulationRobot Foundation Models

    1AIRC, Midea Group · 2Tongji University