HOI Generation

HOI: Human-Object Interaction

Ask about this topic

Momentum

7 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 50

All topics
CardsList

  1. VolCo: Volumetric Contact for High-Fidelity Human Grasp Generation

    Oct 7, 2026Zhuo Chen, Yihua Cheng, Aleš Leonardis +1HOI Generation

    University of Birmingham · Beijing Institute of Technology

  2. Exo2EgoHOI: Hand-Object-Interaction Aware Exocentric-to-Egocentric Video Generation

    Sep 29, 2026Hongjia Zhai, Xiyu Zhang, Haoran Zhang +5HOI GenerationEgocentric Vision

    MBZUAI · Zhejiang University · InSpatio

  3. PAMI: Part Anchored Motion for Text to Human-Object Interaction Generation

    Sep 29, 2026Chuqiao Li, Xianghui Xie, Yong Cao +2HOI GenerationText-to-Motion Generation

    Tübingen AI Center, University of Tübingen, Germany · Max Planck Institute for Informatics, Saarland Informatics Campus, Germany

  4. Counterfactual Video Generation Enables Scalable Humanoid Loco-Manipulation

    Sep 29, 2026Zihan Wang, Zhen Wu, Pieter Abbeel +6HOI GenerationHumanoid Loco-Manipulation

    Amazon FAR · UC Berkeley · Stanford +1

  5. Harnessing Coupled Stream Completion For Human-Object Interaction Modeling

    Sep 26, 2026Dawei Guan, Di Yang, Jiangtao WangHOI GenerationMotion Representation Learning

    School of Artificial Intelligence and Data Science, University of Science and Technology of China

  6. LYRIC: Language-Driven Physics-Based Character Control for Contact-Rich Whole-Body Object Interaction

    Sep 17, 2026Zeyu Han, Zichong Meng, Julian Tanke +8HOI GenerationHuman Motion Generation

    Northeastern University, USA · Sony AI America Inc, USA · Sony Interactive Entertainment Inc, Japan +3

  7. InterMASH: A Unified Geometric Representation for Grasp Synthesis

    Sep 16, 2026Xuanze Yang, Yumeng Liu, Haiyang Xin +5HOI GenerationRobotic Grasping

    University of Science and Technology of China, Hefei, China · Jiangsu Key Laboratory of AI for Industries and Institute of AI for Industries Chinese Academy of Sciences, Nanjing, China · Shenzhen University, Shenzhen, China

  8. Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactions

    Sep 15, 2026Liu Cao, Xingze Wu, Jingzhi Cui +4HOI GenerationHumanoid Loco-Manipulation

    1Tsinghua IIIS · 3Dalian University of Technology · 4The Chinese University of Hong Kong +1

  9. RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction

    Aug 13, 2026Tianyu Sun, Zhoujie Fu, Zihui Gao +2HOI GenerationSynthetic Data Generation for Robotics

    College of Computing and Data Science, Nanyang Technological University · College of Computer Science and Technology, Zhejiang University · Alibaba Group

  10. MAD-HOI: Masked Autoregressive Diffusion for Generating Articulated Hand Object Interactions from Text

    Aug 10, 2026Ananya Bal, Kartik Sharma, Ethan Lai +4HOI GenerationAutoregressive Diffusion

    Carnegie Mellon University

  11. Surface Keypoint Representation for Multi-Object and Articulated Human-Object Interaction Generation

    Aug 4, 2026Xiaogang Peng, Zeyu Han, Zichong Meng +4HOI GenerationHuman Motion Generation

    Northeastern University, USA · Xi’an Jiaotong University, China · Amazon, USA

  12. PhotoHOI: Synthesizing 3D Hand-Object Interactions from a Single RGB Photograph

    Aug 3, 2026Zhenhao Zhang, Jiajun Zhang, Wei Min +1HOI GenerationDexterous Manipulation

    Tsinghua University · Shadow AI

  13. Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfer

    Jul 30, 2026Weiquan Lin, Yu Deng, Shiyang Liu +6HOI GenerationHuman-Object Interaction

    1Xidian University · 2Zhongguancun Academy · 3Microsoft Research Asia +2

  14. Real-Time Human-Centric World Modeling for Upper-Body Human-Object Interaction

    Jul 26, 2026Chaonan Ji, Jinwei Qi, Peng Zhang +1HOI GenerationHuman Motion Generation

    Tongyi Lab, Beijing, China

  15. AgentHOI: Multi-Agent Reasoning for Human-Object-Interaction Video Generation via Implicit Representation Alignment

    Jul 24, 2026Ziyao Huang, Shunkai Li, Juan Cao +7HOI GenerationVideo Diffusion Models

    University of Chinese Academy of Sciences · Tencent HunYuan

  16. StreamHOI: Interaction-aware Temporal Memory Adaptation for Streaming HOI Video Generation

    Jul 22, 2026Zejing Rao, Haoxian Zhang, Xiaoqiang Liu +5HOI GenerationLong-Horizon Video Generation

    National Cheng Kung University, Tainan, Taiwan

  17. GIRAF: Towards Generalizable Human Interactions with Articulated Objects

    Jul 8, 2026Xiaohan Zhang, Sebastian Starke, Alexander Winkler +3HOI GenerationText-to-Motion Generation

    Tübingen AI Center, University of Tübingen · Max Planck Institute for Informatics, Saarland Informatics Campus · Meta Reality Labs Research

  18. SparseCtrl-HOI: Sparse Temporal Control for Human-Object Interaction Video Generation

    Jul 7, 2026Shenbo Xie, Mingrui Cai, Xu Yang +2HOI GenerationControllable Video Generation

    South China University of Technology

  19. JointHOI: Jointly Generating Contact Maps Enhances Hand Object Interaction Generation

    Jul 2, 2026Mingyeong Song, Jungbin Cho, Jisoo Kim +5HOI GenerationDiffusion Models

    Ewha Womans University, Seoul, Korea · Yonsei University, Seoul, Korea · Carnegie Mellon University, Pittsburgh PA, USA +1

  20. DCGrasp: Distance-aware Controllable Grasp Generation

    Jun 29, 2026Hiroyasu Akada, Jesús Pérez, Emre Aksan +6HOI GenerationRobotic Grasping

    Google · Max Planck Institute for Informatics, SIC

  21. IMAGIN-4D: Image-Guided Controllable Interaction Generation

    Jun 22, 2026Sai Kumar Dwivedi, Federica Bogo, Buğra Tekin +6HOI GenerationHuman Motion Generation

    Meta, Switzerland · Max Planck Institute for Intelligent Systems, Tübingen, Germany · University of Amsterdam, Netherlands +1

  22. Policy-as-Data: Learning Generalizable HOI Diffusion Models from Simulated Physics

    Jun 22, 2026Shujia Li, Jianshu Hu, Haiyu Zhang +5HOI GenerationDiffusion Models

    Global College, Shanghai Jiao Tong University · Shanghai AI Laboratory · Beihang University

  23. Wh0: Generative World Models as Scalable Sources of Egocentric Human Hand Manipulation Data

    Jun 20, 2026Yangtao Chen, Zixuan Chen, Peiyang Wang +4HOI GenerationGeneralization in Robotic Manipulation

    Shanghai Innovation Institute · Nanjing University · Shanghai Jiaotong University

  24. MOCHI: Motion Enhancement of Collaborative Human-object Interactions

    Jun 16, 2026Jiye Lee, Yonghun Choi, Jungdam WonHOI GenerationHuman Motion Generation

    Department of Computer Science and Engineering, Seoul National University, South Korea

  25. ActWorld: From Explorable to Interactive World Model via Action-Aware Memory

    Jun 16, 2026Zhexiao Xiong, Yizhi Song, Hao Kang +11HOI GenerationWorld Model Learning

    1Washington University in St. Louis · 2Intelligent Creation, ByteDance · *Work done during internship at ByteDance

  26. Human Universal Grasping

    Jun 15, 2026Kevin Yuanbo Wu, Tianxing Zhou, Isaac Tu +5HOI GenerationRobotic Grasping

    New York University · Tsinghua University · University of Michigan

  27. TextHOI-3D: Text-to-3D Hand-Object Interaction via Discrete Multi-View Generation and Joint Mesh Optimization

    Jun 10, 2026Zixiong Hao, Zhencun JiangHOI Generation3D Mesh Generation

    Technical University of Munich School of Computation, Information and Technology · Tongji University Shanghai Research Institute for Intelligent Autonomous Systems

  28. GRAIL: Generating Humanoid Loco-Manipulation from 3D Assets and Video Priors

    Jun 3, 2026Tianyi Xie, Haotian Zhang, Jinhyung Park +17HOI GenerationHumanoid Loco-Manipulation

    NVIDIA · UCLA

  29. Dex2HOI: Dexterous Bimanual Two-Object Interaction Generation

    May 28, 2026Chrysa Pratikaki, Pablo Ruiz-Ponce, Jiankang Deng +2HOI GenerationHuman Motion Generation

    Imperial College London, UK · University of Alicante, Spain

  30. PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactions

    May 28, 2026Omer Benishu, Gal Fiebelman, Sagie BenaimHOI GenerationHuman Motion Generation

    Hebrew University of Jerusalem

  31. CoMoGen: COntrollable MOtion Dynamics and Interactions with Mask-Guided Video GENeration

    May 21, 2026Adil Meric, Lin Geng Foo, Mert Kiray +3HOI GenerationImage-to-Video Generation

    Technical University of Munich · Max Planck Institute for Informatics, Saarland Informatics Campus · Munich Center for Machine Learning (MCML) +1

  32. iTryOn: Mastering Interactive Video Virtual Try-On with Spatial-Semantic Guidance

    May 20, 2026Jun Zheng, Zhengze Xu, Mengting Chen +6HOI GenerationVirtual Try-On

    Shenzhen Campus of Sun Yat-sen University · Taobao & Tmall Group of Alibaba

  33. Dynamic Full-body Motion Agent with Object Interaction via Blending Pre-trained Modular Controllers

    May 12, 2026Sanghyeok Nam, Byoungjun Kim, Daehyung Park +1HOI GenerationHuman Motion Generation

    KAIST

  34. DexSynRefine: Synthesizing and Refining Human-Object Interaction Motion for Physically Feasible Dexterous Robot Actions

    May 7, 2026Hyesung Lee, Hyunwoo Jung, Si-Hwan Heo +1HOI GenerationDexterous Manipulation

    Korea Institute of Science and Technology · KAIST · Hanyang University

  35. MaMi-HOI: Harmonizing Global Kinematics and Local Geometry for Human-Object Interaction Generation

    May 7, 2026Hao Wang, Shiqi Wang, Qi LiuHOI GenerationHuman Motion Generation

    School of Future Technology, South China University of Technology, Guangzhou, Guangdong, China.

  36. InterPhys: Physics-aware Human Motion Synthesis in a Dynamic Scene

    May 1, 2026Chaoyue Xing, Wei Mao, Miaomiao LiuHOI GenerationHuman Motion Generation

    Australian National University, Canberra, Australia

  37. Stability-Driven Motion Generation for Object-Guided Human-Human Co-Manipulation

    Apr 22, 2026Jiahao Xu, Xiaohan Yuan, Xingchen Wu +3HOI GenerationFlow Matching

    1Tianjin University · 2National University of Singapore · 3Sichuan University

  38. CoInteract: Physically-Consistent Human-Object Interaction Video Synthesis via Spatially-Structured Co-Generation

    Apr 21, 2026Xiangyang Luo, Xiaozhe Xin, Tao Feng +3HOI GenerationPhysical Consistency in Video Generation

    Tsinghua University · Alibaba Group

  39. SynAgent: Generalizable Cooperative Humanoid Manipulation via Solo-to-Cooperative Agent Synergy

    Apr 20, 2026Wei Yao, Haohan Ma, Hongwen Zhang +6Robotic ControlHOI Generation

    School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China · Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China · School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China +2

  40. Ego-InBetween: Generating Object State Transitions in Ego-Centric Videos

    Apr 20, 2026Mengmeng Ge, Takashi Isobe, Xu Jia +7HOI GenerationAction-Conditioned Video Generation

    Advanced Micro Devices, Inc. · Dalian University of Technology · The Hong Kong University of Science and Technology +2

  41. EgoSim: Egocentric World Simulator for Embodied Interaction Generation

    Apr 1, 2026Jinkun Hao, Mingda Jia, Ruiyan Wang +7HOI GenerationEgocentric Vision

    Shanghai Jiaotong University · Shanghai AI Laboratory · The University of Hong Kong

  42. EgoForge: Goal-Directed Egocentric World Simulator

    Mar 20, 2026Yifan Shen, Jiateng Liu, Xinzhuo Li +9HOI GenerationDiffusion Model Guidance

    University of Illinois Urbana-Champaign · University of California San Diego

  43. Controllable Egocentric Video Generation via Occlusion-Aware Sparse 3D Hand Joints

    Mar 12, 2026Chenyangguang Zhang, Botao Ye, Boqi Chen +4HOI GenerationEgocentric Vision

    1ETH Zurich · 2ETH AI Center · 3MPI for Informatics +1

  44. CustomX: Unified Character, Action, and Scene Customization in Video World Models

    Dec 18, 2025Yitong Wang, Fangyun Wei, Hongyang Zhang +2HOI GenerationAction-Conditioned Video Generation

    Fudan University · Microsoft Research · University of Waterloo +1

  45. Learning to Generate Human-Human-Object Interactions from Textual Descriptions

    Nov 25, 2025Jeonghyeon Na, Sangwon Baik, Inhee Lee +2HOI GenerationHuman Motion Generation

    Seoul National University

  46. Learning to Generate Rigid Body Interactions with Video Diffusion Models

    Oct 2, 2025David Romero, Ariana Bermudez, Viacheslav Iablochnikov +3HOI GenerationPhysical Consistency in Video Generation

    MBZUAI, UAE · Picscreen, USA

  47. ECHO: Ego-Centric modeling of Human-Object interactions

    Aug 29, 2025Ilya A. Petrov, Vladimir Guzov, Riccardo Marin +5HOI Generation3D Reconstruction

    University of Tübingen, Germany · Tübingen AI Center, Germany · Technical University of Munich, Germany +3

  48. HunyuanVideo-HOMA: Generic Human-Object Interaction in Multimodal Driven Human Animation

    Jun 10, 2025Ziyao Huang, Zixiang Zhou, Juan Cao +9HOI GenerationPhysical Consistency in Video Generation

    University of Chinese Academy of Sciences · Tencent Hunyuan

  49. FunHOI: Annotation-Free 3D Hand-Object Interaction Generation via Functional Text Guidance

    Feb 28, 2025Yongqi Tian, Xueyu Sun, Haoyuan He +2HOI GenerationRobotic Grasping

    State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an, China

  50. Uni-HOI:A Unified framework for Learning the Joint distribution of Text and Human-Object Interaction

    Date pendingMengfei Zhang, Jinlu Zhang, Zhigang TuHOI GenerationUnified Multimodal Models

    Wuhan University Wuhan, China · Peking University Beijing, China