HOI Generation

HOI: Human-Object Interaction

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 50

All topics

VolCo: Volumetric Contact for High-Fidelity Human Grasp Generation
Oct 7, 2026Zhuo Chen, Yihua Cheng, Aleš Leonardis +1HOI Generation
University of Birmingham · Beijing Institute of Technology
Exo2EgoHOI: Hand-Object-Interaction Aware Exocentric-to-Egocentric Video Generation
Sep 29, 2026Hongjia Zhai, Xiyu Zhang, Haoran Zhang +5HOI Generation Egocentric Vision
MBZUAI · Zhejiang University · InSpatio
PAMI: Part Anchored Motion for Text to Human-Object Interaction Generation
Sep 29, 2026Chuqiao Li, Xianghui Xie, Yong Cao +2HOI Generation Text-to-Motion Generation
Tübingen AI Center, University of Tübingen, Germany · Max Planck Institute for Informatics, Saarland Informatics Campus, Germany
Counterfactual Video Generation Enables Scalable Humanoid Loco-Manipulation
Sep 29, 2026Zihan Wang, Zhen Wu, Pieter Abbeel +6HOI Generation Humanoid Loco-Manipulation
Amazon FAR · UC Berkeley · Stanford +1
Harnessing Coupled Stream Completion For Human-Object Interaction Modeling
Sep 26, 2026Dawei Guan, Di Yang, Jiangtao WangHOI Generation Motion Representation Learning
School of Artificial Intelligence and Data Science, University of Science and Technology of China
LYRIC: Language-Driven Physics-Based Character Control for Contact-Rich Whole-Body Object Interaction
Sep 17, 2026Zeyu Han, Zichong Meng, Julian Tanke +8HOI Generation Human Motion Generation
Northeastern University, USA · Sony AI America Inc, USA · Sony Interactive Entertainment Inc, Japan +3
InterMASH: A Unified Geometric Representation for Grasp Synthesis
Sep 16, 2026Xuanze Yang, Yumeng Liu, Haiyang Xin +5HOI Generation Robotic Grasping
University of Science and Technology of China, Hefei, China · Jiangsu Key Laboratory of AI for Industries and Institute of AI for Industries Chinese Academy of Sciences, Nanjing, China · Shenzhen University, Shenzhen, China
Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactions
Sep 15, 2026Liu Cao, Xingze Wu, Jingzhi Cui +4HOI Generation Humanoid Loco-Manipulation
1Tsinghua IIIS · 3Dalian University of Technology · 4The Chinese University of Hong Kong +1
RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction
Aug 13, 2026Tianyu Sun, Zhoujie Fu, Zihui Gao +2HOI Generation Synthetic Data Generation for Robotics
College of Computing and Data Science, Nanyang Technological University · College of Computer Science and Technology, Zhejiang University · Alibaba Group
MAD-HOI: Masked Autoregressive Diffusion for Generating Articulated Hand Object Interactions from Text
Aug 10, 2026Ananya Bal, Kartik Sharma, Ethan Lai +4HOI Generation Autoregressive Diffusion
Carnegie Mellon University
Surface Keypoint Representation for Multi-Object and Articulated Human-Object Interaction Generation
Aug 4, 2026Xiaogang Peng, Zeyu Han, Zichong Meng +4HOI Generation Human Motion Generation
Northeastern University, USA · Xi’an Jiaotong University, China · Amazon, USA
PhotoHOI: Synthesizing 3D Hand-Object Interactions from a Single RGB Photograph
Aug 3, 2026Zhenhao Zhang, Jiajun Zhang, Wei Min +1HOI Generation Dexterous Manipulation
Tsinghua University · Shadow AI
Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfer
Jul 30, 2026Weiquan Lin, Yu Deng, Shiyang Liu +6HOI Generation Human-Object Interaction
1Xidian University · 2Zhongguancun Academy · 3Microsoft Research Asia +2
Real-Time Human-Centric World Modeling for Upper-Body Human-Object Interaction
Jul 26, 2026Chaonan Ji, Jinwei Qi, Peng Zhang +1HOI Generation Human Motion Generation
Tongyi Lab, Beijing, China
AgentHOI: Multi-Agent Reasoning for Human-Object-Interaction Video Generation via Implicit Representation Alignment
Jul 24, 2026Ziyao Huang, Shunkai Li, Juan Cao +7HOI Generation Video Diffusion Models
University of Chinese Academy of Sciences · Tencent HunYuan
StreamHOI: Interaction-aware Temporal Memory Adaptation for Streaming HOI Video Generation
Jul 22, 2026Zejing Rao, Haoxian Zhang, Xiaoqiang Liu +5HOI Generation Long-Horizon Video Generation
National Cheng Kung University, Tainan, Taiwan
GIRAF: Towards Generalizable Human Interactions with Articulated Objects
Jul 8, 2026Xiaohan Zhang, Sebastian Starke, Alexander Winkler +3HOI Generation Text-to-Motion Generation
Tübingen AI Center, University of Tübingen · Max Planck Institute for Informatics, Saarland Informatics Campus · Meta Reality Labs Research
SparseCtrl-HOI: Sparse Temporal Control for Human-Object Interaction Video Generation
Jul 7, 2026Shenbo Xie, Mingrui Cai, Xu Yang +2HOI Generation Controllable Video Generation
South China University of Technology
JointHOI: Jointly Generating Contact Maps Enhances Hand Object Interaction Generation
Jul 2, 2026Mingyeong Song, Jungbin Cho, Jisoo Kim +5HOI Generation Diffusion Models
Ewha Womans University, Seoul, Korea · Yonsei University, Seoul, Korea · Carnegie Mellon University, Pittsburgh PA, USA +1
DCGrasp: Distance-aware Controllable Grasp Generation
Jun 29, 2026Hiroyasu Akada, Jesús Pérez, Emre Aksan +6HOI Generation Robotic Grasping
Google · Max Planck Institute for Informatics, SIC
IMAGIN-4D: Image-Guided Controllable Interaction Generation
Jun 22, 2026Sai Kumar Dwivedi, Federica Bogo, Buğra Tekin +6HOI Generation Human Motion Generation
Meta, Switzerland · Max Planck Institute for Intelligent Systems, Tübingen, Germany · University of Amsterdam, Netherlands +1
Policy-as-Data: Learning Generalizable HOI Diffusion Models from Simulated Physics
Jun 22, 2026Shujia Li, Jianshu Hu, Haiyu Zhang +5HOI Generation Diffusion Models
Global College, Shanghai Jiao Tong University · Shanghai AI Laboratory · Beihang University
Wh0: Generative World Models as Scalable Sources of Egocentric Human Hand Manipulation Data
Jun 20, 2026Yangtao Chen, Zixuan Chen, Peiyang Wang +4HOI Generation Generalization in Robotic Manipulation
Shanghai Innovation Institute · Nanjing University · Shanghai Jiaotong University
MOCHI: Motion Enhancement of Collaborative Human-object Interactions
Jun 16, 2026Jiye Lee, Yonghun Choi, Jungdam WonHOI Generation Human Motion Generation
Department of Computer Science and Engineering, Seoul National University, South Korea
ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
Jun 16, 2026Zhexiao Xiong, Yizhi Song, Hao Kang +11HOI Generation World Model Learning
1Washington University in St. Louis · 2Intelligent Creation, ByteDance · *Work done during internship at ByteDance
Human Universal Grasping
Jun 15, 2026Kevin Yuanbo Wu, Tianxing Zhou, Isaac Tu +5HOI Generation Robotic Grasping
New York University · Tsinghua University · University of Michigan
TextHOI-3D: Text-to-3D Hand-Object Interaction via Discrete Multi-View Generation and Joint Mesh Optimization
Jun 10, 2026Zixiong Hao, Zhencun JiangHOI Generation 3D Mesh Generation
Technical University of Munich School of Computation, Information and Technology · Tongji University Shanghai Research Institute for Intelligent Autonomous Systems
GRAIL: Generating Humanoid Loco-Manipulation from 3D Assets and Video Priors
Jun 3, 2026Tianyi Xie, Haotian Zhang, Jinhyung Park +17HOI Generation Humanoid Loco-Manipulation
NVIDIA · UCLA
Dex2HOI: Dexterous Bimanual Two-Object Interaction Generation
May 28, 2026Chrysa Pratikaki, Pablo Ruiz-Ponce, Jiankang Deng +2HOI Generation Human Motion Generation
Imperial College London, UK · University of Alicante, Spain
PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactions
May 28, 2026Omer Benishu, Gal Fiebelman, Sagie BenaimHOI Generation Human Motion Generation
Hebrew University of Jerusalem

Oct 7, 2026, cs.CVJ/K move · Enter open · S save

VolCo: Volumetric Contact for High-Fidelity Human Grasp Generation

Zhuo Chen, Yihua Cheng, Aleš Leonardis, Hyung Jin Chang

University of Birmingham · Beijing Institute of Technology

HOI Generation

Open paper AskPDF arXiv

Accurate contact modeling is fundamental to understanding hand-object interaction, yet existing contact representations are typically restricted to object surfaces and rely on hand-crafted rules to recover contact details, leading to severe penetrations and implausible results. To better exploit the rich detail in motion-capture data, we introduce Volumetric Contact (VolCo), a representation that expands surface points to a set of 3D volumetric grids. VolCo encodes 3D contact that allows precise hand part recovery, and is organized in an inherent hierarchy: local contact details within each volume and global hand geometry across all volumes. Our framework, VolCoDiff, employs two modules to capture local and global features following this hierarchy. For local contact details, we use a 3D variational autoencoder to model the possible hand configurations conditioned on the local object signed distance field (SDF). For global hand geometry, we design a prior-guided diffusion model that learns the distribution of compressed latent features aggregated from the volumetric grids. We evaluate our method on two benchmark datasets and demonstrate state-of-the-art performance in penetration and stability, indicating the capability to generate tight grasps with much less severe penetrations. Our code is available at https://github.com/chzh9311/volco.

Momentum

Related topics

Latest papers 50