Semantic Pose

Semantic pose research focuses on understanding and representing the pose of objects or humans in a way that incorporates meaningful contextual information, going beyond simple geometric location. Current research emphasizes robust pose estimation using deep learning models, often incorporating keypoint detection and convolutional neural networks, with a focus on improving accuracy and robustness against factors like motion blur, varying lighting, and semantic perturbations. This work has significant implications for applications ranging from sign language recognition and athletic performance analysis to augmented reality and visual localization systems, improving the accuracy and reliability of these technologies.

Papers

August 17, 2024

An Open-Source American Sign Language Fingerspell Recognition and Semantic Pose Retrieval Interface
Kevin Jose Thomas
Sign Language Translation American Sign Language Semantic Pose Recognition Module

July 31, 2024

Certifying Robustness of Learning-Based Keypoint Detection and Pose Estimation Methods
Xusheng Luo, Tianhao Wei, Simin Liu, Ziwei Wang, Luis Mattei-Mendez, Taylor Loper, Joshua Neighbor, Casidhe Hutchison, Changliu Liu
Pose Estimation Keypoint Detection Keypoint Detector Certifiable Robustness Local Robustness Semantic Pose

September 2, 2023

Mitigating Motion Blur for Robust 3D Baseball Player Pose Modeling for Pitch Analysis
Jerrin Bright, Yuhao Chen, John Zelek
Pose Estimation Motion Blur Pitch Controllability Semantic Pose

May 17, 2023

LPMM: Intuitive Pose Control for Neural Talking-Head Model via Landmark-Parameter Morphable Model
Kwangho Lee, Patrick Kwon, Myung Ki Lee, Namhyuk Ahn, Junsoo Lee
Morphable Model Talking Head Pose Control Semantic Pose

November 12, 2022

Bipartite Graph Reasoning GANs for Person Pose and Facial Image Synthesis
Hao Tang, Ling Shao, Philip H. S. Torr, Nicu Sebe
Generative Adversarial Network Human Pose Graph Reasoning Semantic Pose

April 12, 2022

Semantic keypoint-based pose estimation from single RGB frames
Karl Schmeckpeper, Philip R. Osteen, Yufu Wang, Georgios Pavlakos, Kenneth Chaney, Wyatt Jordan, Xiaowei Zhou, Konstantinos G. Derpanis, Kostas Daniilidis
Deep Convolutional Neural Network Human Pose 3D Human Pose High Performing 1D ConvNet 6 DoF Single RGB Image Semantic Pose

March 31, 2022

Semantic Pose Verification for Outdoor Visual Localization with Self-supervised Contrastive Learning
Semih Orhan, Jose J. Guerrero, Yalin Bastanlar
Contrastive Learning Semantic Similarity Visual Localization Self Supervised Contrastive Learning Semantic Pose

March 23, 2022

Muscle Vision: Real Time Keypoint Based Pose Classification of Physical Exercises
Alex Moran, Bart Gebka, Joshua Goldshteyn, Autumn Beyer, Nathan Johnson, Alexander Neuwirth
Image Recognition 3D Human Physical Activity Biological Vision Downstream Forecasting Task Semantic Pose

Semantic Pose

Papers

An Open-Source American Sign Language Fingerspell Recognition and Semantic Pose Retrieval Interface

Certifying Robustness of Learning-Based Keypoint Detection and Pose Estimation Methods

Mitigating Motion Blur for Robust 3D Baseball Player Pose Modeling for Pitch Analysis

LPMM: Intuitive Pose Control for Neural Talking-Head Model via Landmark-Parameter Morphable Model

Bipartite Graph Reasoning GANs for Person Pose and Facial Image Synthesis

Semantic keypoint-based pose estimation from single RGB frames

Semantic Pose Verification for Outdoor Visual Localization with Self-supervised Contrastive Learning

Muscle Vision: Real Time Keypoint Based Pose Classification of Physical Exercises