Unsupervised Keypoints

Unsupervised keypoint detection aims to automatically identify salient points in images or videos without relying on manually labeled data, a significant challenge in computer vision. Current research focuses on leveraging pre-trained models, such as vision transformers and diffusion models, to guide keypoint discovery, often incorporating techniques like clustering and entropy-based losses to improve performance and handle multiple instances within a scene. These advancements enable applications ranging from automated behavioral analysis in biology to improved medical image registration and analysis, reducing the need for extensive manual annotation and potentially leading to more efficient and accurate analyses across diverse fields.

Papers