Open-Set Recognition
Overview
Open-set recognition studies how models can classify known categories without forcing unfamiliar inputs into those categories, a need in settings such as medical diagnosis, security, and ecological monitoring. Common approaches use calibrated confidence, energy or distance scores, metric learning and prototypes; newer systems also use vision-language models, retrieval, and explicit negative examples. Work spans images, video, audio, text, biometrics, and object detection, with methods for rejecting unknowns as well as discovering and learning new classes. A central challenge is balancing accurate known-class predictions with reliable rejection under domain shift, while calibrating thresholds and evaluating them without access to representative unknown data.
Latest papers
69 papers9 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.
PHOEBI: An Open-World Benchmark for Multi-Label Bacterial Identification in Phase-Contrast Microscopy
Toward Open-Set Speaker Attribute Prediction with Keyword-Appended LLM Embeddings
Out-of-Distribution (OOD) Detectors for Open-Set RF Fingerprinting
Dual-Branch Gated Fusion for Open-Set Audio Deepfake Source Tracing
SafeECGMatch: Calibration-Aware Joint Frequency and Time Space Semi-Supervised Learning for Open-Set ECG Classification
A Closer Look at In-Distribution vs. Out-of-Distribution Accuracy for Open-Set Test-time Adaptation
Beyond the Simplex: Balanced Prototype Geometry for Scorer-Agnostic Open-Set Recognition
HOLA: Holistic Multi-Modal Alignment for Open-Set 3D Recognition
Immuno-VLM: Immunizing Large Vision-Language Models via Generative Semantic Antibodies for Open-World Trustworthiness
Hubris of Semantics'', where models force-fit unknown anomalies into known categories with high confidence due to the lack of explicit negative knowledge. To address this *Open-World Trustworthiness Paradox*, we propose **Immuno-VLM**, a bio-inspired framework that adapts the biological principle of **Immunological Negative Selection** to high-dimensional latent spaces. Departing from traditional Open-Set Recognition methods that rely on passive density estimation or inefficient pixel-space outlier generation, Immuno-VLM leverages the generative reasoning of Large Language Models to actively hallucinate Semantic Antibodies'', textual descriptions of near-distribution outliers (e.g., look-alikes, contextual anomalies) that effectively bound the decision space of known classes.Extensive experiments on ImageNet-1K and four challenging OOD benchmarks reveal that Immuno-VLM establishes a new state-of-the-art.Open World Autoencoding Drift Detection with Novel Class Recognition in Tabular Non-stationary Data Streams
Not All Inputs Are Valid: Towards Open-Set Video Moment Retrieval Using Language
video-relevant query'' as in-distribution (ID) query'' and video-irrelevant query'' as out-of-distribution (OOD) query''.}. Given an OOD query in open-set scenarios, they still utilize it for wrong retrieval, which might lead to irrecoverable losses in high-risk scenarios, e.g., criminal activity detection. To this end, we creatively explore a brand-new VMR setting termed Open-Set Video Moment Retrieval (OS-VMR), where we should not only retrieve the precise moments based on ID query, but also reject OOD queries. In this paper, we make the first attempt to step toward OS-VMR and propose a novel model OpenVMR, which first distinguishes ID and OOD queries based on the normalizing flow technology, and then conducts moment retrieval based on ID queries. Specifically, we first learn the ID distribution by constructing a normalizing flow, and assume the ID query distribution obeys the multi-variate Gaussian distribution. Then, we introduce an uncertainty score to search the ID-OOD separating boundary. After that, we refine the ID-OOD boundary by pulling together ID query features. Besides, video-query matching and frame-query matching are designed for coarse-grained and fine-grained cross-modal interaction, respectively. Finally, a positive-unlabeled learning module is introduced for moment retrieval. Experimental results on three VMR datasets show the effectiveness of our OpenVMR.DualMem: Bypassing the Objectness Bottleneck for Calibrated Unknown-Stream Filtering in Open-World Object Detection
A Systematic Failure Analysis of Vision Foundation Models for Open Set Iris Presentation Attack Detection
Evidence-Guided Unknown Rejection for High-Confidence Near-Known Unknowns
is this sample's score high enough?'' to does this predicted known class have sufficient evidence to accept this sample?'' EGUR-A combines class-conditional local acceptance evidence with global residual evidence, and selects their relative weight from known-sample statistics without unknown validation data. Across CUB, FGVC-Aircraft, and ImageNet-hard, EGUR-A substantially reduces high-confidence false known acceptance at matched known-rejection operating points. The result is not a stronger threshold; it is a different question: whether a known class is entitled to accept a sample.