Nearest Neighbor Classifier

The nearest neighbor classifier is a fundamental non-parametric method that assigns data points to classes based on their proximity to labeled training examples. Current research focuses on addressing its limitations in high-dimensional spaces, improving robustness against adversarial attacks, and developing efficient algorithms for large datasets and federated learning settings. These efforts involve exploring modified distance metrics, adaptive parameter selection, and novel architectures like self-encoders to enhance performance and scalability. The resulting improvements have significant implications for various applications, including image classification, active learning, and crowdsourcing, where efficient and robust classification is crucial.

Papers

July 6, 2024

On high-dimensional modifications of the nearest neighbor classifier
Annesha Ghosh, Deep Ghoshal, Bilol Banerjee, Anil K. Ghosh
Simple Classifier Benchmark Datasets Data Dimensionality Pairwise Distance Non Parametric Nearest Neighbor Classifier

April 9, 2024

On adversarial training and the 1 Nearest Neighbor classifier
Amir Hagai, Yair Weiss
Adversarial Example Adversarial Training Adversarial Robustness Nearest Neighbor Classifier

March 24, 2024

Exemplar-Free Class Incremental Learning via Incremental Representation
Libo Huang, Zhulin An, Yan Zeng, Chuanguang Yang, Xinqiang Yu, Yongjun Xu
Incremental Learning ImageNet Dataset Exemplar Free Class Incremental Learning Nearest Neighbor Classifier Transient Histogram

August 16, 2023

Two Phases of Scaling Laws for Nearest Neighbor Classifiers
Pengkun Yang, Jingzhao Zhang
Generalization Error Scaling Law Civil Engineering Phase Nearest Neighbor Classifier

June 25, 2023

A Self-Encoder for Learning Nearest Neighbors
Armand Boschin, Thomas Bonald, Marc Jeanmougin
Neural Network Self Supervised Nearest Neighbor Self Supervised Approach Categorical Feature Nearest Neighbor Classifier

September 26, 2022

PL-kNN: A Parameterless Nearest Neighbors Classifier
Danilo Samuel Jodas, Leandro Aparecido Passos, Ahsan Adeel, João Paulo Papa
Native Robustness Machine Learning Model Nearest Neighbor Nearest Neighbor Classifier KNN Clip

March 17, 2022

Nearest Neighbor Classifier with Margin Penalty for Active Learning
Yuan Cao, Zhiqiao Gao, Jie Hu, Mingchuan Yang, Jinpeng Chen
Active Learning Nearest Neighbor Margin Loss Nearest Neighbor Classifier

March 7, 2022

Improved Search of Relevant Points for Nearest-Neighbor Classification
Alejandro Flores-Velazco
Search Query Nearest Neighbor Structured Output Exceptional Point Border Control Nearest Neighbor Classifier Training Point

February 26, 2022

Enhanced Nearest Neighbor Classification for Crowdsourcing
Jiexin Duan, Xingye Qiao, Guang Cheng
Machine Learning Nearest Neighbor Crowdsourcing Context Expert Annotated Nearest Neighbor Classifier

January 13, 2022

Certifiable Robustness for Nearest Neighbor Classifiers
Austen Z. Fan, Paraschos Koutris
Native Robustness Machine Learning Model Certifiable Robustness Nearest Neighbor Classifier

December 14, 2021

Federated Nearest Neighbor Classification with a Colony of Fruit-Flies: With Supplement
Parikshit Ram, Kaushik Sinha
Federated Learning Federated Image Classification Hub Structure Nearest Neighbor Classifier