Feature Selection
Feature selection aims to identify the most relevant subset of features from a larger dataset, improving model performance, interpretability, and efficiency. Current research emphasizes developing novel algorithms, including those based on neural networks (e.g., RelChaNet), genetic algorithms, and large language models (LLMs), to select features effectively and efficiently, often incorporating techniques like causal inference and uncertainty quantification. These advancements are crucial for various applications, such as medical diagnosis, financial prediction, and recommender systems, where reducing dimensionality and improving model explainability are paramount. The field is also actively exploring new evaluation metrics and addressing challenges like fairness and privacy in feature selection.
Papers
Ensembling improves stability and power of feature selection for deep learning models
Prashnna K Gyawali, Xiaoxia Liu, James Zou, Zihuai He
Subspace Learning for Feature Selection via Rank Revealing QR Factorization: Unsupervised and Hybrid Approaches with Non-negative Matrix Factorization and Evolutionary Algorithm
Amir Moslemi, Arash Ahmadian