Constructive Reduction
Constructive reduction focuses on efficiently decreasing the size or complexity of data or models while preserving essential information. Current research explores this across diverse fields, employing techniques like deep learning frameworks for dimensionality reduction and continuous representation (e.g., in climate data analysis), information-theoretic approaches for pruning neural networks and causal model simplification, and optimal transport methods for data augmentation and dimensionality reduction. These advancements improve data storage, accelerate model inference, enhance explainability, and enable the application of complex models to resource-constrained environments, impacting fields ranging from climate science and anomaly detection to reinforcement learning and medical imaging.
Papers
Reduce, Reuse, Recycle: Is Perturbed Data better than Other Language augmentation for Low Resource Self-Supervised Speech Models
Asad Ullah, Alessandro Ragano, Andrew Hines
A Quantum Computing-based System for Portfolio Optimization using Future Asset Values and Automatic Reduction of the Investment Universe
Eneko Osaba, Guillaume Gelabert, Esther Villar-Rodriguez, Antón Asla, Izaskun Oregi