Fundamental Limitation

Fundamental limitations in artificial intelligence research currently focus on identifying and addressing bottlenecks in model capabilities and performance. Active research areas include exploring the limitations of large language models (LLMs) in reasoning, particularly compositional abilities and handling complex tasks; analyzing the inherent quadratic time complexity of transformer architectures and the challenges of developing subquadratic alternatives; and investigating the impact of data quality and size on model performance and safety. Understanding these limitations is crucial for improving the reliability, safety, and efficiency of AI systems and for developing more robust and generalizable models across various applications.

Papers

June 21, 2022

On the Limitations of Elo: Real-World Games, are Transitive, not Additive
Quentin Bertrand, Wojciech Marian Czarnecki, Gauthier Gidel
Fundamental Limitation Strong Transitivity Relation Elo Rating Transitive Game Real World Game

June 20, 2022

Limitations of the NTK for Understanding Generalization in Deep Learning
Nikhil Vyas, Yamini Bansal, Preetum Nakkiran
Deep Learning Strong Generalization Neural Tangent Kernel Fundamental Limitation Kernel Size Layer NTK Scaling Deep Network

June 19, 2022

On the Limitations of Stochastic Pre-processing Defenses
Yue Gao, Ilia Shumailov, Kassem Fawaz, Nicolas Papernot
Adversarial Example Adversarial Robustness Fundamental Limitation Stochastic Way Adversarial Input Stochastic Defense

June 9, 2022

Multiple Instance Learning for Digital Pathology: A Review on the State-of-the-Art, Limitations & Future Potential
Michael Gadermayr, Maximilian Tschuchnig
Deep Neural Network Full Potential State of the Art Multiple Instance Learning Digital Pathology Fundamental Limitation Deep Multiple Instance

June 5, 2022

Sequential Counterfactual Decision-Making Under Confounded Reward
Erik Skalnes
Fundamental Limitation Randomized Experiment Soft Intervention

May 22, 2022

Limitations of a proposed correction for slow drifts in decision criterion
Diksha Gupta, Carlos D. Brody
Fundamental Limitation Language Correction Real Drift Systematic Bias Generative Trajectory Trial and Error

May 16, 2022

Power and limitations of single-qubit native quantum neural networks
Zhan Yu, Hongshun Yao, Mujin Li, Xin Wang
Neural Network Real Power Quantum Physic Quantum Circuit Fundamental Limitation Quantum Neural Network Quantum Neuron

May 13, 2022

Differentiable programming: Generalization, characterization and limitations of deep learning
Adrián Hernández, Gilles Millerioux, José M. Amigó
Deep Learning Deep Learning Model Strong Generalization Fundamental Limitation New Characterization Differentiable Programming Differentiable Program

May 10, 2022

Fundamental limitations on optimization in variational quantum algorithms
Hao-Kai Zhang, Chengkai Zhu, Geng Liu, Xin Wang
Optimization Purpose Fundamental Limitation Variational Quantum Algorithm Parameterized Quantum Circuit Near Term Quantum Quantum Application

May 9, 2022

Detecting the Role of an Entity in Harmful Memes: Techniques and Their Limitations
Rabindra Nath Nandi, Firoj Alam, Preslav Nakov
Integral Role Fundamental Limitation Barzilai Borwein Technique Entity Mention Internet Meme hARmful Meme Abusive Content

April 27, 2022

April 17, 2022

Video Action Detection: Analysing Limitations and Challenges
Rajat Modi, Aayush Jung Rana, Akash Kumar, Praveen Tirupattur, Shruti Vyas, Yogesh Singh Rawat, Mubarak Shah
Technical Challenge Motion Information Fundamental Limitation Temporal Order Video Action Detection

February 28, 2022

Limitations of Deep Learning for Inverse Problems on Digital Hardware
Holger Boche, Adalbert Fono, Gitta Kutyniok
Deep Learning Deep Neural Network Inverse Problem Fundamental Limitation Hardware Environment Banach Mazur Computable

February 20, 2022

Trying to Outrun Causality with Machine Learning: Limitations of Model Explainability Techniques for Identifying Predictive Variables
Matthew J. Vowels
Machine Learning Causal Structure Fundamental Limitation Causal Pattern Underlying Causal Explainability Technique Causal Objective Function

February 17, 2022

Limitations of Neural Collapse for Understanding Generalization in Deep Learning
Like Hui, Mikhail Belkin, Preetum Nakkiran
Deep Learning Strong Generalization Fundamental Limitation Neural Collapse Generalization Property

February 1, 2022

On the Limitations of General Purpose Domain Generalisation Methods
Henry Gouk, Ondrej Bohdal, Da Li, Timothy Hospedales
Domain Generalization Empirical Risk Minimization Fundamental Limitation Pairwise Distance Integral Probability Metric Domain Generalisation