Complexity Matter
Complexity science investigates how the inherent intricacy of systems influences their behavior and performance, with current research focusing on quantifying and understanding complexity in diverse domains like artificial intelligence, human cognition, and social interactions. Studies employ various models, including neural networks (e.g., transformers, K-U-Nets), agent-based models, and information-theoretic measures (e.g., Lempel-Ziv complexity, V-information), to analyze the relationship between complexity and key properties such as intelligence, efficiency, and robustness. This research is significant for advancing our understanding of complex systems and has implications for improving AI design, enhancing human-computer interaction, and developing more effective tools for analyzing and interpreting complex data.
Papers
Complexity Matters: Dynamics of Feature Learning in the Presence of Spurious Correlations
GuanWen Qiu, Da Kuang, Surbhi Goel
Simplicity in Complexity : Explaining Visual Complexity using Deep Segmentation Models
Tingke Shen, Surabhi S Nath, Aenne Brielmann, Peter Dayan
TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back) using Taylor-Softmax
Tobias Christian Nauen, Sebastian Palacio, Andreas Dengel
Neural Networks Learn Statistics of Increasing Complexity
Nora Belrose, Quintin Pope, Lucia Quirke, Alex Mallen, Xiaoli Fern
Advancing Legal Reasoning: The Integration of AI to Navigate Complexities and Biases in Global Jurisprudence with Semi-Automated Arbitration Processes (SAAPs)
Michael De'Shazer
RevOrder: A Novel Method for Enhanced Arithmetic in Language Models
Si Shen, Peijun Shen, Danhao Zhu