Optimization Purpose
Optimization, the process of finding the best solution from a set of possibilities, is a fundamental problem across numerous scientific and engineering disciplines. Current research focuses on improving the efficiency and robustness of optimization algorithms, particularly for complex, high-dimensional problems, employing techniques like graph neural networks, normalizing flows, and variants of gradient descent tailored to specific architectures (e.g., transformers, neural differential equations). These advancements are crucial for addressing challenges in diverse fields, ranging from power systems management and robotic control to machine learning model training and resource allocation, ultimately leading to more efficient and effective solutions in various applications.
Papers
L3Ms -- Lagrange Large Language Models
Guneet S. Dhillon, Xingjian Shi, Yee Whye Teh, Alex Smola
ST-ITO: Controlling Audio Effects for Style Transfer with Inference-Time Optimization
Christian J. Steinmetz, Shubhr Singh, Marco Comunità, Ilias Ibnyahya, Shanxin Yuan, Emmanouil Benetos, Joshua D. Reiss
AutoRAG: Automated Framework for optimization of Retrieval Augmented Generation Pipeline
Dongkyu Kim, Byoungwook Kim, Donggeon Han, Matouš Eibich
LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
Jui-Nan Yen, Si Si, Zhao Meng, Felix Yu, Sai Surya Duvvuri, Inderjit S. Dhillon, Cho-Jui Hsieh, Sanjiv Kumar
Logarithmically Quantized Distributed Optimization over Dynamic Multi-Agent Networks
Mohammadreza Doostmohammadian, Sérgio Pequito
Simmering: Sufficient is better than optimal for training neural networks
Irina Babayan, Hazhir Aliahmadi, Greg van Anders
OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization
Hongliang He, Wenlin Yao, Kaixin Ma, Wenhao Yu, Hongming Zhang, Tianqing Fang, Zhenzhong Lan, Dong Yu
How Critical is Site-Specific RAN Optimization? 5G Open-RAN Uplink Air Interface Performance Test and Optimization from Macro-Cell CIR Data
Johnathan Corgan, Nitin Nair, Rajib Bhattacharjea, Wan Liu, Serhat Tadik, Tom Tsou, Timothy J. O'Shea
AgentForge: A Flexible Low-Code Platform for Reinforcement Learning Agent Design
Francisco Erivaldo Fernandes Junior, Antti Oulasvirta