Complex Reasoning
Complex reasoning in artificial intelligence focuses on developing models capable of multi-step, logical inference and problem-solving, mirroring human cognitive abilities. Current research emphasizes improving large language models (LLMs) through techniques like chain-of-thought prompting, retrieval-augmented generation (RAG), and the integration of symbolic reasoning with neural networks, often incorporating multi-modal data (e.g., visual and textual information). These advancements are significant for enhancing the reliability and applicability of AI systems across diverse fields, including autonomous driving, robotics, and scientific discovery, by enabling more robust and accurate decision-making in complex scenarios.
Papers
MALT: Improving Reasoning with Multi-Agent LLM Training
Sumeet Ramesh Motwani, Chandler Smith, Rocktim Jyoti Das, Markian Rybchuk, Philip H. S. Torr, Ivan Laptev, Fabio Pizzati, Ronald Clark, Christian Schroeder de Witt
Planning and Reasoning with 3D Deformable Objects for Hierarchical Text-to-3D Robotic Shaping
Alison Bartsch, Amir Barati Farimani
Do Large Language Models with Reasoning and Acting Meet the Needs of Task-Oriented Dialogue?
Michelle Elizabeth, Morgan Veyret, Miguel Couceiro, Ondrej Dusek, Lina M. Rojas-Barahona
Learning by Analogy: Enhancing Few-Shot Prompting for Math Word Problem Solving with Computational Graph-Based Retrieval
Xiaocong Yang, Jiacheng Lin, Ziqi Wang, Chengxiang Zhai
The Two-Hop Curse: LLMs trained on A->B, B->C fail to learn A-->C
Mikita Balesni, Tomek Korbak, Owain Evans
Preference Optimization for Reasoning with Pseudo Feedback
Fangkai Jiao, Geyang Guo, Xingxing Zhang, Nancy F. Chen, Shafiq Joty, Furu Wei
Unraveling Arithmetic in Large Language Models: The Role of Algebraic Structures
Fu-Chieh Chang, Pei-Yuan Wu
From Laws to Motivation: Guiding Exploration through Law-Based Reasoning and Rewards
Ziyu Chen, Zhiqing Xiao, Xinbei Jiang, Junbo Zhao
Evolution of Thought: Diverse and High-Quality Reasoning via Multi-Objective Optimization
Biqing Qi, Zhouyi Qian, Yiang Luo, Junqi Gao, Dong Li, Kaiyan Zhang, Bowen Zhou