Sci-Mind: Cognitively-Inspired Adversarial Debate for Autonomous Mathematical Modeling
Organizations: Zhejiang Key Laboratory of Accessible Perception and Intelligent Systems, College of Computer Science and Technology, Zhejiang University, China · Hangzhou Dianzi University, China · Hangzhou Normal University, China
Abstract
Real-world mathematical modeling is inherently an experiential and collaborative endeavor. Domain experts rarely solve complex problems from scratch; instead, they draw upon analogies from historical cases and subject their hypotheses to rigorous peer scrutiny. However, autonomous agents powered by Large Language Models predominantly rely on isolated reasoning paradigms, frequently generating plausible but fundamentally flawed models due to a lack of domain grounding and adversarial verification. To address these limitations, we propose Sci-Mind, a novel framework that mirrors the human scientific discovery process. Sci-Mind integrates Experiential Memory Recall to retrieve executable code snippets and modeling paradigm descriptors, grounding abstract reasoning in historical solutions. Subsequently, it employs an Adversarial Cognitive Dialectic where a Theorist optimizing mathematical coherence and a Pragmatist enforcing data feasibility debate through competing objectives to prune elegant but infeasible formulations. A Self-Validating Execution Strategy further ensures blueprint consistency through formal predicates before code generation, achieving fully autonomous execution. Extensive experiments on the MM-Bench and EngiBench demonstrate that Sci-Mind significantly outperforms leading autonomous agents in both modeling rigorousness and code executability.
Figures & tables
| Method | Backbone | AE | MR | PS | RBA | CE (%) | Avg. |
|---|---|---|---|---|---|---|---|
| Direct Prompting | GPT-4o | 7.62 0.18 | 3.86 0.24 | 5.17 0.21 | 6.28 0.15 | 42.5 | 5.73 |
| Claude-3.5 | 7.78 0.16 | 4.15 0.22 | 5.42 0.19 | 6.50 0.17 | 45.8 | 5.96 | |
| DeepSeek-R1 | 8.05 0.14 | 5.32 0.28 | 5.85 0.20 | 6.92 0.16 | 48.2 | 6.54 | |
| Qwen-2.5-72B | 7.45 0.20 | 3.58 0.26 | 4.90 0.23 | 6.05 0.18 | 38.7 | 5.50 | |
| ReAct | GPT-4o | 7.89 0.15 | 5.24 0.31 | 6.02 0.19 | 6.71 0.22 | 51.8 | 6.47 |
| DS-Agent | GPT-4o | 8.18 0.14 | 7.08 0.26 | 7.47 0.18 | 7.86 0.20 | 68.2 | 7.65 |
| Method | Backbone | SC | PS | CB | Avg. | |||
|---|---|---|---|---|---|---|---|---|
| RS | CE | RS | CE | RS | CE | |||
| Direct Prompting | GPT-4o | 28.4 1.8 | 35.0 | 24.1 2.1 | 30.0 | 31.7 1.6 | 40.0 | 28.1 |
| DeepSeek-R1 | 34.2 1.5 | 42.5 | 30.8 1.9 | 37.5 | 38.5 1.4 | 47.5 | 34.5 | |
| MM-Agent | GPT-4o | 51.3 1.2 | 72.5 | 46.8 1.5 | 65.0 | 54.0 1.1 | 75.0 | 50.7 |
| DeepSeek-R1 | 56.8 1.0 | 77.5 | 52.4 1.3 | 72.5 | 59.2 0.9 | 80.0 | 56.1 | |
| Sci-Mind | GPT-4o | 63.8 0.8 | 90.0 | 58.5 1.0 | 85.0 | 66.2 0.7 | 92.5 | 62.8 |
| Variant | AE | MR | PS | RBA | CE (%) | CE | Overall |
|---|---|---|---|---|---|---|---|
| Module-Level Ablation | |||||||
| w/o EMR | 9.20 0.15 | 8.50 0.18 | 7.80 0.22 | 8.10 0.19 | 55.2 | 41.2 | 8.40 |
| w/o ACD | 9.30 0.12 | 7.45 0.24 | 8.60 0.16 | 8.50 0.15 | 94.0 | 2.4 | 8.46 |
| w/o SVE | 9.38 0.10 | 8.78 0.15 | 8.45 0.17 | 8.62 0.14 | 79.5 | 16.9 | 8.81 |
| ACD Design Alternatives | |||||||
| Self-Reflection | 9.32 0.11 | 7.68 0.21 | 8.72 0.14 | 8.55 0.13 | 93.5 | 2.9 | 8.57 |
Autonomous Research Agents
Autonomous research agents use language models and tools to search literature, design and run experiments, analyze results, and support scientific discovery.
See all 318 papers