Bridging Concepts: Multi-Agent Reasoning over Scientific Concept Graphs for High-Impact Research Prediction
Organizations: School of Computing, KAIST · College of Business, KAIST · Department of AI Computing, KAIST
Abstract
Within a research community, new topics often emerge when previously unconnected concepts are first studied together. We construct scientific concept graphs (SCGs)--domain knowledge graphs whose nodes are fine-grained research concepts extracted from paper text by LLMs and whose edges capture their co-occurrence in papers--and study the task of forecasting high-impact concept pairs, i.e., discovering concept pairs that are currently unconnected but will have high impact when connected. To this end, we introduce new benchmark datasets constructed from CIKM, KDD, and SIGIR conference papers, with varied prediction settings, including impact forecasting for emerging concepts unseen during training. We propose MiroGraph, a Multi-agent reasoning framework with scientific concept Graphs, in which a feature designer agent designs predictive features for a given concept pair from structural, semantic, and trend perspectives, and then three LLM agents compute the actual feature values from the enclosing subgraph of the concept pair. Using these feature values, a classifier designer agent constructs a classifier that predicts the final impact labels. MiroGraph outperforms various impact forecasting and temporal link prediction methods.
Figures & tables
| Venue | Setting | |||||
| SCG-CIKM | Test | 6,544 | 74,887 | 2,254 | 1,916 | 338 |
| Eval | 6,059 | 61,862 | 1,948 | 1,610 | 338 | |
| SCG-KDD | Test | 3,833 | 41,685 | 3,196 | 2,716 | 480 |
| Eval | 3,529 | 34,561 | 2,490 | 2,010 | 480 | |
| SCG-SIGIR | Test | 3,188 | 34,445 | 2,734 | 2,324 | 410 |
| Eval | 2,925 | 27,465 | 2,618 | 2,208 | 410 |
| Method | SCG-CIKM | SCG-KDD | SCG-SIGIR | |||
| Test | Eval | Test | Eval | Test | Eval | |
| Impact4Cast ( Gu and Krenn, 2024 ) | 0.6633 0.0197 | 0.5865 0.0106 | 0.6030 0.0065 | 0.5811 0.0074 | 0.6143 0.0198 | 0.6106 0.0063 |
| TGAT ( Xu et al., 2020 ) | 0.6439 0.0062 | 0.5465 0.0069 | 0.5645 0.0025 | 0.5662 0.0013 | 0.5627 0.0061 | 0.5527 0.0148 |
| DyGFormer ( Yu et al., 2023 ) | 0.6785 0.0173 | 0.6264 0.0178 | 0.5764 0.0064 | 0.5736 0.0081 | 0.6065 0.0019 | 0.5951 0.0076 |
| CAWN ( Wang et al., 2021 ) | 0.6311 0.0086 | 0.5699 0.0049 | 0.5642 0.0024 | 0.5727 0.0018 | 0.5747 0.0180 | 0.6001 0.0098 |
| GraphMixer ( Cong et al., 2023 ) | 0.5844 0.0938 | 0.5162 0.0227 | 0.5724 0.0073 | 0.5194 0.0502 | 0.5566 0.0582 | 0.6118 0.0131 |
| Perspective | Feature | Value | Interpretation |
| Structural | Shortest path length | The pair is connected only through distant multi-hop bridges. | |
| Common neighbors | The pair is not a trivial local-closure case. | ||
| Semantic | Novelty synergy | The combination suggests a novel cross-area integration. | |
| Cross-domain fit | The pair bridges educational modeling and graph representation learning. | ||
| Trend | Current relevance | Both concepts are relevant to recent research directions. | |
| Attention durability | The topic is expected to sustain attention beyond a short-lived spike. |
Knowledge Tracing Methods' and Heterogeneous Graph.' The two target concepts are connected through several intermediate research concepts, including Self-attention mechanism, Attention mechanism, Embedding Method, Graph neural networks, and Cold start recommendation. Edges are annotated with citation counts aggregated for recent years, illustrating the temporal changes in interactions among related concepts.| Method | SCG-CIKM ( Test ) | SCG-CIKM ( Eval ) |
| MiroGraph | ||
| w/o structure | ||
| w/o semantic | ||
| w/o trend | ||
| single score | ||
| MLP |
Knowledge Graphs
Knowledge graphs represent entities and relationships as structured, queryable networks for integrating data and supporting reasoning.
See all 230 papers