Do Agents Need a New Kind of Paper? SPRA: Structured Paper Representation for Agents
Organizations: Shanghai Artificial Intelligence Laboratory · Shanghai Jiao Tong University
Abstract
Scientific agents must connect research problems, methods, and findings dispersed through narrative articles. We introduce SPRA (Structured Paper Representation for Agents), a paper-level representation of persistent research objects and typed relations. Its empirical-AI profile organizes Problems, Contributions, Components, ExperimentSetups, Measures, and Findings for querying, traversal, and reuse. Selected paper-level citation relations record dependencies, component use, and comparisons with prior work; source locations support verification. We instantiate SPRA across more than one million AI papers, with 19.95 million research units and 24.07 million internal relations. Evaluations access SPRA through Schema-RAG with task evidence fixed before inference. Across seven subfields, SPRA improves source-conditioned scientific QA by 0.381/5 over passage retrieval while remaining close to Full Compact (0.078/5 lower on average). In directed cross-paper reasoning, qualification improves by 0.184/5 over passage retrieval; Top-5 synthesis shows mixed quality effects. Across all paired RQ2 tasks, including Top-5, input+output tokens decrease by 28.5% relative to passage retrieval and 95.3% relative to Full Compact. In idea generation, a 0.067-point lower Overall score than Full Compact accompanies 93.7% fewer input+output tokens. Together, these results support SPRA as a usable representation of scientific content and a foundation for research workflows that connect, inspect, and reuse paper-level research objects. The SPRA resource is accessible through the Sciverse scholarly-data platform.
Figures & tables
| Relation | Scientific role | Source Target |
|---|---|---|
| part_of | Component or setup membership | |
| co_contribution | Joint contributions | |
| compares_to | Comparison of methods or measures | |
| evaluates | Measure applied to a method | |
| about | Subject of a finding | |
| supports | Provides evidence links from research objects to Findings |
| Statistic | Scope | Value |
|---|---|---|
| AI papers | AI literature; 1965–2026 | 1,059,112 |
| Core units | Corpus; 18.84/paper | 19,949,289 |
| Typed relations | Corpus; 22.73/paper | 24,073,381 |
| Evaluation sample | 7 subfields; 2025; 1,407 each | 9,849 |
| Locator references | Evaluation sample | 409,082 |
| Study | Condensed task | Required evidence |
|---|---|---|
| RQ1 G-U3 | Identify the problem and central contribution. | Problem + Contribution |
| RQ1-qual. | Bind qualifications to claims or methods. | Finding + qualification |
| RQ2 | Assess directed relations; synthesize papers. | Typed relations + multi-paper context |
| RQ3 | Generate a grounded benchmark-transfer idea. | Selected papers + qualifications |
| Measure | Full Compact | Text-RAG | Schema-RAG |
|---|---|---|---|
| G-U1 | 2.420 | 1.961 | 2.342 |
| G-U2 | 1.327 | 1.204 | 1.317 |
| G-U3 | 3.201 | 2.167 | 3.216 |
| Task | Metric | Full Compact | Text-RAG | Schema-RAG | Difference / reduction | |
| Answer quality (0–5) | ||||||
| Directed | Correctness | 2.583 | 4.543 | 4.569 | ||
| Grounding | 3.098 | 4.323 | 4.368 | |||
| Qualification | 2.756 | 4.104 | 4.288 | |||
| Top-5 | Correctness | 3.699 | 2.958 | 3.114 | ||
| Grounding | 3.439 | 3.110 | 2.966 | |||
| Metric | SPRA seeds | SPRA + citations |
|---|---|---|
| Cross-paper integration | 1.779 | 2.032 |
| Novelty | 2.100 | 2.172 |
| Evidence grounding | 1.848 | 1.931 |
| Qualification handling | 2.750 | 2.744 |
| Independent Overall | 2.302 | 2.379 |
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
| AI subfield | Eligible |
|---|---|
| Language, speech, and information access | 1,407 |
| Vision and multimodal perception | 1,407 |
| Learning, optimization, and general ML | 1,407 |
| Data, knowledge, and computational systems | 1,407 |
| Reasoning, agents, RL, and embodied AI | 1,407 |
| Trustworthy and human-centered AI | 1,407 |
| Dimension | Mean |
|---|---|
| Contribution-sentence coverage | 3.967 |
| Key-concept coverage | 4.031 |
| Information-unit alignment | 4.436 |
| Contribution-fact coverage | 3.890 |
| Evidence traceability | 4.998 |
| Overall (0–100) | 84.49 |
| Capability | JATS 1.4 | ORKG | PROV-O | RO-Crate v1.3 | SciREX | NCG | SPRA |
|---|---|---|---|---|---|---|---|
| Paper-associated research units | |||||||
| Typed scientific relations | |||||||
| Units linked to source content | |||||||
| Persistent resource identifiers | |||||||
| Explicit schema/profile validation | |||||||
| Scientific lookup/traversal API |
| Component | Description |
|---|---|
| Sample frame | 2,918 listed papers; 200 selected deterministically |
| Graph contexts | 313 contribution roots; three-hop traversal |
| Scientific statements | 6,578 statement occurrences |
| Mapping rules | Explicit research-role classes and predicate labels |
| Source identity | Scientific resource identifiers and paper-reference links |
| Study or outcome | Analysis frame | Complete pairs | Incomplete |
| RQ1, all question families | 9,849 | 9,438 | 411 |
| RQ1 G-U1, semantic QA | 5,628 | 5,510 | 118 |
| RQ1 G-U2, structured operations | 4,221 | 3,928 | 293 |
| RQ1 G-U3, Problem + Contribution | 1,407 | 1,378 | 29 |
| RQ2, directed | 2,461 | 2,431 | 30 |
| RQ2, Top-5 | 961 | 639 | 322 |
| Study | Evaluation scope | Primary comparison |
|---|---|---|
| RQ1 | 9,849 | Schema-RAG vs. Text-RAG (answer quality) |
| RQ2 | 3,070 complete pairs | Correctness: Schema-RAG vs. Text-RAG (directed); Schema-RAG vs. Full Compact (Top-5) |
| RQ3 | 1,001 | Overall idea quality, three conditions |
| Tasks ( ) | Condition | Mean | Median | Q1–Q3 | P90 |
|---|---|---|---|---|---|
| All (3,070) | Full Compact | 66,209 | 56,093 | 39,863–88,487 | 120,199 |
| All (3,070) | Text-RAG | 4,331 | 3,550 | 3,204–4,157 | 7,591 |
| All (3,070) | Schema-RAG | 3,098 | 2,557 | 2,438–2,773 | 5,335 |
| Directed (2,431) | Full Compact | 54,032 | 48,610 | 36,786–64,701 | 85,691 |
| Directed (2,431) | Text-RAG | 3,472 | 3,413 | 3,125–3,704 | 3,973 |
| Directed (2,431) | Schema-RAG | 2,511 | 2,506 | 2,412–2,604 | 2,704 |
| Access condition | Input representation | Overall (0–5) |
|---|---|---|
| Full Compact | Complete text | 2.965 |
| Text-RAG | Retrieved passages | 2.886 |
| Schema-RAG | SPRA research objects and relations | 2.898 |
| Contrast | Difference | 95% cluster-bootstrap interval | Exact | Holm |
|---|---|---|---|---|
| Schema-RAG–Full Compact | 0.0020 | 0.0059 | ||
| Schema-RAG–Text-RAG | 0.6792 | 0.6792 | ||
| Text-RAG–Full Compact | 0.0096 | 0.0193 |
| Workflow | Input+output (millions) | Reduction |
|---|---|---|
| Full Compact | 155.92 | – |
| Text-RAG | 11.87 | 92.4% |
| Schema-RAG | 9.77 | 93.7% |
| Metric | Seed | Expanded | 95% CI | |
|---|---|---|---|---|
| Cross-paper integration | 1.779 | 2.032 | ||
| Novelty | 2.100 | 2.172 | ||
| Evidence grounding | 1.848 | 1.931 | ||
| Qualification | 2.750 | 2.744 |
Knowledge Representation
Knowledge representation studies how to encode facts, concepts, rules, context, and uncertainty so machines can interpret and reason over them.
See all 121 papersAgents-K1: Towards Agent-native Knowledge Orchestration
cites edges, omitting key entities, claims, evidence, mechanisms, and method lineages essential for scientific reasoning. To this end, we introduce Agents-K1, an end-to-end knowledge orchestration pipeline that converts raw documents into agent-native scientific knowledge graphs. Agents-K1 integrates three components under a unifying theoretical foundation: a multimodal parser whose five-module schema captures entities, multimodal evidence, citations, and typed inter-entity relations across the full paper rather than abstracts alone; a 4B information-extraction backbone trained with GRPO under a rule-based reward; and a graphanything CLI, a tri-source agent interface that unifies web search, multimodal graph retrieval, and cross-document traversal. On top of this, we process 2.46 million scientific papers across six subjects to produce Scholar-KG, of which we release a one-million-paper subset, and the full Scholar-KG is accessible via the SCP link below. The same pipeline can be extended to general-domain corpora and to schema-conformant data synthesis. Extensive experiments demonstrate that Agents-K1 achieves superior performance in scientific information extraction, knowledge graph construction, and multi-hop scientific reasoning.