Adapt Semantics, Not Structure: Few-Instance Schema Calibration for Scientific PDF Extraction
Organizations: School of Computer Science and Technology, University of Science and Technology of China · State Key Laboratory of Cognitive Intelligence · University of Science and Technology of China · CCCC Second Highway Consultants Co., Ltd.
Abstract
A well-designed extraction schema is not necessarily ready for reliable LLM execution. When only limited verified extractions are available, manually tuning hundreds of field definitions through trial and error is costly. We frame this problem as few-instance schema calibration: adapting the operational semantics of an existing schema from a few annotated documents while preserving its structural contract. We introduce CPSE, a contract-preserving semantic extraction framework that jointly calibrates extraction prompts and field-level semantic descriptions from a few gold annotations. CPSE decomposes the schema into an invariant structural contract and mutable field semantics, and further separates identity discovery from record completion using manifest-conditioned resolution. On expert-annotated polymer-science documents, CPSE improves extraction by 9.93 points over an execution-matched baseline, with consistent gains under an independent judge and in a blinded expert audit. These results show that CPSE enables low-resource schema execution while preserving the output structure required downstream.
Figures & tables
| Method | Sol | Terra |
|---|---|---|
| Single-pass baseline | 76.45 | 75.84 |
| Prompt adaptation | 83.26 | 82.44 |
| Description adaptation | 82.09 | 84.28 |
| Prompt + description | 86.74 | 86.64 |
| Manifest-conditioned baseline | 81.02 | 83.88 |
| Full CPSE | 90.95 | 91.09 |
| Method | Sol | Terra |
|---|---|---|
| GEPA prompt only [ 1 ] | 82.12 | 83.03 |
| GEPA [ 1 ] + manifest | 85.52 | 85.50 |
| MIPROv2 full [ 10 ] | 79.44 | 77.86 |
| MIPROv2 instruction only [ 10 ] | 74.21 | 72.44 |
| OPRO [ 16 ] | 71.35 | 71.24 |
| Fixed 3-shot ICL | 76.50 | 74.37 |