This paper investigates whether structured representations can preserve the meaning of scientific sentences. To test this, a lightweight LLM is fine-tuned using a novel structural loss function to generate hierarchical JSON structures from sentences collected from scientific articles. These JSONs are then used by a generative model to reconstruct the original text. Comparing the original and reconstructed sentences using semantic and lexical similarity we show that hierarchical formats are capable of retaining information of scientific texts effectively.
Figures & tables
Domain
Repository
Articles
Sentences
Physics
arXiv
97
447
Computer Science
arXiv
39
193
Mathematics
arXiv
25
113
Economics
arXiv
50
249
Biology
bioRxiv
51
256
Chemistry
ChemRxiv
12
58
TABLE I: Dataset summary by domain and repository.
Metric
Mean
Std Dev
Cosine Similarity
0.8724
0.0682
BLEU
0.1496
0.1215
ROUGE-1 F1
0.5725
0.1138
METEOR
0.4907
0.1405
TABLE II: Summary Statistics on Test Set (n = 274)
ID
Original
Reconstructed
97
Nonlocal boxes, theoretical objects that violate a bipartite Bell inequality as much as the no-signaling principle allows and which are physically impossible for most scenarios, are feasible if the two parties have 3 measurements with 4 outputs.
Nonlocal boxes are feasible with specific measurements, given the condition of 3 measurements and 4 outputs, although they theoretically violate the bipartite Bell inequality and the no-signaling principle, making them physically impossible in most scenarios.
185
The study investigates the electronic properties of complex materials using advanced computational methods.
The study investigates the electronic properties of materials using advanced computational methods.
134
Our formulation and solution framework are to attain Pareto-optimal joint BS association and beamforming design strategies with guaranteed SINRS at the MSS.
The network design strategy involves the formulation and solution for optimal design, which is different from previous works, aiming for pareto-optimal strategies and guaranteed SINRS at MSS.
522
Therefore, in several cases they perform poorly compared to the fully digital approaches since they can not exploit the inherent spatial multiplexing gain of the channel.
In the comparison of digital vs.
TABLE III: Example Reconstructed and Original Sentences