Building verifiable databases at scale from the chemical literature via a multi-agent system
Organizations: Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Hong Kong SAR, China · Department of Chemistry, The Hong Kong University of Science and Technology, Hong Kong SAR, China · Department of Data Science, City University of Hong Kong, Hong Kong SAR, China · Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong SAR, China
Abstract
Accelerating chemical research with artificial intelligence requires high-quality databases. However, many reactions exist only as graphics drawn for human readers, which machines must read exactly. Specialist software is precise but rigid, whereas multimodal language models are flexible yet often write incorrect structures; neither flags errors. We present ChemEAGLE, a multi-agent system where tools supply structures and a language model extends their reach through judgments that programs apply. On 424 published graphics, its F1 score for exactly correct reactions was 82.2%, against 47.7% for a tool-equipped generalist agent, and calibrated confidence limited review to 35% of reactions at 96.6% accuracy. Without review, it built a 60,103-reaction photochemistry database whose records trained models to rank conditions and predict products. Verifiable databases can thus be built at scale.
Figures & tables
| ID | Labels | Reactants | Products | Yield; dr; ee |
| 0_1 | 1, 2 3 | C()=C=O + Cc1ccc(S(=O)(=O)N2OC2c2ccccc2Cl)cc1 | C1()OC@HN(S(=O)(=O)c2ccc(C)cc2)C1=O | 38 - 78% |
| 1_1 | 1a, 2 3a | CCC(=C=O)c1ccccc1 + Cc1ccc(S(=O)(=O)N2OC2c2ccccc2Cl)cc1 | CC[C@@]1(c2ccccc2)OC@HN(S(=O)(=O)c2ccc(C)cc2)C1=O | 71%; 14:1 dr; 91% ee |
| 2_1 | 1b, 2 3b | CCC(=C=O)c1ccc(Br)cc1 + Cc1ccc(S(=O)(=O)N2OC2c2ccccc2Cl)cc1 | CC[C@@]1(c2ccc(Br)cc2)OC@HN(S(=O)(=O)c2ccc(C)cc2)C1=O | 78%; 14:1 dr; 91% ee |
| 3_1 | 1c, 2 3c | CC(=C=O)c1ccccc1 + Cc1ccc(S(=O)(=O)N2OC2c2ccccc2Cl)cc1 | Cc1ccc(S(=O)(=O)N2C(=O)C@(c3ccccc3)O[C@@H]2c2ccccc2Cl)cc1 | 52%; 15:1 dr; 85% ee |
| 4_1 | 1d, 2 3d | CCCC(=C=O)c1ccccc1 + Cc1ccc(S(=O)(=O)N2OC2c2ccccc2Cl)cc1 | CCC[C@@]1(c2ccccc2)OC@HN(S(=O)(=O)c2ccc(C)cc2)C1=O | 60%; 14:1 dr; 92% ee |
| 5_1 | 1e, 2 3e | CCCCC(=C=O)c1ccc(Br)cc1 + Cc1ccc(S(=O)(=O)N2OC2c2ccccc2Cl)cc1 | CCCC[C@@]1(c2ccc(Br)cc2)OC@HN(S(=O)(=O)c2ccc(C)cc2)C1=O | 61%; 14:1 dr; 95% ee |
| ID | Labels | Reactants | Products | Yield; dr; ee |
| 0_1 | 1, 2 3 | O=C=C(Ar)R + O1C(N1S(=O)(=O)c2ccccc2)Ar2 | O=C1C(OC(N1S(=O)(=O)c2ccccc2)Ar2)(R)Ar | 38 - 78% |
| 1_1 | 1a, 2a 3a | O=C=C(c1ccccc1)CC + O1C(N1S(=O)(=O)c2ccccc2)c3ccccc3Cl | O=C1C@(OC([C@H]1N1S(=O)(=O)c2ccccc2)c3ccccc3Cl)c4ccccc4 | 71% yield; 14:1 dr; 91% ee |
| 2_1 | 1b, 2a 3b | O=C=C(c1ccc(cc1)Br)CC + O1C(N1S(=O)(=O)c2ccccc2)c3ccccc3Cl | O=C1C@(OC([C@H]1N1S(=O)(=O)c2ccccc2)c3ccccc3Cl)c4ccc(cc4)Br | 78% yield; 14:1 dr; 91% ee |
| 3_1 | 1c, 2a 3c | O=C=C(c1ccccc1)C + O1C(N1S(=O)(=O)c2ccccc2)c3ccccc3Cl | O=C1C@(OC([C@H]1N1S(=O)(=O)c2ccccc2)c3ccccc3Cl)c4ccccc4 | 52% yield; 15:1 dr; 85% ee |
| 4_1 | 1d, 2a 3d | O=C=C(c1ccccc1)CCC + O1C(N1S(=O)(=O)c2ccccc2)c3ccccc3Cl | O=C1C@(OC([C@H]1N1S(=O)(=O)c2ccccc2)c3ccccc3Cl)c4ccccc4 | 60% yield; 14:1 dr; 92% ee |
| 5_1 | 1e, 2a 3e | O=C=C(c1ccc(cc1)Br)CCCC + O1C(N1S(=O)(=O)c2ccccc2)c3ccccc3Cl | O=C1C@(OC([C@H]1N1S(=O)(=O)c2ccccc2)c3ccccc3Cl)c4ccc(cc4)Br | 61% yield; 14:1 dr; 95% ee |
| ID | Labels | Reactants | Products | Yield; dr; ee |
| 0_1 | –, – – | O=C=C() + O1C(N1S(=O)(=O)c1ccc(C)cc1)Ar2 | Clc1ccccc1[C@H]1OC@(R)C(=O)N1S(=O)(=O)c1ccc(C)cc1 | 38 - 78% |
| 1_1 | –, – – | O=C=C() + O1C(c2ccccc2Cl)N1S(=O)(=O)c1ccc(C)cc1 | CC[C@@]1(c2ccccc2)OC@HN(S(=O)(=O)c2ccc(C)cc2)C1=O | 71% yield; 14:1 dr; 91% ee |
| 1_2 | –, – – | O=C=C() + O1C(c2ccccc2Cl)N1S(=O)(=O)c1ccc(C)cc1 | CC[C@@]1(c2ccc(Br)cc2)OC@HN(S(=O)(=O)c2ccc(C)cc2)C1=O | 78% yield; 14:1 dr; 91% ee |
| 1_3 | –, – – | O=C=C() + O1C(c2ccccc2Cl)N1S(=O)(=O)c1ccc(C)cc1 | C[C@@]1(c2ccccc2)OC@@HN(S(=O)(=O)c2ccc(C)cc2)C1=O | 52% yield; 15:1 dr; 85% ee |
| 2_1 | –, – – | O=C=C() + O1C(c2ccccc2Cl)N1S(=O)(=O)c1ccc(C)cc1 | CCC[C@@]1(c2ccccc2)OC@@HN(S(=O)(=O)c2ccc(C)cc2)C1=O | 60% yield; 14:1 dr; 92% ee |
| 2_2 | –, – – | O=C=C() + O1C(c2ccccc2Cl)N1S(=O)(=O)c1ccc(C)cc1 | CCCC[C@@]1(c2ccc(Br)cc2)OC@HN(S(=O)(=O)c2ccc(C)cc2)C1=O | 61% yield; 14:1 dr; 95% ee |
Document Information Extraction
Document Information Extraction turns text, tables, forms, and images into structured, searchable data.
See all 305 papers