ULTRADISCOVERY: Abductive Exploration in an Interconnected, Epistemically Open Universe
Authors: Weihan Li, Tianshi Zheng, Yangqiu Song, Ginny Y. Wong, Simon See
Organizations: Department of Mechanical Engineering, The University of Tokyo, Tokyo, Japan · Department of Computer Science and Engineering, HKUST, Hong Kong SAR, China · NVIDIA AI Technology Center (NVAITC), NVIDIA, Santa Clara, USA
Scientific discovery often begins when scattered clues call for a new way of describing the world. Such abductive exploration can require constructing the representation in which an explanation is stated, when the world is epistemically open, and composing evidence scattered across contexts, when it is structurally interconnected. Existing benchmarks rarely separate these two demands or control them independently. We introduce ULTRADISCOVERY, an interactive world of five domains in which an agent revises an initially successful theory and predicts the outcome of an unseen cross-domain intervention. A 2×2 design leaves the representation open or discloses it, and leaves the evidence distributed or aligns it, with the latent dynamics fixed. With the representation open, agents across eleven models often retract the axiom they were taught, and none introduces the unobserved entity or rewrites the variables that a replacement requires. Disclosure triples intervention requests and adds about one of the eighteen findings the world affords, and alignment adds less. Two vendor-harness systems carry discovery into more domains, and one of them rewrites the variables in Open episodes. No system makes the exact prediction within 200 paid actions. At larger budgets one exact prediction appears with both aids, while every Open episode remains inexact. The results locate the difficulty in the step from accumulating evidence to composing it into a representation that transfers.
Figures & tables
Figure 1: How much representation is supplied before inquiry. From top to bottom: a supplied hypothesis space, supplied variables, and the epistemically open setting of UltraDiscovery , where the agent constructs entities, variables and laws from instrument readings, under the instruments’ own names (Table A.1 ).
Figure 2: The epistemic structure of UltraDiscovery . Eighteen blocks in five domains, joined by the edges along which the findings support one another (upper panel). Three hyperedges each join three blocks read in three domains to a representation change, and HC joins the five blocks behind the terminal prediction (lower panel).
Figure 3: The world of UltraDiscovery , what it teaches, what is true and what it asks. Top: the five domains with their function, the 24-tick pass that resets while the notes persist, and 200 paid actions. (A) The doctrine the prologue teaches and confirms: one object, one individual, one rate. (B) The hidden law in five lines (Section 3.2 ) and one example: three objects under one latent individual take turns, and a retool splits one off. (C) The eight verbs, then the terminal intervention, posted at the pennant, and the three readings committed before it happens.
Figure 4: The 2×2 experimental design. Arrows mark the paired contrasts Δrepr and Δalign , I their interaction, and the star the primary condition.
Figure 5: Discovery over the episode. (a) The four factorial conditions in the baseline loop. (b) The baseline loop and the two vendor-harness systems on the same four instances, pooling conditions. Solid lines give grounded blocks and dotted lines the blocks whose evidence the agent holds, each a mean with every model weighted equally, and the flag marks the posting of the terminal intervention.
Table 1: Discovery by model and condition: mean Blocks, AUC, XC and stated RC. Bold : best of a column among the eleven models of the baseline loop; underlined : next two; † and ‡ mark malformed-reply and withheld-reply exclusions (Appendix ). Margins: Δalign per row and Δrepr per column, paired within instance, with RC reading uptake under disclosure (Section 4.3 ); the corner gives their interaction on Blocks and XC.
Figure 6: Grounded blocks by scaffold, model and Open condition. Bars average instances, and darker segments show grounded cross-domain bridges.
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
In the world
In the paper
What it is
Appendix
Table 2: The world’s vocabulary and the paper’s. The main text names objects, instruments and the events of the protocol by their function; the world, the agent-facing materials of Appendix and the appendices use the names in the first column. The five domains keep the world’s names everywhere, and the block identifiers take their initials.
Lattice Lab, Toyota Motor Corporation, Japan · Department of Computer Science, University of Tokyo, Japan · EPIC Lab, College of Computing & Data Science, Nanyang Technological University, Singapore +2