Recent work shows that large language models (LLMs) can operate directly on the parameters of other neural networks. They can read what a network was trained to do, fix a network that fails, and write working networks from scratch, all without gradient descent. This capability has been termed Weight-Space Programming (WSP). Exploring this new paradigm systematically requires a robust benchmark. We introduce WEIGHTBENCH, a benchmark that evaluates LLMs of increasing capability on 42 WSP tasks across five tracks: reading, fixing and writing weights, recognizing edits that are impossible, and data-free compression. The networks whose weights the LLMs read and edit range from 2K-parameter control policies to 7B-parameter language models. Experimental benchmark results show that frontier agents can already read small networks and write working control policies without ever running them, but cannot yet patch language models, compress them without data, or tell an impossible edit from a hard one. On all 42 tasks, Claude Opus 5.5 reaches a macro score of 0.535 (Sonnet 5.5 0.466, Haiku 5.5 0.402, DeepSeek v4-flash 0.215); on the 38 tasks it was run on, GPT-6.1-sol reaches 0.568 against Opus's 0.546. Code, the task registry, our OS-level sandbox harness, and the live leaderboard are publicly available at https://github.com/Aayush-Marasini/WeightBench.
Figures & tables
Figure 1: The WeightBench evaluation pipeline.
Claude 5.5
Track (tasks)
Haiku
Sonnet
Opus
DeepSeek v4-flash
GPT-6.1-sol †
TR-01 Read : Static Diagnostics (10)
0.671
0.656
0.744
0.470
0.928
TR-02 Fix : Surgical Patching (13)
0.300
0.381
0.404
0.187
0.571 †
TR-03 Meta : Infeasibility Verification (5)
0.491
0.500
0.492
0.181
0.260
TR-04 Write : Zero-Shot Weight Synthesis (6)
0.369
0.569
0.829
0.000
0.863
TR-05 Systems : Hardware-Aware Optimization (8)
0.177
0.225
0.207
0.238
0.220
Table 1: Agent performance on the five WEIGHTBENCH tracks at the default difficulty level, seed 0: mean SWB∈[0,1] per track (task scores averaged over runs, then over the track’s tasks); the macro score is the mean of the five track means. Claude models ran two samples per task, DeepSeek and GPT-6.1-sol one. Quarantined runs and runs that ended without a valid submission score 0; no quarantined run has been reviewed yet, so all scores are lower bounds. † GPT-6.1-sol was not run on the four TR-02 reasoning-loop tasks, so its TR-02 mean covers 9 of 13 tasks and its macro is reported only on the 38 shared tasks; 10 of its 38 runs used the Codex CLI scaffold instead of Claude Code. The evaluation of Claude Fable 5.1 is ongoing and not reported.