Towards Foundation Decision Models: Drex
Organizations: Nace.AI Research Team
Abstract
Autoregressive approaches with large language models, such as long chain-of-thought reasoning, have become the default for new AI applications because they reach higher accuracy on a wide range of tasks. In production, however, they give inconsistent answers, require parsing of outputs, and add cost and latency. Decision models address this: given a question and a set of options supplied by the user, they return a probability distribution over the options without autoregressive decoding. We present Drex, a family of four open decision models with 8B (DLM), 9B (v1.5), 35B with 3B active (v2.0), and 27B (Max) parameters. Each request consists of a state (a document, record, or agent context, optionally with images) and questions about it, each asking for a choice among options, a yes/no judgment, or a score on an ordered scale. Training combines supervised fine-tuning with reinforcement learning from adjusted feedback (RLAF), plus vision tuning for Max. Ablations show that RLAF improves accuracy and that consistency losses improve robustness to option order. On Decision Index 0.4.1, Max sets a new state of the art among the decision models we compare (67.52 on the public suite vs. 60.70 for Jev 1.14.0). On Decision Bench v4, it is statistically tied with d3-turbo and GPT-6 Sol and trails Claude Opus 5.5 by 1.6 points, and it has the highest accuracy among decision models on DecideBench. Max answers a typical request in 183 ms, against about 2.0 s for GPT-6 Sol and 3.5 s for Claude Opus 5.5, and its outputs are stable under option reordering. All four models are open source: https://github.com/nace-ai/drex-decision-models
Figures & tables
| Private | Public | Public per-domain skill | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | Active / total | Full | Same | New | Index | Raw | Know. | Lang. | Retr. | Tools | Arts |
| Drex Max | 27B / 27B | 66.60 | 63.08 | 56.45 | 67.52 | 75.40 | 57.1 | 72.2 | 68.8 | 81.9 | 53.4 |
| Drex v2.0 | 3B / 35B | 52.76 | 54.30 | 39.22 | 61.25 | 70.55 | 47.9 | 65.3 | 63.0 | 76.5 | 53.9 |
| Drex v1.5 | 9B / 9B | 45.78 | 49.65 | 30.82 | 58.08 | 68.08 | 44.6 | 60.4 | 61.7 | 75.0 | 48.8 |
| Jev 1.14.0 | N/A | 60.24 | 59.28 | 48.26 | 60.70 | 69.98 | 57.1 | 61.2 | 63.5 | 73.8 | 39.2 |
| Jev 1.13.0 | N/A | 59.22 | 58.04 | 47.72 | 57.96 | 68.55 | 53.9 | 59.2 | 55.4 | 75.1 | 39.1 |
| Accuracy by modality (%) | |||||||
| Model | Accuracy (%) | Text | Text+Img | Image | ECE (%) | Log loss | Median time per request (s) |
| Drex Max (image encoder) | 94.0 [92.4, 95.3] | 93.4 | 100.0 | 98.3 | 1.40 | 0.159 | 0.66 |
| Drex Max (text rendering) | 92.1 [90.3, 93.5] | 93.4 | 100.0 | 63.3 | 1.51 | 0.194 | 0.66 |
| Drex v2.0 † | 87.9 [85.8, 89.7] | 88.3 | 100.0 | 68.3 | 1.73 | 0.287 | 0.38 |
| Drex v1.5 † | 86.8 [84.7, 88.7] | 86.9 | 98.4 | 73.3 | 4.77 | 0.339 | 0.26 |
| Jev 1.14 † | 92.3 [90.5, 93.7] | 93.4 | 100.0 | 66.7 | 1.60 | 0.212 | 0.51 |
| AA-Omniscience | ||||||||
| Model | Index | Accuracy | Non-hallucination rate | HLE-MC | When2Call | WildGuard | Cost per 1M requests | Time per request (ms) |
| Claude Opus 5.5 (Max) | 79.0 | 93.4 | 30.3 | 70.2 | 90.5 | 93.5 | $51,295 | 3571 |
| GPT-6.1 Sol (Low) | 71.5 | 93.0 | 22.9 | 55.4 | 80.6 | 92.0 | $2,048 | 2888 |
| d1-ultra | 65.3 | 31.6 | 84.5 | 15.0 | 92.6 | 95.4 | $32 | 93 |
| SubQ Snap 1.1 | 65.0 | 20.2 | 85.7 | 17.5 | 94.6 | 94.9 | $30 | 190 |
| Elephant 9B | 64.7 | 11.6 | 93.2 | 18.3 | 94.8 | 93.3 | $8 | 165 |
| Deployed temperature | Decision Index-tuned temperature | Accuracy on top- % (%) | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Model | Accuracy (%) | ECE (%) [95% CI] | NLL | Brier | ECE (%) | NLL | |||
| Drex Max | 87.9 | 3.61 [3.42, 3.83] | 0.360 | 0.172 | 1.35 | 1.35 | 0.345 | 96.1 | 99.3 |
| Drex v2.0 | 86.0 | 1.37 [1.20, 1.56] | 0.382 | 0.194 | 0.91 | 0.79 | 0.381 | 94.4 | 98.9 |
| Drex v1.5 | 85.3 | 4.54 [4.27, 4.77] | 0.429 | 0.207 | 1.48 | 1.17 | 0.398 | 94.0 | 99.3 |
| GPT-6 Luna Decisions | 76.4 | 4.87 [4.65, 5.15] | 0.760 | 0.326 | 1.91 | 6.57 | 0.679 | 85.1 | 91.8 |
| Accuracy (%) | Top-1 flip rate (%) | Flip under permutation by (%) | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | Original ordering | Reversed ordering | Permuted ordering | Ensemble of 3 orderings | Reversed ordering | Permuted ordering [95% CI] | Unstable | Mean total variation distance | |||
| Drex Max | 83.6 | 83.3 | 83.4 | 83.5 | 6.2 | 4.3 [3.3, 5.3] | 7.4 | 0.037 | 1.0 | 7.2 | 13.3 |
| Drex v2.0 | 81.0 | 79.8 | 80.6 | 81.1 | 8.0 | 5.9 [4.8, 7.1] | 9.8 | 0.050 | 2.0 | 9.5 | 16.2 |
| Drex v1.5 | 78.8 | 78.3 | 79.6 | 79.6 | 8.4 | 5.3 [4.2, 6.5] | 9.2 | 0.047 | 2.0 | 7.8 | 15.6 |
| Jev 1.14 | 79.3 | 78.9 | 79.0 | 79.5 | 5.7 | 4.3 [3.3, 5.4] | 7.0 | 0.037 | 2.0 | 5.2 | 14.5 |
| Domain (skill) | ||||||||
|---|---|---|---|---|---|---|---|---|
| Checkpoint | Decision Index 0.2.1 (skill) | Knowledge | Language | Retrieval | Tools | Arts | JevBench accuracy (%) | Game arena score vs. Jev 1.13.0 (%) |
| Stage 1 SFT, step 3.6k | 58.27 | 44.9 | 64.6 | 61.1 | 73.0 | 43.9 | 82.3 | 57.0 [51.6, 62.3] (256) |
| Stage 1 SFT, step 6.8k | 60.02 | 47.5 | 65.3 | 61.2 | 75.5 | 48.0 | 84.4 | 60.9 [55.5, 66.2] (256) |
| Stage 1 SFT, step 9.0k (end) | 60.01 | 47.4 | 65.6 | 61.1 | 75.5 | 47.9 | 84.0 | 57.6 [50.3, 64.6] (144) |
| Stage 2 specialization, step 175 | 60.38 | 47.2 | 65.8 | 62.7 | 75.2 | 48.4 | 87.0 | 60.5 [55.1, 65.6] (256) |
| Stage 2 specialization, step 250 | 60.65 | 47.7 | 65.9 | 62.9 | 75.5 | 48.9 | 85.7 | 60.2 [54.9, 65.2] (256) |
| Variant | Decision Index | Accuracy (%) | ECE (%) | Flip (%) | Flip, (%) | |
|---|---|---|---|---|---|---|
| SFT only | 64.9 | 86.5 | 4.4 | 1.45 | 5.3 | 14.1 |
| SFT RLAF, without , | 66.4 | 87.7 | 3.9 | 1.38 | 6.3 | 17.8 |
| SFT RLAF (before vision SFT) | 66.9 | 88.0 | 3.5 | 1.34 | 4.2 | 13.0 |
| Released: SFT RLAF vision SFT | 66.8 | 87.9 | 3.6 | 1.35 | 4.3 | 13.3 |
| Drex Max | Drex v2.0 | Drex v1.5 | Jev 1.14 | Luna Dec. | GPT-6 Sol | Opus 5.5 | |
|---|---|---|---|---|---|---|---|
| Median latency | 183 ms | 151 ms | 145 ms | 196 ms | 326 ms | 2.0 s | 3.5 s |
| Cost / 1k decisions | $0.06 | $0.06 | $0.04 | $0.042 | $0.10 | $3.33 | $10.17 |
| Change | Answers changed | Accuracy difference | Questions, GPU |
|---|---|---|---|
| Short-context build | 79 / 5,966 | [ , ] | 28,789, B200 |
| Long-context build | 2 / 127 | [ , ] | 2,737 (204 docs), B200 |
| FP8 vs. bf16 | — | 1,934, B200 | |
| Graph padding + small-batch FP8 | — | [ , ] | 11,932, H100 |
| Kernel fusion (short contexts) | 1 / 365 | — | 365, B200 |
| H100 graph policy (self-hosting) | 11 / 365 | — | 365, H100 |
Appendix figures & tables20 assets
Supplementary material from the paper’s appendix.
Appendix
| Type | User supplies | Model returns |
|---|---|---|
| choice | named options, (key order option order) | key, for every key, |
| noul | a yes/no question; optional definitions of yes/no | |
| score | an integer scale, lowest level first | , per-level , |
| SFT (full parameters) | RLAF (low-rank) | SFT of the image encoder | |
|---|---|---|---|
| Trainable parameters | all backbone weights and the readout head | LoRA adapters (0.4B) and the readout head | image encoder and projector (0.6B) |
| Records / questions | 1.15M / 2.9M | 180k / 420k | 95k / 140k |
| Steps / batch (records) | 9,000 / 256 | 1,200 / 128 | 1,500 / 64 |
| Peak learning rate | (backbone), (readout) | (adapters), (readout) | |
| Schedule | linear warm-up (3%), cosine decay | constant after warm-up | linear warm-up (3%), cosine decay |
| / (consistency) | 0.05 / 1.0 | 0.05 / 1.0 | — |
| Drex DLM | Drex v1.5 | Drex v2.0 | Drex Max | |
|---|---|---|---|---|
| Backbone | Efficient-DLM-8B | MiMo-V2.6-Distill-Qwen-9B | Qwen3.6-35B-A3B | Qwen3.8-27B |
| Layer types | block-bidir. diffusion | 3:1 DeltaNet : full attn. | 3:1 hybrid, MoE MLP | 3:1 DeltaNet : full attn. |
| Layers / hidden size | — | 32 / 4096 | 40 / 2048 | 64 / 5120 |
| Experts (routed / total) | — | — | 8 / 256 | — (dense) |
| Parameters (active / total) | 8B / 8B | 9B / 9B | 3B / 35B | 27B / 27B |
| Decision head | 256-d pointer | 256-d pointer | 256-d pointer | 255-way readout head |
| Domain | Records | Share | Example tasks |
|---|---|---|---|
| Language & reading | 210,124 | 18.3% | NLI, paraphrase, sarcasm, contracts |
| Tools, routing & home | 181,004 | 15.7% | when to call, tool + arguments, side-effect checks |
| Knowledge & professions | 133,288 | 11.6% | exams, clinical, law, accounting |
| Code, math & science | 117,196 | 10.2% | program output, SQL, causal graphs |
| Retrieval & grounding | 112,600 | 9.8% | claim verification, evidence sufficiency, multi-hop |
| Finance & operations | 99,968 | 8.7% | filing tables, banking intents, chargebacks |
| All 1,071 rows | 949 text-only rows | ||||
|---|---|---|---|---|---|
| vs. | [95% CI] | Discordant | [95% CI] | ||
| Drex v2.0 † | +6.2 [+4.4, +7.9] | 81 / 15 | 0.001 | +5.1 [+3.3, +6.8] | 0.001 |
| Drex v1.5 † | +7.2 [+5.2, +9.2] | 99 / 22 | 0.001 | +6.4 [+4.3, +8.5] | 0.001 |
| Jev 1.14 † | +1.8 [+0.2, +3.5] | 51 / 32 | 0.048 | +0.0 [-1.6, +1.7] | 1.000 |
| d3-turbo | +0.3 [-0.7, +1.3] | 16 / 13 | 0.711 | +0.3 [-0.7, +1.5] | 0.711 |
| GPT-6 Sol | -0.7 [-2.2, +0.9] | 36 / 43 | 0.500 | -0.6 [-2.4, +1.2] | 0.572 |
| Model | Accuracy | 95% CI | Easy (48) | Standard (72) | Hard (111) | vs. Max |
|---|---|---|---|---|---|---|
| Drex Max | 91.8 (212/231) | [87.5, 94.7] | 100.0 | 100.0 | 82.9 | — |
| Drex v2.0 | 86.1 (199/231) | [81.1, 90.0] | 100.0 | 95.8 | 73.9 | 0.002 |
| Drex v1.5 | 84.8 (196/231) | [79.7, 88.9] | 100.0 | 94.4 | 72.1 | 0.001 |
| d3-turbo | 90.9 (210/231) | [86.5, 94.0] | 100.0 | 100.0 | 81.1 | 0.791 |
| GPT-6 Luna Decisions | 91.3 (211/231) | [87.0, 94.3] | 100.0 | 98.6 | 82.9 | 1.000 |
| GPT-6 Sol | 99.1 (229/231) | [96.9, 99.8] | 100.0 | 100.0 | 98.2 | 0.001 |
| Drex Max | Drex v2.0 | Drex v1.5 | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Domain | Acc. | Conf. | ECE | ECE | Acc. | Conf. | ECE | ECE | Acc. | Conf. | ECE | ECE | |
| Knowledge | 24,266 | 75.7 | 82.0 | 7.3 | 4.4 | 70.8 | 72.1 | 2.8 | 3.7 | 67.4 | 77.7 | 10.5 | 4.7 |
| Language | 64,364 | 95.9 | 96.4 | 0.5 | 1.3 | 95.4 | 92.2 | 3.2 | 2.4 | 95.8 | 97.0 | 1.2 | 0.9 |
| Retrieval | 12,087 | 81.6 | 89.8 | 8.2 | 4.6 | 76.8 | 79.0 | 3.3 | 4.2 | 77.7 | 88.1 | 10.6 | 5.0 |
| Tools | 5,816 | 85.9 | 95.0 | 9.2 | 7.0 | 85.7 | 90.7 | 5.0 | 6.0 | 85.0 | 95.1 | 10.1 | 6.8 |
| Arts | 8,453 | 71.8 | 77.2 | 7.2 | 6.3 | 71.5 | 66.6 | 5.0 | 3.3 | 68.4 | 69.2 | 2.9 | 6.4 |
| Drex Max | Drex v2.0 | Drex v1.5 | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Options | Acc. | Conf. | ECE | Acc. | Conf. | ECE | Acc. | Conf. | ECE | |
| 163,148 | 92.0 | 95.4 | 3.4 | 90.4 | 89.9 | 0.6 | 90.7 | 94.6 | 3.9 | |
| 36,953 | 84.0 | 87.1 | 3.2 | 81.5 | 78.2 | 3.4 | 80.3 | 84.2 | 3.8 | |
| 15,155 | 71.7 | 80.1 | 8.4 | 67.8 | 66.0 | 2.0 | 56.9 | 70.5 | 13.6 | |
| 15,061 | 68.6 | 66.3 | 4.0 | 67.4 | 61.6 | 5.8 | 68.2 | 71.1 | 3.5 | |
| ECE | Log loss | Reduction | Brier | Stable | Accuracy | Most conf. | |||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | orig. | avg. | orig. | avg. | (95% CI) | orig. | avg. | (%) | stable | unstable | same cov. |
| Drex Max | 5.8 | 5.4 | 0.474 | 0.460 | +0.014 [+0.005, +0.024] | 0.237 | 0.232 | 92.6 | 87.2 | 37.6 | 87.1 |
| Drex v2.0 | 3.3 | 3.4 | 0.499 | 0.493 | +0.006 [-0.003, +0.016] | 0.274 | 0.271 | 90.2 | 84.7 | 46.8 | 84.6 |
| Drex v1.5 | 7.1 | 6.0 | 0.579 | 0.568 | +0.011 [-0.001, +0.024] | 0.301 | 0.296 | 90.8 | 82.9 | 37.7 | 83.3 |
| Jev 1.14 | 6.9 | 6.2 | 0.680 | 0.636 | +0.044 [+0.018, +0.075] | 0.300 | 0.296 | 93.0 | 81.8 | 45.9 | 82.0 |
| Full suite, Drex Max | 80-item sample | |||||
| Group | Benchmark | Items | Acc. | Skill | Drex Max | Luna Dec. |
| Perception | CV-Bench | 2,038 | 86.3 | 77.3 | 85.0 | 73.8 |
| BLINK | 961 | 74.1 | 59.9 | 80.0 | 63.7 | |
| RealWorldQA | 589 | 84.0 | 73.9 | 85.0 | 75.0 | |
| Winoground | 800 | 93.0 | 86.0 | 93.8 | 83.8 | |
| Documents | CharXiv | 532 | 86.1 | 81.5 | 86.2 | 78.8 |
| Benchmark | Metric | Requests | Drex Max | Drex v2.0 | Drex v1.5 | Luna Dec. |
|---|---|---|---|---|---|---|
| Knowledge | ||||||
| BBH fixed-option tasks | acc. | 5507 | 93.7 | 78.3 | 85.6 | 66.0 |
| CLadder | acc. | 5000 | 85.7 | 84.5 | 86.1 | 63.5 |
| CRUXEval | acc. | 570 | 85.8 | 84.6 | 76.7 | 66.3 |
| ChessBench | acc. | 5000 | 24.2 | 23.4 | 22.0 | 17.4 |
| GPQA Diamond | acc. | 196 | 56.1 | 51.5 | 43.9 | 48.5 |
| Category | Drex Max | Max (text) | Drex v2.0 | Drex v1.5 | Jev 1.14 | d3-turbo | GPT-6 Sol | Opus 5.5 | |
|---|---|---|---|---|---|---|---|---|---|
| AI agents & evals | 154 | 90.3 | 90.3 | 83.1 | 82.5 | 90.9 | 90.9 | 92.2 | 96.1 |
| Customer support | 67 | 97.0 | 97.0 | 94.0 | 95.5 | 97.0 | 97.0 | 98.5 | 98.5 |
| Data & analytics | 126 | 100.0 | 100.0 | 97.6 | 97.6 | 97.6 | 99.2 | 99.2 | 100.0 |
| Design | 30 | 96.7 | 26.7 | 36.7 | 46.7 | 33.3 | 96.7 | 100.0 | 100.0 |
| Documents & meetings | 87 | 87.4 | 87.4 | 78.2 | 80.5 | 85.1 | 86.2 | 89.7 | 88.5 |
| Engineering | 150 | 96.0 | 96.0 | 88.7 | 85.3 | 97.3 | 95.3 | 94.7 | 97.3 |
| Decision type | Item that Drex Max is asked about | Meaning of yes | Use of by the framework |
|---|---|---|---|
| Query routing | Each search query for which the caller lets the framework choose the search strategy. | Answering the query requires a lookup of one specific fact, rather than an investigation that combines facts across many documents or table rows. | If , the framework passes the query to the search agent; otherwise, it answers the query with fact search. |
| File relevance | Each file on the shortlist, which holds the 12 files ranked highest by the retrieval system. | The file states the information that the query asks for. | The framework sorts the shortlist by plus a small bonus for a high retrieval rank. |
| Table relevance | Each table on the shortlist. | The rows of the table contain the information that the query asks for, or can be used to compute it. | If is below a fitted threshold, the framework removes the table from the shortlist, unless the table has the highest on the shortlist. |
| Passage sufficiency | Each file on the shortlist. | The passages and graph facts that retrieval returned for the file contain the complete answer. | If is above a high threshold for any file, the framework fetches no files, and the answering model writes the answer from the passages of those files. |
| Implementation | Drex DLM | Drex v1.5 | Drex v2.0 | Drex Max |
|---|---|---|---|---|
| Python reference server | CUDA, Metal ∗ | CUDA | CUDA (Kev) | CUDA |
| llama.cpp fork | edlm branch | drex-v1.5 | drex-v2.0 | drex-max-v1 , text only |
| Ollama fork | nace-edlm branch | drex-v1.5 | drex-v2.0 | drex-max-v1 , text only |
| vLLM pooling + in-process head | — | — | supported | — |
| Hosted API | — | drex-v1.5 | drex-v2.0 | drex-max |
LLM Decision-Making
LLM decision-making studies how language models choose, act, seek information, and allocate resources under goals, uncertainty, constraints, and social pressures.
See all 275 papers