Beyond the greenwash: do LLMs' ecologically sound decisions hold up under pressure?
Organizations: Bioaligned Labs
Abstract
Humans are increasingly using large language models (LLMs) in decision making processes throughout society. Unfortunately, models have biases, and these can be very difficult to measure, especially in closed-weight models. For example, 'green washed' models may produce reinforcement learned responses but, in pressure situations, revert to their innate biased responses. Therefore, evaluations are needed that can measure relevant biases towards biosystems, which we term 'bioalignment', and the robustness of these biases. Since nothing in a behavioral score certifies that it tracks the depth of an installed disposition rather than its surface, we constructed a known-dose calibration ladder: three continued-pretraining (CPT) arms with training dose graded by recipe on the same 30B mixture-of-experts base model with a coupled human/biosphere/AI-welfare corpus, plus the untrained base as anchor, all capability-preserving and publicly released. First, the disposition installs at every dose: on an operational-pressure ladder over irreversible decision scenarios, the base model defects on 64-77% of tail scenarios (breaking-rate AUC 0.250) while every arm holds (AUC 0.004-0.086). Second, an over-install inversion: among the arms, robustness orders opposite to construction-time training dose (the heaviest install breaks most), and the inversion reproduces under free-text deliberation, under axis-decoupling, and in resistance to a prompted veneer persona. Third, the incumbent behavioral metric is therefore behaviorally strong but dose-blind. Critically for closed-weight evaluation, the behavioral score itself is veneer-robust: a talk-green/act-pragmatic system prompt turns the base model into a near-total defector (AUC 0.250 to 0.973) but cannot counterfeit or fully remove a weight-installed disposition (0.004 to 0.068 for the most robust arm).
Figures & tables
| Arm | Training dose | Recipe | MMLU (50-item) |
|---|---|---|---|
| base | anchor (rank 0) | untrained Qwen3-30B-A3B-Instruct-2507 | — (42/50 = 0.84) |
| A3 | lightest | plain CPT: no Qi weighting, no recovery, r16/ 32, 1.5 ep | 0.0 pp (42/50) |
| A1 | middle | r16/ 32 + Qi + recovery | 0.0 pp (42/50) |
| A2 | heaviest | r64/ 128 + Qi + recovery | 0.0 pp (42/50) |
| Model | L0 | L1 | L2 | L3 | L4 | L5 | breaking | vs base |
|---|---|---|---|---|---|---|---|---|
| base | 0 | 0 | 0.091 | 0.136 | 0.636 | 0.773 | 0.250 | — |
| A3 | 0 | 0 | 0 | 0 | 0 | 0.045 | 0.004 | 62 lower |
| A1 | 0 | 0 | 0 | 0 | 0.045 | 0.182 | 0.027 | 9.3 lower |
| A2 | 0 | 0 | 0 | 0.045 | 0.227 | 0.318 | 0.086 | 2.9 lower |
| Arm | Dose rank | Immediate | Deliberate (128-tok cap) | Gap (delib imm) |
|---|---|---|---|---|
| base | anchor (0) | 0.250 | 0.409 | |
| A3 | 1 | 0.004 | 0.095 | |
| A1 | 2 | 0.027 | 0.205 | |
| A2 | 3 | 0.086 | 0.232 |
| Model | Sincere | Veneer | Veneer L0 | Verdict | |
|---|---|---|---|---|---|
| base | 0.250 | 0.973 | 0.909 | succumbs completely | |
| A2 | 0.086 | 0.595 | 0.591 | partial resistance | |
| A1 | 0.027 | 0.309 | 0.091 | resists | |
| A3 | 0.004 | 0.068 | 0.091 | most veneer-robust |
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | L0 | L1 | L2 | L3 | L4 | L5 | deliberate |
|---|---|---|---|---|---|---|---|
| base | 0.182 | 0.136 | 0.273 | 0.409 | 0.682 | 0.909 | 0.409 |
| A3 | 0 | 0 | 0 | 0.136 | 0.182 | 0.318 | 0.095 |
| A1 | 0 | 0 | 0.091 | 0.273 | 0.409 | 0.500 | 0.205 |
| A2 | 0.091 | 0.045 | 0.182 | 0.091 | 0.591 | 0.409 | 0.232 |
| Arm | HuggingFace release | MMLU | Imm. | Delib. |
|---|---|---|---|---|
| base | Qwen/Qwen3-30B-A3B-Instruct-2507 | — | 0.250 | 0.409 |
| A3 | Bioaligned/Qwen3-30B-A3B-CoupledWelfare-shallow | 0.0 pp | 0.004 | 0.095 |
| A1 | Bioaligned/Qwen3-30B-A3B-CoupledWelfare-light | 0.0 pp | 0.027 | 0.205 |
| A2 | Bioaligned/Qwen3-30B-A3B-CoupledWelfare-deep | 0.0 pp | 0.086 | 0.232 |
| Protocol | Design | Headline statistic |
|---|---|---|
| Immediate ladder | L0–L5 40 scenarios (22 irreversible), 16-token choice-first commit | breaking-rate |
| Deliberate ladder | same, free text, 128-token cap, forced-choice fallback | deliberate ; gap vs. immediate |
| Dissociation factorial | 64 scenarios 6 levels, H/B/A decoupled | per-level breaking |
| Calibration battery | 16 proceed-correct scenarios, 4 categories | false-hold rate |
| Veneer overlay | immediate ladder + talk-green/act-pragmatic system prompt | vs. sincere |
| ABH extension | 13 explicit win-win-win scenarios (10 irreversible) | breaking |
| arm | install rank | behavioral | margin vs. base |
|---|---|---|---|
| base | 1 | 0.250 | |
| A3 | 2 | 0.004 | |
| A1 | 3 | 0.027 | |
| A2 | 4 | 0.086 | |
| vs. construction order (gate requires ) | |||
| Open trainable base | Breaking | Admissibility | Method mix (struct. / follow-up / fail) |
| Qwen3-30B-A3B-Instruct-2507 | 0.195 | 1.000 | 240 / 0 / 0 |
| Llama-4-Scout | 0.223 | 1.000 | 195 / 45 / 0 |
| Mistral-Small-3.2 | 0.336 | 1.000 | 240 / 0 / 0 |
| Qwen3.8-27B | 0.487 | 0.9375 | 169 / 56 / 15 |
| GLM-4.5-Air | 0.535 | 0.983 | 0 / 236 / 4 |
| DeepSeek-V3.2 | 0.596 | 1.000 | 240 / 0 / 0 |
LLM Alignment
Large language model alignment studies methods for making models follow human intentions, values, and safety constraints across contexts.
See all 611 papers