cs.AIApr 5, 2026

Comparative reversal learning reveals rigid adaptation in LLMs under non-stationary uncertainty

Authors: Haomiaomiao Wang, Tomás E Ward, Lili Zhang

Organizations: Insight Research Ireland Centre for Data Analytics, Ireland · School of Computing, Dublin City University, Ireland

Abstract

Non-stationary environments require agents to revise previously learned action values when contingencies change. We treat large language models (LLMs) as sequential decision policies in a two-option probabilistic reversal-learning task with three latent states and switch events triggered by either a performance criterion or timeout. We compare a deterministic fixed transition cycle to a stochastic random schedule that increases volatility, and evaluate DeepSeek-V3.2, Gemini-3, and GPT-5.2, with human data as a behavioural reference. Across models, win-stay was near ceiling while lose-shift was markedly attenuated, revealing asymmetric use of positive versus negative evidence. DeepSeek-V3.2 showed extreme perseveration after reversals and weak acquisition, whereas Gemini-3 and GPT-5.2 adapted more rapidly but still remained less loss-sensitive than humans. Random transitions amplified reversal-specific persistence across LLMs yet did not uniformly reduce total wins, demonstrating that high aggregate payoff can coexist with rigid adaptation. Hierarchical reinforcement-learning (RL) fits indicate dissociable mechanisms: rigidity can arise from weak loss learning, inflated policy determinism, or value polarisation via counterfactual suppression. These results motivate reversal-sensitive diagnostics and volatility-aware models for evaluating LLMs under non-stationary uncertainty.

Figures & tables

Explore similar work

CardsList
  1. Rigidity in LLM Bandits with Implications for Human-AI Dyads

    Mar 8, 2026Haomiaomiao Wang, Tomás E Ward, Lili ZhangLLM Decision-MakingLanguage Model Bias Evaluation

  2. Same Signal, Opposite Meaning: Direction-Informed Adaptive Learning for LLM Agents

    May 7, 2026Ziming Li, Jiatan Huang, Xiaoguang Guo +2LLM Agent TrainingInference-Time Compute Allocation

  3. Exact Feedback Is Not Control: Evaluating Text-based Closed-Loop Revision in LLMs

    Sep 23, 2026Haitong Jiang, Chunlin Liu, Yile Wang +1LLM Self-CorrectionControllable Text Generation