Learning Whom to Trust : Decision-Generated Credibility in Social Learning
Authors: Gabriel Bontemps, Abhishek Banerjee
Organizations: GREDEG-CNRS, Université Côte d’Azur, Nice, France · Blizard Institute, Queen Mary University of London, London, United Kingdom of Great Britain and Northern Ireland (the) · Adaptive Decisions Laboratory, Department of Pharmacology, University of Oxford, Oxford, United Kingdom of Great Britain and Northern Ireland (the)
Social interaction can improve collective learning but also amplify early mistakes. We study this tension when the credibility of social information is generated by the sender's own decision process rather than fixed ex ante. Reinforcement-learning agents make binary choices through a drift--diffusion process that jointly determines choice, decision time, and confidence; decision confidence then becomes social credibility by weighting anticipatory influence and retrospective social learning. Under balanced community exposure, the anticipatory field admits an exact quotient representation. Its local Jacobian is a scalar decision-sensitivity term multiplying the community-coupling matrix, which yields a common-mode amplification threshold and an analytical role for cross-community permeability in damping relative community differences. Monte Carlo experiments show the corresponding non-monotone performance pattern: moderate transmission accelerates correction, whereas strong transmission can lock populations into wrong consensus; low permeability instead sustains disagreement. Ablations reveal a dual role for confidence: credibility-sensitive transmission amplifies social error, while confidence-dependent private learning stabilises it. The model yields testable predictions linking sender confidence to receiver behaviour conditional on accuracy.
Figures & tables
Tradition
Typical mechanism
Exogenous element
What this paper changes
DeGroot / consensus
weighted opinion averaging
weights, signals
confidence generated by the choice process
Herding / cascades
action inference
reliability of social signal
credibility is decision-generated
Cooperative bandits
reward learning across agents
communication weight
two distinct social channels
Polarisation ABMs
homophily / social feedback
confidence usually absent
confidence-driven amplification
RLDDM (individual)
value-based diffusion choice
no social network
social transmission of credibility
Table 1: Positioning relative to adjacent model families.
Figure 1: Mechanism. Within a trial, latent values Qi,t are augmented by the anticipatory credibility field Si,t (top, blue) to form subjective values Vi,t ; a drift–diffusion process turns the value contrast into an action Ai,t , a decision time τi,t and process-generated confidence Ci,t (red box). After the reward is observed, values are revised by a simultaneous update combining the private prediction error with the retrospective social prediction error (bottom, orange), whose strength is modulated by neighbours’ confidence. Confidence is the shared link between the two channels. The community coupling matrix B governs how credibility circulates.
Figure 2: Confidence as a decision-process readout (all curves are the exact model maps, not fits). (a) Evidence accumulates to a boundary ±a at rate v=βΔ ; strong evidence yields fast, confident choices, weak evidence slow, uncertain ones. (b) Confidence C=Λ(κ1∣v∣/a−κ2log(1+τ/τ0)) rises with evidence strength and falls with decision time; the dashed ridge is the process’s own mean decision time E[τ∣v] . (c) Choice accuracy P(+a) is monotone in the value contrast, but confidence is U-shaped in Δ — it tracks evidence magnitude , not correctness — so a strongly held wrong belief ( Δ<0 , large) is transmitted with high credibility. This decoupling of confidence from accuracy is the decision-process basis for high-confidence error in the model.
Figure 3: Confidence is a valence-gated learning gain. Reading the 2×2 matrix: the confidence-modulated learning rate ( 6 ) is largest ( αmax ) for good news under low confidence and for bad news under high confidence, and smallest ( αmin ) on the other diagonal. A low-confidence agent is therefore optimistic (soaks up success, brushes off failure); a high-confidence agent is revising (corrects on failure, discounts success) — a confidence-gated analogue of asymmetric reward-prediction-error learning. The same confidence C plays a second role in social transmission. The normalised quantity wi=Ci/∑jCj shown in the schematic summarises relative confidence within the local signal pool; the operative anticipatory exposure in the model remains WijCj,t as defined in Eq. ( 1 ). Confidence therefore acts both as an intra-agent learning gain and as a decision-generated multiplier on baseline social exposure. The exact curves are plotted in Appendix F (Figure 14 ).
Figure 4: Illustrative baseline regimes. Mass on the optimal arm mc,t(a⋆) in each community (mean and 10 – 90 percentile band over R=300 Monte Carlo replications; N=400 agents, horizon T=300 ). The same mechanism produces efficient consensus, wrong consensus and polarisation under the scenario parameters of Table 5 .
Regime
R
λ
P(regime) [Wilson 95% LB]
RT (SE)
Efficient
300
0.40
1.00 [0.987]
450 (1)
Wrong
300
0.90
1.00 [0.987]
11,988 (0)
Polarised
300
0.90
1.00 [0.987]
5,998 (0)
Table 2: Illustrative baseline regimes. Each scenario is run for R Monte Carlo replications; the empirical frequency of the designated regime is 1.00 in every case, reported with its Wilson 95% lower bound. RT is mean group regret with Monte Carlo standard error. Scenario parameters are in Table 5 .
Figure 5: Social-transmission phase diagram. Probability of efficient consensus, wrong consensus and polarisation, and the dominant regime, over the anticipatory social-transmission intensity λ and cross-community permeability Γ=1−Bcc . A corrective band at moderate λ separates an unresolved region ( λ→0 ) from a distortive region (large λ ); within the distortive region, low permeability yields polarisation and high permeability yields wrong consensus. Grid 13×13 , 120 replications per cell, regime threshold 0.9 , horizon T=240 ; the first three panels show regime probabilities and the fourth the dominant (modal) regime. The Wilson half-width at 120 replications is at most 0.09 .
Figure 6: Amplification bifurcation of the representative-community reduction. The early-lead order parameter z⋆ is zero (stable neutral state) below λ⋆ and splits into a correct ( +z⋆ ) and a wrong ( −z⋆ ) amplified branch above it. The transition is mildly subcritical (a bistable window precedes λ⋆ ), so a sufficiently large early lead can lock in just below threshold. Small reward gap ∣Δμ∣=0.06 , Bcc=0.85 .
Figure 7: How early community leads evolve as social influence strengthens. Streamlines show the direction of motion, colour indicates its speed, and dots mark fixed points. (a) Under weak influence, shared and opposing leads both decay toward neutrality. (b) At intermediate influence, shared leads grow while opposing leads decay, producing consensus. (c) Under strong influence, both modes grow, permitting corrective (+,+) , distortive (−,−) and polarised (±,∓) endpoints. The three panels therefore isolate the modal information not contained in the scalar bifurcation diagram. Frozen-value reduction, ∣Δμ∣=0.06 , Bcc=0.85 .
Figure 8: Mechanism isolation under common random numbers ( R=300 ). (a) Regime composition for the full model and five ablations at the contested operating point (Table 5); (b) mean group regret with 95% bootstrap intervals; (c) paired structural contrast in wrong-consensus incidence, ΔP(wrong)=P(wrong∣full)−P(wrong∣ablation) , with paired-bootstrap 95% intervals. Positive contrasts indicate that removing the component lowers wrong-consensus incidence; negative contrasts indicate that removing it raises wrong-consensus incidence. At this operating point, removing the anticipatory channel, the retrospective channel, or the decision-time confidence map eliminates wrong consensus; removing credibility weighting weakens but does not eliminate it; constant learning rates intensify it.
Variant
P(wrong) [ 95% ]
P(efficient) [ 95% ]
RT [ 95% ]
ΔP(wrong) [ 95% ]
Full
0.83 [0.78, 0.87]
0.17 [0.13, 0.22]
8,571 [8,148, 8,962]
—
No anticipatory
0.00 [0.00, 0.01]
0.00 [0.00, 0.01]
3,913 [3,908, 3,919]
+0.83 [+0.79, +0.87]
No retrospective
0.00 [0.00, 0.01]
1.00 [0.99, 1.00]
438 [433, 442]
+0.83 [+0.79, +0.87]
No credibility weighting
0.73 [0.67, 0.77]
0.27 [0.23, 0.33]
7,501 [7,002, 7,996]
+0.10 [+0.04, +0.16]
Constant learning rates
0.99 [0.98, 1.00]
0.01 [0.00, 0.02]
10,239 [10,142, 10,303]
−0.16 [ −0.21 , −0.12 ]
Alternative confidence
0.00 [0.00, 0.01]
1.00 [0.99, 1.00]
911 [882, 941]
+0.83 [+0.79, +0.87]
Table 3: Mechanism isolation at the contested operating point (Table 5 ), R=300 replications under common random numbers. P(wrong) and P(efficient) carry Wilson 95% intervals; regret carries a 95% bootstrap interval. The last column reports the paired structural contrast Δ=P(wrong∣full)−P(wrong∣ablation) , with a paired-bootstrap 95% interval. A positive Δ indicates that removing the component reduces wrong-consensus incidence, whereas a negative Δ indicates that removing it increases wrong-consensus incidence. A component is described as necessary at this operating point only when its removal reduces P(wrong) to approximately zero.
Figure 9: Decision-process confidence and early confident error. Distribution of confidence C for correct and wrong choices, early ( t<T/2 ) and late ( t≥T/2 ), in a neutral contested scenario; densities are normalised to unit area and dashed lines mark group means. Early decisions number ≈1.8×106 (correct) and ≈6×104 (wrong). Early wrong choices carry a wide range of confidence, including high values (mean 0.73 versus 0.98 for correct choices): confidence attaches to error, which is what lets credibility-weighted transmission amplify it. The right panel shows that confidence concentrates near one late in learning as communities reach consensus.
Figure 10: Validity of the community-level approximation. (a) Mean absolute endpoint error over the 11×11(λ,Γ) grid, with contours delimiting one-, five- and ten-percentage-point tolerances. (b) Empirical share of parameter cells meeting each tolerance, stratified by distance from an agent-model regime boundary. All 36 interior cells are within one percentage point; errors are concentrated among the 85 boundary or adjacent cells. (c) Mean absolute micro–meso error over time for efficient consensus, wrong consensus and a four-community stress test; the logarithmic scale distinguishes small persistent discrepancies from large but transient ones. The dotted guides in panels (b) and (c) mark a five-percentage-point tolerance.
Figure 11: Computational-to-neural correspondence. Each model quantity (left) implements a decision computation (centre) with a candidate neural correlate (right). A functional analogy: it motivates the measurements and manipulations of Figure 12 ; the model commits to the centre column.
Figure 12: A model-based experimental design. Inducing confidence orthogonally to accuracy realises the confident-error cell (upper right), where the model predicts distortive transmission. The model supplies the regressors and falsifiable signatures (right), turning predictions (i)–(iv) into a testable protocol for dyadic or networked group-decision experiments.
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.
Appendix
Figure 13: Trajectory-level comparison of the agent model and its community approximation. Solid lines report the agent-ensemble mean and dashed lines the deterministic quotient; vertical position is the probability of choosing the better option, displayed with log-odds spacing so differences near zero and one remain visible. (a) In efficient consensus, both models select the better arm but the quotient converges faster. (b) In wrong consensus, both select the worse arm and their aggregate paths remain close. (c) In the four-community stress test, colours identify communities and line style identifies model level; both models preserve direction and community ordering, with a persistent difference in tail probabilities.
Symbol
Default
Role
Config key
β
6.0
value sensitivity (drift scaling)
beta
σ
1.0
internal decision noise
sigma
a
1.0
speed–accuracy threshold
a_thr
κ1
3.0
confidence: evidence weight
kappa1
κ2
1.0
confidence: decision-time weight
kappa2
τ0
0.5
reaction-time scale
tau0
Appendix
Table 4: Global default parameters ( code/credibility/config.py ). Confidence map is decision (Eq. 5 ); values are projected to [0,1] each trial; reaction times use the inverse-Gaussian approximation.
Scenario
N
T
R
Δμ
λ
η
Γ
init. lead
Fig. 2 efficient
400
300
300
0.20
0.40
0.30
0.30
neutral
Fig. 2 wrong
400
300
300
0.10
0.90
0.20
0.30
asym.
Fig. 2 polarised
400
300
300
0.10
0.90
0.25
0.02
asym.
Fig. 3 phase ( λ,Γ swept)
160
240
120
0.10
[0,1.6]
0.25
[.01,.5]
asym.
Fig. 4 ablation point
400
260
300
0.10
0.60
0.30
0.15
asym.
Fig. 5 confidence
300
260
60
0.10
0.50
0.25
0.15
neutral
Appendix
Table 5: Scenario parameters for all reported figures (standard scale). N is total agents, T horizon, R replications, Δμ=μ1−μ2 , λ anticipatory weight, η retrospective weight, Γ=1−Bcc permeability. Regime threshold 0.9 throughout. Configuration: code/credibility/scenarios.py .
Model element
Equation
Code
Test
Anticipatory signal
Eq. 1
model.py: anticipatory_field_block
test_quotient_field_exact
Augmented value
Eq. 2
model.py: simulate_blocks
test_block_dense_*
DDM choice
Eq. 4
ddm.py: choice_prob_up
test_ddm_choice_*
Reaction time
§ 3
ddm.py: sample_decision_time
test_ddm_mean_fpt_*
Confidence
Eq. 5
confidence.py
test_confidence_bounded
Private learning
Eq. 6
model.py: _private_lr
test_simultaneous_*
Appendix
Table 6: Equation-to-code-to-test map. Code paths are under code/credibility/ ; tests under code/tests/test_credibility.py .
Figure 14: Quantitative companion to Figure 3 . (a) the exact confidence-gated learning rates for good news ( αmax−(αmax−αmin)C ) and bad news ( αmin+(αmax−αmin)C ), crossing at C=21 . (b) An illustrative normalised relative-confidence index C/(C+Cˉ) and the social learning rate γCω ( ω=1,2 ) versus sender confidence. The operative anticipatory exposure in the model is WijCj,t as defined in Eq. ( 1 ).
Table 7: Robustness summary (Appendix G ). Entries are the dominant-regime area fractions of the (λ,Γ) plane, or P(wrong) at the operating point, as indicated. Full tables: paper/tables/robustness_*.csv .
Figure 15: Robustness of the phase structure. (a) regime area fractions are invariant to the terminal threshold; (b) P(wrong) versus horizon for three operating points; (c) P(wrong) and P(efficient) versus early-lead strength δ ; (d) P(wrong) versus reward gap with Wilson intervals; (e) P(wrong) under balanced, weighted-SBM and noisy graphs; (f) regime area fractions versus phase-grid resolution. Full tables in Table 7 .
Figure 16: Stochastically generated early lead (neutral initialisation, R=200 per λ ). (a) P(wrong) is ≈0 below the local amplification threshold λ⋆≈0.67 and rises above it, mirrored by a fall in P(efficient). (b) the frequency of early suboptimal leads rises with λ and they are locked in with fidelity ≈1 . Data: tables/endogenous_early_lead.csv .
Aug 2, 2026·Zixuan Liu, Jonathan Lawry, Michael Crosscombe
School of Engineering Mathematics and Technology, University of Bristol, Bristol, BS8 1TW, UK · Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, 153-8902, Japan