Credibility Governance: A Social Mechanism for Collective Self-Correction under Weak Truth Signals
Organizations: School of Artificial Intelligence, Wuhan University; BIGAI Wuhan, China · Tsinghua University Beijing, China · University of California, Los Angeles Los Angeles, US · State Key Laboratory of General Artificial Intelligence, BIGAI Beijing, China ·
Abstract
Online platforms increasingly rely on opinion aggregation to allocate real-world attention and resources, yet common signals such as engagement votes or capital-weighted commitments are easy to amplify and often track visibility rather than reliability. This makes collective judgments brittle under weak truth signals, noisy or delayed feedback, early popularity surges, and strategic manipulation. We propose Credibility Governance (CG), a mechanism that reallocates influence by learning which agents and viewpoints consistently track evolving public evidence. CG maintains dynamic credibility scores for both agents and opinions, updates opinion influence via credibility-weighted endorsements, and updates agent credibility based on the long-run performance of the opinions they support, rewarding early and persistent alignment with emerging evidence while filtering short-lived noise. We evaluate CG in POLIS, a socio-physical simulation environment that models coupled belief dynamics and downstream feedback under uncertainty. Across settings with initial majority misalignment, observation noise and contamination, and misinformation shocks, CG outperforms vote-based, stake-weighted, and no-governance baselines, yielding faster recovery to the true state, reduced lock-in and path dependence, and improved robustness under adversarial pressure. Our implementation and experimental scripts are publicly available at https://github.com/Wanying-He/Credibility_Governance.
Figures & tables
| Feature | Credibility Gov. (CG) | Web3 Staking (WS) | Social Media (SM) | No Governance (NG) |
|---|---|---|---|---|
| Agent Influence ( ) | Credibility-based | Stake-based | Equal influence | Equal influence |
| Social Signal Update ( ) | Cred.-adj. support | Stake-wtd popularity (delay , noise ) | Raw popularity | None |
| Signal distortion | noise , contam. | noise , delay (stake settles) | noise , contam. | noise |
| Robustness knob | anti-bubble | stake cost / budget | None | None |
| Reward Basis | (delayed) | N/A | N/A |
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
| Parameter | Symbol | Value | Scope / Description |
| Physical Progress Dynamics | |||
| Environmental Noise | 0.1 | std. dev. of | |
| Baseline Velocities | 1.0, 0.8 | intrinsic growth | |
| Acceleration Factor | 0.8 | mid-stage resource impact | |
| Saturation Limits | 10, 8 | max progress | |
| CG variable | Forecasting tournaments | Peer review | Community forums |
|---|---|---|---|
| (social signal) | Aggregate crowd belief on event , e.g., mean implied probability or weighted forecast consensus at time . | Aggregate stance toward paper , e.g., mean recommendation score, accept probability proxy, or discussion sentiment. | Aggregate support for claim or topic , e.g., upvote share, endorsement rate, agreement ratio, or reshare intensity. |
| (momentum) | Change in consensus probability over a window, indicating information arrival or crowd revision. | Shift in consensus during deliberation, e.g., score changes after rebuttal or sentiment swing between rounds. | Change in endorsement rate or vote share, capturing emerging agreement or coordinated surges. |
| (outcome, truth linked) | Realized event outcome, resolved binary or continuous outcome (e.g., whether event occurred). | Post publication outcomes, e.g., reproducibility checks, later expert assessments, or editor adjudication. | Later verification signal, e.g., fact check labels, moderator confirmation, or authoritative source validation. |
| (blurred outcome proxy) | Noisy short horizon proxy such as partial indicators, early reports, or delayed settlement status. | Noisy proxies such as reviewer confidence, independent quick checks, or editor triage signals. | Noisy proxies such as reports, flags, or limited audits, available with delay. |
| (credibility weight) | Forecaster reliability weight used to aggregate predictions, based on past calibration and update dynamics. | Reviewer reliability weight used in aggregation or assignment, based on historical consistency and informativeness. | User credibility weight used in ranking or visibility, based on past helpfulness and resistance to manipulation. |
| (resource allocation) | Attention allocated to event , e.g., information prominence or forecast visibility weight. | Editorial effort on paper , e.g., additional review bandwidth, expert consultation, or priority handling. | Exposure allocated to topic or claim , e.g., ranking position, recommendation frequency, or distribution budget. |