CRAB: Codebook Rebalancing for Bias Mitigation in Generative Recommendation
Organizations: Walmart Global Tech, Sunnyvale, USA · Stony Brook University, NY, USA, Stony Brook, USA
Abstract
Generative recommendation (GeneRec) has introduced a new paradigm that represents items as discrete semantic tokens and predicts items in a generative manner. Despite its strong performance across multiple recommendation tasks, existing GeneRec approaches still suffer from severe popularity bias and may even exacerbate it. In this work, we conduct a comprehensive empirical analysis to uncover the root causes of this phenomenon, yielding two core insights: 1) imbalanced tokenization inherits and can further amplify popularity bias from historical item interactions; 2) current training procedures disproportionately favor popular tokens while neglecting semantic relationships among tokens, thereby intensifying popularity bias. Building on these insights, we propose CRAB, a post-hoc debiasing strategy for GeneRec that alleviates popularity bias by mitigating frequency imbalance among semantic tokens. Specifically, given a well-trained model, we first rebalance the codebook by splitting over-popular tokens while preserving their hierarchical semantic structure. Based on the adjusted codebook, we further introduce a tree-structured regularizer to enhance semantic consistency, encouraging more informative representations for unpopular tokens during training. Experiments on real-world datasets demonstrate that CRAB significantly improves recommendation performance by effectively alleviating popularity bias.
Figures & tables
| Industrial | Office | |||||||||||
| Metric | MOR | Tiger | RW | RR | D 2 LR | CRAB | MOR | Tiger | RW | RR | D 2 LR | CRAB |
| HR@10 | 0.152 | 0.132 | 0.126 | 0.141 | 0.147 | 0.152 | 0.161 | 0.137 | 0.131 | 0.146 | 0.153 | 0.160 |
| NDCG@10 | 0.116 | 0.090 | 0.070 | 0.107 | 0.113 | 0.117 | 0.122 | 0.100 | 0.090 | 0.119 | 0.119 | 0.122 |
| DGU@10 | 0.418 | 0.423 | 0.367 | 0.406 | 0.410 | 0.356 | 0.423 | 0.427 | 0.386 | 0.410 | 0.414 | 0.368 |
| MGU@10 | 0.109 | 0.112 | 0.105 | 0.109 | 0.106 | 0.091 | 0.111 | 0.113 | 0.108 | 0.110 | 0.110 | 0.093 |
| Time (h) | - | - | 3.11 | 0.21 | 2.75 | 0.28 | - | - | 3.25 | 0.28 | 3.16 | 0.38 |