cs.LGMar 24, 2026

Lightweight Fairness for LLM-Based Recommendations via Kernelized Projection and Gated Adapters

Authors: Nan Cui, Wendy Hui Wang, Yue Ning

Organizations: Department of Computer Science, Stevens Institute of Technology, Hoboken NJ, USA

Abstract

Large Language Models (LLMs) have introduced new capabilities to recommender systems, enabling dynamic, context-aware, and conversational recommendations. However, LLM-based recommender systems inherit and may amplify social biases embedded in their pre-training data, especially when demographic cues are present. Existing fairness solutions either require extra parameters fine-tuning, or suffer from optimization instability. We propose a lightweight and scalable bias mitigation method that combines a kernelized Iterative Null-space Projection (INLP) with a gated Mixture-of-Experts (MoE) adapter. Our approach estimates a closed-form projection that removes single or multiple sensitive attributes from LLM representations with no additional trainable parameters. To preserve task utility, we introduce a two-level MoE adapter that selectively restores useful signals without reintroducing bias. Experiments on two public datasets show that our method reduces attribute leakage across multiple protected variables while maintaining competitive recommendation accuracy.

Figures & tables

Explore similar work

CardsList
  1. Fair on the Surface? Benchmarking Hidden-Output Fairness Gaps in LLM Recommenders

    Aug 8, 2026Chan Aristella Lu, Arya Fayyazi, Junhao Zhang +6LLM AuditingLanguage Model Bias Evaluation

  2. Is Your LLM-as-a-Recommender Agent Trustable? LLMs' Recommendation is Easily Hacked by Biases (Preferences)

    Mar 18, 2026Zichen Tang, Zirui Zhang, Qian Wang +3Large Language Model-Based RecommendationLLM Agent Reliability

  3. LBR: Towards Mitigating Length Bias in Large Language Models for Recommendation

    Jul 5, 2026Hongchen Li, Bohao Wang, Jingbang Chen +5Large Language Model-Based RecommendationAttention Mechanisms