eess.SPApr 14, 2026

Token Encoding for Semantic Recovery

Authors: Jingzhi Hu, Ouya Wang, Geoffrey Ye Li

Organizations: Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK.

Abstract

In generative semantic communication, semantic tokens guide receiver-side generative models to synthesize high-dimensional content. In challenging network environments, however, frequent token erasure distorts the conveyed semantics beyond what receiver-side recovery can restore. In this paper, we propose a token encoding framework (TokCode) for robust semantic recovery, achieving erasure resilience by restructuring redundancy in the semantic domain. TokCode uses a lightweight adapter to recast a general-purpose large language model (LLM) at the transmitter into a token encoder, exploiting the LLM's pretrained semantic prior to avoid introducing a dedicated deep model. To optimize the adapter efficiently and make it applicable across diverse channels, we develop a channel-quality-aware distillation approach for token encoder training~(CADET). Using a differentiable sentence-level semantic surrogate, CADET tunes T5 foundation models into experts for distinct erasure rates and distills them into a single reconfigurable low-rank adapter, enabling subsequent reinforcement learning (RL) to start above the plateau where direct RL stalls. Simulation results on token-based generative image transmission show that TokCode improves the image-level similarity over the best-performing receiver-side recovery benchmark by 14.1%--22.4%, closing 71.9%--76.5% of its gap to the erasure-aware oracle encoding, when only 20% to 50% of the tokens survive.

Figures & tables

Explore similar work

CardsList
  1. Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generation

    Aug 28, 2026Zijun Zhang, Li Qiao, Mahdi Boloursaz Mashhadi +3Semantic Communication

  2. ToDMA: Large Model-Driven Massive Token Communications for Semantic Multiple Access

    May 16, 2025Li Qiao, Mahdi Boloursaz Mashhadi, Zhen Gao +2Semantic Communication

  3. Semantic One-Dimensional Tokenizer for Image Reconstruction and Generation

    Mar 17, 2026Yunpeng Qu, Kaidong Zhang, Yukang Ding +2Image TokenizationImage Reconstruction