Token Encoding for Semantic Recovery
Organizations: Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK.
Abstract
In generative semantic communication, semantic tokens guide receiver-side generative models to synthesize high-dimensional content. In challenging network environments, however, frequent token erasure distorts the conveyed semantics beyond what receiver-side recovery can restore. In this paper, we propose a token encoding framework (TokCode) for robust semantic recovery, achieving erasure resilience by restructuring redundancy in the semantic domain. TokCode uses a lightweight adapter to recast a general-purpose large language model (LLM) at the transmitter into a token encoder, exploiting the LLM's pretrained semantic prior to avoid introducing a dedicated deep model. To optimize the adapter efficiently and make it applicable across diverse channels, we develop a channel-quality-aware distillation approach for token encoder training~(CADET). Using a differentiable sentence-level semantic surrogate, CADET tunes T5 foundation models into experts for distinct erasure rates and distills them into a single reconfigurable low-rank adapter, enabling subsequent reinforcement learning (RL) to start above the plateau where direct RL stalls. Simulation results on token-based generative image transmission show that TokCode improves the image-level similarity over the best-performing receiver-side recovery benchmark by 14.1%--22.4%, closing 71.9%--76.5% of its gap to the erasure-aware oracle encoding, when only 20% to 50% of the tokens survive.
Figures & tables
| Case | Corresponding text input to the text-to-image model |
|---|---|
| Lossless | <SPACE> a happy lady in <SPACE> a bright colorful flowy dress dances among jasmines and leaves on <SPACE> a bright sunny day with her arms <SPACE> splayed open. by <SPACE> rebecca <SPACE> guay. pastel tones |
| Raw Rx | <SPACE> a happy lady in <SPACE> a bright colorful flowy dress dances among ja smine s and leaves on <SPACE> a bright sunny day with her arms <SPACE> s played open . by <SPACE> rebe cca <SPACE> gua y . pastel to nes |
| Rx-T5 | <SPACE> a a happy a lady in <SPACE> the a the bright colorful . flow . y dress <SPACE> dance <SPACE> s among ja ja s ja mine s s and s leaves on <SPACE> <SPACE> <SPACE> a bright sunny y day y with her <SPACE> arms <SPACE> <SPACE> s a play a ed open g . g by <SPACE> <SPACE> re <SPACE> be cca au <SPACE> au gua y s . s pastel to s nes s |
| Rx-LLaMA | Lady in <SPACE> a bright yellow dress among leaves with <SPACE> a bright smile, <SPACE> surrounded by <SPACE> a soft pastel glow. |
| Rx-Qwen | A lady in <SPACE> a bright yellow dress among mine leaves, <SPACE> a bright smile with <SPACE> a pastel backdrop. |
| Oracle | <SPACE> a happy lady in <SPACE> a bright colorful flowy dress dances among ja s mine s and leaves on <SPACE> a bright sunny day with her arms <SPACE> s play e d open . by <SPACE> rebecca <SPACE> gu a y . pastel to nes |