eess.SPSep 24, 2026

FRESHLATENT: Channel-Aware Latent Adaptation for Resource-Constrained Embodied VLM Perception

Authors: Rajat Bhattacharjya, Minwoo Kim, Arnab Sarkar, Tamoghno Das, Sing-Yao Wu, Eli Bozorgzadeh, Marco Levorato, Nikil Dutt

Organizations: University of California, Irvine, USA · Kookmin University, Seoul, South Korea · Indian Institute of Technology, Kharagpur, India

Abstract

Mission-critical UAVs increasingly rely on split vision-language model (VLM) perception under tight onboard-resource and wireless-communication constraints. However, corruption of transmitted intermediate features creates a deployment mismatch for clean-trained split interfaces, while stronger channel-aware codecs can impose substantial onboard cost. We present FreshLatent, a lightweight channel-aware latent adapter that trains a power-normalized encoder-decoder through wireless corruption while keeping the surrounding VLM frozen. We formulate deployment around a mission-conditioned perception requirement and embedded interface cost, linking channel quality and communication budget to the operating conditions under which perception remains usable. At 0 dB and the tightest communication budget, FreshLatent improves gIoU and cIoU over clean split compression by 20.79 and 20.87 points, respectively. At the most adverse evaluated SNR (0 dB), across all three communication budgets, FreshLatent recovers 63.5-69.1% of the gIoU improvement achieved by a much heavier, range-trained feature-JSCC codec. On an NVIDIA Jetson AGX Xavier in 10-W mode, FreshLatent uses 37-40x fewer encoder parameters, 7.7-9.9x lower edge-interface latency, and 8.8-10.0x lower edge-interface energy than the heavier codec. Together, these results show that lightweight channel-aware adaptation can recover a substantial fraction of the robustness of a much larger communication interface while broadening quality-valid operation under constrained wireless conditions.

Figures & tables

Explore similar work

CardsList
  1. AeroLat: Channel-Aware Latent Space Semantic Communication for Decentralized UAV Swarms

    Sep 15, 2026Rajdeep Ghosh, Goparaju Venkata Seshachala Sree Vatsava, Sudip MisraSemantic CommunicationWireless Communications

  2. CodecSight: Leveraging Video Codec Signals for Efficient Streaming VLM Inference

    Apr 7, 2026Yulin Zou, Wenyan Chen, Yan Chen +6Efficient VLM InferenceVLM Inference

  3. CABLE: Cloud-Assisted Bandwidth-efficient LMM-based Encoding for V2X Systems

    Jun 17, 2026Haohua Que, Zhipeng Bao, Qianyi Wu +1Efficient VLM InferenceEdge Computing