STAR: Semantic-Criticality Tiered Allocation of Radio Resources via Zero-Shot Learning
Authors: Albert Shaju, Christo Kurisummoottil Thomas, Mingzhe Chen
Organizations: Department of Electrical and Computer Engineering, Worcester Polytechnic Institute, Worcester, MA, USA · Department of Electrical and Computer Engineering, University of Miami, Coral Gables, FL, USA
In remote inference, edge devices transmit high-resolution images over wireless links to a receiver, where an artificial intelligence (AI) model answers task-specific questions about these images to enable reliable decisions. These answers are often determined by a small set of task-causal pixels, such as those of text, whose corruption changes the answer, so these pixels must be delivered with high fidelity. Conventional transmission protects every pixel equally, so it either consumes many resource elements (REs) or corrupts these regions at low signal-to-noise ratio (SNR). To overcome these limitations, in this paper, a zero-shot, domain-agnostic framework, termed semantic-criticality tiered allocation of resources (STAR), is proposed. In particular, a per-pixel semantic-criticality indicator (SCI) is derived from the attention of a frozen vision-language model, so new tasks and domains are handled by changing only the prompt, without retraining. The resulting task causality-aware resource allocation problem over protection tiers is solved exactly by a threshold rule on the SCI, realized by a coded tier for the task-causal pixels and an uncoded, downsampled base layer for the full image. Simulations over a 5G New Radio link demonstrate that STAR attains a semantic accuracy of at least 0.98 for Es/N0≥−4 dB and, at comparable semantic reliability, reduces the REs of robust coded transmission by 59.5% and 91.5% on factory- and vehicle-monitoring datasets, respectively, the latter without any change to the models. Although a deep joint source-channel coding baseline uses fewer REs at comparable semantic accuracy, it must be retrained with labeled data for every new task or domain.
Figures & tables
Fig. 1: Sample images from a factory-monitoring environment.
Fig. 2: Continuous SCI channel overlaid on a fire-event image for different sets of critical tasks.
Fig. 3: Received images of a fire-event image with 256 -QAM at Es/N0=2 dB.
Query
Sample answer
Which room is this?
Boiler Room
Equipment status?
Normal
Pressure reading?
3.8 bar
Temperature reading?
50∘ C
Power on Grid or Backup?
Grid
Is there a fire?
Yes / No
TABLE I: Queries of the factory-monitoring dataset and sample answers.
Fig. 4: Performance at D=4 on the factory-monitoring dataset.
Fig. 5: STAR at D=4 , the conventional scheme at D=1 , and the DeepJSCC on the factory-monitoring dataset.
Fig. 6: Factory-monitoring dataset. (a) REs per image of STAR, and the baselines. (b) Per-task S-Acc with 256 -QAM at Es/N0=2 dB, with only the room task critical for STAR.
Fig. 7: Vehicle-monitoring dataset, 256 -QAM at Es/N0=10 dB. (a) Original image. (b)–(d) Received image zoomed in to the number plate.
Fig. 8: S-Acc and S-PSNR of the plate task with 256-QAM. The upper bound is the S-Acc attained on the images at the transmitter.
Fig. 9: REs per image of the robust baseline and STAR.
School of Computer and Information Engineering, Tianjin Normal University, Tianjin, China · School of Information Science and Engineering, Linyi University, Linyi 276000, China