Structure-Aware Multimodal LLM Framework for Trustworthy Near-Field Beam Prediction
Organizations: School of Information Science and Engineering, Southeast University, Nanjing 210096, China · Institute of Communications Engineering, National Sun Yat-sen University, Kaohsiung 804, Taiwan
Abstract
In near-field extremely large-scale multiple-input multiple-output (XL-MIMO) systems, spherical wavefront propagation expands the traditional beam codebook into the joint angular-distance domain, rendering conventional beam training prohibitively inefficient, especially in complex 3-dimensional (3D) low-altitude environments. Furthermore, since near-field beam variations are deeply coupled not only with user positions but also with the physical surroundings, precise beam alignment demands profound environmental understanding capabilities. To address this, we propose a large language model (LLM)-driven multimodal framework that fuses historical GPS data, RGB image, LiDAR data, and strategically designed task-specific textual prompts. By utilizing the powerful emergent reasoning and generalization capabilities of the LLM, our approach learns complex spatial dynamics to achieve superior environmental comprehension...
Figures & tables
| Configuration | Scenario | Pos MAE [m] | Top-1 Acc [%] | Top-5 Acc [%] | Norm. Gain | High Conf. [%] † |
| Part I: Ablation of Input Modalities | ||||||
| Full Modalities w/ Adaptive Refinement | Overall | 0.8959 | 82.66 (+39.58) | 95.82 | 0.9462 (+0.2172) | 29.4 |
| LoS | 0.9032 | 82.82 (+38.94) | 95.90 | 0.9490 (+0.2052) | 30.0 | |
| NLoS | 0.6675 | 77.75 (+59.91) | 93.43 | 0.8558 (+0.5923) | 13.2 | |
| Full Modalities (w/o Adaptive Refinement) | Overall | 0.8959 | 43.08 | 95.82 | 0.7290 | 29.4 |
| LoS | 0.9032 | 43.88 | 95.90 | 0.7438 | 30.0 | |
Wireless Communications
Wireless communications studies how information is sent over radio links and how networks manage signals, spectrum, and resources reliably.
See all 399 papers