Improving Channel Estimation via Multimodal Diffusion Models with Flow Matching
Authors: Xiaotian Fan, Xingyu Zhou, Le Liang, Xiao Li, Shi Jin
Organizations: School of Information Science and Engineering, Southeast University, Nanjing 210096, China · Purple Mountain Laboratories, Nanjing 211111, China
Deep generative models offer a powerful alternative to conventional channel estimation by learning complex channel distributions. By integrating the rich environmental information available in modern sensing-aided networks, this paper proposes MultiCE-Flow, a multimodal channel estimation framework based on flow matching and diffusion transformer (DiT). We design a specialized multimodal perception module that fuses LiDAR, camera, and location data into a semantic condition, while treating sparse pilots as a structural condition. These conditions guide a DiT backbone to reconstruct high-fidelity channels. Unlike standard diffusion models, we employ flow matching to learn a linear trajectory from noise to data, enabling efficient one-step sampling. By leveraging environmental semantics, our method mitigates the ill-posed nature of estimation with sparse pilots. Extensive experiments demonstrate that MultiCE-Flow consistently outperforms traditional baselines and existing generative models. Notably, it exhibits superior robustness to out-of-distribution scenarios and varying pilot densities, making it suitable for environment-aware communication systems.
Figures & tables
Fig. 1: The architecture of MultiCE-Flow. (Left) The multimodal perception module encodes LiDAR, camera, and positioning information into a fused semantic condition Cenv . (Right) The DiT backbone uses flow matching to transport noise to the channel distribution, conditioned on both the environmental semantics and the pilot-based structural condition Cpilot .
Fig. 2: Performance of MultiCE-Flow versus SNR ( Sp=8 ).
Fig. 3: Performance analysis of MultiCE-Flow.
Fig. 4: Generalization performance of MultiCE-Flow ( Sp=8 ).
College of Electronic Information and Optical Engineering, Nankai University · School of Computing Science, University of Glasgow · School of Natural and Computing Science, University of Aberdeen