cs.CVMar 2, 2025

LFX: Fusion-Form-Flexible Light Field Modeling for Dense Semantic Segmentation and Salient Object Detection

Authors: Fei Teng, Lingxin Huang, Buyin Deng, Kai Luo, Boyuan Zheng, Zheng Fang, Hong Zheng, Kunyu Peng, 

Organizations: The authors are with the School of Artificial Intelligence and Robotics and the National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University, China · The authors are with China Mobile Group Hunan Company Ltd., China. · The author is with the Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology, Germany.

Abstract

Two distinct light field (LF) observation forms, namely sub-aperture images (S.Aperture images) and focal stack (FS), correspond to two fusion settings: the central image with S.Aperture images (CS) and the central image with FS (CF). Existing LF perception methods are typically form-specific, while a modeling design that can be separately instantiated under either setting remains underexplored. To address this gap, we present LFX, a form-flexible LF perception framework. Here, ``X'' represents the LF observation form, indicating that the one modeling design can be separately instantiated under two fusion settings (CS and CF). Specifically, we propose Field-of-Parallax Angular Subspace Modeling (FoP-ASM), which maps the feature difference between each auxiliary observation and the central image to an observation-specific angular marker. This avoids pairwise modeling among auxiliary observations and form-specific geometric assumptions. Meanwhile, a shared manifold subspace and the associated regularization losses constrain the angular residuals within a common feature space, promoting semantic consistency across auxiliary observations. Extensive evaluations across three LF datasets show that LFX achieves state-of-the-art results across distinct LF forms. Under the S.Aperture images and FS settings, respectively, LFX reduces MAE by 12.12%/20.59% on DUTLF-V2 and by 6.15%/7.69% on HFUT, while achieving the best performance on UrbanLF-real. The source code will be made publicly available at https://github.com/FeiT-FeiTeng/LFX.

Figures & tables

Explore similar work

Jun 23, 2026

VSANet: View-aware Sparse Attention Network for Light Field Image Denoising

Light field (LF) image denoising is challenging due to the high-dimensional structure of LF data. While noise is independent across sub-aperture images, scene content exhibits strong cross-view correlations. We introduce VSANet, a view-aware sparse attention network for LF denoising. Specifically, we propose a view-aware sparse attention (VSA) block that represents the 4D LF feature map as a unified spatial-angular token space and performs cross-view aggregation via locality-sensitive hashing-based sparse attention. This enables global feature interactions with linear complexity, effectively exploiting LF correlations across views and spatial locations. In addition, we design a feature refinement (FR) block to emphasize informative features in spatial, angular, and epipolar subspaces. The VSA and FR blocks are integrated within a sequential attention refinement module, forming the core of VSANet. Experiments demonstrate VSANet outperforms stateof-the-art LF denoising methods.
Mar 17, 2026

RASLF: Representation-Aware State Space Model for Light Field Super-Resolution

Current SSM-based light field super-resolution (LFSR) methods often fail to fully leverage the complementarity among various LF representations, leading to the loss of fine textures and geometric misalignments across views. To address these issues, we propose RASLF, a representation-aware state-space framework that explicitly models structural correlations across multiple LF representations. Specifically, a Progressive Geometric Refinement (PGR) block is created that uses a panoramic epipolar representation to explicitly encode multi-view parallax differences, thereby enabling integration across different LF representations. Furthermore, we introduce a Representation Aware Asymmetric Scanning (RAAS) mechanism that dynamically adjusts scanning paths based on the physical properties of different representation spaces, optimizing the balance between performance and efficiency through path pruning. Additionally, a Dual-Anchor Aggregation (DAA) module improves hierarchical feature flow, reducing redundant deeplayer features and prioritizing important reconstruction information. Experiments on various public benchmarks show that RASLF achieves the highest reconstruction accuracy while remaining highly computationally efficient.
Sep 17, 2026

STAR: Structure-aware Test-time Adaptation for diffusion-based light field Reconstruction

Light field (LF) reconstruction from limited and noisy focal stack (FS) measurements is a highly ill-posed inverse problem. Although the LF-to-FS imaging geometry is fixed for a given optical setup, LF spatial-angular structure---including within-view spatial details, cross-view angular dependencies, and disparity across views---varies across scenes. Consequently, a fixed pre-trained prior may not optimally capture the spatial-angular structure of each test LF. We propose Structure-aware Test-time Adaptation for diffusion-based light field Reconstruction (STAR), the first test-time adaptation framework for reconstructing an LF from FS. For each test LF, STAR freezes a pre-trained diffusion prior and fits three lightweight adapters to the observed FS to jointly adapt the three components of the LF's spatial-angular structure. STAR outperforms existing state-of-the-art methods in both two- and three-focal-sheet settings, with shorter inference times than those with test-time parameter updates.