Paper ID: 2207.02250

Array Camera Image Fusion using Physics-Aware Transformers

Qian Huang, Minghao Hu, David Jones Brady

We demonstrate a physics-aware transformer for feature-based data fusion from cameras with diverse resolution, color spaces, focal planes, focal lengths, and exposure. We also demonstrate a scalable solution for synthetic training data generation for the transformer using open-source computer graphics software. We demonstrate image synthesis on arrays with diverse spectral responses, instantaneous field of view and frame rate.

Submitted: Jul 5, 2022