cs.CVNov 10, 2026

Obscured Wildfire Flame Detection by Spatio-temporal Analysis of Smoke Patterns Using Frame-wise Transformers

Authors: Uma Meleti, Abolfazl Razi, Fatemeh Afghah

Organizations: Department of Electrical Engineering Clemson University Clemson, USA

Abstract

In this paper, we propose a new paradigm in wildfire management for detecting both visible and obscured fire using Deep Learning (DL). The essence of our method is the joint spatial and temporal analysis of RGB videos, embracing the fact that temporal patterns of smoke motions in consecutive video frames can indicate obscured fire flames. This perspective contrasts the traditional approach of independently analyzing images and individual video frames. To this end, we propose a frame-wise transformer architecture that applies an attention mechanism between the consecutive frames while preserving spatial information within frames as opposed to regular attention mechanisms like the non-local block, which combines spatial and temporal information into a single vector. We also optimize the temporal pattern lengths under different spatial resolutions to achieve the highest performance while reducing the computational cost. To investigate the applicability of our method in aerial image processing, we applied it to a curated version of the FLAME2 dataset that includes dual-mode RGB/IR videos. The IR video feed is used to extract ground truth, while the model is trained only on RGB videos to maintain applicability to lowcost commercial drones (which are equipped only with regular cameras) and facilitate processing existing RGB-only datasets. Our proposed method achieves a Segmentation Foreground Dice score of 92.61%, an Object Detection Precision and Recall rate of 93.21% and 91.73%, and clip-level classification accuracy of 98.02%, respectively. We also investigated the efficacy and generalizability of our method through ablation study

Figures & tables

Explore similar work

CardsList
  1. Attention-Based Spatio-Temporal Approach for Fire and Smoke Detection

    Oct 14, 2026Alireza Mirrashid, Mohammad Khoshbin, Ali Atghaei +1

  2. Multimodal RGB-Infrared Combination for UAV-Based Wildfire Segmentation: A Comparative Study on FLAME3

    Sep 1, 2026Matheus F. Kovaleski, Luís Garrote, Cristiano Premebida +2Image SegmentationRemote Sensing Image Segmentation

  3. WISE: A Lightweight, Weakly-Supervised Model for Onboard Fire Smoke Detection and Localization

    Sep 16, 2026Sha Lu, Yu Sun, Liang Zhao +6Wildfire DetectionRemote Sensing