Plug and Play
Plug-and-play (PnP) methods represent a powerful paradigm shift in various fields by integrating pre-trained models, often deep learning-based denoisers, as modular components into larger algorithms. Current research focuses on applying PnP to diverse problems, including image reconstruction (MRI, radar), video analysis (deepfake detection), and natural language processing (LLM bias detection, multi-step reasoning). This approach offers advantages in efficiency and generalization, avoiding the need for extensive task-specific training, and has shown promising results across numerous applications, improving performance and resource utilization. The modularity and adaptability of PnP are driving significant advancements in both theoretical understanding and practical deployment of sophisticated algorithms.
Papers
Convergent regularization in inverse problems and linear plug-and-play denoisers
Andreas Hauptmann, Subhadip Mukherjee, Carola-Bibiane Schönlieb, Ferdia Sherry
MarS3D: A Plug-and-Play Motion-Aware Model for Semantic Segmentation on Multi-Scan 3D Point Clouds
Jiahui Liu, Chirui Chang, Jianhui Liu, Xiaoyang Wu, Lan Ma, Xiaojuan Qi
Plug-and-Play split Gibbs sampler: embedding deep generative priors in Bayesian inference
Florentin Coeurdoux, Nicolas Dobigeon, Pierre Chainais
Learning Semantic-Agnostic and Spatial-Aware Representation for Generalizable Visual-Audio Navigation
Hongcheng Wang, Yuxuan Wang, Fangwei Zhong, Mingdong Wu, Jianwei Zhang, Yizhou Wang, Hao Dong