Allure of Craquelure: A Variational-Generative Approach to Crack Detection in Paintings
Organizations: Dept. of Mathematics, LMU Munich, Germany · Munich Center for Machine Learning, Germany · Helmholtz Imaging, Deutsches Elektronen-Synchrotron DESY, Germany · Fachbereich Mathematik, University of Hamburg, Germany · CIT School, Technical University of Munich,Germany
Abstract
Recent advances in imaging technologies, deep learning and numerical performance have enabled non-invasive detailed analysis of artworks, supporting their documentation and conservation. In particular, automated detection of craquelure in digitized paintings is crucial for assessing degradation and guiding restoration, yet remains challenging due to the possibly complex scenery and the visual similarity between cracks and crack-like artistic features such as brush strokes or hair. We propose a hybrid approach that models crack detection as an inverse problem, decomposing an observed image into a crack-free painting and a crack component. A deep generative model is employed as powerful prior for the underlying artwork, while crack structures are captured using a Mumford--Shah-type variational functional together with a crack prior. Joint optimization yields a pixel-level map of crack localizations in the painting.