ENet-GP: Unified Document Image Restoration
Organizations: Indian Institute of Technology, Madras · Adobe, India
Abstract
Reliable document digitization in uncontrolled capture settings is challenging because real images exhibit multiple interacting degradations rather than a single isolated distortion. Documents thus captured are affected simultaneously by geometric distortions, like page warping, as well as photometric degradations such as non-uniform illumination, and blurring. However, most existing approaches address these factors independently and are evaluated on benchmarks containing only one distortion type, limiting their real-world applicability. We introduce GutenDoc, a large-scale dataset of high-resolution dense-text documents with physically grounded compound degradations. Using physics-based rendering, our dataset jointly models geometric warping and diverse photometric effects, enabling systematic evaluation under realistic capture conditions. We further propose a unified restoration framework that jointly corrects geometric and photometric distortions within a single-network and single-training setup, without the need for degradation-specific retraining or sequential inference passes. Extensive experiments show that our method remains competitive on established single-distortion benchmarks while substantially improving robustness under compound degradations, providing a practical solution for real-world document digitization.
Figures & tables
| Task | Real-World Datasets (Size) | Synthetic Datasets (Size) |
|---|---|---|
| Dewarping | DocUnet (130) [ 46 ] , DIW(5k) [ 45 ] , DIR300 (300) [ 17 ] , Inv3DReal (360) [ 23 ] , DocReal(200) [ 81 ] , WarpDoc-R(840) [ 91 ] , UDIR (195) [ 13 ] , Book100 (100) [ 43 ] , WarpDoc (1k) [ 78 ] , UVDoc (50) [ 70 ] | Doc3D (100k) [ 7 ] , UVDoc (pseudo-realistic)(20k) [ 70 ] , Inv3d (25k) [ 23 ] , DICP (30k) [ 77 ] , [ 37 ] (90k), Book3D (56k) [ 43 ] , AlignSynth [ 88 ] |
| Deshadowing | RDD (4.9k) [ 89 ] , Kligler (300) [ 33 ] , Jung (87) [ 31 ] , OSR (237) [ 71 ] , WEZUT (176) [ 51 ] | FSDSRD (14.2k) [ 48 ] , SynDocDS (50k) [ 49 ] , SD7k [ 39 ] |
| Appearance | DocAligner (130) [ 88 ] , RealDAE (600) [ 85 ] | Doc3DShade (90k) [ 8 ] , DocProj (2.4k) [ 38 ] |
| Binarization | (H)-DIBCO [ 57 , 19 , 52 , 53 , 54 , 55 , 56 , 58 , 59 , 60 ] , Synchromedia(240) [ 21 ] , Persian Heritage(15) [ 2 ] , Bickley Diary (7) [ 12 ] | Noisy Office (216) [ 84 ] |
| Deblurring | TDD [ 28 ] (used for both training and benchmarking) | |
| Category | Representative Methods | Core Mechanisms | Primary Limitations |
|---|---|---|---|
| Geometric Networks | DocUNet [ 46 ] , DewarpNet [ 7 ] , DocTr [ 14 ] , DvD [ 90 ] | U-Net, 3D coordinate prediction, Transformers, Diffusion models | Treat shape correction in isolation; fail to address accompanying photometric distortions. |
| Photometric Networks | Skip-connections [ 20 , 47 , 93 ] , General [ 1 , 6 , 82 ] , SwinIR [ 40 ] , Restormer [ 83 ] , Uformer [ 75 ] , DocEnTr [ 67 ] , DocDeshadower [ 94 ] , BGSNet [ 89 ] , DocDiff [ 79 ] | Residual learning, Vision Transformers (Self-attention, Frequency-aware), Diffusion models | Assume a spatially aligned, flat surface; struggle with geometry-induced lighting variations. |
| Unified Solvers | ProRes [ 44 ] , DocRes [ 87 ] , UniDocDiff [ 92 ] , Tang et al. [ 68 ] , DocNLC [ 72 ] | Learnable/Dynamic prompting, Diffusion, Dual-stream networks, Contrastive learning | Struggle to synergistically model the intrinsic correlation between 3D deformations and photometric distortions. |
| Combination | Model | Trained on | Group | Tested on | Inference Passes | Image Metrics | Text Metrics | Average Wall-clock Time (s) | GFLOPs | |||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1st | 2nd | 3rd | 4th | PSNR / | SSIM / | CER | ED | |||||||
| 1 | ENet-GP | GutenDoc (Train and Val split) (see Table 4 ) | GutenDoc Test split (Table 4 ) | Perspective All | – | – | – | 22.1313 | 0.6551 | 0.5118 | 1493.8311 | 0.439 | 280.2937 | |
| DocRes | GutenDoc Test split (Table 4 ) | Dew | – | – | – | 16.4945 | 0.6309 | 0.8622 | 2581.0497 | 1.5326 | 183.6135 | |||
| Dew | Des | – | – | 22.5562 | 0.7309 | 0.9767 | 2928.8002 | 1.9852 | 367.227 | |||||
| Dew | App | – | – | 22.5499 | 0.7307 | 0.9738 | 2917.6717 | 1.6372 | 367.227 | |||||
| Dew | Deb | – | – | 22.6066 | 0.7307 | 0.9768 | 2928.8490 | 1.9092 | 367.227 | |||||
| Combination | Model | Trained on | Group | Tested on | Inference Passes | Image Metrics | Text Metrics | Average Wall-clock Time (s) | GFLOPs | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1st | PSNR / (LD) | SSIM / (MSSIM) | CER | ED | |||||||
| 2 | ENet-GP | GutenDoc (Train and Val split) (see Table 4 ) | DIR300 [ 16 ] | Perspective All | (15.9966) | (0.4980) | 0.4951 | 1250.4833 | 1.4466 | 280.2937 | |
| Kligler [ 33 ] | Perspective All | 6.6137 | 0.3719 | 0.5431 | 115.7933 | 0.4660 | 280.2937 | ||||
| Jung [ 31 ] | Perspective All | 15.2150 | 0.7626 | 0.9537 | 545.5747 | 0.4660 | 280.2937 | ||||
| OSR [ 71 ] | Perspective All | 12.5555 | 0.8549 | 0.2662 | 299.9451 | 0.4660 | 280.2937 | ||||
| TDD [ 28 ] | Perspective All | 7.9188 | 0.2823 | 0.8843 | 136.3169 | 0.4167 | 280.2937 | ||||