PhotoGuider: Composition-Aware Cropping and 360 View Framing with Explainable Photographic Assessments
Organizations: MediaTek Inc. · Department of Computer Science, National Yang Ming Chiao Tung University · National Taiwan University
Abstract
Traditional image cropping assumes the photograph already contains the composition worth keeping, and asks only where to crop. A full 360 scene offers no such guarantee: the viewing direction in a scene has to be discovered before anything can be framed. We present PhotoGuider, a measure-then-frame method that answers both questions with compact learned scorers over one shared set of composition-aware features. The designed features are extracted using foundation and task-specific vision models and structured into four photographic tokens: Subject, Composition, Aesthetics, and Integrity. Our MLLM explainer is fine-tuned to generate composition-related explanations conditioned on images and measured token assessments. To our knowledge, PhotoGuider is the first method to combine explicit composition-based direction selection in 360 panoramas with refined framing, camera-parameter output for native re-rendering, and measurement-conditioned explanations. On two standard 2D cropping benchmarks, PhotoGuider achieves the highest average mIoU performance against ground-truth crops. In a blind ranking study, 120 participants ranked three cropping methods over 100 panoramic scenes from the public Poly Haven HDRI library, placing our framings first in 53.2% of cases, against 27.3% and 19.5% for two strong alternatives. Project page: https://ntuneillee.github.io/research/photoguider/
Figures & tables
| Method | Publication | FCDB | FLMS | Average | |||
|---|---|---|---|---|---|---|---|
| BDE | IoU | BDE | IoU | BDE | IoU | ||
| DIC Wang & Shen (2017) | ICCV 2017 | 0.090 | 0.630 | 0.057 | 0.810 | 0.074 | 0.720 |
| DIC ∗ ( Wang et al., 2019 ) | TPAMI 2019 | 0.080 | 0.650 | 0.052 | 0.830 | 0.066 | 0.740 |
| A2RL ( Li et al., 2018 ) | CVPR 2018 | 0.089 | 0.664 | 0.045 | 0.821 | 0.067 | 0.743 |
| A3RL ( Li et al., 2019 ) | TIP 2019 | 0.077 | 0.696 | – | 0.839 | – | 0.768 |
| VPN ( Wei et al., 2018 ) | CVPR 2018 | 0.073 | 0.711 | 0.044 | 0.836 | 0.059 | 0.774 |
| Drop-one | Keep-only | |||||||
| FCDB | FLMS | FCDB | FLMS | |||||
| Token | BDE | IoU | BDE | IoU | BDE | IoU | BDE | IoU |
| Subject (S) | 0.063 | 0.740 | 0.046 | 0.821 | 0.064 | 0.735 | 0.042 | 0.834 |
| Composition (C) | 0.064 | 0.737 | 0.042 | 0.834 | 0.064 | 0.735 | 0.046 | 0.820 |
| Integrity (I) | 0.060 | 0.754 | 0.042 | 0.834 | 0.068 | 0.718 | 0.044 | 0.826 |
| Aesthetics (A) | 0.060 | 0.753 | 0.042 | 0.834 | 0.070 | 0.714 | 0.052 | 0.792 |
| Method | Rank-1 | Rank-3 | Mean | Scenes |
|---|---|---|---|---|
| rank | won | |||
| Ours | 53.2% | 15.2% | 1.62 | 59 |
| Venus | 27.3% | 37.4% | 2.10 | 26 |
| CACNet | 19.5% | 47.4% | 2.28 | 15 |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| Source | Anchor | Construction |
|---|---|---|
| Base grid | image geometry | center-shift grid, small-area grid and seeded random boxes, each re-aspected to the target ratio |
| Subject anchors | InSPyReNet subject mask | mask centroid, blobs and bounding box seven medium areas |
| Saliency peaks | DINOv3 saliency map | top-five peaks seven medium areas |
| Multi-scale | the three sources above | top-20 by saliency coverage scale factors |
| Diagonal | subject mask and saliency | frames placing the subject on an image diagonal |
| Negative space | subject mask and saliency | frames leaving open space opposite the subject |
| Image | PhotoGuider | Venus | ArtiMuse |
|---|---|---|---|
| fcdb_16002047337 | 20 | 16 | 14 |
| fcdb_9349007347 | 20 | 15 | 15 |
| flms_15659590 | 20 | 19 | 11 |
| flms_799562644 | 21 | 15 | 14 |
| flms_1588688990 | 19 | 17 | 14 |
| All (250) | 100 (40.0%) | 82 (32.8%) | 68 (27.2%) |
Image Editing
Image editing changes selected visual content while preserving the parts of an image that should remain unchanged.
See all 321 papers