cs.CVNov 18, 2026

AnchorUp: Anchoring Feature Upsampling on a Classical Interpolation

Authors: Kotaro Horikawa, Keisuke Toida, Junya Komori, Kazuhiro Hotta

Organizations: Meijo University, Japan · Asia Air Survey Co., Ltd., Japan

Abstract

Vision foundation models produce semantically strong features on a coarse patch grid, and dense prediction needs them at pixel resolution. Existing learned upsamplers close that gap by regressing the high-resolution feature map from the low-resolution one, typically through cross-attention driven by the input image. We observe that most of what they regress needs no learning: plain bilinear interpolation already reproduces the smooth regions of the target, and recent benchmarks even report bilinear and bicubic on par with several learned upsamplers. The rest is mostly edges and fine details, which suggests that these learned upsamplers spend much of their capacity re-computing the smooth content that classical interpolation provides. We therefore introduce AnchorUp, which stops predicting the high-resolution feature map and predicts only its correction from the interpolation. It keeps a parameter-free classical upsampler as an anchor, obtains a second prediction from a small guidance network, and blends the two through a single learnable scalar gate. Because the anchor supplies the smooth content, the guidance network only has to correct what remains. An analysis of the learned correction confirms that it concentrates on edges and fine details, and so the network can be small: AnchorUp uses 167,425 parameters, a quarter of the budget of the strongest baseline, NAF, and runs at 64% of its latency. Trained once on DINOv3 with only the first of NAF's two training stages, and evaluated on that backbone plus six held-out ones, it is already on par with NAF trained through both stages on Pascal VOC and Cityscapes. Our method surpasses it on DAVIS-2017 video object segmentation; the gain holds on every backbone and is larger in contour accuracy F. Code is available at https://github.com/KotaroHorikawa/AnchorUp.

Figures & tables

Explore similar work

CardsList
  1. DiveUp: Learning Feature Upsampling from Diverse Vision Foundation Models

    Mar 13, 2026Xiaoqiong Liu, Heng FanVision Foundation Model Adaptation

  2. ViT-Up: Faithful Feature Upsampling for Vision Transformers

    Jun 12, 2026Krispin Wandel, Jingchuan Wang, Hesheng WangSemantic CorrespondenceVision Transformer