Promptable Image Segmentation

Overview

Promptable image segmentation studies how a model can turn a user's or another model's cue—such as a click, box, scribble, text description, or example mask—into a precise region. Much work builds on Segment Anything models, adapting them with lightweight adapters or fine-tuning, while other methods generate better prompts automatically or use retrieval and visual examples to guide frozen models. These approaches support interactive correction and open-vocabulary segmentation across settings such as medical imaging, remote sensing, microscopy, and video. A central challenge is that results can be sensitive to prompt choice and domain shift, so evaluations increasingly test realistic human prompts, robustness, uncertainty, and the trade-off between accuracy, interaction effort, and speed.

Latest papers

CardsList

160 papers10 papers in the last four weeks, down 17% on the four weeks before. 0.1% of all new papers.

  1. Where is My Mug? Training-Free Framework for Personalized Image Segmentation

    Nov 11, 2026Quang Qui-Vinh Nguyen, Hung Nguyen, Rang Nguyen +1Promptable Image SegmentationInteractive Image Segmentation

  2. Prompt2Echo (P2Echo): Text-Prompted Multi-View Echocardiography Segmentation with One Model

    Nov 10, 2026Moein Heidari, Alvin Kimbowa, Mahdi Tabatabaei +8Ultrasound Image SegmentationEchocardiography

  3. Query-Only Prompt-Agnostic Attacks on Visual In-Context Learning

    Nov 8, 2026Xiao Hu, Muhammad Ibrahim, Hao Wen +3Black-Box Adversarial AttacksIn-Context Learning

  4. Adapting Frozen Promptable Segmenters to User-Defined Taxonomies via Few-Shot Proposal Learning

    Nov 6, 2026Khayrul Islam, Christopher Frederic MillerAutomated Data AnnotationPromptable Image Segmentation

  5. PTQ4SAM3: Semantics-Preserving Post-Training Quantization for Segment Anything Model 3

    Nov 4, 2026Xi Xiao, Yunbei Zhang, Lin Zhao +7Post-Training QuantizationNeural Network Quantization

  6. CASE: Concept-Aware Segmentation from Positive and Negative Visual Exemplars

    Oct 29, 2026Yi-Jen Tsai, Yen-Yu Lin, Chien-Yao WangPromptable Image SegmentationFew-Shot Semantic Segmentation

  7. Analyzing Condensation on Patterned Surfaces via Deep Learning

    Oct 29, 2026Tae E. Cooper, Michael Gee, Sheila Whitman +5Image SegmentationInstance Segmentation

  8. GarmentSegAgent: Autonomous Garment Segmentation for Web Fashion Images via Textual Self-Refinement

    Oct 27, 2026Jia Chen, Chao Huang, Xinrong Hu +3Text-Guided Image SegmentationSemantic Segmentation

  9. Efficient SAM3 Adaptation for Multi-Class Semantic Segmentation via Dense Competitive Representations

    Oct 20, 2026Wenbin Liao, Hao Zhu, Yike Ma +2Promptable Image SegmentationSemantic Segmentation

  10. BaT-SAM: Introducing Inductive Bias into SAM via a Mixture of Convolutional Experts for Brain Tumor Segmentation

    Oct 11, 2026Sumiaya Jannat, Md Mahedi Hasan, Md Shamimul Islam +1Medical Image SegmentationBrain Tumor Segmentation

  11. Text-Guided Medical Image Segmentation via Residual Aggregation and Dense Alignment Representations

    Oct 10, 2026Jie Gui, Hang Tu, Yunfeng Dou +3Text-Guided Image SegmentationPromptable Image Segmentation

  12. One-Shot Adaptive Segmentation For Scientific Images

    Oct 7, 2026Tejaswi V. Panchagnula, Allison M. Davis, Fengqing ZhuImage SegmentationVision Foundation Model Adaptation

  13. Topology-Informed Prompt-Conditioned Universal Segmentation of Uterine Structures from Ultrasound and MRI

    Oct 5, 2026Yongheng Sun, Yuexi Gu, Jingwen Sun +2Ultrasound Image SegmentationCross-Modality Medical Image Segmentation

  14. Seeing as Humans Do: Learning from Motion to Segment Anything Without Supervision

    Sep 30, 2026Weijian Jian, Xiaoyue Zhang, Bin Xiao +5Image SegmentationSelf-Supervised Learning

  15. Universal Cross-Prompt Adversarial Attacks on Promptable Concept Segmentation

    Sep 30, 2026Ziqi Zhou, Yifan Hu, Yufei Song +5Adversarial AttacksPromptable Image Segmentation

  16. S4VY: Segment Anything in Feed-Forward 4D Visual Geometry

    Sep 29, 2026Jingdong Zhang, Xin Li, Jan Kautz +2Instance SegmentationPromptable Image Segmentation

  17. XFlow: A Workflow Model for Instruction-Guided Lesion Segmentation in Chest X-rays

    Sep 28, 2026Geon Choi, Hangyul Yoon, Hyunki Park +2Promptable Image SegmentationMedical Image Segmentation

  18. ReG-SAM: Reference Graph-Driven SAM for 2D Foundational Vessel Segmentation

    Sep 25, 2026Donghang Lyu, Zichen Zhang, Oleh Dzyubachyk +1Medical Image SegmentationPromptable Image Segmentation

  19. Can Frozen Hyperspherical Features Guide the Selection of Pseudo Masks?

    Sep 24, 2026Xinge Guo, Fengyang Xiao, Dingming Zhang +6Promptable Image SegmentationPseudo-Labeling

  20. SRPR-Net: Semantic and Relational Prompt Refinement for Automated SAM-based Instance Segmentation

    Sep 21, 2026Lufei Liu, Guojie Li, Suncheng Xiang +1Instance SegmentationPromptable Image Segmentation

  21. P3^3-SAM: SAM with Perceptual Parallel Prompt for Few-Shot Strip Steel Surface Defect Segmentation

    Sep 18, 2026Qian Xu, Hang Xiong, Anpeng Wang +3Image SegmentationFew-Shot Semantic Segmentation

  22. SetPlanner: A Lightweight Plug-in Point-Set Planner for Frozen SAM

    Sep 16, 2026Dawei Yan, Yuezhe Yang, Menglan Ruan +2Promptable Image SegmentationMedical Image Segmentation

  23. PSMP-CLIP: Patch-Prompt SAM and Multi-Semantic Prompting for CLIP-Based Zero-Shot Anomaly Detection

    Sep 15, 2026Xuezhi Xiang, Guanghao Wu, Heqi Xiang +4Promptable Image SegmentationAnomaly Localization

  24. Parameter-Efficient Fine-Tuning of Foundation Models for Liver Tumor Segmentation in CT

    Sep 12, 2026Ramtin Mojtahedi, Mohammad Hamghalam, Jacob J. Peoples +2Medical Image SegmentationParameter-Efficient Fine-Tuning

  25. Adapting Open-Weight MLLMs to Generate Point Prompts for Electron Microscopy Segmentation

    Sep 12, 2026Samia Mohinta, Albert CardonaElectron MicroscopyVLM Adaptation

  26. Spectral Adapters for Segment Anything Model-based Segmentation of Colorectal Liver Metastases in Computed Tomography

    Sep 10, 2026Ramtin Mojtahedi, Mohammad Hamghalam, Jacob J. Peoples +6Promptable Image SegmentationVision Foundation Model Adaptation

  27. Beyond Weak Labels: Prompt-Guided Local Refinement for Weakly Supervised Water Segmentation in High-Resolution Multispectral Imagery

    Sep 9, 2026Muhammad Farhan Humayun, Mohammad Imangholiloo, Afifah Shah +2Remote Sensing Image SegmentationPromptable Image Segmentation