Dense Prediction

Dense prediction, a core task in computer vision, aims to generate a prediction for every pixel in an image, enabling applications like semantic segmentation and depth estimation. Current research focuses on improving the efficiency and accuracy of dense prediction models, exploring architectures like Vision Transformers (ViTs) and convolutional neural networks (CNNs), often combined with techniques such as multi-scale feature fusion, attention mechanisms, and knowledge distillation. These advancements are driving progress in various fields, including medical image analysis, autonomous driving, and remote sensing, by enabling more accurate and efficient processing of high-resolution visual data.

Papers

July 4, 2022

A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Prediction
Wei Shen, Zelin Peng, Xuehui Wang, Huayu Wang, Jiazhong Cen, Dongsheng Jiang, Lingxi Xie, Xiaokang Yang, Qi Tian
Deep Learning Timely Survey Semantic Segmentation Weak Supervision Dense Prediction Label Efficient

May 28, 2022

Multi-Task Learning with Multi-Query Transformer for Dense Prediction
Yangyang Xu, Xiangtai Li, Haobo Yuan, Yibo Yang, Lefei Zhang
Multi Task Learning Dense Prediction Query Transformer Multi Task Dense Prediction Cross Task Attention

May 17, 2022

Vision Transformer Adapter for Dense Predictions
Zhe Chen, Yuchen Duan, Wenhai Wang, Junjun He, Tong Lu, Jifeng Dai, Yu Qiao
Vision Transformer Inductive Bias Dense Prediction Dense Prediction Task Transformer Adapter

April 28, 2022

Depth Estimation with Simplified Transformer
John Yang, Le An, Anurag Dixit, Jinkyu Koo, Su Inn Park
Transformer Based Depth Estimation Monocular Depth Estimation Dense Prediction Dense Prediction Task Simple Transformer

April 14, 2022

3D Shuffle-Mixer: An Efficient Context-Aware Vision Learner of Transformer-MLP Paradigm for Dense Prediction in Medical Volume
Jianye Pang, Cheng Jiang, Yihao Chen, Jianbo Chang, Ming Feng, Renzhi Wang, Jianhua Yao
Vision Transformer Dense Prediction Deep Transformer Local Transformer Visual in Context Learning MRI Volume CNN Backbone

March 3, 2022

Fast Neural Architecture Search for Lightweight Dense Prediction Networks
Lam Huynh, Esa Rahtu, Jiri Matas, Janne Heikkila
Neural Architecture Search Monocular Depth Estimation Dense Prediction Dense Prediction Task Dense Recognition

February 18, 2022

Joint Learning of Frequency and Spatial Domains for Dense Predictions
Shaocheng Jia, Wei Yao
Joint Learning High Frequency Spatial Domain Dense Prediction Frequency Learning Spatial Generalization Spatial Learning Frequency Domain Learning

December 23, 2021

Dense Out-of-Distribution Detection by Robust Learning on Synthetic Negative Data
Matej Grcić, Petra Bevandić, Zoran Kalafatić, Siniša Šegvić
Distribution Detection Robust Learning Dense Prediction

December 21, 2021

December 2, 2021

DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting
Yongming Rao, Wenliang Zhao, Guangyi Chen, Yansong Tang, Zheng Zhu, Guan Huang, Jie Zhou, Jiwen Lu
Image Text Pair Dense Prediction Dense Prediction Task

November 22, 2021

Topological Regularization for Dense Prediction
Deqing Fu, Bradley J. Nelson
Semantic Segmentation Topological Feature Persistent Homology Dense Prediction Dense Prediction Task Topological Regularization