Supervised ImageNet
Supervised ImageNet research focuses on improving image classification models by leveraging the massive ImageNet dataset. Current efforts concentrate on enhancing data curation strategies, developing more efficient training methods (including exploring alternative architectures like binary neural networks and leveraging self-supervised learning), and addressing challenges like dataset bias and the need for explainable AI. These advancements are crucial for improving the accuracy, efficiency, and trustworthiness of computer vision systems across various applications, from medical imaging to agricultural technology.
Papers
Scaling Laws of Synthetic Images for Model Training ... for Now
Lijie Fan, Kaifeng Chen, Dilip Krishnan, Dina Katabi, Phillip Isola, Yonglong Tian
Understanding the Detrimental Class-level Effects of Data Augmentation
Polina Kirichenko, Mark Ibrahim, Randall Balestriero, Diane Bouchacourt, Ramakrishna Vedantam, Hamed Firooz, Andrew Gordon Wilson
Describing Differences in Image Sets with Natural Language
Lisa Dunlap, Yuhui Zhang, Xiaohan Wang, Ruiqi Zhong, Trevor Darrell, Jacob Steinhardt, Joseph E. Gonzalez, Serena Yeung-Levy
Classification for everyone : Building geography agnostic models for fairer recognition
Akshat Jindal, Shreya Singh, Soham Gadgil
Directions of Curvature as an Explanation for Loss of Plasticity
Alex Lewandowski, Haruto Tanaka, Dale Schuurmans, Marlos C. Machado
Knowledge Transfer from Vision Foundation Models for Efficient Training of Small Task-specific Models
Raviteja Vemulapalli, Hadi Pouransari, Fartash Faghri, Sachin Mehta, Mehrdad Farajtabar, Mohammad Rastegari, Oncel Tuzel
MoCo-Transfer: Investigating out-of-distribution contrastive learning for limited-data domains
Yuwen Chen, Helen Zhou, Zachary C. Lipton
ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy
Kirill Vishniakov, Zhiqiang Shen, Zhuang Liu
Self-Supervised Disentanglement by Leveraging Structure in Data Augmentations
Cian Eastwood, Julius von Kügelgen, Linus Ericsson, Diane Bouchacourt, Pascal Vincent, Bernhard Schölkopf, Mark Ibrahim