Transfer Learning Strategy

Transfer learning strategies aim to leverage knowledge gained from training a model on a large dataset (source domain) to improve performance on a related task with limited data (target domain). Current research focuses on optimizing this transfer process, exploring techniques like data filtering to enhance efficiency and employing various pre-trained models, including transformers and convolutional neural networks, for feature extraction and improved generalization. These advancements are significantly impacting diverse fields, from industrial defect detection and medical image analysis to natural language processing tasks like query-focused summarization and improving the accuracy and efficiency of various machine learning applications.

Papers

March 25, 2024

Enhancing Industrial Transfer Learning with Style Filter: Cost Reduction and Defect-Focus
Chen Li, Ruijie Ma, Xiang Qian, Xiaohao Wang, Xinghui Li
Transfer Learning Knowledge Transfer Industrial Machine Learning Defect Sample Industrial Datasets Transfer Learning Strategy

October 3, 2023

An evaluation of pre-trained models for feature extraction in image classification
Erick da Silva Puls, Matheus V. Todescato, Joel L. Carbonera
Deep Learning Global Evaluation Pre Trained Model Image Classification Feature Extraction Image Classification Task Different Pre Trained Transfer Learning Strategy

July 18, 2023

FISTNet: FusIon of STyle-path generative Networks for Facial Style Transfer
Sunder Ali Khowaja, Lewis Nkenyereye, Ghulam Mujtaba, Ik Hyun Lee, Giancarlo Fortino, Kapal Dev
Pre Trained Hybrid Fusion StyleGAN Latent Generative Network Transfer Learning Strategy Appearance Transfer

June 19, 2023

Transformer Training Strategies for Forecasting Multiple Load Time Series
Matthias Hertel, Maximilian Beichter, Benedikt Heidrich, Oliver Neumann, Benjamin Schäfer, Ralf Mikut, Veit Hagenmeyer
Load Forecasting Smart Grid Transformer Training Transfer Learning Strategy

November 14, 2022

Recognition of Cardiac MRI Orientation via Deep Neural Networks and a Method to Improve Prediction Accuracy
Houxin Zhou
Deep Neural Network Practical Method Recognition Rate Cardiac Magnetic Resonance Prediction Accuracy Medical Image Analysis Task Transfer Learning Strategy Cardiac MRI Orientation

June 17, 2022

COVID-19 Detection using Transfer Learning with Convolutional Neural Network
Pramit Dutta, Tanny Roy, Nafisa Anjum
Convolutional Neural Network Transfer Learning Coronavirus Disease 2019 Novel Coronavirus Transfer Learning Strategy

December 23, 2021

Dual Path Structural Contrastive Embeddings for Learning Novel Objects
Bingbin Li, Elvis Han Cui, Yanan Li, Donghui Wang, Weng Kee Wong
Contrastive Learning Transfer Learning Feature Representation Object Representation Novel Class Discovery Structural Embeddings Transfer Learning Strategy

December 14, 2021

Exploring Neural Models for Query-Focused Summarization
Jesse Vig, Alexander R. Fabbri, Wojciech Kryściński, Chien-Sheng Wu, Wenhao Liu
Transfer Learning Neural Model Abstractive Summary Query Focused Transfer Learning Strategy