End to End Training

End-to-end training optimizes entire machine learning models simultaneously, aiming to improve performance and efficiency compared to modular approaches. Current research focuses on addressing limitations such as high computational cost and memory usage through techniques like parameter reduction, innovative training architectures (e.g., incorporating attention mechanisms, iterative neural networks), and improved data preprocessing. This approach is impacting diverse fields, from autonomous driving and semantic communication to medical image analysis and radar signal processing, by enabling the development of more powerful and efficient AI systems.

Papers

October 24, 2024

End-to-end Training for Recommendation with Language-based User Profiles
Zhaolin Gao, Joyce Zhou, Yijia Dai, Thorsten Joachims
Recommender System Effective Recommendation Explainable Recommendation End to End Training User Profile

October 16, 2024

End-to-end Planner Training for Language Modeling
Nathan Cornille, Florian Mai, Jingyuan Sun, Marie-Francine Moens
Fine Tuning Learning Based Label Embeddings End to End Training

October 2, 2024

Replacement Learning: Training Vision Tasks with Fewer Learnable Parameters
Yuming Zhang, Peizhe Wang, Shouxin Zhang, Dongzhi Guan, Jiabin Liu, Junhao Su
Deep Learning Model Supervised ImageNet Deeper Network End to End Training Trainable Parameter

April 16, 2024

End-To-End Training and Testing Gamification Framework to Learn Human Highway Driving
Satya R. Jaladi, Zhimin Chen, Narahari R. Malayanur, Raja M. Macherla, Bing Li
Autonomous Driving Game Theoretic Highway Driving Gamification User Type End to End Training

April 15, 2024

Building Semantic Communication System via Molecules: An End-to-End Training Approach
Yukun Cheng, Wei Chen, Bo Ai
Semantic Communication Known Molecule Semantic Communication System Molecular Information End to End Training Molecular Communication

February 14, 2024

End-to-End Training Induces Information Bottleneck through Layer-Role Differentiation: A Comparative Analysis with Layer-wise Training
Keitaro Sakamoto, Issei Sato
Comparative Study Multi Layer Information Bottleneck Deep Understanding Layer Wise Intermediate Representation End to End Training

December 15, 2023

End-to-End Training of Neural Networks for Automotive Radar Interference Mitigation
Christian Oswald, Mate Toth, Paul Meissner, Franz Pernkopf
Neural Network Wave Over the Horizon Radar Automotive Radar End to End Training Radar Processing Interference Mitigation

December 12, 2023

Go beyond End-to-End Training: Boosting Greedy Local Learning with Context Supply
Chengting Yu, Fengzhao Zhang, Hanzhi Ma, Aili Wang, Erping Li
Dynamic ModulE Greedy Learning End to End Training Lead Time Gradient Rectification

November 28, 2023

End-to-End Temporal Action Detection with 1B Parameters Across 1000 Frames
Shuming Liu, Chen-Lin Zhang, Chen Zhao, Bernard Ghanem
Many Parameter Indoor Wall Frame Installation Temporal Action Detection End to End Training Temporal Adaptation Memory Deep Learning

October 4, 2023

End-to-End Training of a Neural HMM with Label and Transition Probabilities
Daniel Mann, Tina Raissi, Wilfried Michel, Ralf Schlüter, Hermann Ney
Hidden Markov Model Full Label Transition Probability End to End Training Transition Model

May 23, 2023

One-stop Training of Multiple Capacity Models
Lan Jiang, Haoyang Huang, Dongdong Zhang, Rui Jiang, Furu Wei
Knowledge Distillation Joint Learning Training Model Two Stage Training End to End Training Model Capacity Unified Training

April 18, 2023

Understand Data Preprocessing for Effective End-to-End Training of Deep Neural Networks
Ping Gong, Yuxin Ma, Cheng Li, Xiaosong Ma, Sam H. Noh
Deep Neural Network Raw Data High Fidelity DNN Training Data Preprocessing End to End Training Training Framework State of the Art NVIDIA

March 21, 2023

October 3, 2022

Interpretable Deep Tracking
Benjamin Thérien, Krzysztof Czarnecki
Neural Network Deep Learning Multi Object Tracking Object Tracking Deep Tracker End to End Training

June 9, 2022

Convolutional Dictionary Learning by End-To-End Training of Iterative Neural Networks
Andreas Kofler, Christian Wald, Tobias Schaeffter, Markus Haltmeier, Christoph Kolbitsch
Dictionary Learning Blind Source Separation Iterative Neural Network End to End Training Dynamic MR Physic Informed Convolutional Neural Network Sparsity Search Sparsifying Transform

May 23, 2022

DOGE-Train: Discrete Optimization on GPU with End-to-end Training
Ahmed Abbas, Paul Swoboda
Single GPU Integer Programming Discrete Optimization End to End Training

March 4, 2022

Convolutional Analysis Operator Learning by End-To-End Training of Iterative Neural Networks
Andreas Kofler, Christian Wald, Tobias Schaeffter, Markus Haltmeier, Christoph Kolbitsch
Image Reconstruction Deep Operator Network Iterative Neural Network End to End Training Sparsifying Transform

February 17, 2022

End-to-End Training for Back-Translation with Categorical Reparameterization Trick
DongNyeong Heo, Heeyoul Choi
Neural Machine Translation Translation Task Back Translation Reparameterization Method End to End Training Pre Trained Neural Machine Translation

December 28, 2021

AdaFocus V2: End-to-End Training of Spatial Dynamic Networks for Video Recognition
Yulin Wang, Yang Yue, Yuanze Lin, Haojun Jiang, Zihang Lai, Victor Kulikov, Nikita Orlov, Humphrey Shi, Gao Huang
Video Recognition End to End Training Spatial Network

End to End Training

Papers

End-to-end Training for Recommendation with Language-based User Profiles

End-to-end Planner Training for Language Modeling

Replacement Learning: Training Vision Tasks with Fewer Learnable Parameters

End-To-End Training and Testing Gamification Framework to Learn Human Highway Driving

Building Semantic Communication System via Molecules: An End-to-End Training Approach

End-to-End Training Induces Information Bottleneck through Layer-Role Differentiation: A Comparative Analysis with Layer-wise Training

End-to-End Training of Neural Networks for Automotive Radar Interference Mitigation

Go beyond End-to-End Training: Boosting Greedy Local Learning with Context Supply

End-to-End Temporal Action Detection with 1B Parameters Across 1000 Frames

End-to-End Training of a Neural HMM with Label and Transition Probabilities

One-stop Training of Multiple Capacity Models

Understand Data Preprocessing for Effective End-to-End Training of Deep Neural Networks

Automatic evaluation of herding behavior in towed fishing gear using end-to-end training of CNN and attention-based networks

LEAPT: Learning Adaptive Prefix-to-prefix Translation For Simultaneous Machine Translation

Interpretable Deep Tracking

Convolutional Dictionary Learning by End-To-End Training of Iterative Neural Networks

DOGE-Train: Discrete Optimization on GPU with End-to-end Training

Convolutional Analysis Operator Learning by End-To-End Training of Iterative Neural Networks

End-to-End Training for Back-Translation with Categorical Reparameterization Trick

AdaFocus V2: End-to-End Training of Spatial Dynamic Networks for Video Recognition