DNN Framework

Deep neural network (DNN) frameworks are the foundation of modern artificial intelligence, aiming to improve model accuracy, efficiency, and robustness. Current research focuses on optimizing DNN training and inference, including techniques like efficient parallelization strategies, mixed-precision training, and adaptive model selection based on resource constraints and carbon footprint. These advancements are crucial for deploying DNNs on resource-limited devices (e.g., edge computing) and mitigating challenges like adversarial attacks, noise, and data scarcity, ultimately impacting various fields from computer vision to natural language processing.

Papers

November 29, 2023

Adaptive Early Exiting for Collaborative Inference over Noisy Wireless Channels
Mikolaj Jankowski, Deniz Gunduz, Krystian Mikolajczyk
Deep Neural Network Adaptive Importance DNN Framework Collaborative Inference Early eXit Wireless Edge Noisy Channel

November 13, 2023

Mitigating Backdoors within Deep Neural Networks in Data-limited Configuration
Soroush Hashemifar, Saeed Parsa, Morteza Zakeri-Nasrabadi
Deep Neural Network DNN Framework Limited Data Mitigating Backdoor Backdoor Policy

November 7, 2023

AGNES: Abstraction-guided Framework for Deep Neural Networks Security
Akshay Dhonthi, Marcello Eiermann, Ernst Moritz Hahn, Vahid Hashemi
Deep Neural Network Autonomous Driving Backdoor Attack DNN Framework Image Recognition Abstraction Based

October 17, 2023

Relearning Forgotten Knowledge: on Forgetting, Overfit and Training-Free Ensembles of DNNs
Uri Stern, Daphna Weinshall
Deep Neural Network Anti Forgetting Deep Model DNN Framework Training Free Model Overfitting Modern Deep Learning Model

September 26, 2023

Fixing the problems of deep neural networks will require better training data and learning algorithms
Drew Linsley, Thomas Serre
Deep Neural Network Training Data Real Human DNN Framework Learning Algorithm Related Problem Biological Vision Human Accuracy Low Quality Model

September 20, 2023

Prototype of a robotic system to assist the learning process of English language with text-generation through DNN
Carlos Morales-Torres, Mario Campos-Soberanis, Diego Campos-Sobrino
Natural Language Processing Long Short Term Memory Text Generation Robotic System Humanoid Robot DNN Framework Learning Process

September 12, 2023

Compiled Models, Built-In Exploits: Uncovering Pervasive Bit-Flip Attack Surfaces in DNN Executables
Yanzuo Chen (1), Zhibo Liu (1), Yuanyuan Yuan (1), Sihang Hu (2), Tianxiang Li (2), Shuai Wang (1) ((1) The Hong Kong University of Science and Technology, (2) Huawei Technologies)
DNN Framework Bit Flip Attack Bit Flip

September 4, 2023

On the fly Deep Neural Network Optimization Control for Low-Power Computer Vision
Ishmeet Kaur, Adwaita Janardhan Jadhav
Neural Network Pre Trained Edge Device DNN Framework Edge Speech Application Low Power Computer Vision

August 29, 2023

From DDMs to DNNs: Using process data and models of decision-making to improve human-AI interactions
Mrugsen Nagsen Gopnarayan, Jaan Aru, Sebastian Gluth
Artificial Intelligence Multi Agent Decision Making DNN Framework Behavioral Economics Human Artificial Intelligence Process Data

August 14, 2023

Symphony: Optimized DNN Model Serving using Deferred Batch Scheduling
Lequn Chen, Weixin Deng, Anirudh Canumalla, Yu Xin, Danyang Zhuo, Matthai Philipose, Arvind Krishnamurthy
DNN Framework DNN Model Dynamic Scheduling DNN Inference Phantom 2D Accelerator

August 3, 2023

Assessing Systematic Weaknesses of DNNs using Counterfactuals
Sujan Sai Gannamaneni, Michael Mock, Maram Akila
Semantic Segmentation Model DNN Framework High Quality Counterfactuals Semantic Feature Physical Weakness

July 29, 2023

An Automata-Theoretic Approach to Synthesizing Binarized Neural Networks
Ye Tao, Wanwei Liu, Fu Song, Zhen Liang, Ji Wang, Hongxu Zhu
Neural Network Deep Neural Network DNN Framework Multiplier Free Quantization Quantized Neural Network Automaton Theoretic Approach

July 20, 2023

Neuron Sensitivity Guided Test Case Selection for Deep Learning Testing
Dong Huang, Qingwen Bu, Yichao Fu, Yuhao Qing, Bocheng Xiao, Heming Cui
Deep Neural Network DNN Framework Unlabeled Data DNN Model Deep Learning Testing

July 19, 2023

TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge
Young D. Kwon, Rui Li, Stylianos I. Venieris, Jagmohan Chauhan, Nicholas D. Lane, Cecilia Mascolo
DNN Framework Device Training Energy Efficient Training Sparse Update Edge Data

July 13, 2023

Deep Neural Networks for Semiparametric Frailty Models via H-likelihood
Hangbin Lee, IL DO HA, Youngjo Lee
Deep Neural Network DNN Framework Negative Log Likelihood Frailty Care Competing Risk

July 11, 2023

June 16, 2023

Representation and decomposition of functions in DAG-DNNs and structural network pruning
Wen-Liang Hwang
Deep Neural Network Individual Representation DNN Framework Simple Function Microbial Decomposition Network Pruning

May 23, 2023

Transferring Learning Trajectories of Neural Networks
Daiki Chijiwa
Neural Network Deep Neural Network Pre Trained Model DNN Framework

May 16, 2023

A Note on Dimensionality Reduction in Deep Neural Networks using Empirical Interpolation Method
Harbir Antil, Madhu Gupta, Randy Price
Deep Neural Network Dimensionality Reduction DNN Framework Short Note Parametric Approximation Empirical Interpolation Method

DNN Framework

Papers

Adaptive Early Exiting for Collaborative Inference over Noisy Wireless Channels

Mitigating Backdoors within Deep Neural Networks in Data-limited Configuration

AGNES: Abstraction-guided Framework for Deep Neural Networks Security

Relearning Forgotten Knowledge: on Forgetting, Overfit and Training-Free Ensembles of DNNs

Fixing the problems of deep neural networks will require better training data and learning algorithms

Prototype of a robotic system to assist the learning process of English language with text-generation through DNN

Compiled Models, Built-In Exploits: Uncovering Pervasive Bit-Flip Attack Surfaces in DNN Executables

On the fly Deep Neural Network Optimization Control for Low-Power Computer Vision

From DDMs to DNNs: Using process data and models of decision-making to improve human-AI interactions

Symphony: Optimized DNN Model Serving using Deferred Batch Scheduling

Assessing Systematic Weaknesses of DNNs using Counterfactuals

An Automata-Theoretic Approach to Synthesizing Binarized Neural Networks

Neuron Sensitivity Guided Test Case Selection for Deep Learning Testing

TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge

Deep Neural Networks for Semiparametric Frailty Models via H-likelihood

Membership Inference Attacks on DNNs using Adversarial Perturbations

DyCL: Dynamic Neural Network Compilation Via Program Rewriting and Graph Optimization

Representation and decomposition of functions in DAG-DNNs and structural network pruning

Transferring Learning Trajectories of Neural Networks

A Note on Dimensionality Reduction in Deep Neural Networks using Empirical Interpolation Method