DNN Framework

Deep neural network (DNN) frameworks are the foundation of modern artificial intelligence, aiming to improve model accuracy, efficiency, and robustness. Current research focuses on optimizing DNN training and inference, including techniques like efficient parallelization strategies, mixed-precision training, and adaptive model selection based on resource constraints and carbon footprint. These advancements are crucial for deploying DNNs on resource-limited devices (e.g., edge computing) and mitigating challenges like adversarial attacks, noise, and data scarcity, ultimately impacting various fields from computer vision to natural language processing.

Papers

October 16, 2022

Stability of Accuracy for the Training of DNNs Via the Uniform Doubling Condition
Yitzchak Shmalo
Deep Neural Network Training Data Core Stability Cross Entropy Loss DNN Framework

October 14, 2022

InFIP: An Explainable DNN Intellectual Property Protection Method based on Intrinsic Features
Mingfu Xue, Xin Wang, Yinghao Wu, Shifeng Ni, Yushu Zhang, Weiqiang Liu
Deep Neural Network DNN Framework DNN Model Intellectual Property Protection Intellectual Property Intrinsic Feature

October 8, 2022

Low Error-Rate Approximate Multiplier Design for DNNs with Hardware-Driven Co-Optimization
Yao Lu, Jide Zhang, Su Zheng, Zhen Li, Lingli Wang
DNN Framework Co Design Low Priority Neural Network Weight DNN Accuracy Class Wise Multiplier Approximate Multiplier

September 21, 2022

Progressive with Purpose: Guiding Progressive Inpainting DNNs through Context and Structure
Kangdi Shi, Muhammad Alrabeiah, Jun Chen
Context Information Inner Structure DNN Framework Image Feature Left Leaning Context Feature Convolutional Encoder Laplacian Pyramid Image Frequency

September 18, 2022

Improving the Performance of DNN-based Software Services using Automated Layer Caching
Mohammadamin Abedi, Yanni Iouannou, Pooyan Jamshidi, Hadi Hemmati
Deep Neural Network System Performance DNN Framework DNN Model Software System Optimization Layer

September 9, 2022

Robust and Lossless Fingerprinting of Deep Neural Networks via Pooled Membership Inference
Hanzhou Wu
Deep Neural Network Robust Version DNN Framework DNN Model Membership Inference Fingerprinting Lemma

August 29, 2022

Survey: Exploiting Data Redundancy for Optimization of Deep Learning
Jou-An Chen, Wei Niu, Bin Ren, Yanzhi Wang, Xipeng Shen
Deep Learning Deep Neural Network Timely Survey Optimization Purpose DNN Framework Information Redundancy Deep Neural Network Performance

August 18, 2022

Quantifying the Knowledge in a DNN to Explain Knowledge Distillation for Classification
Quanshi Zhang, Xu Cheng, Yilan Chen, Zhefan Rao
Knowledge Distillation Classification Code Knowledge Based DNN Framework DNN Model Layer Wise

August 2, 2022

OLLIE: Derivation-based Tensor Program Optimizer
Liyan Zheng, Haojie Wang, Jidong Zhai, Muyan Hu, Zixuan Ma, Tuowei Wang, Shizhi Tang, Lei Xie, Kezhao Huang, Zhihao Jia
Deep Neural Network DNN Framework Tensor Program Hybrid Optimization

July 29, 2022

Computational complexity reduction of deep neural networks
Mee Seong Im, Venkat R. Dasari
Deep Neural Network Computer Vision DNN Framework Complexity Reduction

July 25, 2022

On the benefits of non-linear weight updates
Paul Norridge
Gradient Descent Generalization Performance DNN Framework Complementary Benefit Weight Update Deep Neural Network Parameter Optimal Weight

July 22, 2022

July 20, 2022

Automated machine learning for borehole resistivity measurements
M. Shahriari, D. Pardo, S. Kargaran, T. Teijeiro
Deep Neural Network New Machine Neural Architecture Search DNN Framework Optimal Neural Network

July 11, 2022

Deep neural network based adaptive learning for switched systems
Junjie He, Zhihang Xu, Qifeng Liao
Deep Neural Network System Description DNN Framework DNN Model Adaptive Learning Unknown Nonlinear System

July 5, 2022

June 22, 2022

Fighting Fire with Fire: Avoiding DNN Shortcuts through Priming
Chuan Wen, Jianing Qian, Jierui Lin, Jiaye Teng, Dinesh Jayaraman, Yang Gao
Deep Learning DNN Framework Fighting Fire Fire Occurrence Visual Imitation Learning Psychological Priming Practice DNN Optimization

June 21, 2022

CoCoPIE XGen: A Full-Stack AI-Oriented Optimizing Framework
Xiaofeng Li, Bin Ren, Xipeng Shen, Yanzhi Wang
DNN Framework Optimization Framework DNN Workload