Neural Network Structure

Neural network structure research focuses on designing optimal network architectures to improve accuracy, efficiency, and generalizability of machine learning models. Current efforts concentrate on developing novel architectures, such as those incorporating variational autoencoders or recurrent neural networks with convolutional layers, and optimizing existing ones through techniques like additive regularization schedules and Bayesian optimization for hyperparameter tuning. These advancements are crucial for enhancing the performance of various applications, from robot-guided assembly and image recognition to protein structure prediction and customer churn analysis, by enabling the creation of more accurate, efficient, and robust models.

Papers

June 18, 2024

Additive regularization schedule for neural architecture search
Mark Potanin, Kirill Vayser, Vadim Strijov
Neural Network Neural Architecture Search Efficient Neural Network Neural Network Structure Optimal Neural Network

May 11, 2024

PIPE: Process Informed Parameter Estimation, a learning based approach to task generalized system identification
Constantin Schempp, Christian Friedrich
Constructive Approach Variational Autoencoder Related Task System Identification Robotic Assembly Contact Estimation Software Evolution Neural Network Structure Contact Model

January 25, 2024

Design and Implementation of Hardware Accelerators for Neural Processing Applications
Shilpa Mayannavar, Uday Wali
Artificial Intelligence Product Design Practical Implementation DNN Model Hardware Accelerator Autoregressive Neural Network Neural Network Structure Neural Network Application

January 19, 2024

Classification with neural networks with quadratic decision functions
Leon Frischauf, Otmar Scherzer, Cong Shi
Neural Network Classification Code MNIST Dataset Standard Deep Neural Network Structure Quadratic Objective

December 27, 2023

Structure and Optimization of Parameters for Neural Network Controllers in Automatic Control Systems
Sergey Feofilov, Dmitry Khapkin, Andrey Kozyr, Eduard Heiss, Andrey Efromeev
Optimization Purpose Many Parameter Inner Structure Neural Network Controller Control Synthesis Neural Network Structure

October 11, 2023

An On-Chip Trainable Neuron Circuit for SFQ-Based Spiking Neural Networks
Beyza Zeynep Ucpinar, Mustafa Altay Karamuftuoglu, Sasan Razmkhah, Massoud Pedram
Spiking Neural Network Spike Based Chip Learning Neural Network Structure Neuron Attribution

August 29, 2023

An Adaptive Tangent Feature Perspective of Neural Networks
Daniel LeJeune, Sina Alemohammad
Neural Network Neural Network Structure Structural Regularization Neural Tangent Kernel Target Alignment

July 24, 2023

Neural Bradley-Terry Rating: Quantifying Properties from Comparisons
Satoru Fujii
Consistent Comparison Neural Topic Neural Network Structure Rating Matrix Value Estimation Bradley Terry

June 3, 2023

Transforming to Yoked Neural Networks to Improve ANN Structure
Xinshun Liu, Yizhi Fang, Yichao Jiang
Character Transformation Classical Neural Network Traditional Neural Network SNN Based Neural Network Structure Deep Learning Module

May 17, 2023

Understanding the Initial Condensation of Convolutional Neural Networks
Zhangchen Zhou, Hanxu Zhou, Yuqing Li, Zhi-Qin John Xu
Convolutional Neural Network Training Dynamic Neural Network Structure Initial Condensation Two Layer

January 30, 2023

Prediction of Customer Churn in Banking Industry
Sina Esmaeilpour Charandabi
Human Prediction Random Forest Customer Retention Neural Network Structure Supervised Learning Method Customer Churn

January 9, 2023

A Study on the Generality of Neural Network Structures for Monocular Depth Estimation
Jinwoo Bae, Kyumin Hwang, Sunghoon Im
Study Feature Monocular Depth Estimation CNN Transformer Texture Bias Neural Network Structure Shape Bias

August 24, 2022

Secondary Protein Structure Prediction Using Neural Networks
Sidharth Malhotra, Robin Walters
Neural Network Protein Sequence Amino Acid Neural Network Structure Secondary Structure

July 11, 2022

The Mean Dimension of Neural Networks -- What causes the interaction effects?
Roman Hahn, Christoph Feinauer, Emanuele Borgonovo
Neural Network Dimensionless Variable Neural Network Structure Interaction Effect Effective Dimension

April 21, 2022

Physical Modeling using Recurrent Neural Networks with Fast Convolutional Layers
Julian D. Parker, Sebastian J. Schlecht, Rudolf Rabenstein, Maximilian Schäfer
Synthetic Data Recurrent Neural Network Discrete Time Audio Processing Physical Model Modal Analysis Neural Network Structure

March 8, 2022

Bayesian Optimisation-Assisted Neural Network Training Technique for Radio Localisation
Xingchi Liu, Peizheng Li, Ziming Zhu
Neural Network Bayesian Perspective Bayesian Optimisation Localization Method Precise Localization Neural Network Structure Radio Based