Deep Learning Architecture

Deep learning architectures are complex computational models designed to learn intricate patterns from data, primarily aiming to improve the accuracy and efficiency of machine learning tasks. Current research focuses on optimizing existing architectures like convolutional neural networks (CNNs), recurrent neural networks (RNNs), transformers, and autoencoders, as well as developing novel activation functions and exploring efficient search algorithms for optimal network structures. These advancements are significantly impacting various fields, from medical image analysis and anomaly detection in complex systems to natural language processing and 3D data processing, driving improvements in accuracy, efficiency, and interpretability.

Papers

June 30, 2023

Transformers in Healthcare: A Survey
Subhash Nerella, Sabyasachi Bandyopadhyay, Jiaqing Zhang, Miguel Contreras, Scott Siegel, Aysegul Bumin, Brandon Silva, Jessica Sena, Benjamin Shickel, Azra Bihorac, Kia Khezeli, Parisa Rashidi
Timely Survey Transformer Megatron Decepticons Transformer Based Deep Learning Architecture Healthcare System Neural Network Architecture Unstructured Electronic Health Record

June 29, 2023

Spatial Reasoning via Deep Vision Models for Robotic Sequential Manipulation
Hongyou Zhou, Ingmar Schubert, Marc Toussaint, Ozgur S. Oguz
Vision Transformer Motion Planning Deep Learning Architecture Spatial Reasoning Deep Vision Model Complex Robotic Task

June 25, 2023

A Deep Learning Architecture with Spatio-Temporal Focusing for Detecting Respiratory Anomalies
Dat Ngo, Lam Pham, Huy Phan, Minh Tran, Delaram Jarchi
Feature Extraction Deep Learning Architecture Deep Learning System Respiratory Sound Respiratory Anomaly Temporal Focus

June 14, 2023

Unbiased Learning of Deep Generative Models with Structured Discrete Representations
Harry Bendekgey, Gabriel Hope, Erik B. Sudderth
Generative Model Deep Learning Architecture Graphical Model Discrete Representation Unbiased Learning Discrete Latent Variable

June 9, 2023

DeepLCZChange: A Remote Sensing Deep Learning Model Architecture for Urban Climate Resilience
Wenlu Sun, Yao Sun, Chenying Liu, Conrad M Albrecht
Data Driven Deep Learning Architecture Land Use Local Climate

June 2, 2023

Centered Self-Attention Layers
Ameen Ali, Tomer Galanti, Lior Wolf
Vision Transformer Deep Learning Architecture Self Attention Layer Deep Architecture Similar Representation

May 31, 2023

Breast Cancer Detection and Diagnosis: A comparative study of state-of-the-arts deep learning architectures
Brennon Maistry, Absalom E. Ezugwu
Convolutional Neural Network Deep Learning Model Comparative Study State of the Art Artificial Intelligence Model Medical Diagnosis Deep Learning Architecture Breast Cancer Breast Cancer Detection Breast Cancer Histopathological Image Classification

May 30, 2023

TrueDeep: A systematic approach of crack detection with less data
Ram Krishna Pandey, Akshit Achara
Domain Knowledge Deep Learning Architecture Semi Supervised Semantic Segmentation Crack Detection Deep Depth Systematic Approach Less Data

May 25, 2023

Making Vision Transformers Truly Shift-Equivariant
Renan A. Rojas-Gomez, Teck-Yian Lim, Minh N. Do, Raymond A. Yeh
Convolutional Neural Network Vision Transformer Semantic Segmentation Deep Learning Architecture Shift Equivariance

May 24, 2023

Sound Design Strategies for Latent Audio Space Explorations Using Deep Learning Architectures
Kıvanç Tatar, Kelsey Cotton, Daniel Bisig
Latent Space Variational Autoencoders Deep Learning Architecture Audio Generation Sound Design

May 15, 2023

Text2Gender: A Deep Learning Architecture for Analysis of Blogger's Age and Gender
Vishesh Thakur, Aneesh Tickoo
Human Prediction Ticket BERT Deep Learning Architecture BERT Based Speech Based Age Gender Inclusive Text NLP Research

April 11, 2023

Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Search
Alexandre Heuillet, Ahmad Nasser, Hichem Arioui, Hedi Tabia
Reinforcement Learning Timely Survey Evolutionary Algorithm Comprehensive Taxonomy Deep Learning Architecture Differentiable Neural Architecture Search Neural Network Design Full Scaling Automation

April 4, 2023

Adaptive Feature Fusion: Enhancing Generalization in Deep Learning Models
Neelesh Mungoli
Deep Learning Model Strong Generalization Deep Learning Architecture Feature Fusion Fusion Layer

March 15, 2023

Transformer Models for Type Inference in the Simply Typed Lambda Calculus: A Case Study in Deep Learning for Code
Brando Miranda, Avi Shinnar, Vasily Pestun, Barry Trager
Deep Learning Transformer Model Real World Code Deep Learning Architecture Lambda Calculus Type Inference

March 14, 2023

Efficiently Training Vision Transformers on Structural MRI Scans for Alzheimer's Disease Detection
Nikhil J. Dhinagar, Sophia I. Thomopoulos, Emily Laltoo, Paul M. Thompson
Vision Transformer Transformer Model Alzheimer'S Disease Deep Learning Architecture Disease Detection Structural MRI Brain Image Vision Transformer Variant

March 2, 2023

BioImageLoader: Easy Handling of Bioimage Datasets for Machine Learning
Seongbin Lim, Xingjian Zhang, Emmanuel Beaurepaire, Anatole Chessel
Machine Learning High Efficiency Deep Learning Architecture Image Augmentation

February 27, 2023

An algorithmic framework for the optimization of deep neural networks architectures and hyperparameters
Julie Keisler, El-Ghazali Talbi, Sandra Claudel, Gilles Cabriel
Optimization Purpose Evolutionary Algorithm Deep Learning Architecture Related Hyperparameters Search Space Efficient Deep Evolutionary Operator Algorithmic Framework

February 25, 2023

In Search of Deep Learning Architectures for Load Forecasting: A Comparative Analysis and the Impact of the Covid-19 Pandemic on Model Performance
Sotiris Pelekis, Evangelos Karakolis, Francisco Silva, Vasileios Schoinas, Spiros Mouzakitis, Georgios Kormpakis, Nuno Amaro, John Psarras
Long Short Term Memory Comparative Study Deep Learning Architecture Model Performance Load Forecasting Covid 19 Pandemic Short Term Load Forecasting Neural Forecasting Net Load Forecasting

February 23, 2023

MCWDST: a Minimum-Cost Weighted Directed Spanning Tree Algorithm for Real-Time Fake News Mitigation in Social Media
Ciprian-Octavian Truică, Elena-Simona Apostol, Radu-Cătălin Nicolescu, Panagiotis Karras
Social Medium Fake News Deep Learning Architecture Real World Datasets Bidirectional LSTM Spanning Tree

February 22, 2023

Magnification Invariant Medical Image Analysis: A Comparison of Convolutional Networks, Vision Transformers, and Token Mixers
Pranav Jeevan, Nikhil Cherian Kurian, Amit Sethi
Convolutional Neural Network Vision Transformer Consistent Comparison Neural Architecture Medical Image Analysis Deep Learning Architecture Token Mixer

Deep Learning Architecture

Papers

Transformers in Healthcare: A Survey

Spatial Reasoning via Deep Vision Models for Robotic Sequential Manipulation

A Deep Learning Architecture with Spatio-Temporal Focusing for Detecting Respiratory Anomalies

Unbiased Learning of Deep Generative Models with Structured Discrete Representations

DeepLCZChange: A Remote Sensing Deep Learning Model Architecture for Urban Climate Resilience

Centered Self-Attention Layers

Breast Cancer Detection and Diagnosis: A comparative study of state-of-the-arts deep learning architectures

TrueDeep: A systematic approach of crack detection with less data

Making Vision Transformers Truly Shift-Equivariant

Sound Design Strategies for Latent Audio Space Explorations Using Deep Learning Architectures

Text2Gender: A Deep Learning Architecture for Analysis of Blogger's Age and Gender

Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Search

Adaptive Feature Fusion: Enhancing Generalization in Deep Learning Models

Transformer Models for Type Inference in the Simply Typed Lambda Calculus: A Case Study in Deep Learning for Code

Efficiently Training Vision Transformers on Structural MRI Scans for Alzheimer's Disease Detection

BioImageLoader: Easy Handling of Bioimage Datasets for Machine Learning

An algorithmic framework for the optimization of deep neural networks architectures and hyperparameters

In Search of Deep Learning Architectures for Load Forecasting: A Comparative Analysis and the Impact of the Covid-19 Pandemic on Model Performance

MCWDST: a Minimum-Cost Weighted Directed Spanning Tree Algorithm for Real-Time Fake News Mitigation in Social Media

Magnification Invariant Medical Image Analysis: A Comparison of Convolutional Networks, Vision Transformers, and Token Mixers