Architecture Design

Architecture design, encompassing both physical structures and software systems, is undergoing a transformation driven by advancements in artificial intelligence. Current research focuses on developing novel architectures for various applications, including efficient neural networks for tasks like speech emotion recognition and video question answering, as well as generative AI models for architectural design and autonomous systems. These efforts aim to improve efficiency, robustness, and adaptability across diverse domains, impacting fields from robotics and urban planning to computer vision and software engineering.

Papers

November 24, 2023

What you need to know about a learning robot: Identifying the enabling architecture of complex systems
Helen Beierling, Phillip Richter, Mara Brandt, Lutz Terfloth, Carsten Schulte, Heiko Wersing, Anna-Lisa Vollmer
Artificial Intelligence Non Humanoid Robot Line by Line Explanation Robotic System Architecture Design Complex System New Technology Learning Robot

November 14, 2023

DeepThought: An Architecture for Autonomous Self-motivated Systems
Arlindo L. Oliveira, Tiago Domingos, Mário Figueiredo, Pedro U. Lima
Large Language Model Autonomous System Architecture Design Cognitive Agent Complementary Learning

November 5, 2023

Architecture Matters: Uncovering Implicit Mechanisms in Graph Contrastive Learning
Xiaojun Guo, Yifei Wang, Zeming Wei, Yisen Wang
Contrastive Learning Graph Learning Graph Classification Architecture Design Visual Representation Learning Domain Specific Augmentation

November 3, 2023

November 1, 2023

Architecture of Data Anomaly Detection-Enhanced Decentralized Expert System for Early-Stage Alzheimer's Disease Prediction
Stefan Kambiz Behfar, Qumars Behfar, Marzie Hosseinpour
Blockchain Based Platform Architecture Design Disease Prediction Magnetic Resonance Imaging Data Anomalous Event Quantitative MRI Early Alzheimer

October 25, 2023

Free-form Flows: Make Any Architecture a Normalizing Flow
Felix Draxler, Peter Sorrenson, Lea Zimmermann, Armand Rousselot, Ullrich Köthe
Generative Model Normalizing Flow Architecture Design Molecule Generation

October 23, 2023

Handling Data Heterogeneity via Architectural Design for Federated Visual Recognition
Sara Pieri, Jose Renato Restom, Samuel Horvath, Hisham Cholakkal
Convolutional Neural Network Data Heterogeneity Architecture Design Visual Recognition Federated Object Detection

October 20, 2023

The Safety Shell: an Architecture to Handle Functional Insufficiencies in Automated Driving
C. A. J. Hanselaar, E. Silvas, A. Terechko, W. P. M. H. Heemels
Autonomous Vehicle Automated Driving Architecture Design Functional Safety Autonomous Behavior Architecture Framework Asset Administration Shell Functional Insufficiency Safety Architecture

October 18, 2023

Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture
Daniel Y. Fu, Simran Arora, Jessica Grogan, Isys Johnson, Sabri Eyuboglu, Armin W. Thomas, Benjamin Spector, Michael Poli, Atri Rudra, Christopher Ré
Architecture Design Major Challenge Bottleneck GPT Model Simple Alternating Mixer Structured Matrix Butterfly Matrix

October 17, 2023

Self-supervision meets kernel graph neural models: From architecture to augmentations
Jiawang Dan, Ruofan Wu, Yunpeng Liu, Baokun Wang, Changhua Meng, Tengfei Liu, Tianyi Zhang, Ningtao Wang, Xing Fu, Qi Li, Weiqiang Wang
Graph Representation Learning Self Supervision Neural Model Architecture Design Soft Augmentation Graph Augmentation Graph Kernel Kernel Graph Random Walk Kernel

October 11, 2023

Hypergraph Neural Networks through the Lens of Message Passing: A Common Perspective to Homophily and Architecture Design
Lev Telyatnikov, Maria Sofia Bucarelli, Guillermo Bernardez, Olga Zaghen, Simone Scardapane, Pietro Lio
Architecture Design Message Passing Nested Hypergraphs Hypergraph Neural Network Higher Order Network Hyperedge Prediction Common Ground

October 2, 2023

Data Efficient Training of a U-Net Based Architecture for Structured Documents Localization
Anastasiia Kabeshova, Guillaume Betmont, Julien Lerouge, Evgeny Stepankevich, Alexis Bergès
U Net Architecture Design Data Efficient Structured Document Document Analysis Document Understanding Task Document Localization

October 1, 2023

September 25, 2023

SAMN: A Sample Attention Memory Network Combining SVM and NN in One Architecture
Qiaoling Yang, Linkai Luo, Haoyu Zhang, Hong Peng, Ziyang Chen
Neural Network Support Vector Machine Architecture Design Sample Attention

September 22, 2023

Efficient N:M Sparse DNN Training Using Algorithm, Architecture, and Dataflow Co-Design
Chao Fang, Wei Sun, Aojun Zhou, Zhongfeng Wang
Practical Algorithm Architecture Design Better Zero Sparse Training Dataflow Architecture Sparse Accelerator Sparse DNN

September 21, 2023

Impact of architecture on robustness and interpretability of multispectral deep neural networks
Charles Godfrey, Elise Bishoff, Myles McKay, Eleanor Byler
Deep Learning Native Robustness Deep Learning Model Global Impact Inherent Interpretability Architecture Design Fusion Method Fusion Strategy

September 19, 2023

A multimodal deep learning architecture for smoking detection with a small data approach
Robert Lakatos, Peter Pollner, Andras Hajdu, Tamas Joo
Deep Learning Architecture Design Small Datasets Smoke Segmentation Tobacco Origin

September 11, 2023

Using causal inference to avoid fallouts in data-driven parametric analysis: a case study in the architecture, engineering, and construction industry
Xia Chen, Ruiji Sun, Ueli Saluz, Stefano Schiavon, Philipp Geyer
Case Study Data Driven Causal Inference Architecture Design Causal Analysis Data Driven Model Position Engineering Data Driven Modeling

Architecture Design

Papers

What you need to know about a learning robot: Identifying the enabling architecture of complex systems

DeepThought: An Architecture for Autonomous Self-motivated Systems

Architecture Matters: Uncovering Implicit Mechanisms in Graph Contrastive Learning

Architecture of Smart Certificates for Web3 Applications Against Cyberthreats in Financial Industry

A Neural Radiance Field-Based Architecture for Intelligent Multilayered View Synthesis

Architecture of Data Anomaly Detection-Enhanced Decentralized Expert System for Early-Stage Alzheimer's Disease Prediction

Free-form Flows: Make Any Architecture a Normalizing Flow

Handling Data Heterogeneity via Architectural Design for Federated Visual Recognition

The Safety Shell: an Architecture to Handle Functional Insufficiencies in Automated Driving

Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture

Self-supervision meets kernel graph neural models: From architecture to augmentations

Hypergraph Neural Networks through the Lens of Message Passing: A Common Perspective to Homophily and Architecture Design

Data Efficient Training of a U-Net Based Architecture for Structured Documents Localization

Optimization or Architecture: How to Hack Kalman Filtering

PatchMixer: A Patch-Mixing Architecture for Long-Term Time Series Forecasting

SAMN: A Sample Attention Memory Network Combining SVM and NN in One Architecture

Efficient N:M Sparse DNN Training Using Algorithm, Architecture, and Dataflow Co-Design

Impact of architecture on robustness and interpretability of multispectral deep neural networks

A multimodal deep learning architecture for smoking detection with a small data approach

Using causal inference to avoid fallouts in data-driven parametric analysis: a case study in the architecture, engineering, and construction industry