Deep Learning

Deep learning, a subfield of machine learning, focuses on training artificial neural networks with multiple layers to extract complex patterns from data. Current research emphasizes improving model robustness against noisy or adversarial inputs, exploring efficient architectures like Vision Transformers and convolutional LSTMs for various tasks (e.g., image classification, time series forecasting), and integrating physics-informed approaches for enhanced interpretability and reliability. These advancements are significantly impacting diverse fields, from automated industrial inspection and medical image analysis to improved weather forecasting and more efficient content moderation systems.

Papers

October 11, 2024

Learning Algorithms Made Simple
Noorbakhsh Amiri Golilarz, Elias Hossain, Abdoljalil Addeh, Keyan Alexander Rahimi
Deep Learning Machine Learning Convolutional Neural Network Learning Algorithm
HyperPg -- Prototypical Gaussians on the Hypersphere for Interpretable Deep Learning
Maximilian Xiling Li, Korbinian Franz Rudolf, Nils Blank, Rudolf Lioutikov
Deep Learning
Multi-modal Fusion based Q-distribution Prediction for Controlled Nuclear Fusion
Shiao Wang, Yifeng Wang, Qingchuan Ma, Xiao Wang, Ning Yan, Qingquan Yang, Guosheng Xu, Jin Tang
Deep Learning Multimodal Fusion Multi Modal Fusion Nuclear Fusion

October 10, 2024

Bilinear MLPs enable weight-based mechanistic interpretability
Michael T. Pearce, Thomas Dooms, Alice Rigg, Jose M. Oramas, Lee Sharkey
Deep Learning Mechanistic Interpretability Bilinear Convolutional Neural Network MLP Layer
Optimizing YOLO Architectures for Optimal Road Damage Detection and Classification: A Comparative Study from YOLOv7 to YOLOv10
Vung Pham, Lan Dong Thi Ngoc, Duy-Linh Bui
Deep Learning Classification Code YOLOv5 Model YOLO Model Road Scene Road Damage Road Damage Detection
Physics and Deep Learning in Computational Wave Imaging
Youzuo Lin, Shihang Feng, James Theiler, Yinpeng Chen, Umberto Villa, Jing Rao, John Greenhall, Cristian Pantea, Mark A. Anastasio, Brendt Wohlberg
Deep Learning Theoretical Physic Computational Imaging Wave Propagation Acoustic Imaging
Deep Learning for Generalised Planning with Background Knowledge
Dillon Z. Chen, Rostislav Horčík, Gustav Šír
Deep Learning Reasoning Capability Background Knowledge Classical Planning Generalized Planning
Exploring Foundation Models in Remote Sensing Image Change Detection: A Comprehensive Survey
Zihan Yu, Tianxiao Li, Yuxin Zhu, Rongze Pan
Deep Learning Foundation Model Comprehensive Survey Remote Sensing Change Detection Information Fusion
On the Generalization Properties of Deep Learning for Aircraft Fuel Flow Estimation Models
Gabriel Jarry, Ramon Dalmau, Philippe Very, Junzi Sun
Deep Learning Model Generalization Generalization Property Fuel Consumption
Boosting Deep Ensembles with Learning Rate Tuning
Hongpeng Jin, Yanzhao Wu
Deep Learning Learning Rate Deep Ensemble

October 9, 2024

Exploring the design space of deep-learning-based weather forecasting systems
Shoaib Ahmed Siddiqui, Jean Kossaifi, Boris Bonev, Christopher Choy, Jan Kautz, David Krueger, Kamyar Azizzadenesheli
Deep Learning Design Space Convolutional Architecture Grid Based
Enhancing Soccer Camera Calibration Through Keypoint Exploitation
Nikolay S. Falaleev, Ruilong Chen
Deep Learning Camera Calibration
JPEG Inspired Deep Learning
Ahmed H. Salamah, Kaixiang Zheng, Yiwen Liu, En-Hui Yang
Deep Learning Joint Photographic Expert Group
Emergent properties with repeated examples
François Charton, Julia Kempe
Deep Learning Strong Generalization Fewer Example Fast Learning Emergent Property
Learning a Neural Solver for Parametric PDE to Enhance Physics-Informed Methods
Lise Le Boudec, Emmanuel de Bezenac, Louis Serrano, Ramon Daniel Regueiro-Espino, Yuan Yin, Patrick Gallinari
Deep Learning Feature Enhancement Physic Informed Physic Based Neural Solver Physic Aware Parametric PDE
Deep Learning for Surgical Instrument Recognition and Segmentation in Robotic-Assisted Surgeries: A Systematic Review
Fatimaelzahraa Ali Ahmed, Mahmoud Yousef, Mariam Ali Ahmed, Hasan Omar Ali, Anns Mahboob, Hazrat Ali, Zubair Shah, Omar Aboumarzouk, Abdulla Al Ansari, Shidin Balakrishnan
Deep Learning Segmentation Based Approach Systematic Review Robot Assisted Surgery Surgical Instrument Open Surgery Surgical Tool Detection

October 8, 2024

Beyond the Alphabet: Deep Signal Embedding for Enhanced DNA Clustering
Hadas Abraham, Barak Gahtan, Adir Kobovich, Orian Leitersdorf, Alex M. Bronstein, Eitan Yaakobi
Deep Learning Biological Sequence DNA Storage DNA Sequence Classification
Estimating the Number of HTTP/3 Responses in QUIC Using Deep Learning
Barak Gahtan, Robert J. Shahla, Reuven Cohen, Alex M. Bronstein
Deep Learning Numerical Data New Connection Network Traffic Data Multiplexing
Uncertainty estimation via ensembles of deep learning models and dropout layers for seismic traces
Giovanni Messuti, ortensia Amoroso, Ferdinando Napolitano, Mariarosaria Falanga, Paolo Capuano, Silvia Scarpetta
Deep Learning Convolutional Neural Network Deep Learning Model Uncertainty Estimation Diverse Ensemble Model Uncertainty Dropout Layer
Data Quality Issues in Vulnerability Detection Datasets
Yuejun Guo, Seifeddine Bettaieb
Deep Learning Vulnerability Detection Software Vulnerability Vulnerability Data Code Security Data Quality Issue

Deep Learning

Papers

Learning Algorithms Made Simple

HyperPg -- Prototypical Gaussians on the Hypersphere for Interpretable Deep Learning

Multi-modal Fusion based Q-distribution Prediction for Controlled Nuclear Fusion

Bilinear MLPs enable weight-based mechanistic interpretability

Optimizing YOLO Architectures for Optimal Road Damage Detection and Classification: A Comparative Study from YOLOv7 to YOLOv10

Physics and Deep Learning in Computational Wave Imaging

Deep Learning for Generalised Planning with Background Knowledge

Exploring Foundation Models in Remote Sensing Image Change Detection: A Comprehensive Survey

On the Generalization Properties of Deep Learning for Aircraft Fuel Flow Estimation Models

Boosting Deep Ensembles with Learning Rate Tuning

Exploring the design space of deep-learning-based weather forecasting systems

Enhancing Soccer Camera Calibration Through Keypoint Exploitation

JPEG Inspired Deep Learning

Emergent properties with repeated examples

Learning a Neural Solver for Parametric PDE to Enhance Physics-Informed Methods

Deep Learning for Surgical Instrument Recognition and Segmentation in Robotic-Assisted Surgeries: A Systematic Review

Beyond the Alphabet: Deep Signal Embedding for Enhanced DNA Clustering

Estimating the Number of HTTP/3 Responses in QUIC Using Deep Learning

Uncertainty estimation via ensembles of deep learning models and dropout layers for seismic traces

Data Quality Issues in Vulnerability Detection Datasets