Sequential Model

Sequential models aim to analyze and predict patterns in ordered data, leveraging temporal dependencies to improve accuracy and efficiency. Current research focuses on developing and refining architectures like Mamba (a state space model) and Transformers, addressing challenges such as computational complexity and handling diverse data types (tabular, image, time series). These advancements are impacting various fields, including medical image analysis, recommendation systems, and reinforcement learning, by enabling more accurate predictions and efficient processing of complex sequential data. The development of efficient algorithms for handling long sequences and incorporating multi-modal information is a key area of ongoing investigation.

Papers

December 20, 2023

Continuous-time Graph Representation with Sequential Survival Process
Abdulkadir Celikkanat, Nikolaos Nakis, Morten Mørup
Link Prediction Graph Representation Sequential Model Information Retention Connected Network Latent dIstance Model

December 1, 2023

Sequential Modeling Enables Scalable Learning for Large Vision Models
Yutong Bai, Xinyang Geng, Karttikeya Mangalam, Amir Bar, Alan Yuille, Trevor Darrell, Jitendra Malik, Alexei A Efros
Semantic Segmentation Vision Task Visual Data Large Vision Model Sequential Model Scalable Learning

November 19, 2023

Large Pre-trained time series models for cross-domain Time series analysis tasks
Harshavardhan Kamarthi, B. Aditya Prakash
Time Series Large Pre Trained Model Sequential Model General Time Series

November 3, 2023

RigLSTM: Recurrent Independent Grid LSTM for Generalizable Sequence Learning
Ziyu Wang, Wenhao Jiang, Zixuan Zhang, Wei Tang, Junchi Yan
Sequential Model LSTM Model Standard LSTM

September 28, 2023

DeepPCR: Parallelizing Sequential Operations in Neural Networks
Federico Danieli, Miguel Sarabia, Xavier Suau, Pau Rodríguez, Luca Zappella
Neural Network Deep Neural Network Sequential Model Sequential Manipulation

September 21, 2023

Parallelizing non-linear sequential models over the sequence length
Yi Heng Lim, Qi Zhu, Joshua Selfridge, Muhammad Firmansyah Kasim
Recurrent Neural Network Gated Recurrent Unit Sequential Model Sequence Length Training Bottleneck

September 6, 2023

Random Postprocessing for Combinatorial Bayesian Optimization
Keisuke Morita, Yoshihiko Nishikawa, Masayuki Ohzeki
Optimization Purpose Bayesian Optimization Posterior Inference Post Processing Sequential Model

August 31, 2023

A Sequential Framework for Detection and Classification of Abnormal Teeth in Panoramic X-rays
Tudor Dascalu, Shaqayeq Ramezanzade, Azam Bakhshandeh, Lars Bjorndal, Bulat Ibragimov
Classification Code Data Detection Multi Label Sequential Model Panoramic X Ray Dental Disease Detection Tooth Instance Segmentation

August 29, 2023

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding
Xinyi Chen, Jibin Wu, Huajin Tang, Qinyuan Ren, Kay Chen Tan
Spiking Neural Network Full Potential Neuron Model Sequential Model Contextual Embeddings LIF Model Spike Threshold LIF Neuron

August 25, 2023

TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential Modelling
Shimin Zhang, Qu Yang, Chenxiang Ma, Jibin Wu, Haizhou Li, Kay Chen Tan
Neuromorphic Computing Neuron Model Sequential Model Spiking Neuron Leaky Integrate and Fire LIF Model

August 9, 2023

On Error Propagation of Diffusion Models
Yangming Li, Mihaela van der Schaar
Diffusion Model Regularization Model Sequential Model Regularization Term Error Propagation

July 3, 2023

Rockmate: an Efficient, Fast, Automatic and Generic Tool for Re-materialization in PyTorch
Xunyi Zhao, Théotime Le Hellard, Lionel Eyraud, Julia Gusak, Olivier Beaumont
Full Model Pytorch Model Sequential Model Digital Tool

June 24, 2023

Intensity-free Convolutional Temporal Point Process: Incorporating Local and Global Event Contexts
Wang-Tao Zhou, Zhao Kang, Ling Tian, Yi Su
Temporal Point Process \Sigma}{\Delta}$ Low Pas RNN Global Context Sequential Model Event Prediction

May 30, 2023

Robust Reinforcement Learning Objectives for Sequential Recommender Systems
Melissa Mozifian, Tristan Sylvain, Dave Evans, Lili Meng
Reinforcement Learning Recommender System Sequential Recommendation Robust Reinforcement Learning Sequential Recommender System Sequential Model Attention Based Sequential Recommendation

April 11, 2023

Towards More Robust and Accurate Sequential Recommendation with Cascade-guided Adversarial Training
Juntao Tan, Shelby Heinecke, Zhiwei Liu, Yongjun Chen, Yongfeng Zhang, Huan Wang
Adversarial Perturbation Sequential Recommendation Sequential Model Traditional Recommender

April 2, 2023

Modelling customer churn for the retail industry in a deep learning based sequential framework
Juan Pablo Equihua, Henrik Nordmark, Maged Ali, Berthold Lausen
Deep Learning Recurrent Neural Network Sequential Model Deep Survival Model Retail Store Customer Behavior Customer Churn

March 21, 2023

Uniform Risk Bounds for Learning with Dependent Data Sequences
Fabien Lauer
LeArning Abstract Sample Complexity Sequential Model Risk Bound VC Dimension Complexity Bound Accuracy Constraint

February 13, 2023

Fourier-RNNs for Modelling Noisy Physics Data
Vignesh Gopakumar, Stanislas Pamela, Lorenzo Zanisi
Fourier Neural Operator Sequential Model Fourier Feature

February 6, 2023

A Scalable and Efficient Iterative Method for Copying Machine Learning Classifiers
Nahuel Statuto, Irene Unceta, Jordi Nin, Oriol Pujol
Machine Learning Model Sequential Model Machine Learning Classifier Serial Reproduction Data Copying

January 2, 2023

Data-Driven Optimization of Directed Information over Discrete Alphabets
Dor Tsur, Ziv Aharoni, Ziv Goldfeld, Haim Permuter
Channel State Information Sequential Model Gradient Information Data Driven Optimization Gaussian Channel