Markov

Ask about this topic

Momentum

16 papers in the last four weeks, up 220% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 102

All topics
CardsList

  1. Cost-augmented Schrödinger bridges on graphs are exactly solvable: a Feynman-Kac tilt replaces learned control

    Oct 1, 2026Akshay BalsubramaniSchrödinger BridgesMissing Bridge

  2. Sample complexity bounds for categorical Markov random fields via Discrete Diffusions

    Oct 1, 2026Shivam Kumar, Nabarun DebScore-Based Diffusion ModelMarkov

    Booth School of Business, University of Chicago

  3. The Asymptotics of Language Model Alignment with Memory

    Oct 1, 2026Haricharan Balasundaram, V. Arvind RameshwarLarge Language Model AlignmentLanguage Modeling

    School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA · IIT Madras · Department of Electrical Engineering, IIT Madras, Chennai, India

  4. Discrete Wasserstein Flows for One-Step Generative Modeling

    Oct 1, 2026Alessandro Micheli, Andrea Zerio, Samir BhattWasserstein Gradient FlowsWasserstein Distance

    Imperial College London London, United Kingdom · Department of Computer Science, Aalborg University, Copenhagen, Denmark; Centre for Frontier AI Research (CFAR), Institute of Advanced Intelligence and Computing (IAIC), A*STAR, Singapore · University of Copenhagen Copenhagen, Denmark

  5. Markovian Dynamics Enforcer: Feasibility Preserving Correction on Learned Dynamics Manifolds

    Sep 30, 2026Kevin Yu, Tao Guo, Constantinos Antoniou +1Model Predictive ControlInverse Dynamics

    Imperial College London, UK · Technical University of Munich, Germany

  6. Sharp Stationary Gaussian Approximation for Constant-Stepsize SGD

    Sep 30, 2026Junghoon SeoStochastic Gradient DescentGaussian Primitives

    PIT IN Corp., South Korea

  7. Learning Continuous Neural Representation of Stochastic Hybrid Systems

    Sep 30, 2026Sangli Teng, Hang Liu, Koushil SreenathStochastic Differential EquationsLatent Dynamics

  8. Sharp Statistical Rates for Asynchronous TD Learning with Markovian Data

    Sep 30, 2026Yang PengTemporal DifferenceMarkov

    Yau Mathematical Sciences Center, Tsinghua University

  9. Information-Theoretic Analysis of Next-Token Prediction under Markovian Data

    Sep 28, 2026Masoud Kavian, Abdellatif Zaidi, Milad SefidgaranNext-Token PredictionInformation-Theoretic Limits

    Mathematical and Algorithmic Science Laboratory, Huawei Paris Research Center, 92100 Boulogne-Billancourt, France · Laboratoire d’Informatique Gaspard Monge, Université Gustave Eiffel, 77420 Champs-sur-Marne, France

  10. Identifying the Predictable Drift of a Semimartingale from Marginal Laws

    Sep 27, 2026Jakub Marecek, Enrico Biffis, Abigail Langbridge +1Conformal Test MartingalesStochastic Differential Equations

    Department of Computer Science, Czech Technical University in Prague, Czechia · Department of Finance, Imperial College London, UK · Dyson School of Design Engineering, Imperial College London, UK

  11. TAM-Chain: Multi-Scale Thyroid Cytology Classification via Absorbing Markov Chains and Shannon Entropy Uncertainty Quantification for False-Negative Suppression and Domain-Shift Adaptation

    Sep 23, 2026Hai Pham NgocCancer DetectionFalse-Negative Rate

    Faculty of Mathematics, Mechanics and Informatics, VNU University of Science

  12. Statistical Convergence of Transformer Encoder-Accelerated Robust Reinforcement Learning

    Sep 20, 2026Suman Banerjee, Hiroyasu TsukamotoOffline Reinforcement LearningValue Functions

    Department of Aerospace Engineering, The Grainger College of Engineering, University of Illinois Urbana-Champaign, Urbana, IL, USA

  13. Decoupled Causal Discovery

    Sep 20, 2026Zhengkang Guan, Fei Wu, Kun KuangCausal Discovery MethodsDecoupling

    College of Computer Science and Technology Zhejiang University

  14. Adaptive Agent Design

    Sep 14, 2026Raj Kiriti Velicheti, Subhonmesh Bose, Tamer BaşarQ-LearningMarkov Decision Processes

    Department of Electrical and Computer Engineering and the Coordinated Science Laboratory at the University of Illinois, Urbana-Champaign, Urbana, IL 61801

  15. Explanations-Driven Active Feature Acquisition for Algorithmic Recourse

    Sep 14, 2026Vinura Galwaduge, Jagath SamarabanduFeature EngineeringAlgorithmic Cores

    Dept. of Electrical and Computer Engineering Western University London, ON, Canada

  16. Gaussian Approximation for Multivariate Martingale Sums from Uniformly Ergodic Markov Chains

    Sep 8, 2026Yixuan Zhang, Qiaomin XieConformal Test MartingalesWasserstein Distance

    Department of Industrial & Systems Engineering, University of Wisconsin–Madison

  17. Artificial Rosetta Stone: Constrained Maximum A Posteriori (MAP) Reconstruction of Symbolic Raga Sequences via Order-k Markov Models

    Sep 1, 2026Saanvi Raghavendran, Abhishek BhattacharjeeSymbolic Music GenerationMarkov

    Abstract Math Institute

  18. Poisson-Gamma Dynamical Systems with Time-varying Transition Dynamics

    Sep 1, 2026Jiahao Wang, Yijun Wang, Nan Fang +1Bayesian InferenceMarkov

    Department of Electrical and Computer Engineering, University of Arizona, US · School of Computing and Information Technology, Great Bay University, China · Tsinghua University, China +1

  19. User-Assisted Collaborative Distributed Inference for Efficient QoS-Aware Autoscaling

    Aug 12, 2026Alfreds Lapkovskis, Ali Beikmohammadi, Sindri Magnússon +1Rate ScalingScalability

    Department of Computer Systems and Sciences, Stockholm University SE-106 91 Stockholm, Sweden

  20. Self-Normalized Inference for Constant-Stepsize Temporal-Difference Learning under Markovian Sampling

    Aug 11, 2026Min Zeng, Yichen Zhang, Xiaofeng ShaoTemporal DifferenceLarge Deviation Principle

    Department of Biostatistics, City University of Hong Kong, Hong Kong SAR, China · Department of Quantitative Methods, Purdue University, West Lafayette, Indiana, USA · Department of Statistics and Data Science, Washington University in St. Louis, St. Louis, Missouri, USA +1

  21. Generator-Guided Inverse Sampling for Lévy-Driven Generative Models

    Aug 11, 2026Tianfu Qi, Jun Wang, Jun ZhangStochastic Differential EquationsGenerative Models

    National Key Laboratory of Wireless Communications, University of Electronic Science and Technology of China, Chengdu 611731, China · Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology, Hong Kong, China

  22. A Direct Route to Markov Chain Convergence via Asymptotic Equivalence with the Target

    Aug 4, 2026Patrick ForréMarkovProbability Measures

    AI4Science Lab Korteweg-de Vries Institute for Mathematics University of Amsterdam

  23. PAC Approximation and DIRECT Optimization for Parametric Markov Models

    Aug 3, 2026Zhiming Chi, Ying Liu, Andrea Turrini +2Markov Decision ProcessesMarkov

    Key Laboratory of System Software (Chinese Academy of Sciences), Beijing, China · Institute of Software, Chinese Academy of Sciences, Beijing, China · University of Chinese Academy of Sciences, Beijing, China +2

  24. Tensor Probabilistic Model Checking of Finite-Horizon Markov Chains (Extended Version)

    Aug 1, 2026Jianlin Li, Nick Guo, Peter Ye +1Probabilistic Model CheckingMarkov

    David R. Cheriton School of Computer Science University of Waterloo, Canada

  25. Reflected UAS: Corrected Deterministic Stability and Direct CTMC Drift Calculation

    Jul 30, 2026Krishna SubediQueue ControlMarkov

    Neryva

  26. Latent States in Neural Networks: Recovering the Temporal Structure of Drifting Data from Model Weights

    Jul 29, 2026Kevin GuanLatent StatesModel Weights

    Department of Mathematics, Princeton University

  27. Minimal Markovization via Stable Quotients in Holonomy-Cover Decision Processes

    Jul 29, 2026Zuyuan Zhang, Yongshan Chen, Mahdi Imani +1Partially Observable Markov Decision ProcessMarkov

    Department of Electrical and Computer Engineering, The George Washington University · Department of Electrical and Computer Engineering, Northeastern University

  28. High-Order Markov Blanket Discovery via a k-Order Relaxation of the Faithfulness Assumption

    Jul 29, 2026Loong Kuan Lee, Ragavi Krishnamoorthy, Nico PiatkowskiConditional IndependenceMarkov

    Hybrid Intelligence, Fraunhofer IAIS, Sankt Augustin, Germany

  29. Self-Attention Dynamics with Rotary Position Embeddings: Twisted States and Explicit Consensus Rates on the Sphere

    Jul 27, 2026Hao YeRotary Position EmbeddingSphere

    Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, University of Chinese Academy of Sciences · Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences · University of Chinese Academy of Sciences

  30. A Characterization of the Orthocomplement of the Tangent Space of Semiparametric Markov Models

    Jul 26, 2026Trung Phung, Ilya ShpitserProbabilistic Graphical ModelsInfluence Function

    Computer Science Department, Johns Hopkins University, Baltimore, Maryland, USA

  31. Characterizing Arbitrary Lindbladian Dynamics with a Few Pauli Measurements

    Jul 25, 2026Taiqi Zhou, Weiyuan GongQubitQuantum Processor

    Department of Information Engineering, The Chinese University of Hong Kong, Hong Kong, China · School of Engineering and Applied Sciences, Harvard University, Allston, MA 02134, USA

  32. Context-weighted Discrete Flow Matching

    Jul 23, 2026Daniil Cherniavskii, Daniel Severo, Karen UllrichGenerative Flow NetworksGenerative Models

    University of Amsterdam · Work done during an internship at Meta FAIR. · Meta FAIR

  33. Parallel Noising in Neural Markov Logic Networks

    Jul 21, 2026Peter Jung, Giuseppe Marra, Ondrej KuzelkaGraph Neural NetworksProbabilistic Graphical Models

    Czech Technical University, Prague, Czech Republic · Department of Computer Science, KU Leuven, Leuven, Belgium

  34. A Continuous-Time Reinforcement Learning Framework for Fine-Tuning Discrete Diffusion Models

    Jul 16, 2026Zikun Zhang, Jiayuan Sheng, David D. Yao +1Diffusion-Based Reinforcement Learning MethodsScore-Based Diffusion Model

    Department of Industrial Engineering and Operations Research, Columbia University, New York, NY 10027

  35. Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes

    Jul 14, 2026Minh-Quan Le, Armand Comas, Alexandros Lattas +7Multimodal GenerationMulti-Reference Image Generation

    Google · Stony Brook University · Google DeepMind

  36. An End-to-End Hybrid Quantum--Classical Sampling Workflow for Discrete Markov Random Fields: A Reproducible Case Study

    Jul 10, 2026Arul Rhik MazumderMarkov Chain Monte CarloHybrid Quantum-Classical Pipeline

    School of Computer Science

  37. Estimation, Prediction, and Assortment Optimization for Markov Chain Choice Models with Panel Data

    Jul 10, 2026Yalcin Akcay, Gerardo Berbeglia, Young-San LinAssortmentDiscrete Choice Models

    Melbourne Business School

  38. Tensorized algorithms and scalable filtering methods for hidden Markov and factorial hidden Markov models

    Jul 8, 2026Roxana Barrios, Ioannis SgouralisHidden Markov ModelsTensor Decomposition

    Department of Mathematics, University of Tennessee, Knoxville, TN

  39. Accelerating Discrete Diffusion Models with Parallel-In-Time Sampling

    Jul 1, 2026Yu Yao, Huanjian Zhou, Andi Han +2Diffusion SamplingDiffusion Models

    The University of Tokyo · The University of Sydney · RIKEN AIP & The Institute of Statistical Mathematics +1

  40. Policy Optimization Achieves Data-Dependent Regret Bounds in MDPs with Unknown Transitions

    Jun 30, 2026Mingyi Li, Taira Tsuchiya, Kenji YamanishiMarkov Decision ProcessesTransitions

    Department of Mathematical Informatics, The University of Tokyo · Center for Advanced Intelligence Project, RIKEN

  41. Global Explanations for Multivariate Time Series Forecasting Models via KK-Order Markov Approximations

    Jun 25, 2026Amadeo TunyiMultivariate Time Series ForecastingTemporal Dependence

    XITASO GmbH Austraße 35, 86153 Augsburg, Germany

  42. Robustness and Leadership in Markov-switching Consensus Networks

    Jun 24, 2026Sarah H. Cen, Vaibhav Srivastava, Naomi Ehrich LeonardModel-Based Multi-Agent SystemsOptimistic Follow-The-Regularized-Leader

    Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA · Department of Electrical and Computer Engineering, Michigan State University, East Lansing, MI 48824, USA · Department of Mechanical and Aerospace Engineering, Princeton University, Princeton, NJ 08544, USA

  43. Solving Markov Decision Processes with Future Information via MPC

    Jun 23, 2026Shambhuraj Sawant, Akhil S Anand, Dirk Reinhardt +1Model Predictive ControlMarkov Decision Processes

    Norwegian University of Science and Technology (NTNU), Trondheim, Norway.

  44. A Markov Chain Approach to Preference Alignment

    Jun 21, 2026Takuya Koriyama, Tengyuan LiangPreference AlignmentReinforcement Learning From Human Feedback

    The University of Chicago

  45. Multi-AUV Marine Life Tracking with Single Hydrophone Payloads via a Hidden Markov Model Equipped Particle Filter

    Jun 21, 2026Christopher Herrera, Kehlani Fay, Christopher Clark +3Autonomous Underwater VehiclesForward-Looking Sonar

    Harvey Mudd College, Claremont, CA 91711 USA · California State University Long Beach, Long Beach, CA 90840 USA · University of Costa Rica, San Jose, Costa Rica

  46. Attractive and Repulsive Pattern Control in Sequence Generation

    Jun 19, 2026Francois PachetMarkovRepulsive Distribution

  47. Volterra Generative Models

    Jun 16, 2026Yusen Jia, Bingyan HanScore-Based Diffusion ModelGenerative Models

    The Hong Kong University of Science and Technology (Guangzhou)

  48. Random coloured digraphs defined by a Markov logic network

    Jun 16, 2026Yasmin Tousinejad, Vera KoponenProbabilistic ModelMarkov

    Department of Mathematics, Uppsala University, Sweden.

  49. Context-Aware Markov VAE for CSI Compression in Wireless Systems

    Jun 15, 2026Efstathios Chatziloizos, Konstantinos Vandikas, Aneta Vulgarakis Feljan +2Channel State InformationWireless Communications

    Ericsson Research, Stockholm, Sweden · Department of Computer and Information Science, Linköping University, Linköping, Sweden · Department of Electrical Engineering, Linköping University, Linköping, Sweden

  50. Semantic DLM+: Improving Diffusion Language Models through Bias-variance Trade-off in Transition Kernel Design

    Jun 13, 2026Keyue Jiang, Yuxiang Wang, Yanan Zhao +7Diffusion Language ModelsDiffusion Models

    Alibaba Group · Fudan University · Nanyang Technological University +1

  51. Learning Object Manipulation from Scratch via Contrastive Interaction

    Jun 10, 2026Tongle Shen, Caleb Chuck, Fan Feng +1Real-World Manipulation TasksContrastive Learning

    1UC San Diego · 2UT Austin

  52. A Continuous-Time Markov Chain Framework for Insertion Language Models

    Jun 8, 2026Dhruvesh Patel, Benjamin Rozonoyer, Soumitra Das +3Diffusion Language ModelsLanguage Modeling

    UMass Amherst · IBM Research · University of Toronto & Vijil

  53. Mamba-Assisted Non-Markovian Closure for Reduced-Order Modeling

    Jun 3, 2026Zhi-Feng Wei, Saad Qadeer, Panos StinisReduced-Order ModelsState Space Models

    Advanced Computing, Mathematics, and Data Division, Pacific Northwest National Laboratory, Richland, WA 99354, USA · Department of Applied Mathematics, University of Washington, Seattle, WA 98195, USA · Division of Applied Mathematics, Brown University, Providence, RI 02912, USA

  54. Brief Announcement: Generative Markov Model for Distributed Computing Systems

    Jun 2, 2026Alfreds Lapkovskis, Ali Beikmohammadi, Sindri Magnússon +1Distributed OptimizationMarkov

    Department of Computer and Systems Sciences, Stockholm University, Sweden

  55. A Doeblin-Anchored Contrastive Chart for Learning Markov Transition Kernels

    Jun 1, 2026Ao XuMarkovTransitions

    School of Artificial Intelligence Jilin University No. 2699, Qianjin Street, Chaoyang District Changchun 130012, China · Zhongguancun Academy Daniufang 2nd Ring Road, Haidian District Beijing 100094, China

  56. Structure and Scale in Simplicial Sequence Modelling

    May 31, 2026Matthew Farrugia-RobertsSequence ModelingEmergence

    Department of Computer Science, University of Oxford

  57. Theoretical Analysis of Engression and Reverse Markov Engression

    May 31, 2026Jiaqi Huang, Gongjun Xu, Ji ZhuConditional DistributionMarkov

    Department of Statistics, University of Michigan · Ann Arbor, MI 48109, U.S.A.

  58. Flow map learning in nonlinear vector autoregressive models: influence of the feature-library structure on the training error

    May 29, 2026Markus GrossNonlinear DynamicsNonlinearity

    Institute for AI Safety and Security, German Aerospace Center (DLR), Sankt Augustin and Ulm, Germany

  59. Reachability and asymptotics of Gaussian Transformer dynamics

    May 29, 2026Albert Alcalde, Zhengping Ji, Enrique ZuazuaTransformer ArchitecturesFinite Time Analysis

    †Chair for Dynamics, Control, Machine Learning & Numerics (Alexander von Humboldt Profes- sorship), Department of Mathematics, Friedrich–Alexander-Universität Erlangen–Nürnberg, 91058 Erlangen, Germany. · ‡Departamento de Matem´aticas, Universidad Aut´onoma de Madrid, 28049 Madrid, Spain. · Chair of Computational Mathematics, Fundaci´on Deusto. Av. de las Universidades, 24, 48007 Bilbao, Basque Country, Spain.

  60. The Good, the Bad, and the Ugly of Markov Boundary for Tabular Prediction

    May 28, 2026Shu Wan, Abhinav Gorantla, Huan Liu +1Tabular LearningClinical Prediction

    Arizona State University Tempe, United States