Graph Language Models

Follow this topic Ask about this topic

Recent momentum

+175%

11 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

6 new papers

A weekly snapshot of new work published in Graph Language Models.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Graph Language Models.

Period ending 2026-09-07

1 new paper

A weekly snapshot of new work published in Graph Language Models.

79 papers

Latest in Graph Language Models

Open your feed →

Dictionary-Constrained Grapheme-to-Phoneme for Unsegmented Languages from LLM-Annotated Data
Sep 17, 2026Rui Hu, Zhenpeng Zhan, Xiaolong LinPhoneme-Level Analysis Graph Language Models
MoRE: Mixture of Reused Experts
Sep 16, 2026Eric S. Qiu, Utku Umur Acikalin, Justin Lovelace +4Mixture-of-Experts Models Experts
Can We Do Interpretable NLI with Graphs Based on Atomic Propositions?
Sep 15, 2026Younes Boufouss, Luc Pommeret, Thomas Gerald +2Natural Language Inference Model Interpretability
PunGraph: Retrieval-Enhanced Phonetic-Semantic Graph Reasoning for Pun Understanding
Sep 15, 2026Yuchen Su, Zijian Huang, Yaotian Shi +6Graph Language Models Linguistics
Attention Mean Fields Predict Average Representation Dynamics and Reveal Context-Specific Computation
Sep 14, 2026Micah Adler, John W. Byers, Mark CrovellaGraph Language Models Mean-Field Limit
Salesforce Koa: An Enterprise Language Model for Agentic Tool Use
Sep 14, 2026Zixiang Chen, Sufeng Niu, Yingchi Liu +22Agent Framework Agentic Tool Use
RiLM: Parameter-Efficient Language Modeling via Geodesic Decoding
Sep 9, 2026Fang LiGraph Language Models Bidirectional Long Short-Term Memory
Sequence-Informed Geometric Evaluation of RNA 3D Structures
Sep 9, 2026Andrea Zerio, Yighua Yao, Alessandro Micheli +5Messenger Rna Feature Alignment
Line-Coupled Language Model
Sep 7, 2026Shiyuan Li, Shaorong Zhang, Zhaorui Yang +3Autoregressive Language Models Graph Language Models
ProtLingo: Efficient Protein Language Modeling via Conditional Memory and Expert Routing
Sep 7, 2026Mingrui Li, Sixian Shen, Minzhang Li +4Graph Language Models Sequence Modeling
Lngram v2: Latent N-Gram Memory with Interpretable Discrete Representations
Sep 3, 2026Yunao Zheng, Bin Wen, Xiaojie WangN$-Grams Features Graph Language Models
Structured Memory for Edge Language Models: Persistent Context and Corpus Retrieval via O(1) SSM State Injection
Aug 3, 2026Anusha Madan Gopal, Aras Pirbadian, Kristofor D. Carlson +2Graph Language Models State Space Models
Agentic Graph Token Reasoning
Aug 1, 2026Zhuoyi Peng, Yi YangLatent Reasoning Tokens Agentic Reasoning
GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generation
Jul 30, 2026Maya Arseven, Anette Frank, Beni Egressy +2Graph-Based Retrieval Augmented Generation Hievi-Rag
Relation Geometry in Semantic Space of Language Models
Jul 29, 2026Zhihan Cao, Hiroaki Yamada, Simone Teufel +4Semantic Representations Graph Language Models
LC-SEPLM: long-range contact-supervised adaptation for sequence-only protein representation learning
Jul 24, 2026Chen Wang, Boming Kang, Qinghua CuiProtein Data Bank Sequence Modeling
Holographic Neural PCFG for Unsupervised Parsing
Jul 9, 2026Ryosuke Yamaki, Daichi Mochihashi, Nobutaka Shimada +1Context-Free Grammars Graph Language Models
RSF-GLLM: Bridging the Semantic Gap in Multi-Hop Knowledge Graph QA via Recurrent Soft-Flow and Decoupled LLM Generation
Jul 7, 2026Sambaran Bandyopadhyay, Ananth MuppidiGraph-Based Retrieval Augmented Generation Knowledge Graphs
Where to cut, how deep: BPE and Unigram-LM on chemistry SMILES
Jul 6, 2026Hunter HeidenreichSubword Tokenization Byte-Pair Encoding
Language Models Represent and Transform Concepts with Shared Geometry
Jul 5, 2026Zhimin Hu, Lanhao Niu, Sashank VarmaSemantic Representations Graph Language Models
Full Glyph Images Beat Token Embeddings: A Controlled Study for Transformers
Jul 4, 2026Shuyang Xiang, Hao GuanGraph Language Models Transformer Architectures
Back to Basics: Improving Molecular Understanding in LLMs via SMILES-Graph Translation
Jul 3, 2026Wenda Wang, Jinjia Feng, Zhewei WeiMolecular Structure Elucidation Graph Language Models
Prototype Language Models
Jul 1, 2026Dan Ley, Giang Nguyen, Himabindu Lakkaraju +1Graph Language Models Prototype
TAG-DLM: Diffusion Language Models for Text-Attributed Graph Learning
Jun 30, 2026Lingjie Chen, Yuanchen Bei, Haobo Xu +3Text-Attributed Graph Graph Language Models
Text Distance from Nested and Hierarchical Repetitions: A Compression-Based Perspective
Jun 23, 2026Xiaojun Hu, Jing Wang, Jingwen Zhang +5Sequence Modeling Ladder
What Does a Chemical Language Model Know About Molecules?
Jun 22, 2026Christian Kenneth, Etowah Adams, Liam Bai +1Graph Language Models Semantic Representations
TaLK: Text-attributed Graph Dataset Distillation via Coupling Language Model with Graph-Aware Kernel
Jun 22, 2026Yeongho Kim, Yeonje Choi, Kijung ShinText-Attributed Graph Graph Neural Networks
Atomistic Language Models Understand and Generate Materials
Jun 19, 2026Sathya Edamadaka, Krithik Ramesh, Ju Li +1Crystal Structure Graph Language Models
Contextualizing Biological Language Models across Modalities via Logit-Space Contrastive Alignment
Jun 17, 2026Yanjun Shao, Yundi Chen, Yashvi Patel +2Contrastive Alignment Graph Language Models
Does Traversal Order Matter? A Systematic Study of Tree Traversal Methods in Transformer Grammars
Jun 15, 2026Zongru Liu, Pengyu Ji, Pengcheng Wang +1Graph Language Models Systematic Study
Formalizing and Mitigating Structural Distortion in LLM Attention for Graph Reasoning
Jun 14, 2026Donald Loveland, Puja Trivedi, Ari Weinstein +2Heterogeneous Graph Transformers Text-Attributed Graph
Knowledge Graph Enhanced Memory-Augmented Retrieval for Long Context Modeling
Jun 12, 2026Ghadir Alselwi, Basem Suleiman, Hao Xue +4Efficient Long-Context Inference Memory-Augmented Large Language Models
Viral Proteins Reveal Geometry of Protein Language Models
Jun 10, 2026Arthur Bigot, Harmon Bhasin, Core Francisco Park +2Graph Language Models Viral Sharing
Augmenting Molecular Language Models with Local $n$ -gram Memory
Jun 10, 2026Xinni Zhang, Zijing Liu, He Cao +2N$-Grams Features Graph Language Models
Express Language Modeling
Jun 9, 2026Albert Gong, Annabelle Michael Carrell, Raaz Dwivedi +1Graph Language Models Causal Attention
A Continuous-Time Markov Chain Framework for Insertion Language Models
Jun 8, 2026Dhruvesh Patel, Benjamin Rozonoyer, Soumitra Das +3Diffusion Language Models Graph Language Models
Tensorizing Engram: Sharing Latents Across N-Gram Embeddings is Beneficial in LLMs
Jun 6, 2026Wuyang Zhou, Yuxuan Gu, Giorgos Iacovides +3N$-Grams Features Graph Language Models
What's the Point? Spatial Grammar & Index Resolution for Sign Language Processing
Jun 6, 2026Oline Ranum, Simon Hadfield, Richard BowdenSign Language Recognition Linguistics
Are Large Language Models Suitable for Graph Computation? Progress and Prospects
Jun 5, 2026Yuting Zhang, Yi Han, Kai Wang +3Graph Language Models Taxonomy
A Navigable Manifold of Hypothesized Consciousness-Spectrum States in Language Model Representations
Jun 4, 2026Sophie ZhaoSpatial Representation Representation Space
When Graph Tokens Sink: A Mechanistic Analysis of Graph Language Models
Jun 2, 2026Ding Zhang, Runtao Zhou, Wenqing Zheng +3Graph Language Models Discrete Tokens
AgentPLM: Agentic Protein Language Models with Reasoning-Augmented Decoding for Protein Sequence Design
Jun 1, 2026Sahil Rahman, Maxx Richard RahmanProtein Design Antibody
Coupling Language Models with Physics-based Simulation for Synthesis of Inorganic Materials
May 29, 2026Edward W. Staley, Tom Arbaugh, Michael Pekala +6Data-Driven Materials Discovery Automated Synthesis Techniques
What Gets Unmasked First? Trajectory Analysis of Diffusion Models for Graph-to-Text Generation
May 29, 2026Qing Wang, Jacob Devasier, Chengkai LiMasked Diffusion Language Models Diffusion Language Models
Neuro-symbolic Syntactic Parsing: Shaping a Neural Network with the CYK Algorithm
May 29, 2026Fabio Massimo Zanzotto, Federico Ranaldi, Giorgio SattaNeuro-Symbolic Framework Context-Free Grammars
A Protocol-Language Model for Network Intrusion (Without Deep Packet Inspection)
May 29, 2026Vivek Kumar SharmaIntrusion Detection Singguard-Nsfa
Teaching Language Models to Check Grounded Claim Factuality with Human Test-Taking Strategies
May 28, 2026Yuxuan Ye, Raul Santos-Rodriguez, Edwin SimpsonFacts Graph Language Models
Lngram: N-gram Conditional Memory in Latent Space
May 24, 2026Yunao Zheng, Guoyang Xia, Xiaojie Wang +1N$-Grams Features Graph Language Models
Hierarchical Concept Geometry in Language Models Emerges from Word Co-occurrence
May 22, 2026Andres Nava, Matthieu WyartCo-Occurrence Vocabulary Expansion
Relational Linear Properties in Language Models: An Empirical Investigation
May 21, 2026Giovanni Valer, Luigi Gresele, Marco Bronzini +1Graph Language Models Empirical Study
Hypergraph as Language
May 21, 2026Mengqi Lei, Guohuan Xie, Shihui Ying +4Hypergraphs Graph Language Models
Sutra: Tensor-Op RNNs as a Compilation Target for Vector Symbolic Architectures
May 20, 2026Emma LeonhartPytorch Tensor Programs
LLMForge: Multi-Backend Hardware-Aware Neural Architecture Search with Infinite-Head Attention for Edge Language Models
May 17, 2026Xinting Jiang, Junyi Luo, Ruichen Qi +4Neural Architecture Search LLM Inference Efficiency
GiLT: Augmenting Transformer Language Models with Dependency Graphs
May 15, 2026Tianyu Huang, Yida Zhao, Chuyan Zhou +1Graph Language Models Transformer Architectures
ENSEMBITS: an alphabet of protein conformational ensembles
May 13, 2026Kaiwen Shi, Carlos OliverProtein Data Bank Conformational Ensembles
Sampling from Flow Language Models via Marginal-Conditioned Bridges
May 13, 2026Iskander Azangulov, Leo ZhangGenerative Flow Networks Diffusion Language Models
Chem-GMNet: A Sphere-Native Geometric Transformer for Molecular Property Prediction
May 13, 2026Deepak Warrier, Raja Sekhar PappalaMolecular Structure Elucidation Molecular Property Prediction
A Unified Graph Language Model for Multi-Domain Multi-Task Graph Alignment Instruction Tuning
May 12, 2026Haibo Chen, Xin Wang, Jiaheng Chao +2Gnn-Based Detectors Graph Language Models
GRAFT: Graph-Tokenized LLMs for Tool Planning
May 12, 2026Xinyi Gao, Xinyu Ren, Junliang Yu +3Large Language Model Planning Graph Language Models
A Single-Layer Model Can Do Language Modeling
May 11, 2026Zanmin WangGraph Language Models Transformer Layers

Sep 17, 2026 · cs.CLJ/K move · Enter open · S save

Dictionary-Constrained Grapheme-to-Phoneme for Unsegmented Languages from LLM-Annotated Data

Rui Hu, Zhenpeng Zhan, Xiaolong Lin

Grapheme-to-phoneme (G2P) conversion turns raw text into its phonemic form and is an essential part of both text-to-speech (TTS) and automatic speech recognition (ASR) systems. It is required to be fast, stable and context-aware. For unsegmented languages such as Japanese, G2P additionally couples word segmentation with highly context-dependent polyphone disambiguation, and the scarcity of accurately annotated data remains a bottleneck. In this paper, we present a context-aware, segmentation-agnostic neural G2P framework that models the joint segmentation-and-reading hypothesis space, scoring paths of a discriminative conditional random field (CRF) over a dictionary-derived word lattice. To tackle data scarcity, we utilize large language models (LLMs) to generate more than 2 million sentences. Experimental results demonstrate that our method substantially outperforms conventional morphological analyzer-based methods and neural sequence models. On the Joyo-Kanji-Yomi benchmark, our method reaches 99.62% target word reading accuracy, 0.32% target word phoneme error rate (PER) and 0.14% sentence PER.

Phoneme-Level Analysis Graph Language Models English Disambiguation

Open paper Ask about it PDF