Token-Level Uncertainty

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

17 new papers

A weekly snapshot of new work published in Token-Level Uncertainty.

Period ending 2026-09-14

9 new papers

A weekly snapshot of new work published in Token-Level Uncertainty.

Period ending 2026-09-07

14 new papers

A weekly snapshot of new work published in Token-Level Uncertainty.

Inside this field

Focused directions

473 papers

Latest in Token-Level Uncertainty

Browse all topics →
CardsList

  1. SEAD: Competence-Aware On-Policy Distillation via Entropy-Guided Supervision

    Jun 26, 2026Chia-Hsuan Lee, Zelei Cheng, Yu Wang +4On-Policy DistillationCurriculum

  2. VASAE: Naming SAE Dictionary Directions with Vocabulary-Aligned Anchoring

    Jun 26, 2026Kairui Zhang, Ziwen Yu, Zahraa S. Abdallah +1Sparse Autoencoder FeaturesImproving Sparse Autoencoders

  3. Beyond MoCap: Scaling Motion Tokenizers with Synthetic Human Motion for Generative Modeling

    Jun 25, 2026Yiwen Yan, Wanning He, Yu-Wing TaiHuman Motion GenerationGenerative Models

  4. Information-Aware KV Cache Compression for Long Reasoning

    Jun 25, 2026Jushi Kai, Zhuiri Xiao, Alexandra Birch +1Key-Value Cache CompressionKey-Value

  5. TaskTok: Delving into Task Tokens for Task-driven Image Restoration

    Jun 25, 2026Hongjae Lee, Sojung Kang, Jaeseong Yu +1Image RestorationSelf-Supervised Reconstruction Method

  6. Position Spaces and Graphs

    Jun 24, 2026Rita-Nathalia Assaf, Tom Davot, Frédéric Lardeux +1PositionStructural Constraints

  7. What Intermediate Layers Know: Detecting Jailbreaks from Entropy Dynamics

    Jun 23, 2026Sofiia Nikolenko, Michele Papucci, Mina Rezaei +1Large Language Model JailbreaksJailbreak Evaluations

  8. ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization

    Jun 23, 2026Lei Xu, Haowei Wang, Shen Chen +3Face Forgery DetectionDigital Forensics

  9. The African Language Tax: Quantifying the Cost, Latency, and Context Penalty of Tokenizing African Languages in Frontier LLMs

    Jun 23, 2026Olaoye Anthony SomideAfrican LanguagesTokenization

  10. Best Preprocessing Techniques for Sentiment Analysis

    Jun 23, 2026Saranzaya Magsarjav, Melissa Humphries, Jonathan Tuke +1PreprocessingIndonesian E-Commerce Reviews

  11. LangMAP: A Language-Adaptive Approach to Tokenization

    Jun 22, 2026Clara Meister, Suchir Salhan, Andrzej Szablewski +3TokenizationMultilingual Language Models

  12. ROMEVA: Geometry-Preserving Vocabulary Expansion for Roman Urdu Language Models

    Jun 21, 2026Mahnoor Khan, Afsheen Asif, Milhan Afzal Khan +2Multilingual Language ModelsSubword Tokenization

  13. Structural Assessment for Understanding and Guiding Dataset Distillation in Discrete Token Space

    Jun 19, 2026Yue Cao, Jianyang Gu, Vyacheslav Kungurtsev +4Chain-Of-Thought DistillationToken-Level Uncertainty

  14. Phonemes to the Rescue: Multilingual Tokenization Based on International Phonetic Alphabet

    Jun 18, 2026Milan Miletić, Julie Kallini, Ekaterina ShutovaSubword TokenizationMultilingual Language Models

  15. Comparing Transformers and Hybrid Models at the Token Level

    Jun 18, 2026Yanhong Li, William MerrillTransformer ArchitecturesToken-Level Uncertainty

  16. Structuring and Tokenizing Distributed User Interest Context for Generative Recommendation

    Jun 18, 2026Ruizhong Qiu, Yinglong Xia, Dongqi Fu +6RecommendationTokenization

  17. Beyond Entropy: Learning from Token-Level Distributional Deviations for LLM Reasoning

    Jun 18, 2026Xuanzhi Feng, Zhengyang Li, Zeyu Liu +6Reinforcement Learning With Verifiable RewardLarge Language Model Reasoning

  18. BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation

    Jun 17, 2026Max Van Puyvelde, Ibrahim Gulluk, Wim Van Criekinge +13D Latent Diffusion ModelBrain Magnetic Resonance Imaging

  19. Beyond Tokenization: Direct Timestep Embedding and Contrastive Alignment for Time-Series Question Answering

    Jun 17, 2026Yafeng Wu, Huu Hiep Nguyen, Thin Nguyen +1Latent Reasoning TokensTimestep

  20. Contextualizing Biological Language Models across Modalities via Logit-Space Contrastive Alignment

    Jun 17, 2026Yanjun Shao, Yundi Chen, Yashvi Patel +2Contrastive AlignmentGraph Language Models

  21. Dual Dimensionality for Local and Global Attention

    Jun 17, 2026Zhiyuan Wang, Xuan Luo, Sirui Zeng +1Transformer EncoderRepresentational Capacity

  22. Self-Generated Error Training for Token Editing in Diffusion Language Models

    Jun 15, 2026Lin YaoDiffusion Language ModelsMultimodal Knowledge Editing

  23. The Art of Mixology: Mixup-based Obfuscation for Privacy-Preserving Split Learning in Large Language Models

    Jun 15, 2026Chen Chen, Xiang Gao, Xianshun Wang +6Privacy-Preserving FrameworkObfuscation

  24. CraBERT: Efficient Phoneme Encoder Pre-Training via Cascade Fusion of Subword Representations for Text-to-Speech

    Jun 15, 2026Dong Yang, Yuki Saito, Wataru Nakata +1Speech EncoderSubword Tokenization

  25. Surpassing Scale by Efficiency: A Compact 135M Parameter Foundational LLM Natively Adapted for the Bangla Language

    Jun 15, 2026Rabindra Nath NandiBanglaSmall Language Models

  26. Demystifying Training-Time Augmentation for Data-Constrained Language Model Pretraining

    Jun 15, 2026Michael K. Chen, Xikun Zhang, Fan Bai +2Large Language Model PretrainingSynthetic Data Augmentation

  27. From Tokens to Regions: CUDA-Sensitive Instruction Tuning for GPU Kernel Generation

    Jun 15, 2026Wentao Chen, Jiace Zhu, Xing Zhe Chai +4Graphics Processing Unit KernelsInstruction Tuning

  28. PVminerLLM2: Improving Structured Extraction of Patient Voice via Preference Optimization

    Jun 15, 2026Samah Fodeh, Linhai Ma, Ganesh Puthiaraju +7Large Language Model PipelinesToken-Level Uncertainty

  29. Koshur Diacritizer: A Byte-Level Sequence-to-Sequence Model for Kashmiri Diacritic Restoration

    Jun 14, 2026Haq Nawaz Malik, Nahfid Nissar, Faizan IqbalSubword TokenizationSequence Modeling

  30. Re-feeding Is Not Replaying: Measuring Replay Noise in Counterfactual Token-Credit Estimation

    Jun 14, 2026Nils MattesonToken-Level UncertaintyReplication

  31. PACUTE: Phonology-, Affix-, and Character-level Understanding of Tokens for Filipino

    Jun 13, 2026Jann Railey Montalan, David Demitri Africa, Jimson Paulo Layacan +3MorphologySubword Tokenization

  32. MotionVLA: Vision-Language-Action Model for Humanoid Motion

    Jun 13, 2026Nonghai Zhang, Siyu Zhai, Yanjun Li +5Human Motion GenerationVideo Latents

  33. Equity with Efficiency: An Empirical Study of Tokenizers for Multilingual Large Language Models

    Jun 13, 2026Kieron Seven Jun Wei Lee, Muhammad Reza Qorib, Andrew Ivan Soegeng +1Multilingual Large Language ModelsMultilingual Language Models

  34. Explainable Task-Oriented Token Communication for AI-Native 6G Networks

    Jun 12, 2026Feibo Jiang, Lei Mao, Li Dong +3Semantic CommunicationsVisual Tokens

  35. Beyond Perplexity: UTF-8 Validity in Byte-aware Language Models

    Jun 12, 2026Sangwhan Moon, Daisuke Oba, Youmi Ma +2Byte-Pair EncodingSingle-Character Wildcards

  36. FreoStream:Enhancing Stream Guardrails via Future-Aware Reasoning and Safety-Aligned Optimization

    Jun 11, 2026Jianwei Wang, Guoyang Shen, Yanhong Wu +5Streaming GuardrailsLarge Language Model Safety

  37. ReSET: Accurate Latency-Critical NVFP4 Reasoning via Step-Aware Temperature Scaling

    Jun 11, 2026Sihwa Lee, Janghwan Lee, Donghoon Yoo +4Fp8Autoregressive Decoding

  38. From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image Fusion

    Jun 10, 2026Yuchen Xian, Yunqiu Xu, Yang He +1Visible Image FusionTokenization

  39. Augmenting Molecular Language Models with Local nn-gram Memory

    Jun 10, 2026Xinni Zhang, Zijing Liu, He Cao +2N$-Grams FeaturesGraph Language Models

  40. Last But Not Least: Boundary Attention CalibratiON for Multimodal KV Cache Compression

    Jun 10, 2026Tianhao Chen, Yuheng Wu, Kelu Yao +3Key-Value Cache CompressionMulti-Modal Large Language Models

  41. Higher-Order Token Interactions via Quantum Attention

    Jun 10, 2026Jian Xu, Chao Li, Delu Zeng +2QubitToken Communications

  42. AI Tokenomics: The Economics of Tokens, Computation, and Pricing in Foundation Models

    Jun 10, 2026Quanyan ZhuToken-Level UncertaintyPrices

  43. SARA: A Dual-Stream VAE for High-Fidelity Speech Generation via Integrating Semantic and Acoustic Representations

    Jun 10, 2026Peijie Chen, Wenhao Guan, Weijie Wu +7Zero-Shot Text-To-SpeechSpeech Encoder

  44. When Probing Accuracy Saturates, Fragility Resolves: A Complementary Metric for LLM Pre-Training Analysis

    Jun 9, 2026Orion Reblitz-RichardsonFragilityLarge Language Model Pretraining

  45. A Unifying Lens on Supervised Fine-Tuning Through Target Distribution Design

    Jun 9, 2026Tong Xie, Yuanhao Ban, Yunqi Hong +3Supervised Fine-TuningToken-Level Uncertainty

  46. Beyond Uniform Token-Level Trust Region in LLM Reinforcement Learning

    Jun 9, 2026Renjie Mao, Xiangxin Zhou, Lvfang Tao +7Reinforcement Learning With Verifiable RewardVerifiable Rewards

  47. UniDexTok: A Unified Dexterous Hand Tokenizer from Real Data

    Jun 9, 2026Dong Fang, Youjun Wu, Yuanxin Zhong +4Dexterous Robot HandsHand

  48. Dynamic Linear Attention

    Jun 9, 2026Xin Wang, Hui Shen, Boyuan Zheng +7Quadratic AttentionEfficient Long-Context Inference

  49. Stop Early, Spend Less: Hidden-State Probes as a Practical Recipe for Streaming Moderation of LLM Outputs

    Jun 9, 2026Huizhen Shu, Xuying Li, Piao XueLarge Language Model SafetyLarge Language Model Output

  50. Early-Token Confidence Predicts Reasoning Quality in Multi-Agent LLM Debate

    Jun 9, 2026Ali Keramati, Justin Cheok, Jacob Horne +1Multi-Agent Large Language Model SystemsLlm-As-A-Judge

  51. What the Eyes See, the LLMs Miss: Exploiting Human Perception for Adversarial Text Attacks

    Jun 8, 2026Qin Yang, Lu Malloy, Joshua Lee +4Language Model Evasion AttacksContent Moderation

  52. PriFT: Prior-Support Guided Supervised Fine-Tuning

    Jun 8, 2026Ke Wang, Shuangqi Li, Mathieu Salzmann +1Supervised Fine-TuningToken-Level Uncertainty

  53. PRPO: Perception-Reinforced Policy Optimization via Token-Level Dynamic Advantage Reshaping

    Jun 7, 2026Qiming Li, Tianlun Li, Xiaolong Cheng +5Multimodal Reasoning BenchmarksReinforcement Learning With Verifiable Reward

  54. Inside the LLM Word Factory

    Jun 7, 2026Benzi Busigin, Yuval PinterTokenizationModel Activations

  55. X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretraining

    Jun 7, 2026Miracle Kang, Lights Shi, Lucy Liang +10Vision-Language-Action ModelsVisual Tokens

  56. A Unifying View of Attention Sinks: Two Algorithms, Two Solutions

    Jun 6, 2026Lukas Fesser, Mozes Jacobs, Thomas Fel +2Discrete Tokens

  57. WhiFlash: Accelerating Speculative Decoding with Token-Level Cross-Paradigm Routing

    Jun 5, 2026Young D. Kwon, Miles Williams, Rui Li +2Speculative DecodingLLM Inference Efficiency

  58. AdaTok: Self-Budgeting Image Tokenization with Quality-Preserving Dynamic Tokens

    Jun 5, 2026Xiaocheng Lu, Yuxi Chen, Jie Zhang +5Visual TokensTokenization

  59. How Language Models Fail: Token-Level Signatures of Committed and Persistent Reasoning Failures

    Jun 4, 2026Tanvi Thoria, Kiana Jafari, Marc R. Schlichting +1Reasoning FailuresLarge Language Model Reasoning

  60. F3-Tokenizer: Taming Audio Autoencoder Latents for Understanding and Generation

    Jun 4, 2026Dinghao Zhou, Xingchen Song, Di Wu +3Audio TokensTokenization