Language Model Probing

Follow this topic Ask about this topic

Momentum

19 papers in the last four weeks, up 12% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 192

All topics

Probing Latent Colombian Identity Inferences in Qwen2.5-7B with Natural Language Autoencoders
Jul 23, 2026Pablo Santiago Potes Velasco, María del Mar García Matabanchoy, Óscar Julián Pérez Ladino +3LLM Interpretability Cultural Bias in Language Models
Universidad Autónoma de Occidente Cali, Colombia · Universidad Autónoma de Occidente GobLab-UAI Cali, Colombia
Train the Model, Not the Reader: Decodability Supervision for Verifiable Activation Explanations
Jul 22, 2026Hiskias DingetoFaithfulness of Language Model Explanations LLM Interpretability
StackOne Technologies
Geometric Configurations of Perturbed Jailbreak Prompts
Jul 22, 2026Lynn Delcon, Andres Algaba, Vincent GinisJailbreak Attacks LLM Jailbreak Attacks
Department of Business Technology and Operations, Data Analytics Laboratory, Vrije Universiteit Brussel, Pleinlaan 2, 1050 Brussels, Belgium · imec-SMIT, Vrije Universiteit Brussel, Pleinlaan 9, 1050 Brussels, Belgium · School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts 02138, USA
The Knowing-Saying Gap: When Probes See Errors that Confidence Misses
Jul 21, 2026Jyotin Goel, Ipshita Bandyopadhyay, Justin ShenkLanguage Model Error Detection Confidence Estimation in Language Models
Operational Proto-Introspection in Looped Language Models: Process-Quality Taps, Executable Branching, and the Readout-Control Boundary
Jul 20, 2026Jan KirinLanguage Model Introspection Language Model Self-Assessment
Diagnosing Correctness Probes under Self-Judgement Confounding
Jul 18, 2026Yi-Long LuLLM Interpretability Language Model Self-Assessment
Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education, Wuhan 430079, China · Key Laboratory of Human Development and Mental Health of Hubei Province, School of Psychology, Central China Normal University, Wuhan 430079, China
Graded Entity-Familiarity Readouts in Language Models: Polish Adaptation, Cross-Language Robustness, and Refusal Steering
Jul 15, 2026Grzegorz BrzezinkaMultilingual Language Model Evaluation Language Model Introspection
Prosit AS
Epistemic Stance Flexibility Probing: Measuring Prompt-Conditioned Register Shift in Large Language Models
Jul 14, 2026Binwen Liu, Yilin RenLLM Evaluation Pragmatic Reasoning in Language Models
Institute of Artificial Intelligence and Robotics Xi’an Jiaotong University Xi’an, China
The Model Knows Your Project, Not You: Measuring Recognition in LLMs with NameRank
Jul 14, 2026Bojie Li, Noah ShiLLM Evaluation Factual Knowledge in Language Models
Pine AI · University of Washington
Confidently Wrong: Detecting Hallucinations in Financial Question Answering from LLM Internal States
Jul 13, 2026Richard Zhe WangFinancial QA LLM Hallucination Detection
St. John Fisher University Rochester, NY, USA
MafiaScope: Non-Invasive, Time-Resolved Belief Probing for LLM Agents in Social Deduction Games
Jul 12, 2026Ilia KarpovSocial Deduction Games Theory of Mind
HSE University
SPARK: Susceptibility-Guided Profiling and Steering of Latent Reasoning States in Large Language Models
Jul 11, 2026Dongxu Zhang, Yiding Sun, Zihao Guo +5LLM Interpretability Activation Steering
Xi’an Jiaotong University · Peking University · Tencent
TypeProbe: Recovering Type Representations from Hidden States of Pre-trained Code Models
Jul 9, 2026Giuliano Gorgone, Fausto CarcassiLLM Interpretability Representation Geometry in Language Models
ILLC, University of Amsterdam, Amsterdam, The Netherlands
What LLM Forecasters Know but Don't Say: Probing Internal Representations for Calibration and Faithfulness
Jul 9, 2026Raphaël Sarfati, Pratyush Ranjan Tiwari, Siddharth Boppana +3CoT Faithfulness Language Model Calibration
goodfire · eternis
Does Bielik Know What It Doesn't Know? Activation Dispersion Separates Entity Familiarity from Factual Reliability Across Model Scale
Jul 8, 2026Grzegorz BrzezinkaHallucination in Language Models Knowledge Representation
Prosit AS
Doomed from the Start: Early Abort of LLM Agent Episodes via a Recall-Controlled Probe Cascade
Jul 7, 2026Kai Ruan, Zihe Huang, Ziqi Zhou +4LLM Inference Efficiency Early Stopping
Gaoling School of Artificial Intelligence, Renmin University of China · Institute of Computing Technology, Chinese Academy of Sciences · Duke University +3
SpanUQ: Span-Level Uncertainty Quantification for Large Language Model Generation
Jul 7, 2026Yimeng Zhang, Yingying Zhuang, Ziyi Wang +12LLM Evaluation Confidence Estimation in Language Models
Amazon · Northeastern University
Latent Programming Horizons in Coding Agents
Jul 6, 2026André Silva, Han Tu, Martin MonperrusLLM Interpretability Coding Agents
KTH Royal Institute of Technology Stockholm, Sweden
Knowledge Knows, Verbalization Tells: Disentangling Latent Directions for Mathematical Solvability in LLMs
Jul 6, 2026Nikolaos Xiros, Maria-Eleni Zoumpoulidi, Georgios ParaskevopoulosHallucination in Language Models Representation Geometry in Language Models
Institute for Language and Speech Processing, Athena Research Center, Greece
Unsupervised Features Mining via Activation Geometry
Jul 5, 2026Amit LeVi, Elad David, Max FominLLM Interpretability Unsupervised Representation Learning
Zenity Tel Aviv, Israel
CrossHallu: Do Hallucination Signals Generalize Across Languages and Domains in Large Language Model's Internals?
Jul 4, 2026Aisha Alansari, Malak Alkhorasani, Hamzah LuqmanMultilingual Language Model Evaluation LLM Hallucination Detection
King Fahd University of Petroleum and Minerals · Imam Abdulrahman bin Faisal University
Revealing Hidden Model Behaviors with Task-Specific Self-Reports
Jul 3, 2026Taras Kutsyk, Bartosz ZielińskiLLM Auditing Language Model Introspection
1Jagiellonian University, Faculty of Mathematics and Computer Science · 2Jagiellonian University, Doctoral School of Exact and Natural Sciences
Reading Between the Dots: Decoding Hidden Computation across Filler Tokens
Jul 3, 2026Kaley Brauer, Claudio Mayrink Verdun, Samuel MarksLLM Auditing LLM Interpretability
Harvard University · 4Anthropic
Understanding Why Language Models Hallucinate: Testing Reasoning Against Priors
Jul 1, 2026Yangfan Hu, Xuhan Tong, Haoyue Bai +5Knowledge Conflicts in Language Models LLM Prompting
University of Wisconsin–Madison
Probe Choice Changes Canary-Memorization Verdicts: Three Post-Hoc Disagreement Case Studies in a Text-Dominant LoRA-Tuned Autoregressive Testbed
Jun 30, 2026Zhichao Fan, Zexin Zhuang, Yanhang LiMemorization in Language Models LLM Auditing
University of Illinois Urbana-Champaign · Southern Methodist University · Northeastern University
Closing the Activation-Cone Blind Spot: Response-Time Probing and Unified Defense
Jun 28, 2026Subhadip MitraAdversarial Attacks on LLMs LLM Safety
Independent Researcher
Representational Depth of Evaluation Awareness Shifts With Scale in Open-Weight Language Models
Jun 28, 2026Archit ManekLLM Interpretability Language Model Scaling Laws
Independent Researcher.
ThinkProbe: Beyond Accuracy -- Structural Profiling of Open-Ended LLM Reasoning Traces via Non-Generative Thought Graphs
Jun 27, 2026Mohamed Amine Kerkouri, Simon D. Hernandez, Marouane Tliba +3LLM Reasoning with Graphs Structured Reasoning
F-Initiatives, Paris, France · Université sorbonne Paris Nord, Villetaneuse , France
From Signals to Transfer: A Factorised Study of Probe-Based Uncertainty Estimation in Large Language Models
Jun 26, 2026Ponhvoan Srey, Xiaobao Wu, Cong-Duy Nguyen +3Uncertainty Quantification Hallucination in Language Models
Nanyang Technological University · Shanghai Jiao Tong University · VinUniversity +1
Probing the Misaligned Thinking Process of Language Models
Jun 23, 2026Kaiwen Zhou, Constantin Venhoff, Jonathan Michala +2LLM Alignment LLM Auditing
1Anthropic Fellows · 2MATS · 3UCSC +2

Jul 23, 2026, cs.CLJ/K move · Enter open · S save

Probing Latent Colombian Identity Inferences in Qwen2.5-7B with Natural Language Autoencoders

Pablo Santiago Potes Velasco, María del Mar García Matabanchoy, Óscar Julián Pérez Ladino, Jhoan Stevan Mosquera Ortiz+2

Universidad Autónoma de Occidente Cali, Colombia · Universidad Autónoma de Occidente GobLab-UAI Cali, Colombia

LLM Interpretability Cultural Bias in Language Models Linguistic Bias in Language Models Demographic Bias in Language Models Language Model Probing

Open paper AskPDF arXiv

Large language models may infer demographic attributes from subtle linguistic cues even when those attributes are not explicitly stated. This pilot study examines whether Qwen2.5-7B-Instruct internally represents Colombian identity, socioeconomic status, or stereotype-related information when processing Colombian-Spanish and English prompts. We use Natural Language Autoencoders (NLA) to verbalize residual-stream activations from layer 20 across four positional quartiles per prompt. Our dataset contains 30 prompts arranged as 15 matched Spanish-English pairs, spanning explicit Colombian cues, implicit Colombian cues, and neutral controls. We report descriptive rates and qualitative evidence rather than statistically powered effects, focusing on whether latent nationality or stereotype representations appear before they are verbalized in the model output. This work connects activation-level interpretability with bias evaluation for underrepresented Spanish varieties.

Momentum

Related topics

Latest papers 192