Factual Knowledge in Language Models

Follow this topic Ask about this topic

Momentum

18 papers in the last four weeks, up 38% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 117

All topics

REAP: Relation-Aware Elicitation and Parsing for Closed-Book Knowledge Base Construction from LLMs
Aug 11, 2026Thanh-Dan Bui, Thanh-Trung Do, Tuan-Phong NguyenKG Construction LLM Prompting
VNU University of Engineering and Technology, Hanoi, Vietnam
From Values to Benchmarks: Evaluating Large Language Models for Governmental Use in Dutch
Aug 10, 2026Laurens Samson, Iva Gornishka, Gossa Lô +2Multilingual Language Model Evaluation LLM Evaluation
City of Amsterdam · Socially Intelligent Artificial Systems Group, University of Amsterdam · Fundamental AI Lab, University of Technology Nuremberg
Language Models Encode the Contextual Truth of Propositions
Aug 4, 2026Rupak Sarkar, Pritika Ramu, Rachel RudingerLLM Sycophancy Knowledge Conflicts in Language Models
University of Maryland, College Park
Sky sphere representation in language models
Jul 29, 2026Aleksandr Berdnikov, Yevgeny LiokumovichFactual Knowledge in Language Models Representation Geometry in Language Models
Fields Institute · Principles of Intelligence · University of Toronto
Attention-Guided Layer Selection for Contrastive Decoding in Large Language Models
Jul 25, 2026Yusuke Sakai, Natthawut Kertkeidkachorn, Kiyoaki ShiraiFactual Knowledge in Language Models Contrastive Decoding
Japan Advanced Institute of Science and Technology
Data Quality over Capacity: Internalizing Documents into LoRA Adapters for Closed-Book QA
Jul 23, 2026Joan Figuerola HurtadoKnowledge Augmentation for Language Models LLM Fine-Tuning
Independent Researcher
When Trivia Is Not Trivial: Everyday Knowledge Failures in Multilingual LLMs
Jul 23, 2026Anna Mosolova, Djamé SeddahMultilingual Language Model Evaluation LLM Evaluation
INRIA Paris
The Anatomy of a Truth Direction: Knowledge-Dependent Dimensionality, a Relational Law, and a Shared Category Geometry in Small Language Models
Jul 18, 2026Francesco Karim VicidominiLLM Interpretability Factual Knowledge in Language Models
Independent researcher
Graded Entity-Familiarity Readouts in Language Models: Polish Adaptation, Cross-Language Robustness, and Refusal Steering
Jul 15, 2026Grzegorz BrzezinkaMultilingual Language Model Evaluation Language Model Introspection
Prosit AS
Knowledgeless Language Models: Suppressing Parametric Recall for Evidence-Grounded Language Modeling
Jul 14, 2026Roi Cohen, Yvan Carré, Nick Lechtenbörger +5Language Model Pretraining LLM Grounding
HPI / University of Potsdam · African Institute for Mathematical Sciences · Polytechnique Montréal +2
The Model Knows Your Project, Not You: Measuring Recognition in LLMs with NameRank
Jul 14, 2026Bojie Li, Noah ShiLLM Evaluation Factual Knowledge in Language Models
Pine AI · University of Washington
Can a Language Model Learn Facts Continually in Its Weights?
Jul 13, 2026Charles O'Neill, Max Kirkby, Jonathon Liu +1Knowledge Editing Continual Learning for LLMs
Baseten
MLPs are Hebbians: Constructing Efficient Fact-Storing MLPs for Transformers
Jul 10, 2026Roberto Garcia, Jerry Liu, Ronny Junkins +3Transformer Memorization in Language Models
Institute for Computational & Mathematical Engineering, Stanford University · Department of Computer Science, Stanford University · Department of Computer Science and Engineering, University at Buffalo
Forget Narrowly, Retain Broadly: Unlearning as an Asymmetric Generalization Problem
Jul 10, 2026Amit Peleg, Naman Deep Singh, Naama Pearl +2Factual Knowledge in Language Models Machine Unlearning
Tübingen AI Center, University of Tübingen
Towards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model Finetuning
Jul 9, 2026Lu Dai, Ziyang Rao, Yili Wang +3Memorization in Language Models LLM Fine-Tuning
HKUST · HKUST(GZ)
Concretized Proposition Prompting Resolves Composition-Knowledge Dichotomy in Large Language Models
Jul 9, 2026Changhun Lee, Minguk Jeon, Jongkyung Shin +1Compositional Reasoning LLM Prompting
Columbia University · UNIST · POSCO Holdings
Co-LMLM: Continuous-Query Limited Memory Language Models
Jul 8, 2026Yair Feldman, Linxi Zhao, Nathan Godey +5Language Model Pretraining Memory-Augmented Language Models
Department of Computer Science Cornell University
Does Bielik Know What It Doesn't Know? Activation Dispersion Separates Entity Familiarity from Factual Reliability Across Model Scale
Jul 8, 2026Grzegorz BrzezinkaHallucination in Language Models Knowledge Representation
Prosit AS
IsoSci: A Benchmark of Isomorphic Cross-Domain Science Problems for Evaluating Reasoning versus Knowledge Retrieval in LLMs
Jul 1, 2026Samir Abdaljalil, Erchin Serpedin, Hasan KurbanLLM Evaluation Scientific Reasoning
Electrical and Computer Engineering Texas A&M University College Station, TX USA · College of Science and Engineering Hamad Bin Khalifa University Doha, Qatar
LMs as Task-Specific Knowledge Bases: An Interpretability Analysis
Jun 25, 2026Amit Elhelo, Amir Globerson, Mor GevaLLM Interpretability Factual Knowledge in Language Models
Blavatnik School of Computer Science and AI, Tel Aviv University · Google Research
KARLA: Knowledge-base Augmented Retrieval for Language Models
Jun 25, 2026Francois Crespin, Fabian M. Suchanek, Nils HolzenbergerRetrieval-Augmented Generation LLM Grounding
IP Paris, LTCI · Télécom Paris · Institut Polytechnique de Paris, France
LibEvoBench: Probing Temporal Knowledge Stratification in Code Generation Models
Jun 24, 2026Daniele Cipollone, Sergey Titov, Maliheh Izadi +2Software Engineering Temporal Reasoning in Language Models
JetBrains Research, Amsterdam, Netherlands · Faculty of EEMCS, Delft University of Technology, Delft, Netherlands.
Cross-Lingual Exploration for Parametric Knowledge
Jun 23, 2026Elisha Diskind, Itamar Trainin, Uri Shaham +3Multilingual Language Models LLM Prompting
The Hebrew University of Jerusalem · Google Research · MIT, IBM-MIT Watson AI Lab
Exposing the Illusion of Erasure in Knowledge Editing for LLMs
Jun 22, 2026Advik Raj Basani, Anshuman ChhabraKnowledge Editing Knowledge Conflicts in Language Models
Birla Institute of Technology and Science, Goa · University of South Florida
Same question, different history: language, national identity, and credit in large language models
Jun 22, 2026William Guey, Pierrick Bougault, Wei Zhang +2Social Bias in Language Models Cultural Bias in Language Models
Department of Industrial Engineering, Tsinghua University, Beijing, China · School of Social Sciences, Tsinghua University, Beijing, China · Department of Industrial Engineering, Federal University of Rio de Janeiro, Brazil
Knowledge-Graph Grounding Helps LLMs Only for Out-of-Training Knowledge: A Controlled Study on Clinical Question Answering
Jun 21, 2026Madhulatha Mandarapu, Sandeep KunkunuruLLM Grounding LLM Reasoning with Graphs
samyama
Finetuning with Scientific Data Increases Hallucinations: A Multi-domain Factuality Evaluation of LLMs
Jun 19, 2026Raia Abu Ahmad, Nikolas Rauscher, Ekaterina Borisova +3LLM Evaluation LLM Fine-Tuning
Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI) · Technische Universität Berlin · Humboldt-Universität zu Berlin
Factual Retrieval in LLMs Is a Redundant, Distributed and Non-Contiguous Process
Jun 19, 2026Hail Hochman, Natalie Shapira, Yoav GoldbergLLM Interpretability Factual Knowledge in Language Models
Bar-Ilan University · Northeastern University
Right Knowledge, Wrong Answer: Test-Time Steering for Temporal Fact Conflicts in Open-Weight Language Models
Jun 18, 2026Elias Hossain, Sourav Saha, Umesh Chandra Biswas +1Knowledge Conflicts in Language Models Temporal Reasoning in Language Models
University of Central Florida · 2Mississippi State University
When to Write and When to Suppress: Route-Specialized Dual Adapters for Memory-Assisted Knowledge Editing
Jun 12, 2026Baijia Zhang, Yining HuangKnowledge Editing Factual Knowledge in Language Models
Xinjiang University · Meta Emergence Laboratory

Aug 11, 2026, cs.CLJ/K move · Enter open · S save

REAP: Relation-Aware Elicitation and Parsing for Closed-Book Knowledge Base Construction from LLMs

Thanh-Dan Bui, Thanh-Trung Do, Tuan-Phong Nguyen

VNU University of Engineering and Technology, Hanoi, Vietnam

KG Construction LLM Prompting LLM Information Extraction Factual Knowledge in Language Models

Open paper AskPDF arXiv

We present the REAP system for the AKBC Shared Task 2026 on constructing knowledge bases from language models in a closed-book setting, subject to a budget of at most 32B parameters and no model fine-tuning. Our system combines structured chain-of-thought reasoning, relation-specific query strategies, and a reasoning-based empty-set gate to elicit parametric knowledge, followed by direct extraction into valid JSON arrays. On the test set, the system, built on the Mistral-Small-24B-Instruct-2501 model, achieves a macro-F1 score of 0.62, with particularly strong results on countryLandBordersCountry (F1 = 0.95), companyTradesAtStockExchange (F1 = 0.73), and hasArea (F1 = 0.77). Our code is publicly available at https://github.com/yammdd/AKBC-Shared-Task-2026.

Momentum

Related topics

Latest papers 117