Knowledge Editing

Follow this topic Ask about this topic

Momentum

6 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 58

All topics

Not Every Change Is Necessary: Recoverable Drift in Large Language Model Unlearning
Oct 8, 2026Xunlei Chen, Qinghui Gong, Jingkun Xue +3Machine Unlearning LLM Unlearning
University of Electronic Science and Technology of China · Southwest Jiaotong University
FedAlphaEdit: Null-Space-Aligned Merging for Collaborative Knowledge Editing
Oct 8, 2026Sota Sugawara, Yukihiko OkadaKnowledge Editing Language Model Editing
Graduate School of Science and Technology, University of Tsukuba, Tsukuba, Japan · Center for Artificial Intelligence Research, Tsukuba Institute for Advanced Research, University of Tsukuba, Tsukuba, Japan · Institute of Systems and Information Engineering, University of Tsukuba, Tsukuba, Japan
EngramEdit: Decoupled Knowledge Updates in LLMs through Conditional Memory
Oct 7, 2026Hongru Cai, Ran Wei, Wenjie Wang +4Knowledge Editing Factual Knowledge in Language Models
The Hong Kong Polytechnic University · Hangzhou Diagens Biotechnology Co., Ltd · University of Science and Technology of China
Positions Are Not Facts: The Mismatch Between KV Caches and Memory
Sep 27, 2026Changhai Zhou, Yuhua Zhou, Shiyang Zhang +5Knowledge Editing Knowledge Conflicts in Language Models
Fudan University · Baidu · Zhejiang University +2
ManiEdit: Sequential Unstructured Knowledge Editing for Language Models from a Manifold Perspective
Sep 27, 2026Rui Liu, Chenheng Zhang, Haoxuan Li +1Knowledge Editing Continual Learning for LLMs
State Key Lab of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University · Institute for Artificial Intelligence, Peking University
Style-Debiased DPO: Updating LLM Knowledge with Factuality-Aware Synthetic Preference Data
Sep 15, 2026Takayuki Yamamoto, Daisuke KawaharaKnowledge Editing Direct Preference Optimization
Waseda University
When Successful Knowledge Graph Edits Displace Correct Answers: Rank-Level Locality beyond Parameter Support
Sep 14, 2026Yi-Cheng Lai, Jerry Wang, Hsin-Ling Hsu +3Knowledge Editing KG Embedding
Institute of Information Science, Academia Sinica Taipei, Taiwan · University of Illinois Urbana-Champaign Urbana, IL, USA · National Chengchi University Taipei, Taiwan
Through the Looking Glass: Directly Reading and Writing Transformers
Sep 9, 2026Mark OskinKnowledge Editing Transformer Interpretability
School of Computer Science and Engineering University of Washington
Popular Knowledge Propagates More Errors in LLM Knowledge Updating
Sep 8, 2026Yuji Zhang, Weibing Wang, Cheng Qian +5Knowledge Editing Factual Knowledge in Language Models
University of Illinois Urbana-Champaign · City University of New York · Massachusetts Institute of Technology +1
Selective Knowledge Edit Reversal via Gated Singular Vector Shrinkage
Sep 2, 2026Weifeng Jiang, Ruirui Chen, Qianren Mao +3Knowledge Editing LLM Safety
College of Computing and Data Science, Nanyang Technological University, Singapore. · Digital Trust Centre, Nanyang Technological University, Singapore. · Institute of Advanced Intelligence and Computing, Agency for Science, Technology and Research, Singapore. +2
Synthetic Worlds for Temporal Evaluation and Knowledge Updating in LLMs
Aug 31, 2026Jonathan Zheng, Zirui Shao, Alan Ritter +1Synthetic Data Pretraining Knowledge Editing
Georgia Institute of Technology · Zhejiang University
In-Cell Learning: Language Models That Update Their Own Weights in Sequence Without Changing the File They Ship
Aug 21, 2026Zifeng Liu, Yaxin Lu, Xuanhan Wu +6LLM Quantization Knowledge Editing
Big Data and Artificial Intelligence Center, The Third Affiliated Hospital of Sun Yat-sen University · Institute for Frontier Interdisciplinary Research in Health Sciences and Technology, Sun Yat-sen University · Sun Yat-sen University Institute of Artificial Intelligence +7
Hybrid-Policy Self-Editing for Composable Unstructured Knowledge Editing
Aug 12, 2026Tianci Liu, Zihan Dong, Tianchun Li +8Knowledge Editing Self-Distillation
University of Tennessee · 2Rutgers University · 3Purdue University +1
CACHE-UK: A Stability-Aware Memory Editor for Sequentially Updated Quantized LLMs in Finance
Jul 30, 2026Anubhav Lakra, Yue FengKnowledge Editing Continual Learning for LLMs
University of Birmingham, Birmingham, United Kingdom
ForgetBench: Benchmarking Forgetting Dynamics of Long-Term Parametric Memory in Language Models
Jul 29, 2026Ruxi Gu, Zhenliang Zhang, Wei WangKnowledge Editing Continual Learning for LLMs
Department of Automation, University of Science and Technology of China, Hefei, China · State Key Laboratory of General Artificial Intelligence, BIGAI, Beijing, China · School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, China.
Can a Language Model Learn Facts Continually in Its Weights?
Jul 13, 2026Charles O'Neill, Max Kirkby, Jonathon Liu +1Knowledge Editing Continual Learning for LLMs
Baseten
Evaluating and Understanding Model Editing for Medical Vision Language Models
Jul 6, 2026Guli Zhu, Chenwei Wu, Liyue ShenKnowledge Editing Medical VLMs
EECS, University of Michigan, Ann Arbor, MI 48105, USA
Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing
Jul 2, 2026Siyuan Li, Youyuan Zhang, Ruitong Liu +2Knowledge Editing Multimodal Large Language Models
Harbin Institute of Technology, Shenzhen, China · Peng Cheng Laboratory · Peking University +1
KnowledgeDebugger -- an Exploration Tool for Knowledge Localization and Editing in Transformers
Jul 1, 2026Eric Benz, Lennart Stöpler, Nikolai Bolik +1Knowledge Editing Transformer Interpretability
Heidelberg University
Reproducibility Study of "AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models"
Jun 25, 2026Ananth K Suresh, Arya HariharanKnowledge Editing Model Editing
Independent
Towards Version-aware Operations and Transaction Memories for Multi-layer MeMo
Jun 23, 2026Peiran LiKnowledge Editing Continual Learning for LLMs
Freie Universität Berlin, Kaiserswerther Str. 16-18, 14195 Berlin, Germany
Exposing the Illusion of Erasure in Knowledge Editing for LLMs
Jun 22, 2026Advik Raj Basani, Anshuman ChhabraKnowledge Editing Knowledge Conflicts in Language Models
Birla Institute of Technology and Science, Goa · University of South Florida
Orthogonal Representation Editing: Decoupling Semantic Entanglement in Batch Knowledge Editing of LLMs
Jun 21, 2026Wenhao Yu, Zhicong Lu, Bo Lv +4Knowledge Editing Model Editing
School of Computer Science and Technology, Tianjin University · Kexin Technology · University of Chinese Academy of Sciences +2
LOKI: Memory-Free Null-Space Constrained Lifelong Knowledge Editing
Jun 18, 2026Masih Eskandar, Miquel Sirera Perelló, Stratis Ioannidis +1Knowledge Editing Continual Learning for LLMs
Department of Electrical and Computer Engineering Northeastern University Boston, MA, 02115
Repeated Shared Access Enables Grokking, but Edit Propagation Depends on an Addressable Memory
Jun 17, 2026Yanan NiuMemory-Augmented Neural Networks Knowledge Editing
Kuaishou Technology
User as Engram: Internalizing Per-User Memory as Local Parametric Edits
Jun 17, 2026Bojie LiKnowledge Editing LLM Personalization
Pine AI
Conflict-Aware Retriever Editing for Knowledge Injection Attacks on LLM-Based RAG Systems
Jun 16, 2026Xinru Liu, Xianglong Zhang, Di Cai +3Knowledge Editing RAG Poisoning Attacks
Shandong University, China · Tsinghua University, China
When to Write and When to Suppress: Route-Specialized Dual Adapters for Memory-Assisted Knowledge Editing
Jun 12, 2026Baijia Zhang, Yining HuangKnowledge Editing Factual Knowledge in Language Models
Xinjiang University · Meta Emergence Laboratory
TimeROME-DLM: Temporal Causal Tracing and Low-Rank Inference-Time Knowledge Editing for Masked Diffusion Language Models
Jun 11, 2026Zhengtao Yao, Liuyang Song, Hongbo Zhang +4Knowledge Editing Masked Diffusion Models
University of Southern California, USA · Peking University, China · Stevens Institute of Technology, USA +1
Benchmarking Knowledge Editing using Logical Rules
Jun 9, 2026Tatiana Moteu Ngoli, NDah Jean Kouagou, Hamada M. Zahera +1Knowledge Editing LLM Evaluation
Data Science Group, Heinz Nixdorf Institute, Paderborn University

Oct 8, 2026, cs.CLJ/K move · Enter open · S save

Not Every Change Is Necessary: Recoverable Drift in Large Language Model Unlearning

Xunlei Chen, Qinghui Gong, Jingkun Xue, Qihe Liu+2

University of Electronic Science and Technology of China · Southwest Jiaotong University

Machine Unlearning LLM Unlearning Knowledge Editing Machine Unlearning Evaluation

Open paper AskPDF arXiv

Machine unlearning in large language models aims to remove unwanted knowledge while preserving the model's remaining capabilities. Although existing methods use retention objectives or restrict where edits occur, achieving the desired forgetting level can still leave collateral changes that impair non-target behavior. Our recovery comparisons suggest that some of these changes can be reversed while preserving observed forgetting performance. In this work, we present Propose-Then-Project Unlearning (PTP-U), a framework that combines targeted forgetting with the recovery of non-target capabilities. PTP-U first applies local analytic edits to weaken target knowledge associations, then aligns non-target output distributions with those of the original model to recover capabilities while maintaining fixed forgetting constraints. Both stages serve a common goal: satisfying the forgetting requirements while preserving fluent generation and performance on non-target tasks. Across three benchmarks, PTP-U achieves the strongest forgetting-retention trade-off among evaluated methods, reaching 81.22%-91.03% forgetting while preserving 94.20% non-target utility on average. At matched forgetting, PTP-U consistently retains higher non-target utility.

Momentum

Related topics

Latest papers 58