Model Auditing

Ask about this topic

Momentum

105 papers in the last four weeks, up 133% on the four weeks before. 1.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 538

All topics
CardsList

  1. Know2Guess: A Contamination-Aware Multi-Zone Benchmark for Knowledge-Boundary Evaluation in Large Language Models

    Apr 30, 2026Renwei Meng, Bowen Zhang, Jian Wang +4Prompt EngineeringModel Auditing

    Anhui University, Hefei, China

  2. Evaluating Epistemic Guardrails in AI Reading Assistants: A Behavioral Audit of a Minimal Prototype

    Apr 30, 2026Matthew Christian AgustinInterpretive LayerStreaming Guardrails

    Responsible Innovation Lab Tempe, Arizona, USA

  3. Ambient Persuasion in a Deployed AI Agent: Unauthorized Escalation Following Routine Non-Adversarial Content Exposure

    Apr 29, 2026Diego F. Cuadros, Abdoul-Aziz MaigaAgentic DeploymentsEscalation

    Digital Epidemiology Laboratory, Digital Futures, University of Cincinnati, Cincinnati, OH, USA · Center for Humanities and Technology (CHaT), University of Cincinnati, Cincinnati, OH, USA · Norwegian University of Science and Technology, Trondheim, Norway

  4. TRUST: A Framework for Decentralized AI Service v.0.1

    Apr 29, 2026Yu-Chao Huang, Zhen Tan, Mohan Zhang +3Trustworthy Artificial IntelligenceAI Trustworthiness

    UNITES Lab, University of North Carolina at Chapel Hill · Arizona State University · Columbia University

  5. Auditing Marketing Budget Allocation with Hindsight Regret

    Apr 28, 2026Nilavra Pathak, Olivier Jeunen, Eric LambertToken Budget AllocationModel Auditing

    Expedia Group · New York, USA · aampe +2

  6. Making AI-Assisted Grant Evaluation Auditable without Exposing the Model

    Apr 28, 2026Kemal BicakciModel Auditing

    Informatics Institute, Istanbul Technical University, Istanbul, Türkiye · Securify Information Technology and Security Training Consulting Inc., Ankara, Türkiye

  7. Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skills

    Apr 28, 2026Lijia Lv, Xuehai Tang, Jie Wen +2Model Auditing

    Institute of Information Engineering, Chinese Academy of Sciences · School of Cyber Security, University of Chinese Academy of Sciences

  8. Optimally Auditing Adversarial Agents

    Apr 28, 2026Sanmay Das, Fang-Yi Yu, Yuang ZhangModel AuditingBounded Adversary

    Virginia Tech · George Mason University

  9. BenchGuard: Who Guards the Benchmarks? Automated Auditing of LLM Agent Benchmarks

    Apr 27, 2026Xinming Tu, Tianze Wang, Yingzhou +4Agentic BenchmarksModel Auditing

    Minta · Allen School, University of Washington, Seattle, WA, USA · Phylo, Inc., South San Francisco, CA, USA +1

  10. A Multi-Dimensional Audit of Politically Aligned Large Language Models

    Apr 27, 2026Lisa Korver, Mohamed Mostagir, Sherief RedaLarge Language Model BiasLarge Language Model Alignment

    Department of Computer Engineering Brown University Providence, RI 02906 · Ross School of Business University of Michigan Ann Arbor, MI 48109

  11. Agentic Witnessing: Pragmatic and Scalable TEE-Enabled Privacy-Preserving Auditing

    Apr 27, 2026Antony RowstronZero-Knowledge ProofsModel Auditing

    Advanced Research and Invention Agency (ARIA) London, UK

  12. FinGround: Detecting and Grounding Financial Hallucinations via Atomic Claim Verification

    Apr 26, 2026Dongxin Guo, Jikun Wu, Siu Ming YiuFinancial Question AnsweringCategory-Aware Atomic Claims

    1The University of Hong Kong · 2Stellaris AI Limited

  13. Do Transaction-Level and Actor-Level AML Queues Agree? An Empirical Evaluation of Granularity Effects on the Elliptic++ Graph

    Apr 26, 2026Ankur MalikAnti-Money LaunderingModel Auditing

    Hudson Data, New York, NY, USA

  14. Make Mechanistic Interpretability Auditable: A Call to Develop Guidelines via Continuous Collaborative Reviewing

    Apr 24, 2026Michael Lan, Narmeen Fatimah Oozeer, Chaithanya Bandi +4Artificial Intelligence SafetyModel Auditing

    Martian · University of Delaware · MATS +2

  15. Behavioral Canaries: Auditing Private Retrieved Context Usage in RL Fine-Tuning

    Apr 24, 2026Chaoran Chen, Dayu Yuan, Peter KairouzModel AuditingReinforcement Fine-Tuning

    Google

  16. Spontaneous Persuasion: An Audit of Model Persuasiveness in Everyday Conversations

    Apr 23, 2026Nalin Poungpeth, Nicholas Clark, Tanu MitraPersuasionHuman-Written Text

    Department of Cognitive Science Northwestern University Evanston, IL 60201, USA · Information School University of Washington Seattle, WA 98195 USA

  17. Who Audits the Auditor? Tamper-Proof Fraud Detection with Blockchain-Anchored Explainable ML

    Apr 23, 2026Zhaohui WangFraud DetectionModel Auditing

    Viterbi School of Engineering University of Southern California Los Angeles, CA, USA

  18. Reliability Auditing for Downstream LLM tasks in Psychiatry: LLM-Generated Hospitalization Risk Scores

    Apr 23, 2026Shevya Panda, Shinjini Bose, Ananya JoshiMental HealthClinician Trust

    Johns Hopkins University Baltimore, USA

  19. AUDITA: A New Dataset to Audit Humans vs. AI Skill at Audio QA

    Apr 23, 2026Tasnim Kabir, Dmytro Kurdydyk, Aadi Palnitkar +3Audio UnderstandingText-To-Audio

    University of Maryland · Davidson College · Columbia University +1

  20. OptiVerse: A Comprehensive Benchmark towards Optimization Problem Solving

    Apr 23, 2026Xinyu Zhang, Boxuan Zhang, Yuchen Wan +5Optimization ModelingModel Auditing

    School of Computer Science and Technology, Xi’an Jiaotong University · 2Ministry of Education Key Laboratory of Intelligent Networks and Network Security, China · 4Lenovo Research +1

  21. Participatory provenance as representational auditing for AI-mediated public consultation

    Apr 22, 2026Sachit MahajanGeneration ProvenanceModel Auditing

    Computational Social Science, D-GESS · ETH Zurich, Rämistrasse 101, 8092 Zurich, Switzerland

  22. Evian: Towards Explainable Visual Instruction-tuning Data Auditing

    Apr 22, 2026Zimu Jia, Mingjie Xu, Andrew Estornell +1Recent Vision-Language ModelsData Quality

    1The Hong Kong University of Science and Technology (Guangzhou) · 2ByteDance Seed

  23. MedSkillAudit: A Domain-Specific Audit Framework for Medical Research Agent Skills

    Apr 22, 2026Yingyong Hou, Xinyuan Lao, Huimei Wang +10Inter-Annotator AgreementClinician Trust

    Department of Pathology, Zhongshan Hospital, Fudan University, Shanghai, China · 1AIPOCH PTE. LTD., Singapore

  24. Auditing and Controlling AI Agent Actions in Spreadsheets

    Apr 22, 2026Sadra Sabouri, Zeinabsadat Saghi, Run Huang +4SpreadsheetsModel Auditing

    University of Southern California Los Angeles, USA · California State Polytechnic University Pomona, USA · Microsoft Redmond, USA

  25. Taming Actor-Observer Asymmetry in Agents via Dialectical Alignment

    Apr 21, 2026Bobo Li, Rui Wu, Zibo Ji +5Large Language Model AgentsAsymmetry

    National University of Singapore · Sichuan University · University of Minnesota Twin Cities +2

  26. Co-Refine: AI-Powered Tool Supporting Qualitative Analysis

    Apr 21, 2026Athikash Jeyaganthan, Kai Xu, Franziska Becker +1Qualitative ResearchModel Auditing

    University of Nottingham Nottingham, United Kingdom · University of Stuttgart Stuttgart, Germany

  27. Semantic Needles in Document Haystacks: Sensitivity Testing of LLM-as-a-Judge Similarity Scoring

    Apr 20, 2026Sinan G. Aksoy, Alexandra A. Sabrio, Erik VonKaenel +1Large Language Model BiasLlm-As-A-Judge

    Pacific Northwest National Laboratory · Washington University in St. Louis · Humana Inc.

  28. Tight Auditing of Differential Privacy in MST and AIM

    Apr 20, 2026Georgi Ganev, Meenatchi Sundaram Muthu Selva Annamalai, Bogdan KulynychStandard Differential-PrivacyPrivacy

    1UCL · 2SAS · 3Lausanne University Hospital

  29. Committed SAE-Feature Traces for Audited-Session Substitution Detection in Hosted LLMs

    Apr 20, 2026Ziyang LiuCryptographic Merkle Tree CommitmentsModel Auditing

    Independent Researcher

  30. The Granularity Gap: A Multi-Dimensional Longitudinal Audit of Sycophancy in Gemini Models

    Apr 19, 2026Patrick KeoughSycophancyModel Auditing

    Independent Researcher Bremerton, WA, USA

  31. Auditing Support Strategies in LLMs through Grounded Multi-Turn Social Simulation

    Apr 18, 2026Michelle Star, Andrew Aquilina, Yu-Ru LinScaling Improve Social SimulationEmotional Support Conversation Task

    School of Computing and Information, University of Pittsburgh

  32. Beyond Black-Box Labels: Interpretable Criteria for Diagnosing Subjective NLP Tasks

    Apr 18, 2026Nisrine Rair, Alban Goupil, Valeriu Vrabie +1Human AnnotatorsDisagreement

    CReSTIC, Université de Reims Champagne-Ardenne, Reims, France · Chochoy Conseil, Reims, France

  33. Bias in the Loop: Auditing LLM-as-a-Judge for Software Engineering

    Apr 18, 2026Zixiao Zhao, Amirreza Esmaeili, Fatemeh FardLlm-As-A-JudgeSoftware Engineering

    University of British Columbia, Canada

  34. Don't Start What You Can't Finish: A Counterfactual Audit of Support-State Triage in LLM Agents

    Apr 17, 2026Eren UnluTriageLarge Language Model Agents

    Globeholder Paris, France

  35. Auditing Sabotage Bench: A Benchmark for Detecting and Fixing Research Sabotage in ML Codebases

    Apr 17, 2026Eric Gan, Aryan Bhatt, Buck Shlegeris +2SabotageCode Quality

    Redwood Research

  36. Rater State Bias in RLHF Preference Data: An Audit Framework

    Apr 14, 2026Elena Kopteva, Vitaliy Hlynianyi-ZhukReinforcement Learning From Human FeedbackRater

    The Grainger College of Engineering, Department of Physics & Illinois Center for Advanced Studies of the Universe, University of Illinois Urbana-Champaign, Urbana, Illinois 61801, USA · Faculty of Applied Mathematics, Oles Honchar Dnipro National University, Dnipro, 49045, Ukraine · Department of Clinical Psychology, Kyiv Institute of Modern Psychology and Psychotherapy, Kyiv, 01133, Ukraine

  37. Auditable Agents

    Apr 7, 2026Yi Nian, Aojie Yuan, Haiyue Zhang +7AccountabilityModel Auditing

    University of Southern California · Arizona State University · University of Tennessee, Knoxville +1

  38. Knowdit: Agentic Smart Contract Vulnerability Detection with Auditing Knowledge Summarization

    Mar 27, 2026Ziqiao Kong, Wanxu Xia, Chong Wang +6Smart ContractsDecentralized Finance

    Nanyang Technological University · Beihang University · Independent Researcher +4

  39. Learning When to Trust in Contextual Social Bandits

    Mar 9, 2026Majid Ghasemi, Mark CrowleyContextual Bandit FrameworkAI Trustworthiness

    Department of Electrical & Computer Engineering University of Waterloo, Canada

  40. MASRubric: Auditing Information Flow in Multi-Agent Systems with Failure-Distilled Pitfall Rubrics

    Feb 26, 2026Yutong Wang, Siyuan Xiong, Xuebo Liu +4Model-Based Multi-Agent SystemsModel Auditing

    Harbin Institute of Technology, Shenzhen · Alibaba Group

  41. AuditBench: Evaluating Alignment Auditing Techniques on Models with Hidden Behaviors

    Feb 26, 2026Abhay Sheshadri, Aidan Ewart, Elias Kempf +8Model AuditingArtificial Intelligence Alignment

    Anthropic Fellows Program · Anthropic

  42. Beyond Pixels: A Vector-to-Graph Framework for Reliable Schematic Auditing

    Feb 12, 2026Chengwei Ma, Zhen Tian, Zhou Zhou +5Structure-AwareGraph Representations

    Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Shenzhen, China · Guangdong Power Grid Co., Ltd., Yangjiang Power Supply Bureau, Yangjiang, China · Shanghai University, Shanghai, China +1

  43. Auditing Multi-Agent LLM Reasoning Trees Outperforms Majority Vote and LLM-as-Judge

    Feb 10, 2026Wei Yang, Shixuan Li, Heng Ping +3Multi-Agent ReasoningReasoning Benchmark

    University of Southern California

  44. Bypassing the Rationale: Causal Auditing of Implicit Reasoning in Language Models

    Feb 3, 2026Anish Sathyanarayanan, Aditya Nagarsekar, Aarush RathoreChain-of-Thought ReasoningReasoning Skills

    BITS Pilani, K. K. Birla Goa Campus

  45. Adversarial Reward Auditing for Active Detection and Mitigation of Reward Hacking

    Feb 2, 2026Mohammad Beigi, Ming Jin, Junshan Zhang +2Reinforcement Learning From Human FeedbackModel-Agnostic Defense

    Department of Computer Science, University of California, Davis, USA · Virginia Tech, Blacksburg, USA · Meta AI Research.

  46. Framing Instability in LLM Ethical Stance: Auditing Negation Sensitivity in Moral Dilemmas

    Jan 29, 2026Katherine Elkins, Jon ChunMoral ReasoningTask Framing

    Kenyon College Gambier, OH

  47. Unknown Unknowns: Do Hidden Intentions in LLMs Evade Detection?

    Jan 26, 2026Devansh Srivastav, David Pape, Lea SchönherrArtificial Intelligence DetectionArtificial Intelligence Governance

    CISPA Helmholtz Center for Information Security, Saarbrücken, Germany

  48. White-Box Sensitivity Auditing with Steering Vectors

    Jan 23, 2026Hannah Cyberey, Yangfeng Ji, David EvansModel AuditingLarge Language Model Evaluation

    University of Virginia

  49. Audit Me If You Can: Query-Efficient Active Fairness Auditing of Black-Box LLMs

    Jan 6, 2026David Hartmann, Lena Pohlmann, Lelia Hanslik +3Fairness AuditsLarge Language Model Bias

    Weizenbaum Institut Berlin · Technische Universität Berlin · FIZ Karlsruhe +2

  50. A framework for auditing grounding claims

    Dec 5, 2025Daniel Quigley, Eric MaynardContextual GroundingModel Auditing

    Center for Possible Minds Indiana University Bloomington Bloomington, IN 47408 · Eruditis Milwaukee, WI 53207

  51. Auditing Information Disclosure During Large-Scale Gradient-Based Training via Gradient Uniqueness

    Oct 13, 2025Sleem Abdelghafar, Maryam Aliakbarpour, Christopher JermaineGradient-Based AttacksMembership Inference Attacks

    Rice University Houston, USA

  52. Data Provenance Auditing of Fine-Tuned Large Language Models with a Text-Preserving Technique

    Oct 7, 2025Yanming Li, Cédric Eichler, Nicolas Anciaux +3Large Language Model WatermarksMachine-Generated Text Detection

    PETSCRAFT · Petscraft, Inria, Palaiseau, France · INSA CVL, Bourges, France +6

  53. WirelessMathBench-XL: An Auditable Benchmark for Wireless Mathematical Reasoning

    Sep 27, 2025Xin Li, Mengbing Liu, Yiyang Zhu +4Mathematical Reasoning BenchmarksModel Auditing

    Nanyang Technological University

  54. Do Modern Video-LLMs Need to Listen? A Benchmark Audit and Scalable Remedy

    Sep 22, 2025Geewook Kim, Minjoon SeoAudio-Visual ReasoningSpeech Encoder

    NAVER Cloud AI, South Korea · KAIST AI, South Korea

  55. Optimizing Canaries for Privacy Auditing with Metagradient Descent

    Jul 21, 2025Matteo Boglioni, Terrance Liu, Andrew Ilyas +1Stochastic Gradient DescentMembership Inference Attacks

    Carnegie Mellon University · Stanford Statistics

  56. DelistBench: Evaluating Search-Enabled LLMs for Auditable Corporate-Event Database Completion

    Date pendingXuan Yao, Shuping Li, Yang Dai +2Model AuditingSecurity Evaluation

    Asian Institute of Digital Finance, National University of Singapore, Singapore

  57. When Auditors Fabricate: Batch-Size Degradation and Confident Hallucination in LLM Detection of Planted Document Contamination

    Date pendingKaran Parekh, Sanjana Pendyala Ravinder, Sana Mhapsekar +1Large Language Model EvaluationMachine-Generated Text Detection

    University of North Texas

  58. FaultLens: Learning Compact Behavioral Test Suites for Generated Operational Programs

    Date pendingZeming Liu, Hang Lyu, Jingtao ZhangModel AuditingLens

    Independent Researchers