Black-Box Model Auditing

Follow this topic Ask about this topic

Momentum

12 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 65

All topics

PairAudit: Guiding Human Review with Graph Tokens under Distribution Shift
Oct 7, 2026Jiran Tao, Binyan JiangNetwork Intrusion Detection Black-Box Model Auditing
The Hong Kong Polytechnic University
What Does an Observability Foundation Model Know?
Oct 4, 2026Dhyey Dharmendrakumar Mavani, Rian Atri, Tairan JiTime Series Forecasting Representation Probing
Independent · Keiji AI
Beyond Answer Confidence: A Controlled Audit of Self-Knowledge in a Black-Box Decision Model
Oct 1, 2026Sharath M Shankaranarayana, Davor Runje, Jan JanninkProbability Calibration Black-Box Model Auditing
Efficient Active Auditing of Multi-Group Fairness with Bias Probes
Sep 30, 2026Ayoub Ajarra, Debabrota BasuAlgorithmic Fairness Group Fairness
´Equipe Scool, Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189- CRIStAL
VStress: Correlation-Aware Auditing and Adaptive Budget Allocation for Repeated Verifiers
Sep 29, 2026Miaobo Hu, Shuhao Hu, Xiaobo Guo +5Algorithmic Auditing Black-Box Model Auditing
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China · Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China
PhysioTRACE: Provenance-Aware Stress Tests for Physiological Foundation Models
Sep 28, 2026Ayana Mussabayeva, Anuar Aimoldin, Olivier Oullier +2Data Provenance Electrocardiogram Foundation Models
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, UAE · McGill University, Montreal, Canada · Carnegie Mellon University, Pittsburgh, USA
Auditing Agent Actions through Query-Conditioned Attribution
Sep 27, 2026Yifan Liu, Praveen Venkateswaran, Abdulhamid Adebayo +1Gradient-Based Attribution AI Agent Benchmarks
University of Illinois Urbana-Champaign · IBM
When Temporal Perturbations Act Like Sensor Biases: Label-Free Auditing of Wearable Activity Recognizers
Sep 24, 2026Qingyu Wu, Yuan Wei, Renju Liu +1Human Activity Recognition Adversarial Attacks
Defense Innovation Institute, Academy of Military Science, Beijing, China · School of Software Engineering, South China University of Technology, Guangzhou, China
The Delegation Blind Spot: Auditing Product Decisions from Agent Choices
Sep 22, 2026Shivam GuptaAI Agent Auditing Partial Identification
Independent Research
Trust, but Validate the Instrument: Auditing AI-Generated RTL Verification Plans on Authored Security-Regression Proxies
Sep 17, 2026Hang Xiao, Chuhong Xu, Kainan Zhou +2Formal Hardware Verification LLM Auditing
Fortinet, Inc. Sunnyvale, CA, USA · Sony Corporate of America San Jose, CA, USA · Google LLC Mountain View, CA, USA
Membership Inference via Pairwise Likelihood Ratios
Sep 14, 2026Shengjie Niu, Zebin Yun, Yeheng Ge +1Membership Inference Attacks Black-Box Model Auditing
The Hong Kong Polytechnic University, Hong Kong, China · Tel Aviv University, Israel
Interpolation Is Not Invariance: Pair Count Is Not Coverage in Transformation Audits
Sep 14, 2026Mohammed Ahnouch, Lotfi ElaachakAlgorithmic Auditing Black-Box Model Auditing
Université Paris 1 Paris, France · Faculty of Science and Technology of Tangier Abdelmalek Essaadi University Tangier, Morocco
The Audit Decides the Verdict: Instrument Effects Rival Demographic Bias in LLM Decision Audits
Sep 8, 2026Siddharth Vohra, Manikandan RavikiranLanguage Model Bias Evaluation Demographic Bias in Language Models
Carnegie Mellon University Amazon Web Services AI Native Pittsburgh, PA, USA · Indian Institute of Technology Mandi, India
Clean Engineering, Unstable Measurement: A Preregistered Reliability Failure of Black-Box LLM Observers on Shared Endpoints
Sep 3, 2026Haoyaun Zhu, Jie ZhangLLM Evaluation LLM-as-a-Judge
School of Electronic and Electrical Engineering, University of Sheffield, Sheffield S10 2TN, UK · R&D Department, Ranplan Wireless Network Design Ltd., Cambridge CB23 3UY, UK · R&D Department, Cambridge AI+ Ltd., Cambridge CB23 3UY, UK
Rent-a-RAG: Embedding-Space Watermarks for Auditing Third-Party RAG
Sep 3, 2026Alexandr Goultiaev Tolstokorov, Kyriakos Mouratidis, Javad Dogani +1Dataset Watermarking RAG Security
IMDEA Networks Institute, Madrid, Spain · Universidad Carlos III de Madrid, Madrid, Spain · Singapore Management University, Singapore
Auditing Anonymous AI Models: A Four-Stage Protocol for Black-Box Identity Verification
Aug 31, 2026Yisen XiLanguage Model Fingerprinting Black-Box Model Auditing
Independent Researcher, Beijing, China
BLOOM-WILT: Logit Tilting for Behaviour Elicitation in Automated LLM Auditing
Aug 31, 2026Adrians Skapars, Edoardo ManinoLanguage Model Steering Language Model Safety Evaluation
University of Manchester, United Kingdom
Not to Break, but to Attest: Adversarial Probes for Privacy-Preserving LLM Verification
Aug 28, 2026Cameron Wilding, Mina Shaker, Fatemeh GanjiLLM Auditing Privacy-Preserving ML
Worcester Polytechnic Institute Worcester, MA, USA
When Explanations Betray Backdoors: Black-Box Auditing for Language Model Classifiers
Aug 12, 2026Yang Liu, Ran ZouLLM Backdoor Attacks Backdoor Detection
Department of Statistics and Operations Research, University of North Carolina at Chapel Hill · Department of Statistics, University of California, Irvine
Relational Response Fields: A General Theory of Black-Box LLM Response Consistency and Recovery
Aug 5, 2026Song ZichenLLM Reliability Corruption Robustness
Sungkyunkwan University
Manipulation-Proof Oblivious Audits against Deceptive Model Providers
Aug 5, 2026Augustin Godinot, Sofiane Azogagh, Julien Ferry +1Algorithmic Fairness Black-Box Model Auditing
1INRIA Centre de l’Universit´e de Rennes, France · 2EURECOM, Sophia Antipolis, France · 3CIRRELT & SCALE-AI Chair in Data-Driven Supply Chains, Department of Mathematics and Industrial Engineering, Polytechnique Montr´eal, Canada +1
Auditing Data Provenance in LLM Fine-tuning via Intrinsic Distributional Fingerprints
Aug 3, 2026Zirui Huang, Yunlong Mao, Wei Tong +3Language Model Fingerprinting Training Data Attribution
State Key Laboratory of Novel Software Technology, Nanjing University Nanjing, Jiangsu, China
Latent-Regime Bias Auditing for Volatility Forecasting
Aug 3, 2026Arthur Chagas, Pedro Bento, Yan Aquino +3Time Series Forecasting Financial Time Series
Department of Computer Science Universidade Federal de Minas Gerais – UFMG Belo Horizonte, Brazil
When May a Model Replace the Experiment? Audits, Licenses, and the Price of Trust in Surrogate-Driven Design
Aug 2, 2026Shuangxiu, Ma, Wenhe +1Surrogate Modeling Surrogate-Assisted Optimization
Max · William G. Lowrie Department of Chemical and Biomolecular Engineering, The Ohio State University, Columbus, Ohio 43210, United States · Zachary +1
Two Regimes of Chain-of-Thought Unfaithfulness: Behavioral Detection Fails Where Models Are Wrong
Jul 26, 2026Suramya R. Angdembay, Dikshant Aryal, Nick RahimiCoT Faithfulness CoT Evaluation
The University of Southern Mississippi
Certified in Theory, Broken in Practice: Assumption Gaps in Cryptographic Model Certification
Jul 23, 2026Carter Luck, Olive Franzese-McLaughlin, Elisaweta Masserova +3Privacy-Preserving ML Black-Box Model Auditing
University of Massachusetts Amherst · Vector Institute · University of Toronto +3
HindsightBench: A Black-Box Behavioral Audit Protocol for Parametric Hindsight in Time-Indexed LLM Decision Tasks
Jul 21, 2026Haozhe JiaLLM Auditing Temporal Data Leakage
University College Dublin
Bet on Features: Anytime-Valid and Feature-Aware Auditing of Conditional Quantile Forecasters
Jul 13, 2026Ivane Antonov, Sohom Mukherjee, Richard Pibernik +1Quantile Regression Sequential Hypothesis Testing
Julius-Maximilians-Universität Würzburg · INSEAD
Overthinking: Amplifying Reasoning Weights to Extract Learned Secrets
Jul 9, 2026Jack Hopkins, Dipika Khullar, Fabien RogerOverthinking in Language Models Privacy Leakage in Language Models
Anthropic Fellows Program · MATS · Anthropic.
SHARC: SHAP-Based Interpretability in Machine Learning Risk Models for Regulatory Capital under ICAAP and CCAR
Jul 6, 2026Ujjwala VadrevuAI Risk Management Black-Box Model Auditing
Agent Step Value: Auditing Evaluator-Channel Reversals in Black-Box Agent Traces
Jul 5, 2026Andrew Zhang, Chengzhan LiLLM Agent Evaluation AI Agent Evaluation
KTH Royal Institute of Technology · University of Electronic Science and Technology of China
Aionoscope: Debugging Latent-State Accessibility in Time-Series Representations
Jul 1, 2026Alexander Chemeris, Ming Jin, Randall BalestrieroSynthetic Benchmark Generation Time Series Representation Learning
Langotime South Africa · Griffith University Australia · Brown University United States
Using AI Agents to Automate Black-Box Audits of Personalization Algorithms at Scale
Jun 29, 2026Alessandro Morosini, Sarah H. Cen, Andrew Ilyas +3Algorithmic Auditing Algorithmic Bias
Massachusetts Institute of Technology · Carnegie Mellon University
Sequential Fairness Auditing with Limited Output Access
Jun 29, 2026Ioannis Pitsiorlas, Martha V. Sourla, Marios KountourisAlgorithmic Fairness Group Fairness
EURECOM, France · DaSCI, University of Granada, Spain
RECAST: Model Reconstruction via Counterfactual-Aware Wasserstein Geometry under Limited Data
Jun 26, 2026Xuan Zhao, Lena Krieger, Zhuo Cao +3Surrogate Modeling Model Extraction Attacks
IAS-8, Forschungszentrum Jülich, Germany · LMU Munich, Munich Center for Machine Learning (MCML), Germany · Department of Computer Science, Aarhus University, Denmark
Where Black-box Drug-Target Interaction Prediction Models Look: Cross-Method Explainability
Jun 12, 2026Ali Vefghi, Zahed Rahmati, Mohammad AkbariFeature Attribution Explainability Evaluation
Department of Mathematics and Computer Science, Amirkabir University of Technology, Tehran, Iran
A prior-free blind detection of information leakage from model predictions
Jun 9, 2026Laurence A. JacobsData Leakage Black-Box Model Auditing
Center for Molecular Cardiology, University of Zurich, Zurich, Switzerland · Center for Complexity Sciences, National University of Mexico, Mexico City, Mexico
Pretrained, Frozen, Still Leaking: Auditing Cross-Encoder Attribute Transfer in EEG Foundation Models
Jun 8, 2026Jianwei TaiData Leakage Adversarial Attacks
School of Internet, Anhui University
Evaluating AI Investment Strategies
Jun 7, 2026Irene AldridgeAlgorithmic Auditing Policy Evaluation
Auditing Proprietary Alignment in Large Language Models: A Comparative Framework Without a Ground-Truth Standard
Jun 7, 2026Alireza Arbabi, Florian KerschbaumLLM Alignment LLM Auditing
Department of Computer Science, University of Waterloo, Waterloo, ON, Canada · Vector Institute, Toronto, ON, Canada
MC-PDD: Masked Corpus-Level Pretraining Data Detection for Black-Box Large Language Models
Jun 6, 2026Kaixin Lan, Mu You, Tao Fang +3Membership Inference Attacks LLM Auditing
Natural Language Processing & Portuguese-Chinese Machine Translation (NLP2CT) Laboratory, University of Macau, Macau SAR, China · Institute of International Language Services Studies, Macau Millennium College, Macau SAR, China · Innovation Research & Development, BoardWare Information System Limited
Is My Vision-Language Data in Your AI? Membership Inference Test (MINT) Demo 2
Jun 5, 2026Daniel DeAlcala, Gonzalo Mancera, Julian Fierrez +3Membership Inference Attacks Privacy Leakage in Language Models
BiometricsAI, Universidad Aut´onoma de Madrid, Spain
Auditing Near-Optimal Policies Can Be Exponentially Hard: Conditional Query Lower Bounds via Occupancy Rashomon Capacity
May 29, 2026Ibne Farabi Shihab, Sanjeda Akter, Anuj SharmaInformation-Theoretic Lower Bounds Black-Box Model Auditing
Department of Computer Science, Iowa State University · Department of Civil, Construction & Environmental Engineering, Iowa State University
Token Inflation: How Dishonest Providers Can Overcharge for Large Language Model Usage
May 28, 2026Shahinul Hoque, Jinghuai Zhang, Jinyuan Sun +1LLM Auditing Black-Box Model Auditing
University of Tennessee, Knoxville · University of California, Los Angeles
Auditing Training Data in Generative Music Models via Black-Box Membership Inference
May 28, 2026Yi Chen Liu, Jiawei Yu, Kexin Cao +3Text-to-Music Generation Membership Inference Attacks
University of Georgia, Athens, GA, USA · Independent Researcher · University of Tennessee, Knoxville, TN, USA
Symmetry Defeats Auditing
May 27, 2026Nick Merrill, Zeke MedleyAlgorithmic Auditing Adversarial Attacks
UC Berkeley · Forecasting Research Institute · Northeastern University
Auditing and Fixing Economic Validity in Tabular Foundation Models for Discrete Choice
May 26, 2026Yingshuo Wang, Xian Sun, Yanhang Li +2Tabular Foundation Models Discrete Choice Modeling
University of California, Berkeley, CA, USA · Duke University, Durham, NC, USA · Northeastern University, Boston, MA, USA +2
Unlocking Apple's Private Cloud Compute: An Analysis of Privacy-Preserving Artificial Intelligence
May 22, 2026Yannik Dittmar, Marvin Jerome Stephan, Thomas Völkl +2Privacy Auditing Privacy-Preserving Language Models
Hasso Plattner Institute, University of Potsdam Potsdam, Germany · TU Darmstadt, Secure Mobile Networking Lab Darmstadt, Germany · TU Darmstadt, Secure Mobile Networking Lab, Darmstadt, Germany +1
Optimal Guarantees for Auditing Rényi Differentially Private Machine Learning
May 21, 2026Benjamin D. Kim, Lav R. Varshney, Daniel AlabiPrivacy Auditing Black-Box Model Auditing
University of Illinois Urbana-Champaign · 1Massachusetts Institute of Technology · Brook University
I-SAFE: Wasserstein Coherence Metrics for Structural Auditing of Scientific AI Models
May 20, 2026Barbara Tarantino, Gennaro Auricchio, Paolo GiudiciAlgorithmic Auditing Black-Box Model Auditing
Department of Economics, University of Pavia, Via S. Felice Al Monastero, 5, Pavia, 27100, Italy · Department of Mathematics, University of Padua, Via Trieste, 63, Padua, 35131, Italy
How Do Document Parsers Break? Auditing Structural Vulnerability in Document Intelligence
May 19, 2026Yue Chen, Yihao Wang, Ziyi Tang +2Document Parsing Document Layout Analysis
Sun Yat-sen University · Chaotic Pendulum Lab · Nanyang Technological University
Position: Behavioural Assurance Cannot Verify the Safety Claims Governance Now Demands
May 14, 2026Pratinav Seth, Vinay Kumar SankarapuAI Assurance AI Governance
Lexsi Labs
Architecture-Aware Explanation Auditing for Industrial Visual Inspection
May 14, 2026Sibo Jia, Zihang Zhao, Kunrong LiIndustrial Inspection Explainability Evaluation
Dublin College, Beijing University of Technology, Beijing, P.R. China · College of Computer Science, Beijing University of Technology, P.R. China
Black-box model classification under the discriminative factorization
May 8, 2026Hayden Helm, Merrick Ohata, Carey PriebeClassification Black-Box Model Auditing
Helivan · JHU
Beyond the Wrapper: Identifying Artifact Reliance in Static Malware Classifiers using TRUSTEE
May 7, 2026Riyazuddin Mohammed, Lan ZhangMalware Classification Malware Analysis
School of Informatics, Computing, and Cyber Systems
Narrow Secret Loyalty Dodges Black-Box Audits
May 7, 2026Alfie Lamerton, Fabien RogerData Poisoning Attacks Black-Box Model Auditing
Formation Research
ISAAC: Auditing Causal Reasoning in Deep Models for Drug-Target Interaction
May 3, 2026Barbara Tarantino, Sun Kim, Yijingxiu Lu +1Reasoning Evaluation Causal Interpretability
Department of Economics and Management, University of Pavia, Pavia, Italy · Department of Computer Science and Engineering, Seoul National University, Gwanak-gu 08826, Korea.
Bounding the Black Box: A Statistical Certification Framework for AI Risk Regulation
Apr 23, 2026Natan Levy, Gadi PerlAI Assurance AI Risk Management
School of Computer Science and Engineering The Hebrew University of Jerusalem(HUJI) Jerusalem, Israel · dept. name of organization (of Aff.) The Hebrew University of Jerusalem(HUJI) Jerusalem, Israel
Behavioral Consistency and Transparency Analysis on Large Language Model API Gateways
Apr 22, 2026Guanjie Lin, Yinxin Wan, Shichao Pei +3LLM Auditing Black-Box Model Auditing
University of Massachusetts Boston · Boston, Massachusetts, USA · Arizona State University +2
Identifying Ethical Biases in Action Recognition Models
Apr 20, 2026Ana Baltaretu, Pascal Benschop, Jan van GemertHuman Activity Recognition Algorithmic Fairness
1EEMCS, Delft University of Technology, The Netherlands

Oct 7, 2026, cs.LGJ/K move · Enter open · S save

PairAudit: Guiding Human Review with Graph Tokens under Distribution Shift

Jiran Tao, Binyan Jiang

The Hong Kong Polytechnic University

Network Intrusion Detection Black-Box Model Auditing Anomaly Detection OOD Detection

Open paper AskPDF arXiv

Intrusion detectors can confidently misclassify attacks that were not seen during training. Human review can correct these errors, but only a limited number of cases can be checked. Uncertainty-based review may overlook confident errors, while anomaly scores alone do not show whether changing the review plan will correct more errors. We introduce PairAudit to find overlooked errors and improve review under a fixed budget. Its graph tokens capture prediction patterns across connected nodes. Rather than building another predictor through feature aggregation, PairAudit uses unusual relational patterns to uncover potential errors in existing predictions. Human feedback then helps decide whether these findings justify changing review priorities. Experiments across security tasks show that PairAudit corrects more errors on average than uncertainty-based review, including more errors on unseen attacks. These gains account for all review costs and do not require retraining the detector.

Momentum

Related topics

Latest papers 65