Search research

Topics & fields

Mechanistic Interpretability434 papers Model Interpretability269 papers Mechanistic Interpretability158 papers Interpretable Models38 papers Interpretable Diabetic Retinopathy Grading25 papers Interpretive Openness25 papers

5,761–5,790 of 5,970

Papers

Social Caption: Evaluating Social Understanding in Multimodal Models
Jan 21, 2026Leena Mathur, Bhaavanaa Thumu, Youssouf Kebe +1Multimodal Learning Large Language Model Evaluation
No Reliable Evidence of Self-Reported Sentience in Small Large Language Models
Jan 20, 2026Caspar Kaiser, Sean EnderbySmall Language Models Model Interpretability
DSAEval: Evaluating Data Science Agents on a Wide Range of Real-World Data Science Problems
Jan 20, 2026Maojun Sun, Yifei Xie, Yue Wu +5Evaluation Benchmarks Flash
AMVICC: A Novel Benchmark for Cross-Modal Failure Mode Profiling for VLMs and IGMs
Jan 20, 2026Aahana Basappa, Pranay Goel, Anusri Karra +3Visual Reasoning Cross-Modal Learning
ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation
Jan 19, 2026Jesus-German Ortiz-Barajas, Jonathan Tonglet, Vivek Gupta +1Multi-Modal Large Language Models Attacker-Chosen Wrong Answer
Tracing the Latent Threads: A Mechanistic Study of How LLMs Represent and Operationalize Race and Ethnicity Cues
Jan 19, 2026Shiyue Hu, Ruizhe Li, Yanjun GaoLarge Language Model Bias Large Language Model Performance
Replayable Financial Agents: A Determinism-Faithfulness Assurance Harness for Tool-Using LLM Agents
Jan 17, 2026Raffi KhatchadourianMulti-Turn Tool-Use Agent
GenDA: Generative Data Assimilation on Complex Urban Areas via Classifier-Free Diffusion Guidance
Jan 16, 2026Francisco Giral, Álvaro Manzano, Ignacio Gómez +2Data Assimilation Urban Wind
Auditing Frozen-Encoder Anomaly Detection Across Mechanical Systems: Representation Provenance, Calibration, and Protocol Effects
Jan 16, 2026Jose Sánchez AndreuAnomaly Score Content Provenance
CROCS: A Two-Stage Clustering Framework for Behaviour-Centric Consumer Segmentation with Smart Meter Data
Jan 15, 2026Luke W. Yerbury, Ricardo J. G. B. Campello, G. C. Livingston +2Demand Response Image Clustering
Graph Regularized PCA
Jan 15, 2026Antonio Briola, Marwin Schmidt, Fabio Caccioli +4Principal Component Analysis Graph Representation Learning
Resolving Predictive Multiplicity for the Rashomon Set
Jan 14, 2026Parian Haghighat, Hadis Anahideh, Cynthia RudinMultimodal Classification Interpretable Models
M3CoTBench: Benchmark Chain-of-Thought of MLLMs in Medical Image Understanding
Jan 13, 2026Juntao Jiang, Jiangning Zhang, Yali Bi +7Medical Visual Question Answering Diagnostic Benchmark
Neural Architectures for Amortized Bayesian Inference: Statistical Foundations and Empirical Assessments
Jan 12, 2026Roy Shivam Ram Shreshtth, Arnab Hazra, Gourab MukherjeeBayesian Neural Networks Bayesian
Learning to bin: differentiable and Bayesian optimization for multi-dimensional discriminants in high-energy physics
Jan 12, 2026Johannes Erdmann, Nitish Kumar Kasaraguppe, Florian MausolfBayesian Optimization
WebCryptoAgent: Agentic Crypto Trading with Web Informatics
Jan 8, 2026Ali Kurban, Wei Luo, Liangyu Zuo +5Decentralized Finance Stochastic Volatility
Survival Dynamics of Neural and Programmatic Policies in Evolutionary Reinforcement Learning
Jan 7, 2026Anton Roupassov-Ruiz, Yiyang ZuoSurvival Analysis
Who Laughs with Whom? Disentangling Influential Factors in Humor Preferences across User Clusters and LLMs
Jan 6, 2026Soichiro Murakami, Hidetaka Kamigaito, Hiroya Takamura +1Humor Large Language Model Bias
Hidden State Poisoning Attacks against Mamba-based Language Models
Jan 5, 2026Alexandre Le Mercier, Chris Develder, Thomas DemeesterLanguage Model Evasion Attacks Bidirectional Mamba
ELF: A Family of Encoder-Free ECG-Language Models
Jan 5, 2026William Han, Tony Chen, Chaojing Duan +6Pediatric-Adult Electrocardiogram Alignment Ear
An Agentic Framework for Neuro-Symbolic Programming
Jan 2, 2026Aliakbar Nafar, Chetan Chigurupati, Danial Kamali +2Neuro-Symbolic Framework Modular Agentic Framework
RIMRULE: Improving Tool-Using Language Agents via MDL-Guided Rule Learning
Dec 31, 2025Xiang Gao, Yuguang Yao, Qi Zhang +5Large Language Model Adaptation Injecting
Gradient Descent as Implicit EM in Distance-Based Neural Models
Dec 31, 2025Alan OurslandExpectation-Maximization Gradient Descent
Evolutionary Physics-Informed Temporal Fusion for Lane-Change Intention Prediction
Dec 30, 2025Jiazhao Shi, Qiyang Xie, Ziyu Wang +7Autonomous Driving Temporal Fusion Transformer
MUSON: A Reasoning-oriented Multimodal Dataset for Socially Compliant Navigation in Urban Environments
Dec 28, 2025Zhuonan Liu, Xinyu Zhang, Zishuo Wang +8Vision-Language Navigation Multimodal Dataset
Constituency Structure over Eojeol in Korean Treebanks
Dec 27, 2025Jungyeul Park, Chulwoo ParkKorean Morphology
GeCo: Evaluating Geometric Consistency for Video Generation via Motion and Structure
Dec 25, 2025Leslie Gu, Junhwa Hur, Charles Herrmann +4Large-Scale Video Generation Models Occlusion
EvoXplain: When Machine Learning Models Agree on Predictions but Disagree on Why -- Measuring Mechanistic Multiplicity Across Training Runs
Dec 23, 2025Chama BensmailExplainability Machine Learning
DEER: A Benchmark for Evaluating Deep Research Agents on Expert Report Generation
Dec 19, 2025Janghoon Han, Heegyu Kim, Changho Lee +6Deep Research Llm-As-A-Judge
AdaSearch: Balancing Parametric Knowledge and Search in Large Language Models via Reinforcement Learning
Dec 18, 2025Tzu-Han Lin, Wei-Lin Chen, Chen-An Li +3Search Agents

Jan 21, 2026 · cs.CLJ/K move · Enter open · S save

Social Caption: Evaluating Social Understanding in Multimodal Models

Leena Mathur, Bhaavanaa Thumu, Youssouf Kebe, Louis-Philippe Morency

School of Computer Science, Carnegie Mellon University

Social understanding abilities are crucial for multimodal large language models (MLLMs) to interpret human social interactions. We introduce SOCIAL CAPTION, a framework grounded in interaction theory to evaluate social understanding abilities of MLLMs along three dimensions: Social Inference (SI), the ability to make accurate inferences about interactions; Holistic Social Analysis (HSA), the ability to generate comprehensive descriptions of interactions; Directed Social Analysis (DSA), the ability to generate relevant information from interactions. We analyze factors influencing model performance in social understanding, such as scale, architectural design, and spoken context. Experiments with MLLM judges demonstrate a path towards scaling automated evaluation of multimodal social understanding.

Multimodal Learning Large Language Model Evaluation Inferring

Open paper Ask about it PDF