cs.CVNov 8, 2026

MICE: Multi-animal Interaction Context Encoder - A Hierarchical Foundation Model for Mouse Behavior

Authors: Yen-Shuo Su, Weihan Li, Anqi Wu

Organizations: Georgia Institute of Technology, Atlanta, GA, USA

Abstract

Quantifying mouse behavior from pose is a foundational tool in neuroscience, ethology, drug discovery, and animal welfare. Self-supervised foundation models are a natural fit, but a foundation model for mouse behavior must handle social behavior - many behaviors that matter (aggression, courtship, mounting, allogrooming) are inherently multi-animal. Existing self-supervised pose models fall short: they encode each animal independently and discard interaction signal, hard-code the animal count, and pretrain one dataset at a time. We introduce MICE (Multi-animal Interaction Context Encoder), a hierarchical foundation model for mouse behavior that pretrains jointly on six mouse-pose corpora spanning one to four mice and 7 to 27 keypoints. MICE combines a hierarchical individual encoder capturing per-mouse kinematics at multiple temporal scales with a Perceiver-style social encoder whose learned latent codebook decouples parameter count from animal count, so a single checkpoint serves any group size without retraining. Across four evaluation protocols spanning six datasets, MICE matches or exceeds prior keypoint-based baselines, and layer-wise probing shows the social stage incrementally improves discriminability beyond the individual encoder. Code, weights, and data are available at https://github.com/eric0708/MICE.

Figures & tables

Appendix figures & tables17 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. MTT-Bench: Predicting Social Dominance in Mice via Multimodal Large Language Models

    Apr 24, 2026Yunquan Chen, Haoyu ChenMultimodal Large Language ModelsSocial Reasoning

  2. Modeling Fly Social Behavior with Agent-Centric Pose Forecasting

    Jul 21, 2026Eyrun Eyjolfsdottir, Kristin BransonMulti-Agent Trajectory PredictionAnimal Behavior Analysis