cs.CVNov 4, 2026

MATA: Motion-aligned Temporal Adapter

Authors: Ashish Kumar Singh, Prakash Chandra Chhipa

Organizations: Scalable Systems, RISE Research Institutes of Sweden, Sweden

Abstract

Few-shot fine-grained video action recognition requires recognizing novel action classes from only a few labeled examples. The difficulty is that visually similar actions often share actors, scenes, poses, and objects, differing only in the order, timing, and short duration of motion changes. We study this problem under three practical constraints: few tunable parameters, low compute cost, and use of the video modality alone. We propose Motion-aligned Temporal Adapter (MATA), a parameter-efficient adapter on top of a frozen CLIP backbone. MATA specializes CLIP features along the temporal dimension using two components: temporal phase alignment through learnable temporal positional embeddings, and a local motion transition operator through depth-wise convolution. With only ~3.6M tunable parameters, MATA achieves state-of-the-art performance across multiple fine-grained benchmarks while remaining robust to both visual corruptions and temporal disruptions induced by frame dropping. Code is available at https://github.com/prakashchhipa/MATA-Motion-aligned-Temporal-Adapter

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Frame2Freq: Spectral Adapters for Fine-Grained Video Understanding

    Feb 21, 2026Thinesh Thiyakesan Ponbagavathi, Constantin Seibold, Alina RoitbergFine-Grained Action UnderstandingVideo Action Recognition

  2. EV-CLIP: Efficient Visual Prompt Adaptation for CLIP in Few-shot Action Recognition under Visual Challenges

    Apr 24, 2026Hyo Jin Jon, Longbin Jin, Eun Yi KimVLM AdaptationDomain Generalization

  3. Motion-Guided Semantic Alignment with Negative Prompts for Zero-Shot Video Action Recognition

    Apr 18, 2026Yiming Wang, Frederick W. B. Li, Jingyun WangRepresentation LearningVideo Action Recognition