cs.CLSep 27, 2026

Classifying Dominant Temporal Orientation without Pretrained Text Embeddings: A Novel Morphosyntactic Inventory Vector Approach

Authors: Jonathan Cleveland, Peter S. Bearman

Organizations: Interdisciplinary Center for Innovative Theory and Empirics, Columbia University, New York, NY 10115, Department of Sociology, Columbia University, New York, NY 100271

Abstract

Computational methods have consistently struggled to determine the dominant temporal orientation of a sentence. This difficulty is especially pronounced when a sentence contains multiple embedded clauses with competing tense and aspectual information. To address this difficulty, we propose an alternative approach for identifying a sentence's past, present, or future global reference interval. Our method does not use any form of pretrained embeddings. We rather encode sentences using fixed-length inventory vectors that are comprised of part-of-speech counts, dependency relation counts, and explicit futurate pattern counts. We term this inventory vector of a sentence a "Morphosyntacton". The method does not use any padding, sequence models, or large language models. Evaluation on 1,799 syntactically complex English sentences, annotated as past, present or future, shows balanced and high accuracy multiclass classification, achieving an overall multi-class accuracy of 92%.

Explore similar work

CardsList
  1. Uncovering Temporal Framing in the News

    May 29, 2026Tarek Mahmoud, Veronika Solopova, Premtim Sahitaj +7Multilingual Text Classification

  2. Recovering Temporal and Geographic Signals from Language Model Embeddings

    Sep 4, 2026Esteban Feuerstein, Victoria Klimkowski, Juan Manuel Ortiz de Zarate +1Text Embedding ModelsLLM Interpretability

  3. TEMPS: Temporal Sentence Embeddings for Temporal Information Retrieval

    Sep 23, 2026Mourad Hassani, Julien Romero, Amel Bouzeghoub +1Sentence EmbeddingsTemporal IR