cs.CLAug 25, 2026

A Primer on Computational Semantics for Artificial Intelligence Systems

Authors: Casey Kennington

Organizations: Computer Science Boise State University

Abstract

As people adopt transformer-based language models (e.g., ChatGPT and Gemini) for an increasing number of use-cases, it is important to know how such models learn and represent the meaning of the language, and to be more informed about what language is. This document is an attempt to help the reader understand how linguistic meaning (i.e., semantics) is approached from different fields of scientific and philosophical examination. I also explain three primary semantic theories: formal semantics, grounded semantics, and distributional semantics then compare how transformer-based language models differ from how humans learn language.

Explore similar work

CardsList
  1. When transformers learn "impossible" languages, what do they learn?

    Jun 29, 2026Ram Janarthan, Coleman Haley, Sharon GoldwaterLinguistic Bias in Language ModelsText Generation

  2. Humans and transformer LMs: Abstraction drives language learning

    Mar 18, 2026Jasper Jian, Christopher D. ManningLLM TrainingLanguage Model Pretraining