cs.CLJul 25, 2026

Speech Signals Complement LLMs for Predicting Interpersonal Attraction in Speed Dating

Authors: Yuriko KikuchiTakato HayashiRyusei KimuraNaoya InoueRyo IshiiShogo Okada

Organizations: Japan Advanced Institute of Science and Technology · Nomi, Ishikawa, Japan · NTT, Inc. · Yokosuka, Kanagawa, Japan

Abstract

Large language models (LLMs) can predict interpersonal attraction from conversation transcripts, but it remains unclear what a speech predictor can add beyond transcript-only LLM prediction. Using Japanese speed-dating conversations, we combine predictions from a transcript-only LLM and a supervised speech predictor to estimate participants' reported liking of their partners. We show that speech can complement transcript-only LLM prediction, but that this complementarity is conditional rather than universal. Combining the two predictions significantly improves pairwise ranking accuracy over the transcript-only LLM alone in all evaluated conditions. By contrast, gains in per-participant Pearson rr vary across conversation rounds and rating directions, with none significant after correction. Retrospectively, these rr gains are concentrated among participants for whom the speech predictor is more accurate. Speech can therefore retain predictive value even when an LLM predicts attraction from transcripts. The relevant question is not simply whether speech helps, but where its complementarity emerges.

Explore similar work

CardsList
  1. Predicting Psychological Well-Being from Spontaneous Speech using LLMs

    May 11, 2026Erfan Loweimi, Sofia de la Fuente Garcia, Saturnino LuzContextual Cues