cs.AINov 7, 2026

SituRecBench: Evaluating Frontier Models as Situated Recommendation Assistants in 3D Environments

Authors: Jingtong Yang, Dongding Lin, Jian Wang, Wenjie Li

Organizations: Department of Computing, The Hong Kong Polytechnic University · College of Computer Science, Sichuan University

Abstract

Recommender systems are transitioning from static retrieval engines into interactive assistants grounded in physical environments. However, current studies largely neglect the combined complexities of spatial navigation, visual grounding, and multi-turn social interaction. To bridge this gap, we introduce SituRecBench, an interactive benchmark for evaluating frontier vision-language models (VLMs) as situated recommendation assistants within high-fidelity 3D environments. We reformulate recommendation as a situated assistance process in which an assistant interacts with a user while sharing the user's egocentric view. Our benchmark simulates real-world shopping environments (e.g., supermarkets and home furnishings stores), requiring assistants to elicit preferences, ground recommendations in the environment, and guide the user to relevant locations through dialogue. The benchmark evaluates dialogue quality, recommendation utility, and navigation effectiveness through a unified interactive protocol. Extensive experiments reveal persistent challenges in spatial grounding and preference elicitation, highlighting limitations in their ability to integrate global contextual information with local observations. SituRecBench provides a rigorous foundation for advancing the development of situated assistants in the real world.

Figures & tables

Appendix figures & tables12 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models

    May 27, 2026Jiyao Zhang, Mingxu Zhang, Yitong Peng +8VLM EvaluationSpatial Reasoning Benchmarks

  2. Where and What: Reasoning Dynamic and Implicit Preferences in Situated Conversational Recommendation

    Apr 22, 2026Dongding Lin, Jian Wang, Yongqi Li +1Recommender SystemsLarge Language Model-Based Recommendation

  3. Re2A: Situated Conversational Recommendation via Rubric-based Preference Reasoning and Alignment

    Sep 16, 2026Dongding Lin, Jian Wang, Xiaoyan Zhao +1Recommender SystemsPreference Alignment