cs.CVApr 7, 2026

DietDelta: A Vision-Language Approach for Dietary Assessment via Before-and-After Images

Authors: Gautham Vinod, Siddeshwar Raghavan, Bruce Coburn, Fengqing Zhu

Organizations: Purdue University, West Lafayette, Indiana, U.S.A.

Abstract

Accurate dietary assessment is critical for precision nutrition, yet most image-based methods rely on a single pre-consumption image and provide only coarse, meal-level estimates. These approaches cannot determine what was actually consumed and often require restrictive inputs such as depth sensing, multi-view imagery, or explicit segmentation. In this paper, we propose a simple vision-language framework for food-item-level nutritional analysis using paired before-and-after eating images. Instead of relying on rigid segmentation masks, our method leverages natural language prompts to localize specific food items and estimate their weight directly from a single RGB image. We further estimate food consumption by predicting weight differences between paired images using a two-stage training strategy. We evaluate our method on three publicly available datasets and demonstrate consistent improvements over existing approaches, establishing a strong baseline for before-and-after dietary image analysis.

Figures & tables

Explore similar work

CardsList
  1. NutriVision: Ingredient-Conditioned Fusion and Prediction for Single-Image Food Nutrition Estimation

    Sep 27, 2026Avinash Anand, Aman Kumar, Chaitanya Lakhchaura +4Feature FusionMulti-Source Image Fusion

  2. Improving Image-Based Nutrition Estimation Through Multimodal Food-Item Verification and Recovery

    Oct 8, 2026Jingbo Yue, Bruce Coburn, Jinge Ma +2Visual Grounding