cs.CVMar 17, 2026

IOSVLM: A 3D Vision-Language Model for Unified Dental Diagnosis from Intraoral Scans

Authors: Huimin Xiong, Zijie Meng, Tianxiang Hu, Chenyi Zhou, Yang Feng, Zuozhu Liu

Organizations: ZJU-UIUC Institute, Zhejiang University, Haining, 314400, China · Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Hangzhou, 310058, China · Angelalign Research Institute, Angel Align Inc., Shanghai, 200011, China

Abstract

3D intraoral scans (IOS) are increasingly adopted in routine dentistry due to abundant geometric evidence, and unified multi-disease diagnosis is desirable for clinical documentation and communication. While recent works introduce dental vision-language models (VLMs) to enable unified diagnosis and report generation on 2D images or multi-view images rendered from IOS, they do not fully leverage native 3D geometry. Such work is necessary and also challenging, due to: (i) heterogeneous scan forms and the complex IOS topology, (ii) multi-disease co-occurrence with class imbalance and fine-grained morphological ambiguity, (iii) limited paired 3D IOS-text data. Thus, we present IOSVLM, an end-to-end 3D VLM that represents scans as point clouds and follows a 3D encoder-projector-LLM design for unified diagnosis and generative visual question-answering (VQA), together with IOSVQA, a large-scale multi-source IOS diagnosis VQA dataset comprising 19,002 cases and 249,055 VQA pairs over 23 oral diseases and heterogeneous scan types. To address the distribution gap between color-free IOS data and color-dependent 3D pre-training, we propose a geometry-to-chromatic proxy that stabilizes fine-grained geometric perception and cross-modal alignment. A two-stage curriculum training strategy further enhances robustness. IOSVLM consistently outperforms strong baselines, achieving gains of at least +9.58% macro accuracy and +1.46% macro F1, indicating the effectiveness of direct 3D geometry modeling for IOS-based diagnosis.

Figures & tables

Explore similar work

CardsList
  1. MetaDent: Labeling Clinical Images for Vision-Language Models in Dentistry

    Apr 16, 2026Meng-Xun Li, Wen-Hui Deng, Zhi-Xing Wu +6VLM EvaluationMedical Image Analysis

  2. Large AI Models in Dental Healthcare: From General-Purpose Systems to Domain-Specific Foundation Models

    Jun 1, 2026Sema Helali, Lina Abu Nada, Sausan Al Kawas +3Medical Imaging Foundation ModelsMedical VLMs

  3. AgenTeeth: A Model-Agnostic Framework for Suppressing Hallucination in Frozen Vision-Language Models on Dental X-Rays via Tool Evidence Injection

    Sep 15, 2026Ahmed Rafid, Fariya Ahmed, Rumman Adib +3VLM Hallucination MitigationRadiology VLMs