Ophthalmology

Latest papers

41 papers4 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

A Visual Grounding Benchmark for Retinal OCT with Multimodal Large Language Models
Oct 22, 2026Ronald Fecso, José Morano, Botond Fazekas +6Medical VLMs Medical Image Grounding
Institute of Artificial Intelligence, Center for Medical Data Science, Medical University of Vienna, Vienna, Austria · Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria
RetiJev: Fast and Source-Grounded Ophthalmic Decision Models
Oct 22, 2026Bo Liu, Lianyu Wang, Meng Wang +2Ophthalmology Clinical Decision Support
Centre for Innovation and Precision Eye Health, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore. · Department of Ophthalmology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore. · University of Washington, Seattle, WA, USA. +3
Two for One: Privileged Learning for Resource-Constrained Screening
Oct 21, 2026Lisa Y. W. TangLearning Using Privileged Information Medical Image Analysis
University of British Columbia - Faculty of Medicine
Can large language models unlock discrete data in ophthalmic diagnostic reports?
Sep 30, 2026Umair A. Zaidi, An-Lun Wu, Wei-Chun Lin +2Document Information Extraction Clinical Information Extraction
Division of Informatics, Clinical Epidemiology and Translational Data Science, Oregon Health & Science University, Portland, OR · Casey Eye Institute, Department of Ophthalmology, Oregon Health & Science University, Portland, OR · Department of Ophthalmology and Visual Sciences, University of Illinois Chicago, Chicago, IL
EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding
Sep 26, 2026Gujie Shao, Zixun Xie, Xuechun Xing +7VLM Evaluation Medical VQA
Longitudinal Retinal Vascular Remodeling in Myopic Children Treated with Orthokeratology or Defocus Lenses: A Two-Year Comparative Study
Sep 22, 2026Zhihao Zhao, Yinzheng Zhao, Jie Zhang +7Ophthalmology
TUM University Hospital Rechts der Isar, Technische Universität München, 81675 Munich, Germany · Department of ophthalmology, Tongji Hospital, School of Medicine, Tongji University, Shanghai, 200065, China · Department of ophthalmology, Shanghai Demu Youmei Ophthalmology Outpatient Department Co., Ltd. Shanghai, 200001, China +3
Multimodal Shared Latent Representation of Narration, Microscope and iOCT Images for Phase Recognition in Vitreoretinal Surgery
Aug 31, 2026Onur Izmitlioglu, Shervin Dehghani, Tarek Ghannoum +2Surgical Video Understanding Multimodal Contrastive Learning
Computer Aided Medical Procedures, Technical University of Munich, Germany · SynthesEyes GmbH, Munich, Germany · Department of Ophthalmology, LMU University Hospital, Munich, Germany
Co-Annotator: Expert-Distilled ViT and VLM for Visual and Documentation Guidance in Age-Related Macular Degeneration
Aug 31, 2026Ziheng "Leo" Li, Benjamin Freeman, Akshay Raman +5Medical Report Generation Medical Image Analysis
Columbia University
Polar-domain Segmentation of Peripapillary Atrophy and Optic Disc
Aug 9, 2026Mengxian He, Yunyun Sun, Ziyue Gao +3Medical Image Segmentation Medical Image Analysis
Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China · Capital Medical University, Beijing, China
SpecF2M: A Spectral-Aware Multi-task Network Estimating Axial Length and Refractive Error from Pediatric Fundus Photographs
Aug 7, 2026Mengxian He, Xinyue Liu, Yunyun Sun +5Medical Imaging Multi-Task Learning
The Chinese University of Hong Kong, Sha Tin, New Territories, Hong Kong · Guangdong Laboratory of Machine Perception and Intelligent Computing, Shenzhen MSU-BIT University, China · Capital Medical University, China +1
Algorithmic statistics of retinal images
Aug 6, 2026Loan Huynh, Ronald Zambrano, Layton Aho +4Medical Imaging Longitudinal Medical Image Analysis
Department of Electrical and Computer Engineering, Drexel University, Philadelphia, PA, USA · Glaucoma Service, Wills Eye Hospital, Philadelphia, PA, USA · School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA, USA +2
Video-Based Detection of squint and cataract for accessibility-aware adaptive web interface rendering
Jul 8, 2026Amar Ranjan Dash, Manas Ranjan PatraMedical Image Analysis Medical Diagnosis
Department of Computer Science, Berhampur University, Berhampur, India · CSE Department, NIST University, Pallur Hills, Berhampur, India
IRIS: An Intelligent Vision-Language System for Ocular Surface Diseases via Topic Tree and Scene-Driven VQA Generation
Jul 5, 2026Hao Wei, Wenjin Qi, Dasen Dai +2Visual Question Answering Vision-Language Models
The Chinese University of Hong Kong, Shatin, Hong Kong, China · Westlake University, Xihu District, Hangzhou, Zhejiang Province, China
Fully Automated High-Precision Segmentation of Retinal Atrophy and Ellipsoid Zone Thickness in OCT: A Reliable Tool for Real-World GA Monitoring
Jun 30, 2026Wolf-Dieter Vogl, Hlynur Skulason, Oliver Leingang +3Medical Imaging Optical Coherence Tomography
RetInSight GmbH, Vienna, Austria · Laboratory of Opthalmic Image Analysis (OPTIMA), Medical University of Vienna, Austria
OphthaDT: Generative Digital Twins for Forecasting Visual Acuity Trajectories in Ophthalmology
Jun 20, 2026Pietro Belligoli, Nikita Makarov, Sayedali Shetab Boushehri +3Clinical Outcome Prediction LLM-Based Time Series Forecasting
Computational Sciences Center of Excellence, Roche, Penzberg, Germany · Technical University of Munich, Munich, Germany · Computational Health Center, Helmholtz Munich, Munich, Germany +3
EyeMVP: OCT-Informed Fundus Representation Learning via Paired CFP--OCT Pretraining
Jun 13, 2026Zhuo Deng, Ruiheng Zhang, Ziheng Zhang +23Fundus Imaging Cross-Modal Representation Learning
Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing, China · Liangxiang Hospital of Beijing Fangshan District, Capital Medical University, Beijing, China +6
HD-DinoMoE: A Class-Aware Hierarchical Dual Mixture-of-Experts Network for Scleral Anomaly Segmentation in Complex Acquisition Scenarios
Jun 3, 2026Yinxiang Yu, Maoxiang Chu, Qi Niu +7Medical Imaging Ophthalmic Image Analysis
School of Electronic and Information Engineering, University of Science and Technology Liaoning, No.189 Qianshan Middle Road, Lishan District, Anshan, 114051, Liaoning, China
Response-Aware Multimodal Learning for Post-Treatment Visual Acuity Forecasting
May 30, 2026Phuoc-Nguyen Bui, Van-Vi Vo, Duc-Tai Le +5Long-Term Time Series Forecasting Clinical Outcome Prediction
Research Convergence Institute, Sungkyunkwan University, Korea · Dept. of AI Systems Engineering, Sungkyunkwan University, Korea · College of Computing and Informatics, Sungkyunkwan University, Korea +2
OphIn-500K: Curating Web-Scale Visual Instructions for Scaling Ophthalmic Multimodal Large Language Models
May 27, 2026Xuanzhao Dong, Wenhui Zhu, Xiwen Chen +13Medical Image Analysis Medical VQA
1Arizona State University · 2Clemson University · 3Washington University in St. Louis +5
Towards Clinically Interpretable Ophthalmic VQA via Spatially-Grounded Lesion Evidence
May 21, 2026Xingyue Wang, Bo Liu, Meng Wang +4Medical VQA Fundus Imaging
Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen 518055, China · The Hong Kong Polytechnic University, Hong Kong S.A.R., China. · National University of Singapore, Singapore. +2
Anatomy-Slot: Unsupervised Anatomical Factorization for Homologous Bilateral Reasoning in Retinal Diagnosis
May 13, 2026Yingzhe Ma, Xiao Yang, Yuguo Yin +1Explainable Medical Image Analysis Medical Image Analysis
University of Electronic Science and Technology of China · Peking University
MPD $^2$ -Router: Mask-aware Multi-expert Prior-regularized Dual-head Deferral Router in Glaucoma Screening and Diagnosis
May 8, 2026Wenxin ZhanAI-Assisted Decision Making Learning to Defer
Baruch college
Retina-RAG: Retrieval-Augmented Vision-Language Modeling for Joint Retinal Diagnosis and Clinical Report Generation
May 7, 2026Abdelrahman Zaian, Sheethal Bhat, Mohamed Abdalkader +1Diabetic Retinopathy Grading Medical Report Generation
Friedrich-Alexander-Universität, Germany
Scientific Domain Knowledge Improves Vision-Language Fundus Models
May 4, 2026Verena Jasmin Hallitschke, Carsten Eickhoff, Philipp BerensVision-Language Pretraining Healthcare
1Hertie Institute for AI in Brain Health, University of Tübingen, Tübingen, Germany · Institute for Applied Medical Informatics, University of Tübingen, Tübingen, Germany · 2Tübingen AI Center, Tübingen, Germany
Representation learning from OCT images
May 4, 2026Hedi Tabia, Désiré Sidibé, Nawres Khlifa +6Medical Imaging Medical Imaging Foundation Models
IBISC Univ. Evry Université Paris-Saclay · University of Tunis El Manar · ESIEE Paris - Université Gustave Eiffel +2
Toward Multimodal Conversational AI for Age-Related Macular Degeneration
Apr 28, 2026Ran Gu, Benjamin Hou, Mélanie Hébert +5Medical Diagnosis Medical VQA
Division of Intramural Research, NaMonal Library of Medicine, NaMonal InsMtutes of Health, Bethesda, Maryland, USA · 2. Division of Epidemiology and Clinical ApplicaMons, NaMonal Eye InsMtute, NaMonal InsMtutes of Health, Bethesda, Maryland, USA · 1. Division of Intramural Research, NaMonal Library of Medicine, NaMonal InsMtutes of Health, Bethesda, Maryland, USA
Weighting What Matters: Boosting Sample Efficiency in Medical Report Generation via Token Reweighting
Apr 22, 2026Alexander Weers, Daniel Rueckert, Martin J. MentenMedical Report Generation Healthcare
TUM School of Computation, Information and Technology, Technical University of Munich, DE · Munich Center for Machine Learning (MCML), DE · Department of Computing, Imperial College London, UK
X-PCR: A Benchmark for Cross-modality Progressive Clinical Reasoning in Ophthalmic Diagnosis
Apr 22, 2026Gui Wang, Zehao Zhong, YongSong Zhou +6Healthcare Medical Diagnosis
School of Computer Science and Software Engineering, Shenzhen University · 2Tsinghua University · 5Wenzhou Medical University +3
Nested Radially Monotone Polar Occupancy Estimation: Clinically-Grounded Optic Disc and Cup Segmentation for Glaucoma Screening
Apr 10, 2026Rimsa Goperma, Rojan Basnet, Liang ZhaoOptic Disc Segmentation Glaucoma Detection
Graduate School of Advanced Integrated Studies in Human Survivability (GSAIS), Kyoto University, Kyoto 606-8306, Japan
Retinal Malady Classification using AI: A novel ViT-SVM combination architecture
Mar 31, 2026Shashwat Jha, Vishvaditya Luhach, Raju PoddarRetinal Disease Classification Medical Image Classification
Department of Electrical and Electronics Engineering, Birla Institute of Technology Mesra · Department of Computer Science and Engineering, Maharaja Surajmal Institute of Technology · Department of Bio-Technology, Birla Institute of Technology Mesra

Oct 22, 2026J/K move · Enter open · S save

A Visual Grounding Benchmark for Retinal OCT with Multimodal Large Language Models

Ronald Fecso, José Morano, Botond Fazekas, Paul Widmann-Sedlnitzky+5

Institute of Artificial Intelligence, Center for Medical Data Science, Medical University of Vienna, Vienna, Austria · Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, Austria

Medical VLMs Medical Image Grounding Visual Grounding Medical Image Benchmarks Optical Coherence Tomography Ophthalmology

Open paper AskPDF arXiv

Multimodal large language models (MLLMs) can answer clinical questions about medical images, but trustworthy use requires visual grounding: models should localize the pathology they report rather than rely on spurious shortcuts. Whether MLLMs can visually ground clinical findings in retinal optical coherence tomography (OCT), the most widely used imaging modality in ophthalmology, remains largely unexplored. To address this gap, we introduce RetinaGroundBench, the first benchmark for biomarker visual grounding in retinal OCT. It comprises 815 B-scans exhaustively annotated by ophthalmologists with 4,537 bounding boxes covering 13 biomarkers across 8 diseases. Because MLLMs often fragment a single lesion into multiple partial predictions, we propose AggIoU, a metric that evaluates whether the union of overlapping predicted boxes covers the annotated region. Across 27 open-source MLLMs (0.8-38B parameters), we find that visual grounding remains largely unsolved: the best general-purpose model achieves a macro F1 of just 23.7%, with consistently low recall, despite reaching up to 73% balanced accuracy on biomarker presence questions. To narrow this gap, we developed RetGrounder, an MLLM fine-tuned using an OCT-specific strategy integrating grounding and textual information. Despite its relatively small size (8B), RetGrounder improves grounding F1 to 33.9%, a 43% relative improvement. Our benchmark provides a reference point for measuring progress in the field of OCT diagnosis with MLLMs.