Multimodal Model Evaluation

Latest papers 496

All topics
CardsList
  1. Explain Before You Answer: A Survey on Compositional Visual Reasoning

    Aug 24, 2025Fucai Ke, Joy Hsu, Zhixi Cai +10Compositional ReasoningVisual Reasoning

  2. VGGSounder: Audio-Visual Evaluations for Foundation Models

    Aug 11, 2025Daniil Zverev, Thaddäus Wiedemer, Ameya Prabhu +3Audio-Visual UnderstandingMultimodal Classification

  3. Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes

    Jun 11, 2025Zhaoyang Wei, Bowen Jiang, Xumeng Han +6Multimodal GroundingMultimodal Robustness

  4. MMMG: a Comprehensive and Reliable Benchmark for Multitask Multimodal Generation

    May 23, 2025Jihan Yao, Yushi Hu, Wenyuan Wang +10Multimodal GenerationMultimodal Model Evaluation

  5. FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflow

    May 23, 2025Haoyu Sun, Huichen Will Wang, Jiawei Gu +2Software EngineeringWeb Application Generation

  6. Redemption Score: A Multi-Modal Evaluation Framework for Image Captioning via Distributional, Perceptual, and Linguistic Signal Triangulation

    May 22, 2025Ashim Dahal, Ankit Ghimire, Saydul Akbar Murad +1Image CaptioningMultimodal Model Evaluation

  7. HumaniBench: A Human-Centric Framework for Large Multimodal Models Evaluation

    May 16, 2025Shaina Raza, Aravind Narayanan, Vahid Reza Khazaie +6Algorithmic FairnessMultimodal Large Language Models

  8. ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Models

    Feb 13, 2025Jonathan Roberts, Mohammad Reza Taesiri, Ansh Sharma +31Visual ReasoningVLM Reasoning

  9. MedGEN-Bench: A Contextually Entangled Benchmark for Open-ended Multimodal Medical Generation

    Date pendingJunjie Yang, Yuhao Yan, Gang Wu +12HealthcareMultimodal Generation

  10. MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation

    Date pendingZefan Cai, Haoyi Qiu, Tianyi Ma +13Embodied NavigationMultimodal Reasoning

  11. Do Multimodal LLMs See Before They Read? Diagnosing Contextual Sycophancy

    Date pendingYi-Cheng Lai, Hen-Hsen HuangLLM SycophancyEvidence-Grounded Reasoning