Multimodal Instruction Tuning

Ask about this topic

Latest papers 80

7 papers in the last four weeks, down 36% on the four weeks before. 0.0% of all new papers.

All topics
CardsList

  1. neuralCAD-Edit: An Expert Benchmark for Multimodal-Instructed 3D CAD Model Editing

    Apr 17, 2026Toby Perrett, Matthew Bouchard, William McCarthy3D Shape EditingParametric CAD Modeling

    Autodesk Research

  2. MAny: Merge Anything for Multimodal Continual Instruction Tuning

    Apr 15, 2026Zijian Gao, Wangwang Jia, Xingxing Zhang +6Continual Learning for VLMsMultimodal Instruction Tuning

    College of Computer Science and Technology, National University of Defense Technology · State Key Laboratory of Complex & Critical Software Environment · National Key Laboratory of Parallel and Distributed Computing, National University of Defense Technology +1

  3. Boosting Visual Instruction Tuning with Self-Supervised Guidance

    Apr 14, 2026Sophia Sirko-Galouchenko, Monika Wysoczanska, Andrei Bursuc +2Large Vision-Language ModelsVLM Reasoning

    Sorbonne Universite, CNRS, ISIR, F-75005 Paris, France · Institut universitaire de France (IUF)

  4. Vision-Language Foundation Models for Comprehensive Automated Pavement Condition Assessment

    Apr 9, 2026Blessing Agyei Kyem, Joshua Kofi Asamoah, Anthony Dontoh +1Multimodal Instruction TuningVLM Evaluation

    Department of Civil, Construction and Environmental Engineering, North Dakota State University, Fargo, 58102, ND, USA · Department of Civil, Construction and Environmental Engineering, University of Memphis, Memphis, 38152, TN, USA

  5. InstructTable: Improving Table Structure Recognition Through Instructions

    Apr 3, 2026Boming Chen, Zining Wang, Zhentao Guo +5Table Structure RecognitionMultimodal Instruction Tuning

    Meituan · Beijing Institute of Technology

  6. Visual Instruction-Finetuned Language Model for Versatile Brain MR Image Tasks

    Apr 3, 2026Jonghun Kim, Sinyoung Ra, Hyunjin ParkMedical VLMsMultimodal Instruction Tuning

    Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon, Korea · Department of Artificial Intelligence, Sungkyunkwan University, Suwon, Korea

  7. Jagle: Building a Large-Scale Japanese Multimodal Post-Training Dataset for Vision-Language Models

    Apr 2, 2026Issa Sugiura, Keito Sasagawa, Keisuke Nakao +8Vision-Language ModelsVisual Question Answering

    Institute of Science Tokyo · NII LLMC · Waseda University +4

  8. A Comprehensive Information-Decomposition Analysis of Large Vision-Language Models

    Mar 31, 2026Lixin Xiu, Xufang Luo, Hideki NakayamaLarge Vision-Language ModelsVLM Interpretability

    The University of Tokyo · Microsoft Research

  9. Data Organization Matters in Multimodal Instruction Tuning: A Controlled Study of Capability Trade-offs

    Mar 29, 2026Guowei TangMultimodal Instruction TuningCurriculum Learning

    School of Statistics, East China Normal University

  10. Domain Adapted Large Language Models for Additive Manufacturing

    Mar 23, 2026Peter Pak, Amir Barati FarimaniMultimodal Large Language ModelsDomain Adaptation for LLMs

    Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA · Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA, USA

  11. Less Data, Faster Convergence: Goal-Driven Data Optimization for Multimodal Instruction Tuning

    Mar 12, 2026Rujie Wu, Haozhe Zhao, Hai Ci +1Video UnderstandingInstruction-Tuning Data Selection

    School of Computer Science, Peking University, Beijing, China · Institute for Artificial Intelligence, Peking University, Beijing, China · State Key Laboratory of General Artificial Intelligence, Peking University, Beijing, China +2

  12. Does the Question Really Matter? Training-Free Data Selection for Vision-Language SFT

    Mar 10, 2026Peng Sun, Yi Yang, Huawen Shen +4Multimodal Instruction TuningLarge Vision-Language Models

    Nanjing University · Institute of Information Engineering · North University of China +1

  13. Crab+^{+}: A Scalable and Unified Audio-Visual Scene Understanding Model with Explicit Cooperation

    Mar 4, 2026Dongnuan Cai, Henghui Du, Chang Zhou +5Audio-Visual UnderstandingUnified Multimodal Models

    Gaoling School of Artificial Intelligence, Renmin University of China · Institute of Artificial Intelligence of China Telecom (TeleAI) · AI Technology Center, Online Video Business Unit, Tencent PCG +2

  14. From Narrow to Panoramic Vision: Attention-Guided Cold-Start Reshapes Multimodal Reasoning

    Mar 4, 2026Ruilin Luo, Chufan Shi, Yizhen Zhang +10Multimodal ReasoningVLM Reasoning

    1Tsinghua University · 3Qwen Team, Alibaba Group · University of South California +3

  15. VisNec: Measuring and Leveraging Visual Necessity for Multimodal Instruction Tuning

    Mar 1, 2026Mingkang Dong, Hongyi Cai, Jie Li +4Vision-Language ModelsData Selection

    SJTU · Universiti Malaya · CMU +3

  16. CMI-RewardBench: Evaluating Music Reward Models with Compositional Multimodal Instruction

    Feb 28, 2026Yinghao Ma, Haiwen Xia, Hewei Gao +9Music Generation EvaluationMultimodal Reward Modeling

    Queen Mary University of London, London, UK · Peking University, Beijing, China · Technical University of Munich, Munich, Germany +5

  17. MM-NeuroOnco: A Multimodal Benchmark and Instruction Dataset for MRI-Based Brain Tumor Diagnosis

    Feb 26, 2026Feng Guo, Jiaxiang Liu, Yang Li +2Medical Image BenchmarksBrain MRI

    Guangdong Institute of Intelligence Science and Technology, Hengqin, China · Center for Brain-Inspired Computing Research (CBICR), Department of Precision Instrument, Tsinghua University, Beijing, China

  18. LUMEN: Longitudinal Multi-Modal Radiology Model for Prognosis and Diagnosis

    Feb 24, 2026Zhifan Jiang, Dong Yang, Vishwesh Nath +7Radiology VLMsMedical VQA

    Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Hospital, Washington DC, USA · Nvidia Corporation, Santa Clara, CA, USA · ETSI Telecomunicación, Universidad Politécnica de Madrid, Madrid, Spain +1

  19. QuPAINT: Physics-Aware Instruction Tuning Approach to Quantum Material Discovery

    Feb 19, 2026Xuan-Bac Nguyen, Hoang-Quan Nguyen, Sankalp Pandey +4Microscopy Image AnalysisMultimodal Instruction Tuning

    CVIU Lab, University of Arkansas, USA · University of Utah, USA · Department of Physics, University of Arkansas, USA

  20. MultiViewDx: Evidence-Linked Multi-View Clinical Diagnosis

    Oct 19, 2024Junda Wang, Zonghai Yao, Yujan Ting +5HealthcareMedical Image Analysis

    United Imaging Intelligence, MA, USA · Manning College of Information and Computer Sciences, University of Massachusetts Amherst, MA, USA · Department of Medicine, University of Massachusetts Medical School, Worcester, MA, USA +1