Multimodal

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

65 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-14

18 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-07

26 new papers

A weekly snapshot of new work published in Multimodal.

Inside this field

Focused directions

Focused topic

Multimodal Learning

Within Multimodal

456 papersExplore

Focused topic

Cross-Modal Learning

Within Multimodal

432 papersExplore

Focused topic

Multi-Modal Large Language Models

Within Multimodal

376 papersExplore

Focused topic

Multimodal Reasoning

Within Multimodal

224 papersExplore

Focused topic

Multimodal Benchmarks

Within Multimodal

171 papersExplore

Focused topic

Unified Multimodal Models

Within Multimodal

100 papersExplore

Focused topic

Cross-Modal Attention

Within Multimodal

75 papersExplore

Focused topic

Input Modality

Within Multimodal

73 papersExplore

Focused topic

Modality Gap

Within Multimodal

73 papersExplore

Focused topic

Multimodal Generation

Within Multimodal

73 papersExplore

Focused topic

Cross-Modal Alignment

Within Multimodal

66 papersExplore

Focused topic

Video Multimodal Large Language Models

Within Multimodal

58 papersExplore

1,965 papers

Latest in Multimodal

Browse all topics →

Multilingual and Multimodal LLMs in the Wild: Building for Low-Resource Languages
May 16, 2026Firoj Alam, Shammur Absar Chowdhury, Enamul Hoque PrinceLow-Resource Languages Multi-Modal Large Language Models
CAM-VFD: Cross-Attention Multimodal Video Forgery Detection
May 16, 2026Hoda Osama Elkhodary, Sherin Mostafa Youssef, Marwa Elshenawy +1Explainable Deepfake Detection Deepfake Detection
PyraVid: Hierarchical Multimodal Memory for Long-Horizon Video Reasoning
May 16, 2026Sikuan Yan, Sicheng Dong, Haotong Wang +8Multimodal Memory Video Understanding
Ranking-Aware Calibration for Reliable Multimodal Reinforcement Learning
May 16, 2026Peng Cui, Boyao Yang, Jun ZhuMultimodal Reasoning Benchmarks Capture-Aware Prototype Calibration
OmniVL-Guard Pro: A Tool-Augmented Agent for Omnibus Vision-Language Forensics
May 16, 2026Jinjie Shen, Zheng Huang, Yuchen Zhang +7Face Forgery Detection Digital Forensics
Navigating the Emotion Tree: Hierarchical Hyperbolic RAG for Multimodal Emotion Recognition
May 16, 2026Zeheng Wang, Bo Zhao, Yijie Zhu +6Emotion Recognition Multimodal Reasoning
TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agents
May 16, 2026Zhiqiang Liu, Wenhui Dong, Yilang Tan +3Tool Omni-Modal
Controlling Decision Drift in Multimodal Sentiment Analysis with Missing Modalities
May 16, 2026Chenglizhao Chen, Yuchen Cao, Xinyu Liu +3Missing Modalities Multimodal Alignment
Mind the Gap: Learning Modality-Agnostic Representations with a Cross-Modality UNet
May 16, 2026Xin Niu, Enyi Li, Jinchao Liu +3Cross-Modality Modality Gap
Learning Relative Representations for Fine-Grained Multimodal Alignment with Limited Data
May 16, 2026Shiwon Kim, Yu Rang ParkMultimodal Alignment Multimodal Pretraining
Cross-modal Affinity-aligned Multimodal Learning Analytics for Predicting Student Collaboration Satisfaction in Game-Based Learning
May 16, 2026Wen-Hsin Tsai, Chia-Ming Lee, Yuk-Ying TungRobust Multimodal Learning Cross-Modal Learning
Axial-Relation Guided Fusion State Space Model for Optical-Elevation Sensing Image Segmentation
May 16, 2026Feng Gao, Zhilin Jin, Yanhai Gan +2Remote Sensing Image Segmentation Cross-Modal Learning
EVA01: Unified Native 3D Understanding and Generation via Mixture-of-Transformers
May 16, 2026Zongyuan Yang, Mingjing Yi, Wanli Ma +83D Generative Models 3D Object Understanding
MAVEN A Multi-Agent Framework for Multicultural Text-to-Video Generation
May 16, 2026Shuowei Li, Yuming Zhao, Parth Bhalerao +1Text-To-Video Models Multimodal Generation
Controlla: Learning Controllability via Graph-Constrained Latent Geometry
May 15, 2026Jamuna S. Murthy, Amin Karimi Monsefi, Rajiv RamnathControllability Multimodal Generation
MAgSeg: Segmentation of Agricultural Landscapes in High-Resolution Satellite Imagery using Multimodal Large Language Models
May 15, 2026Piyush Tiwary, Utkarsh Ahuja, Depanshu Sani +5Remote Sensing Image Segmentation Agricultural Landscapes
Second-Order Multi-Level Variance Correction for Modality Competition in Multimodal Models
May 15, 2026Yishun Lu, Wes ArmourMultimodal Alignment Modality Gap
A Cross-Modal Prompt Injection Attack against Large Vision-Language Models with Image-Only Perturbation
May 15, 2026Hao Yang, Zhuo Ma, Yang Liu +3Large Vision Language Models Cross-Modal Attention
Linked Multi-Modal Data on Russian Domestic and Foreign Policy Speeches
May 15, 2026Daria Blinova, Gayathri Emuru, Rakesh Emuru +4Russian Political Discourse
ForMaT: Dataset for Visually-Grounded Multilingual PDF Translation
May 15, 2026Michał Ciesiółka, Dawid Wiśniewski, Adrian Charkiewicz +1Machine Translation Models Multimodal Learning
Reversing the Flow: Generation-to-Understanding Synergy in Large Multimodal Models
May 15, 2026Yujun Tong, Dongliang Chang, Zijin Yin +3Multimodal Artificial Intelligence Multimodal Learning
Attribute-Grounded Selective Reasoning for Artwork Emotion Understanding with Multimodal Large Language Models
May 15, 2026Cheng Zhang, Yuer Liu, Zhiyu Zhou +2Emotion Recognition Emotion
GOMA: Toward Structure-Driven Multimodal Alignment from a Graph Signal Smoothing Perspective
May 15, 2026Xu Wang, Xunkai Li, Yinlin Zhu +2Multimodal Alignment Modality-Specific Encoders
Semi-MedRef: Semi-Supervised Medical Referring Image Segmentation with Cross-Modal Alignment
May 15, 2026Yuchen Li, Zhen Zhao, Yi Liu +1Medical Image Segmentation Cross-Modal Alignment
SMMBench: A Benchmark for Source-Distributed Multimodal Agent Memory
May 15, 2026Huacan Chai, Yukai Wang, Yingxuan Yang +7Multimodal Memory Multimodal Reasoning Benchmarks
ASRU: Activation Steering Meets Reinforcement Unlearning for Multimodal Large Language Models
May 15, 2026Jiahui Guang, Haiyan Wang, Yingjie Zhu +4Large Language Model Unlearning Multi-Modal Large Language Models
VLMs Trace Without Tracking: Diagnosing Failures in Visual Path Following
May 15, 2026Hyesoo Hong, Minsoo Kim, Wonje Jeung +3Vision-Language Multimodal Benchmarks
MaTe: Images Are All You Need for Material Transfer via Diffusion Transformer
May 15, 2026Nisha Huang, Henglin Liu, Yizhou Lin +5Discrete Diffusion Model Generative Quality
Peak-Detector: Explainable Peak Detection via Instruction-Tuned Large Language Models in Physiological Sign
May 15, 2026Jiahui Li, Yida Zhang, Zixuan Zeng +10Physiological Data Cross-Modal Learning
DRS-GUI: Dynamic Region Search for Training-Free GUI Grounding
May 15, 2026Yichao Liu, Huawen Shen, Liu Yu +3Graphical User Interface Multi-Modal Large Language Models
Differentially Private Motif-Preserving Multi-modal Hashing
May 14, 2026Zehua Cheng, Wei Dai, Jiahao SunLocality-Sensitive Hashing Differential Privacy
Deep Pre-Alignment for VLMs
May 14, 2026Tianyu Yu, Kechen Fang, Zihao Wan +5Vision-Language Alignment Vision Transformer
Text Knows What, Tables Know When: Clinical Timeline Reconstruction via Retrieval-Augmented Multimodal Alignment
May 14, 2026Sayantan Kumar, Shahriar Noroozizadeh, Juyong Kim +1Patient Trajectories Electronic Health Records
From Scenes to Elements: Multi-Granularity Evidence Retrieval for Verifiable Multimodal RAG
May 14, 2026Guanhua Chen, Chuyue Huang, Yutong Yao +4Multi-Source Retrieval-Augmented Generation Multimodal Benchmarks
MHSA: A Lightweight Framework for Mitigating Hallucinations via Steered Attention in LVLMs
May 14, 2026Wei Ding, Yilin Li, Yudong Zhang +4Hallucination Mitigation Hallucinations
Octopus: History-Free Gradient Orthogonalization for Continual Learning in Multimodal Large Language Models
May 14, 2026Yuehao Liu, Shanyan Guan, Weijia Zhang +4Efficient Continual Learning Continual Learning Methods
Chain-of-Procedure: Hierarchical Visual-Language Reasoning for Procedural QA
May 14, 2026Guanhua Chen, Yutong Yao, Shenghe Sun +5Knowledge-Based Visual Question Answering Large Vision Language Models
MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models
May 14, 2026Xiyu Ren, Zhaowei Wang, Yiming Du +11Multimodal Memory Large Vision Language Models
Decision-Level Fusion for Robust Wearable Affect Recognition
May 14, 2026Lokesh Singh, Athina Georgara, Jayati Deshmukh +2Remote Physiological Measurement Affective Computing
Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasoners
May 14, 2026Qingyang Liu, Bingjie Gao, Canmiao Fu +9Unified Multimodal Models Visual Reasoning
StyleTextGen: Style-Conditioned Multilingual Scene Text Generation
May 14, 2026Zeyu Chen, Fangmin Zhao, Yan Shu +3Scene Text Recognition Multilingual Benchmark
MultiEmo-Bench: Multi-label Visual Emotion Analysis for Multi-modal Large Language Models
May 14, 2026Tianwei Chen, Takuya Furusawa, Yuki Hirakawa +3Emotion Recognition Multimodal Benchmarks
UniTriGen: Unified Triplet Generation of Aligned Visible-Infrared-Label for Few-Shot RGB-T Semantic Segmentation
May 14, 2026Ping Zhou, Haoyu Wang, Mengmeng Zheng +4Large-Scale Image Generation 3D Generative Models
OmniDrop: Layer-wise Token Pruning for Omni-modal LLMs via Query-Guidance
May 14, 2026Yeo Jeong Park, Hyemi Jang, Minseo Choi +3Visual Token Pruning Token Compression
Think When Needed: Adaptive Reasoning-Driven Multimodal Embeddings with a Dual-LoRA Architecture
May 14, 2026Longxiang Zhang, Weilong Dai, Guanghao Zhang +2Multimodal Embeddings Multimodal Learning
GeoViSTA: Geospatial Vision-Tabular Transformer for Multimodal Environment Representation
May 14, 2026Yuhao Liu, Sadeer Al-Kindi, Ashok Veeraraghavan +1Geospatial Foundation Models Spatial Representation
ICED: Concept-level Machine Unlearning via Interpretable Concept Decomposition
May 14, 2026Shen Lin, Jing Lin, Junhao Dong +2Several Approximate Unlearning Strategies Cross-Modal Learning
Diagnosing and Correcting Concept Omission in Multimodal Diffusion Transformers
May 14, 2026Kanghyun Baek, Jaihyun Lew, Chaehun Shin +2Multimodal Diffusion Transformers Multimodal Generation
LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling
May 13, 2026Qi Cao, Yufan Wang, Peijia Qin +2Metacognition Large Language Model Performance
MuteBench: Modality Unavailability Tolerance Evaluation for Incomplete Multimodal Fusion
May 13, 2026Wugeng Zheng, Ziwen Kan, Tianlong Chen +2Missing Modalities Multimodal Fusion
Bad Seeing or Bad Thinking? Rewarding Perception for Multimodal Reasoning
May 13, 2026Haozhe Wang, Qixin Xu, Changpeng Wang +4Multimodal Reasoning Perceptual Understanding
CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning
May 13, 2026Tengda Guo, Jie Leng, Hanlei Li +6Visual Reasoning Visual Evidence
Senses Wide Shut: A Representation-Action Gap in Omnimodal LLMs
May 13, 2026Trung Nguyen Quang, Yiming Gao, Fanyi Pu +3Multi-Modal Large Language Models
Multimodal Graph-based Classification of Esophageal Motility Disorders
May 13, 2026Alexander Geiger, Lars Wagner, Daniel Rueckert +3Electrocardiogram Classification Multimodal Learning
Multilingual OCR-Aware Fine-Tuning and Prompt-Guided Chain-of-Thought Reasoning for Multimodal Large Language Models
May 13, 2026Qinwu Xu, Yifan Jiang, Haoyu RenMulti-Modal Large Language Models Deepseek-Ocr
MMSkills: Towards Multimodal Skills for General Visual Agents
May 13, 2026Kangning Zhang, Shuai Shao, Qingyao Li +8Multimodal Agents Reusable Agent Skills
GeoFlowVLM: Geometry-Aware Joint Uncertainty for Frozen Vision-Language Embedding
May 13, 2026Mayank Nautiyal, Li Ju, Andreas Hellander +2Vision-Language Cross-Modal Learning
FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages
May 13, 2026Sarmistha Das, Vaibhav Vishal, Syed Ibrahim Ahmad +2Multilingual Financial Question Answering Multimodal Reasoning Benchmarks
KamonBench: A Grammar-Based Dataset for Evaluating Compositional Factor Recovery in Vision-Language Models
May 13, 2026Richard Sproat, Stefano PeluchettiMultimodal Benchmarks Textual Dataset
Supervised Deep Multimodal Matrix Factorization for Interpretable Brain Network Analysis
May 13, 2026Amjad Seyedi, Lifang He, Songlin Zhao +2Human Brain Networks Nonnegative Matrix Factorization

May 16, 2026 · cs.CLJ/K move · Enter open · S save

Multilingual and Multimodal LLMs in the Wild: Building for Low-Resource Languages

Firoj Alam, Shammur Absar Chowdhury, Enamul Hoque Prince

Qatar Computing Research Institute, HBKU, Qatar · York University, Canada

Multimodal LLMs are evolving from vision-language to tri-modality that see, hear, and read, yet pipelines and benchmarks remain English-centric and compute-heavy. The tutorial offers an overview of this emerging research area for multilingual multimodality across text, speech, and vision under limited data/compute budgets, synthesizing foundations, recent multilingual models (PALO, Maya), speech-text LLMs. We cover low-cost data creation/curation; adapter stacks for tri-modal alignment; culture-aware evaluation beyond English and hands on resources for fine-tuning a compact multilingual VLM and wiring a speech->text->LLM pipeline. The content will be delivered as an interactive half-day tutorial, designed for researchers and practitioners working on multilingual, multimodal AI in low-resource language settings.

Low-Resource Languages Multi-Modal Large Language Models Multimodal Artificial Intelligence Multimodal Learning Large Vision Language Models

Open paper Ask about it PDF