Multimodal Foundation Model

Follow this topic Ask about this topic

Recent momentum

-33%

4 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

2 new papers

A weekly snapshot of new work published in Multimodal Foundation Model.

Period ending 2026-09-14

1 new paper

A weekly snapshot of new work published in Multimodal Foundation Model.

Period ending 2026-09-07

2 new papers

A weekly snapshot of new work published in Multimodal Foundation Model.

63 papers

Latest in Multimodal Foundation Model

Browse all topics →

SPEAR NeXT Causal Latent Forecasting Across Multiple Horizons for Spectral Temporal Earth Representation Learning
Sep 15, 2026Rajiv Ranjan, Udaiveer Singh, Shashank Tamaskar +1Time Series Foundation Models Latent Bridge Matching
A Language-Guided Multimodal Foundation Model for Zero-Shot and Multi-Task Brain Signal Analysis
Sep 14, 2026Mingzhi Chen, Yiyu Gui, Guibo Luo +1Multimodal Foundation Model Retraining
Robust Rank Aggregation for Multimodal Speech-Based Alzheimer's Disease Detection
Sep 9, 2026Zemin Jin, Tomoko MatsuiAlzheimer Disease Detection
A Composable Evaluation System for Reproducible Omni-Modal Foundation Model Evaluation
Sep 1, 2026Hodong Lee, Sanghee Park, Dohoon Ryu +4Omni-Modal Multimodal Foundation Model
Intern-S2-Preview: Scientific Agentic Foundation Model
Aug 13, 2026Lei Bai, Jiaqi Cao, Chiyu Chen +122Multimodal Foundation Model Agentic Reinforcement-Learning Framework
VOICE: A Vision-Omics Foundation Model Integrating Direct and Retrieval-Based Prediction of In-situ Single-Cell Gene Expression
Aug 8, 2026Xin Luo, Yicheng Tao, Haoxuan Zeng +6Spatial Transcriptomics Single-Cell Rna Sequencing
IndustryForge-27B: A Domain-Enhanced Multimodal Foundation Model for Industrial CAD
Jul 30, 2026Nianchen Deng, Jiaxin Ai, Tao Hu +10Text-To-Cad Industrial
LAST: The Last Query Token Guides Visual Token Pruning for Edge-Cloud Collaborative MLLM Inference
Jul 30, 2026Feng Yang, Xinrui Ju, Keyang Zhang +6Visual Token Pruning Visual Tokens
CHARM: A Multimodal Graph Foundation Model with Hierarchical Context Modeling for Zero-Shot Transfer
Jul 28, 2026Ankang Yang, Jitao Zhao, Di Jin +2Graph Foundation Model Multimodal Foundation Model
Data Pyramid for Embodied Manipulation: A Survey
Jul 27, 2026Yifan Ye, Yankai Fu, Yaoxu Lv +26Multimodal Foundation Model Vision-Language-Action Models
LunarFM: A Shared Multimodal Representation of the Moon's Surface
Jul 24, 2026Marc Girona-Mata, Jakob Gawlikowski, Sumit Goski +6Lunar Surface Multimodal Foundation Model
Autoregressive EHR Foundation Models with Multimodal Inputs
Jul 24, 2026Yuxuan Liu, Joshua Placidi, Jinpei Han +3Electronic Health Record Foundation Models Electronic Health Records
Antigen-specific Antibody Multi-modal Foundation Model for Functional Antibody Design
Jul 22, 2026Xiaoliang Shi, Zichen Wang, Runze Ma +2Antibody Epitope Prediction
PGN: Design and Implementation of a Vision-Language Navigation System Based on Pangu Multimodal Foundation Model
Jul 20, 2026Li Xian, Mingxi Li, Yizheng Wang +3Vision-Language Navigation Vision Encoders
VLT: A Vision-Language-Time Series Multimodal Foundation Model for Industrial Intelligence
Jul 16, 2026Haiteng Wang, Jingheng Yan, Xiaokang Wang +1Multimodal Foundation Model Unified Multimodal Models
FM $^2$ : Unified Federated Foundation Models for Heterogeneous Multimodal Medical Imaging
Jul 15, 2026Shengchao Chen, Ting ShuMultimodal Foundation Model Medical Imaging
A Foundation Model for Multimodal Event Sequences in Financial Applications
Jul 10, 2026Nikita Rusakov, Vladislav Meshkov, Konstantin Zorin +4Multimodal Foundation Model Time Series Foundation Models
Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks
Jul 8, 2026Nobin Sarwar, Shubhashis Roy Dipta, Zheyuan Liu +1Large Language Model Unlearning Cross-Modal Learning
MedPMC: A Systematic Framework for Scaling High-Fidelity Medical Multimodal Data for Foundation Models
Jul 8, 2026Hyunjae Kim, Dain Kim, Pan Xiao +25Multimodal Clinical Data Multimodal Foundation Model
Moonstone: A Multimodal Foundation Model and Benchmark for Lunar Remote Sensing
Jul 3, 2026Ayush Prasad, Swarnalee MazumderRemote Sensing Multimodal Foundation Model
MorphologyFM: A Foundation Model for Morphology-Aware Representation Learning from ECG and Pulse Oximetry Waveforms
Jul 3, 2026Saiyang Feng, Yuanyun Zhang, Shi LiPhysiological Data Electronic Health Record Foundation Models
A harmonised dataset for Earth system foundation models
Jul 3, 2026Carlos Rodriguez-Pardo, Massimo TavoniGeospatial Foundation Models Multimodal Foundation Model
NIVA: A Multimodal Foundation Model for Actionable Earth System Intelligence
Jun 26, 2026Anisha Pal, Aodhan Sweeney, Kyle Heyblom +1Multimodal Foundation Model Adverse Weather
Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models
Jun 23, 2026Lianghua Huang, Zhi-Fan Wu, Wei Wang +22Audio-Visual Consistency Full-Duplex Dialogue
Yuvion VL: A Multimodal Foundation Model for Adversarial Content and AI Safety
Jun 23, 2026Shikai Qiu, Xiaowen Xu, Benlei Cui +55Adversarial Evaluation Multimodal Foundation Model
BioMatrix: Towards a Comprehensive Biological Foundation Model Spanning the Modality Matrix of Sequences, Structures, and Language
Jun 20, 2026Qizhi Pei, Zhimeng Zhou, Yi Duan +9Multimodal Foundation Model Unified Multimodal Models
Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Games
Jun 17, 2026Shengyuan Ding, Xilin Wei, Xinyu Fang +4Multimodal Foundation Model Joint Reinforcement Learning
Visuals Lie, Consistency Speaks: Disentangling Spatial Attention from Reliability in Vision-Language Models
Jun 16, 2026Logan Mann, Yi Xia, Ajit Saravanan +6Vision-Language Visual Perception
Probing, Fusion, and Trustworthiness: A Systematic Evaluation of Foundation Model Representations for Multimodal Cancer Analysis
Jun 15, 2026Jingyu Hu, Giuseppe Tripodi, Reed Naidoo +2Pathology Foundation Models Multimodal Clinical Data
CausalMoE: A Billion-Scale Multimodal Foundation Model for Granger Causal Discovery with Pattern-Routed Heterogeneous Experts
Jun 11, 2026Bo Liu, Di Dai, Jingwei Liu +5Causal Foundation Models Causal Graph
Emerging Flexible Designs for Geospatial Multimodal Foundation Models
Jun 10, 2026Philipe Dias, Waqwoya Abebe, Abhishek Potnis +4Geospatial Foundation Models Multimodal Foundation Model
GLACIER: A Multimodal Student-Teacher Foundation Model for Molecular Property Prediction
Jun 9, 2026Emily Nguyen, Yongchan Hong, Harsh Toshniwal +2Molecular Property Prediction Vast Chemical Space
Kwai Keye-VL-2.0 Technical Report
Jun 9, 2026Kwai Keye Team, Bin Wen, Changyi Liu +50Video Understanding Multimodal Foundation Model
RespiraMFM: A Multimodal Foundation Model with Contrastive Audio-Language Alignment for Respiratory Disease Identification
Jun 8, 2026Shakhrul Iman Siam, Tiantian Feng, Jiankun Zhang +2Respiratory Sound Classification Multimodal Clinical Data
Next-Token Prediction Learns Generalisable Representations of Sleep Physiology
Jun 8, 2026Jonathan F. Carter, Lionel TarassenkoMultimodal Physiological Signals Electronic Health Record Foundation Models
AlloSpatial: Agentic Harness Framework for Spatial Reasoning in Foundation Models
Jun 8, 2026Shouwei Ruan, Bin Wang, Zhenyu Wu +5Spatial Reasoning Multimodal Foundation Model
Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning
Jun 6, 2026Cong Wan, Ying He, Zhongzhan Huang +1Multimodal Foundation Model Test-Time Scaling
TRACE: A Temporal Conditional Estimation for Multimodal Time Series Foundation Models
Jun 4, 2026Ziwen Kan, Yishuo Chen, Kecheng Li +7Multimodal Foundation Model Time Series Foundation Models
Differentiable Efficient Operator Search
Jun 3, 2026Xiaohuan Pei, Jiyuan Zhang, Yuanfan Guo +4Multimodal Foundation Model Visual Token Pruning
GGT-100K: Generative Ground Truth for Generalizable Real-World Image Restoration
May 29, 2026Xiangtao Kong, Jixin Zhao, Lingchen Sun +2Image Restoration Single Images
ReasonLight: A Multimodal Foundation Model-Enhanced Reinforcement Learning Framework for Zero-Shot Traffic Signal Control
May 28, 2026Aoyu Pang, Maonan Wang, Yuejiao Xie +3Adaptive Traffic Signal Control Iterative Reinforcement Learning
FLORO: A Multimodal Geospatial Foundation Model for Ecological Remote Sensing Across Sensors and Scales
May 27, 2026Jorge L. Rodriguez, Victor Angulo Morales, Areej Alwahas +6Geospatial Foundation Models Remote Sensing
Falcon-X: A Time Series Foundation Model for Heterogeneous Multivariate Modeling
May 26, 2026Yiding Liu, Yifan Hu, Hongjie Xia +5Multivariate Time Series Forecasting Time Series Foundation Models
PolyFusionAgent: A Multimodal Foundation Model and Autonomous AI Assistant for Polymer Property Prediction and Inverse Design
May 26, 2026Manpreet Kaur, Xingying Zhang, Qian LiuPolymer Multimodal Foundation Model
Chronicle: A Multimodal Foundation Model for Joint Language and Time Series Understanding
May 18, 2026Paul Quinlan, Jeremy Levasseur, Qingguo Li +1Time Series Foundation Models Time Series
DarkLLM: Learning Language-Driven Adversarial Attacks with Large Language Models
May 15, 2026Ye Sun, Xin Wang, Jiaming Zhang +7Adversarial Examples Multimodal Foundation Model
SMA: Submodular Modality Aligner For Data Efficient Multimodal Learning
May 13, 2026Truong Pham, Anay Majee, Rishabh IyerMultimodal Alignment Modality Alignment
Earth Science Foundation Models: From Perception to Reasoning and Discovery
May 9, 2026Xiangyu Zhao, Bo Liu, Yuehan Zhang +9Multimodal Foundation Model Geological Semantic Understanding
EggHand: A Multimodal Foundation Model for Egocentric Hand Pose Forecasting
May 8, 2026Jaeyoung Choi, Hyeondong Kim, Yujin Kim +13D Hand Human Motion Prediction
Emergent Symbolic Structure in Health Foundation Models: Extraction, Alignment, and Cross-Modal Transfer
May 8, 2026Gajendra Katuwal, Advait Koparkar, Salar Abbaspourazad +2Electronic Health Record Foundation Models Multimodal Foundation Model
A foundation model of vision, audition, and language for in-silico neuroscience
May 5, 2026Stéphane d'Ascoli, Jérémy Rapin, Yohann Benchetrit +5Neurophysiological Correlates Human Brain Networks
Audio-Visual Intelligence in Large Foundation Models
May 5, 2026You Qin, Kai Liu, Shengqiong Wu +12Audio-Visual Reasoning Multimodal Foundation Model
WildTableBench: Benchmarking Multimodal Foundation Models on Table Understanding In the Wild
May 1, 2026Junzhe Huang, Xiaoxiao Sun, Yan Yang +6Tabular Data Multimodal Benchmarks
A Pattern Language for Resilient Visual Agents
Apr 30, 2026Habtom Kahsay Gidey, Alexander Lenz, Alois KnollMultimodal Agents Multimodal Foundation Model
Energy-Efficient Plant Monitoring via Knowledge Distillation
Apr 29, 2026Ilyass Moummad, Reda Bensaid, Kawtar Zaher +5Tomato Diseases Knowledge Distillation
MIMIC: A Generative Multimodal Foundation Model for Biomolecules
Apr 27, 2026Siavash Golkar, Jake Kovalic, Irina Espejo Morales +28Dna Multimodal Foundation Model
FAIR_XAI: Improving Multimodal Foundation Model Fairness via Explainability for Wellbeing Assessment
Apr 26, 2026Sophie Chiang, Tom Brennan, Fethiye Irmak Dogan +2Medical Vision-Language Models Explainability
CheXmix: Unified Generative Pretraining for Vision Language Models in Medical Imaging
Apr 24, 2026Ashwin Kumar, Robbie Holland, Corey Barrett +8Medical Vision-Language Models Medical Image Generation
Focus Session: Hardware and Software Techniques for Accelerating Multimodal Foundation Models
Apr 23, 2026Muhammad Shafique, Abdul Basit, Muhammad Abdullah Hanif +3Multimodal Foundation Model Accelerator
A multimodal and temporal foundation model for virtual patient representations at healthcare system scale
Apr 20, 2026Andrew Zhang, Tong Ding, Sophia J. Wagner +8Multimodal Clinical Data Multimodal Foundation Model

Sep 15, 2026 · cs.CVJ/K move · Enter open · S save

SPEAR NeXT Causal Latent Forecasting Across Multiple Horizons for Spectral Temporal Earth Representation Learning

Rajiv Ranjan, Udaiveer Singh, Shashank Tamaskar, Dharmendra Saraswat

Earth observation is inherently dynamic, yet temporal information in many foundation models is learned through reconstruction, invariance, or retrospective sequence summarization. SPEAR NeXT is introduced as a compact pixel-wise multimodal spectral temporal foundation model in which temporal self supervision is formulated as past only, multi horizon latent Earth state prediction. Instantaneous states are first encoded by the pretrained SPEAR model from optical, radar, and environmental observations into compact 32 dimensional embeddings. Their temporal evolution is then modeled by a causally masked Trans former that predicts multiple future latent states from pre ceding observations. Relative temporal order is represented using Rotary Position Embeddings, while month and year embeddings encode seasonal phase and interannual con text.

Time Series Foundation Models Latent Bridge Matching Spatiotemporal Representations Earth Observation Multimodal Foundation Model Horizon

Open paper Ask about it PDF