Overview

The field covers both optimization of models that combine modalities such as text, images, audio, and video, and search over objectives with many distinct optima. For multimodal learning, methods tune data mixtures and model components, balance or prioritize modality-specific gradients, and use gating, distillation, or adaptive optimization; evaluation commonly spans multimodal understanding, generation, and domain-generalization benchmarks. For multimodal objective landscapes, population-based methods such as CMA-ES, Stein-based search, and learned proposal models aim to find high-quality solutions while preserving coverage of different peaks. A central tension is how to balance convergence speed and performance against robustness and diversity: equal treatment of modalities or solutions is not always best, but aggressive prioritization can neglect useful signals or optima.

Latest papers

CardsList

35 papers3 papers in the last four weeks, down 40% on the four weeks before. 0.0% of all new papers.

  1. Contour-Assisted Evolutionary Computation: Estimating Peaks From the Contour Lines of Evaluated Solutions

    Nov 11, 2026Jun Zhang, Tong Qian, Hua Ding +3Evolutionary OptimizationMultimodal Optimization

  2. Probe-Guided Gradient Balancing for Multimodal Learning

    Nov 2, 2026Vu Vo, Haytham M. Fayek, Thuy NguyenModality ImbalanceModality Reliance in Multimodal Models

  3. MSCR: Jointly Balancing Utilization Across Modalities and Discovering Synergistic Information

    Oct 17, 2026Xinyu Chen, Liangjian Wen, Jiang Duan +7Multimodal FusionModality Reliance in Multimodal Models

  4. Contact-Implicit Stein Projected ADMM for Discovery of Diverse Contact-Rich Manipulation Strategies

    Sep 23, 2026Hrishikesh Sathyanarayan, Christian Hughes, Ian AbrahamContact-Implicit Trajectory OptimizationContact-Rich Robotic Manipulation

  5. Confidence Falls Short: Asymmetric Certainty Gains from Optimization Hinder Multimodal Classification

    Sep 23, 2026Longfei Huang, Xiangyu Wu, Yang YangModality ImbalanceMultimodal Optimization

  6. GeoBalance: Geometry-Aware Monitoring and Reconstruction with Asymmetric Optimization for Balanced Multimodal Learning

    Sep 20, 2026Zechang Xiong, Da Li, Rong Yin +7Modality ImbalanceGeometric Representation Learning

  7. From Models to Systems: A Comprehensive Survey of Efficient Multimodal Learning

    Sep 16, 2026Pan Wang, Siwei Song, Hui Ji +12Efficient Multimodal InferenceMultimodal Optimization

  8. PACE: Progressive Angular-to-Norm Contrastive Embedding

    Sep 14, 2026Yanping Li, Wei Zhou, Yawen Liu +7Cross-Modal Representation LearningMultimodal Embedding

  9. The Illusion of Balanced Multimodal Sentiment Analysis: Beyond the Limits of Optimization-Based Methods

    Sep 10, 2026Ioanna Kaffeza, Efthymios Georgiou, Alexandros PotamianosModality ImbalanceMultimodal Optimization

  10. CAT-GS: Balanced Multimodal Learning via Calibrated Gating and Fusion Surgery

    Aug 24, 2026Mahir Shahriar Tamim, Sharjil Khan, Md. Samiul Alim +3Multimodal UnderstandingCross-Modal Learning

  11. Beyond Independent Optimization: Compression, MoE Routing, and Quantization Interactions in Multimodal Edge Intelligence

    Jul 23, 2026Jay Gor, Karm Dave, Akshita Abrol +3Efficient Multimodal InferenceVLM Quantization

  12. OPOD: On-Policy Omni Distillation

    Jul 23, 2026Tong Zhao, Yuyang Hu, Yutao Zhu +5Cross-Modal Knowledge DistillationUnified Multimodal Models

  13. S-CARD-CMSA: A Score-Aware Candidate Archive with Density-Filtered Reporting for Multimodal Optimization

    Jul 15, 2026Dikshit ChauhanEvolutionary OptimizationMultimodal Optimization

  14. Bridging Interleaved Multi-Modal Reasoning as a Unified Decision Process

    Jul 4, 2026Zican Hu, Xuyang Hu, Yiming Liu +10Unified Multimodal ModelsMultimodal Reasoning

  15. \chisao{}: A GPU-Native Parallel Optimizer for Multimodal Black-Box Functions via Convergence-Anticonvergence Oscillation

    Jun 24, 2026Ira WolfsonGPU AccelerationBlack-Box Optimization

  16. MSC-CMA-ES: Structure-Aware Restarts for CMA-ES via Cyclic Nearest-Better Basin Discovery

    Jun 14, 2026Dimitar Nedanovski, Svetoslav Nenov, Dimitar PilevEvolutionary OptimizationCovariance Matrix Adaptation Evolution Strategy

  17. GLENS: Global Search via Learning from Solver Iterates with Diffusion Models

    May 29, 2026Anjian Li, Bartolomeo Stellato, Ryne BeesonLearning to OptimizeDiffusion Sampling

  18. DIVA: Harnessing the Representation Divergence in Unified Multimodal Models for Mutual Reinforcement

    May 25, 2026Renjie Lu, Xulong Zhang, Xiaoyang Qu +2Multimodal Disentangled Representation LearningUnified Multimodal Models

  19. MM-OptBench: A Solver-Grounded Benchmark for Multimodal Optimization Modeling

    May 12, 2026Zhong Li, Qi Huang, Yuxuan Zhu +6Multimodal OptimizationSynthetic Benchmark Generation

  20. Stein Variational Black-Box Combinatorial Optimization

    Apr 17, 2026Thomas Landais, Olivier Goudet, Adrien Goëffon +2Stochastic OptimizationBlack-Box Optimization

  21. PDMP: Rethinking Balanced Multimodal Learning via Performance-Dominant Modality Prioritization

    Apr 7, 2026Shicai Wei, Chunbo Luo, Qiang Zhu +1Multimodal LearningMultimodal Optimization

  22. MixAtlas: Uncertainty-aware Data Mixture Optimization for Multimodal LLM Midtraining

    Apr 3, 2026Bingbing Wen, Sirajul Salekin, Feiyang Kang +4Data Mixture OptimizationMultimodal Large Language Models

  23. Joint Segmentation and Grading with Iterative Optimization for Multimodal Glaucoma Diagnosis

    Mar 15, 2026Zhiwei Wang, Yuxing Li, Meilu Zhu +2Optic Disc SegmentationGlaucoma Detection

  24. Balancing Multimodal Domain Generalization via Gradient Modulation and Projection

    Mar 15, 2026Hongzhao Li, Guohao Shen, Shupan Li +2Multimodal Domain GeneralizationDomain Generalization