Multimodal IR

IR: Information Retrieval

Follow this topic Ask about this topic

Momentum

10 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 81

All topics

Vortex: Multi-Modal Fusion System for Intelligent Video Retrieval
Jun 18, 2026Duc-Tho Nguyen, Hieu-Hoc Tran-Minh, Khanh-Hoa Lam +4Multimodal IR Information Retrieval
University of Science, VNU-HCM, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam
VCG: A Multimodal Retrieval Framework for E-Commerce Video Feeds under Extreme Cold-Start Conditions
Jun 17, 2026Katya Mirylenka, Egor Malykh, Mahdyar Ravanbakhsh +10Multimodal IR Cold-Start Recommendation
TU Wien, Vienna, Austria · Zalando Switzerland AG, Zurich, Switzerland · Zalando SE, Berlin, Germany
Hierarchical Multi-Modal Retrieval for Knowledge-Grounded News Image Captioning
Jun 17, 2026Minh-Loi Nguyen, Xuan-Vu Le, Long-Bao Nguyen +2Multimodal RAG Multimodal IR
University of Science, VNU-HCM, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam
Multimodal and Multiscale Spatial-Temporal Semantic Search and Recommendation with AI Foundation Models
Jun 15, 2026Yuanyuan Tian, Wenwen Li, Xiao Chen +4Multimodal IR Multimodal Embedding
School of Geographical Sciences and Urban Planning, Arizona State University Tempe, Arizona, USA · Alaska Native Tribal Health Consortium Anchorage, Alaska, USA · Woodwell Climate Research Center Falmouth, Massachusetts, USA +1
Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning
Jun 13, 2026Zhengbo Zhang, Changtao Miao, Jinbo Su +10Multimodal IR Multimodal Grounding
School of Artificial Intelligence, UCAS · Institute of Automation, CAS · Ant Digital Technologies, Ant Group +2
PRISMR: Overcoming Parse Collapse in Multimodal Listwise Ranking via Parameterized Representation Internalization
Jun 11, 2026Hao Jiang, Xin Li, Annan Wang +4Multimodal IR Learning to Rank
1Nanyang Technological University · 2Peking University · 3Independent Researcher
Bridging the Modality Gap in Forensic Image Retrieval
Jun 10, 2026Ricardo González-Gazapo, Annette Morales-González, Yoanna Martínez-Díaz +2Multimodal IR Digital Forensics
Advanced Technologies Application Center (CENATAV), Havana, Cuba · Centro de Sistemas Complejos, Facultad de Física, Universidad de La Habana, Havana, Cuba
Struct-Searcher: Agentic Structural Thinking Advances Multimodal Deep Information Seeking
Jun 5, 2026Fan Zhang, Vireo Zhang, Shengju Qian +7Multimodal IR Belief Revision
1CUHK · 2LIGHTSPEED · 3PKU +3
MMLongEmbed: Benchmarking Multimodal Embedding Models in Long-Context Scenarios
Jun 5, 2026Haitian Wang, Ruoxi Sun, Quantong Qiu +5Multimodal IR Multimodal Embedding
Soochow University, Suzhou, China · Ant Group, Beijing, China
TAPO: Tool-Aware Policy Optimization via Credit Transfer for Multimodal Search Agents
Jun 4, 2026Chengqi Dong, Chuhuai Yue, Hang He +6Multimodal IR Token-Level Credit Assignment
University of Science and Technology of China · 2Meituan
UniCA: Bi-directional Cross-Attention with Positive Similarity Loss for Robust Multi-Modal Retrieval
Jun 3, 2026Yini Huang, Wenlong ZhangMultimodal IR Cross-Modal Alignment
The Hong Kong University of Science and Technology (Guangzhou), Guangdong, China · Southern Medical University, Guangdong, China
Fine-grained Fragment Retrieval in Multi-modal Long-form Dialogues
Jun 3, 2026Hanbo Bi, Zhiqiang Yuan, Chongyang Li +7Multimodal IR Conversational Search
Pattern Recognition Center, WeChat AI, Tencent Inc, China · Aerospace Information Research Institute, Chinese Academy of Sciences
Overview of the EReL@MIR 2025 Multimodal Document Retrieval Challenge (Track 1)
Jun 2, 2026Jingbiao MeiMultimodal IR Multimodal Embedding
University of Cambridge · Cambridge, United Kingdom
Beyond Classification: Dynamic Adapter Routing for Continual Multimodal Retrieval
May 29, 2026Alicja Dobrzeniecka, Filip Szatkowski, Sebastian Cygert +2Multimodal IR VLM Adaptation
NASK National Research Institute · IDEAS Research Institute Warsaw University of Technology · Warsaw University of Technology +2
Inference-Free Multimodal Learned Sparse Retrieval for Production-Scale Visual Document Search
May 29, 2026Gyu-Hwung Cho, Youngjune Lee, Kiyoon Jeong +5Multimodal IR Learned Sparse Retrieval
NAVER Corp., Republic of Korea · Seoul National University, Republic of Korea · NAVER Corp. +6
DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark
May 28, 2026Ruofan Hu, Menghui Zhu, Jieming Zhu +8Multimodal IR LLM Reranking
Zhejiang University · Hangzhou, Zhejiang, China · Huawei Technologies Co., Ltd +2
HiKEY: Hierarchical Multimodal Retrieval for Open-Domain Document Question Answering
May 28, 2026Joongmin Shin, Gyuho Shim, Jeongbae Park +2Multimodal RAG Multimodal IR
Human-inspired AI Research, Korea University · Department of Computer Science and Engineering, Korea University · Computer Science and Engineering, Konkuk University
UniNote: A Unified Embedding Model for Multimodal Representation and Ranking
May 28, 2026Jinghan Zhao, Wenwei Jin, Anqi Li +5Multimodal IR Multimodal Embedding
Xiaohongshu Beijing, China · Shanghai Jiao Tong University Shanghai, China · Huazhong University of Science and Technology Wuhan, Hubei, China +1
DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agents
May 27, 2026Jiamian Wang, Ruiyi Zhang, Tong Yu +5Multimodal IR Multimodal QA
Rochester Institute of Technology · ⋆Work done during an internship at Adobe Research. · Adobe Research
Your Embedding Model is SMARTer Than You Think
May 24, 2026Jianrui Zhang, Hyun Jung Lee, Sukanta Ganguly +3Multimodal IR Efficient Multimodal Inference
UW-Madison · Korea University · NetApp, Inc.
U-CESE: Unified Clip-based Event Search Engine for AI Challenge HCMC 2025
May 22, 2026Duc-Nhuan Le, Hoang-Phuc Nguyen, Thanh-Duy Lam +2Multimodal IR Information Retrieval
Faculty of Information Technology, University of Science, VNU-HCM · Vietnam National University, Ho Chi Minh City, Vietnam
TIGER-FG: Text-Guided Implicit Fine-Grained Grounding for E-commerce Retrieval
May 18, 2026Xinyu Sun, Huangyu Dai, Lingtao Mao +5Multimodal IR Multimodal Grounding
Kuaishou Technology · Beijing, China
SVFSearch: A Multimodal Knowledge-Intensive Benchmark for Short-Video Frame Search in the Gaming Vertical Domain
May 18, 2026Lingtao Mao, Huangyu Dai, Xinyu Sun +4Multimodal IR Agentic Search
Kuaishou Technology Beijing, China
SOLAR: Self-supervised Joint Learning for Symmetric Multimodal Retrieval
May 15, 2026Wenjie Yang, Hang Yu, Yuyu Guo +1Cross-Modal Learning Multimodal IR
Ant Group
GOMA: Toward Structure-Driven Multimodal Alignment from a Graph Signal Smoothing Perspective
May 15, 2026Xu Wang, Xunkai Li, Yinlin Zhu +2Cross-Modal Learning Multimodal IR
School of Airspace Science and Engineering, Shandong University, WeiHai, China · Department of Computer Science, Beijing Institute of Technology, Beijing, China · School of Computer Science and Engineering, Sun Yat-sen University, GuangZhou, China
Very Efficient Listwise Multimodal Reranking for Long Documents
May 12, 2026Yiqun Sun, Pengfei Wei, Lawrence B. HsiehMultimodal IR Efficient Multimodal Inference
Magellan Technology Research Institute (MTRI), Japan.
Towards On-Policy Data Evolution for Visual-Native Multimodal Deep Search Agents
May 11, 2026Shijue Huang, Hangyu Guo, Guanting Dong +8Multimodal IR Tool-Using Vision-Language Agents
Hong Kong University of Science and Technology · Renmin University of China · The Chinese University of Hong Kong +3
Hystar: Hypernetwork-driven Style-adaptive Retrieval via Dynamic SVD Modulation
May 11, 2026Yujia Cai, Boxuan Li, Chenghao Xu +1Multimodal IR VLM Adaptation
School of Computer Science and Technology, Xidian University, Xi’an, Shaanxi, China · School of Electronic Engineering, Xidian University, Xi’an, Shaanxi, China
Urban-ImageNet: A Large-Scale Multi-Modal Dataset and Evaluation Framework for Urban Space Perception
May 11, 2026Yiwei Ou, Chung Ching Cheung, Jun Yang Ang +5Multimodal IR Instance Segmentation
University of Auckland · University of Pennsylvania · Stanford University +1
Omni-DeepSearch: A Benchmark for Audio-Driven Omni-Modal Deep Search
May 9, 2026Tao Yu, yiming ding, Shenghua Chai +16Multi-Hop QA Multimodal IR
CASIA · UCAS · BAAI +2

Jun 18, 2026, cs.CVJ/K move · Enter open · S save

Vortex: Multi-Modal Fusion System for Intelligent Video Retrieval

Duc-Tho Nguyen, Hieu-Hoc Tran-Minh, Khanh-Hoa Lam, Hoang-Nhut Ly+3

University of Science, VNU-HCM, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam

Multimodal IR Information Retrieval Hybrid Retrieval Multimodal Fusion Video Retrieval

Open paper AskPDF arXiv

This paper presents Vortex, the multimodal video retrieval system developed by our team, FocusOnFun, for the Ho Chi Minh City AI Challenge 2025, designed to advance intelligent multimedia search and temporal reasoning. The system integrates adaptive keyframe extraction, multimodal metadata generation from vision-language and speech models, and a hybrid retrieval strategy that fuses CLIP and SigLIP2 embeddings through Reciprocal Rank Fusion to balance global and fine-grained semantics. To enhance interactivity, Vortex incorporates Rocchio-based relevance feedback and a multi-stage temporal search mechanism for sequential event alignment. Built on Milvus and Elasticsearch, the architecture enables scalable indexing and efficient retrieval. Evaluated in the official competition, our FocusOnFun team's system achieved a score of 79.6/88 (90.5%) in the Preliminary Round and was further evaluated in the Final Round, achieving an Excellent' overall performance with Outstanding' results in the question-answering (QA) task. This demonstrating the complementary strengths of CLIP and SigLIP2 and confirming the effectiveness of the hybrid retrieval approach. The system establishes a robust foundation for future research in intelligent, context-aware, and interactive video retrieval.

Momentum

Related topics

Latest papers 81