Streaming

Follow this topic Ask about this topic

Momentum

20 papers in the last four weeks, up 18% on the four weeks before. 0.2% of all new papers.

Jul 6Week of Sep 21

Latest papers 171

All topics

IPIBench: Evaluating Interactive Proactive Intelligence of MLLMs under Continuous Streams
May 26, 2026Jinzhao Li, Yinuo Chen, Wenxuan Song +5Proactive Multimodal Large Language Models
College of AI, Tsinghua University · 2ByteDance
OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants
May 26, 2026Xudong Lu, Xueying Li, Annan Wang +8Omni-Modal Omni
CUHK MMLab · SJTU · NTU +3
Geometric Evolution Maps: Extracting Stable Concept Probes from Transformer Residual Streams
May 25, 2026James HenryTransformer Residual Streams Streaming
Independent Researcher
Modeling Dynamic Mixtures of Time-Delay Systems from Streaming Time Series
May 25, 2026Ren Fujiwara, Yasuko Matsubara, Yasushi SakuraiMixture Models Rapid Adaptation
SANKEN, The University of Osaka, Japan
StreamChar: Long-Horizon Streaming Character Audio-Video Generation with Decoupled Orchestration
May 25, 2026Linrui Tian, Qi Wang, Bang ZhangAudio-Video Generation Streaming
Tongyi Lab, Alibaba Group
STREAM: A Data-Centric Framework for Mining High-Value Task-Oriented Dialogues from Streaming Media
May 24, 2026Liang Xue, Haoyu Liu, Cheng Wang +3Conversational Datasets Dialogue
Harbin Institute of Technology Byering Technology Harbin, China · Harbin Institute of Technology Harbin, China
Stream Assembly Is an Uncontrolled Treatment in Streaming Intrusion-Detection Benchmarks
May 23, 2026Michel A. YoussefIntrusion Detection Alarm Fatigue
Independent Researcher, Beirut, Lebanon
HorizonStream: Long-Horizon Attention for Streaming 3D Reconstruction
May 22, 2026Chong Cheng, Peilin Tao, Nanjie Yao +93D Reconstruction Shape Correspondence
HKUST(GZ) · Horizon Robotics · CASIA +2
HarnessAPI: A Skill-First Framework for Unified Streaming APIs and MCP Tools
May 21, 2026Edwin JoseApplication Programming Interfaces Model Context Protocol
Department of Computer Science Western Michigan University Kalamazoo, MI 49008, USA
FiLark: a streaming-first software framework for end-to-end exploration, annotation, and algorithm integration in distributed acoustic sensing
May 19, 2026Jintao Li, Weichang Li, Kai Tong +1Streaming Graph Signal Processing
State Key Laboratory of Ocean Sensing & Ocean College, Zhejiang University, Zhoushan, 316021, China · College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China · College of Computer Science and Technology, Zhejiang University, Hangzhou, China
An Efficient Streaming Video Understanding Framework with Agentic Control
May 18, 2026Jinming Liu, Jianguo Huang, Zhaoyang Jia +7Streaming Video Understanding Streaming Video
1Shanghai Jiao Tong University · 2Eastern Institute of Technology, Ningbo, China · 3Microsoft Research Asia
Attend Locally, Remember Linearly: Linear Attention as Cross-Frame Memory for Autoregressive Video Diffusion
May 15, 2026Kunyang Li, Mubarak Shah, Yuzhang ShangAutoregressive Video Diffusion Models Spatio-Temporal Attention
Institute of Artificial Intelligence, University of Central Florida
GHOST: Geometry-Hierarchical Online Streaming Token Eviction for Efficient 3D Reconstruction
May 15, 2026Leyang Chen, Junyi Wu, Zhiteng Li +13D Reconstruction Modern Data-Streaming Systems
Shanghai Jiao Tong University
MaxSketch: Robust Distinct Counting in Streams via Random Projections
May 15, 2026Nikos Tsikouras, Constantine Caramanis, Christos TzamosLocality-Sensitive Hashing Optimal Sample Complexity
National and Kapodistrian University of Athens, Greece · Archimedes, Athena Research Center, Greece · The University of Texas at Austin, USA
Attention Once Is All You Need: Efficient Streaming Inference with Stateful Transformers
May 13, 2026Victor NorgrenFast Inference Streaming
LayerScale, Inc.
Action Emergence from Streaming Intent
May 12, 2026Pengfei Jing, Victor Shea-Jay Huang, Hengtong Lu +3Autonomous Driving Human Driving
1Li Auto · 3CUHK · 2Tsinghua University
Multi-Stream LLMs: Unblocking Language Models with Parallel Streams of Thoughts, Inputs and Outputs
May 12, 2026Guinan Su, Yanwu Yang, Xueyan Li +1Artificial Intelligence Agents Thoughts
Max Planck Institute for Intelligent Systems · University Hospital Tübingen · University of Tübingen +3
OmniHumanoid: Streaming Cross-Embodiment Video Generation with Paired-Free Adaptation
May 12, 2026Yiren Song, Xiyao Deng, Pei Yang +2Cross-Embodiment Transfer Embodiment
Show Lab, National University of Singapore
CAGS: Color-Adaptive Volumetric Video Streaming with Dynamic 3D Gaussian Splatting
May 10, 2026Daheng Yin, Yili Jin, Jianxin Shi +7Volumetric Video 3D Gaussian
Simon Fraser University, Canada and Jiangxing Intelligence Inc., China · Jiangxing Intelligence Inc., China · McGill University, Canada and Simon Fraser University, Canada +5
ORACLE: Anticipating Scams from Partial Trajectories in Streaming App Usage
May 9, 2026Wenbo Gao, Songbai Tan, Zhongan Wang +6Fraud Detection Threat Detection
Harbin Institute of Technology, Shenzhen · Shenzhen University · Zhejiang University +4
Streaming of rendered content with adaptive frame rate and resolution
May 9, 2026Yaru Liu, Joseph G. March, Rafal K. MantiukFrame Rate Streaming
University of Cambridge, UK
EmoS: A High-Fidelity Multimodal Benchmark for Fine-grained Streaming Emotional Understanding
May 9, 2026Pengze Guo, Jingxi Liang, Zhiwen Xie +2Emotion Recognition Empathy
NLP2CT Lab, Department of Computer and Information Science, University of Macau · School of Computer Science, Central China Normal University · University of Macau
StreamPhy: Streaming Inference of High-Dimensional Physical Dynamics via State Space Models
May 8, 2026Panqi Chen, Yifan Sun, Shikai Fang +2Streaming Inference Spatiotemporal Fields
College of Information Science and Electronic Engineering, Zhejiang University · School of EECS,Oregon State University
StrLoRA: Towards Streaming Continual Visual Instruction Tuning for MLLMs
May 8, 2026Chang Che, Ziqi Wang, Hui Ma +2Multimodal Continual Instruction Tuning Replay-Based Continual Learning
Hefei University of Technology · Tsinghua University
Decentralized Time-Varying Optimization for Streaming Data via Temporal Weighting
May 7, 2026Muhammad Faraz Ul Abrar, Nicolò Michelusi, Erik G. LarssonDecentralized Optimization Weight Decay
School of Electrical, Computer and Energy Engineering, Arizona State University · Department of Electrical Engineering (ISY), Linköping University
Revisiting Adam for Streaming Reinforcement Learning
May 7, 2026Florin Gogianu, Adrian Catalin Lutu, Razvan PascanuDeep Q-Networks Adam
Bitdefender, Bucharest, Romania · Mila, Montreal, Canada
Ray-Aware Pointer Memory with Adaptive Updates for Streaming 3D Reconstruction
May 7, 2026Feifei Li, Qi Song, Chi Zhang +13D Reconstruction Streaming
The Chinese University of HongKong, Shenzhen · Tsinghua University
Stream-T1: Test-Time Scaling for Streaming Video Generation
May 6, 2026Yijing Tu, Shaojin Wu, Mengqi Huang +4Video Generation Streaming
University of Science and Technology of China · Independent Researcher
When to Think, When to Speak: Learning Disclosure Policies for LLM Reasoning
May 5, 2026Jiaqi Wei, Xuehang Guo, Pengfei Yu +5LLM Reasoning Strategies Token-Level Uncertainty
Zhejiang University · College of William and Mary · University of Illinois Urbana-Champaign +4
Efficient Temporal Datalog Materialisation for Composite Event Recognition
May 4, 2026Periklis MantenoglouStreaming
Örebro University, Sweden
Decouple and Cache: KV Cache Construction for Streaming Video Understanding
May 3, 2026Zhanzhong Pang, Dibyadip Chatterjee, Fadime Sener +1Streaming Video Understanding Streaming Video
National University of Singapore.
Autonomous Drift Learning in Data Streams: A Unified Perspective
May 2, 2026Xiaoyu Yang, En Yu, Jie LuNon-Stationarity Continual Learning
Australian Artificial Intelligence Institute (AAII), Faculty of Engineering and Information Technology, University of Technology Sydney, Australia
Learning from a single labeled face and a stream of unlabeled data
Apr 30, 2026Branislav Kveton, Michal ValkoFace Recognition Model Unlabeled Data
Technicolor Labs Palo Alto, CA · Inria Lille - Nord Europe, team SequeL Lille, France
WhisperPipe: A Resource-Efficient Streaming Architecture for Real-Time Automatic Speech Recognition
Apr 28, 2026Erfan Ramezani, Mohammad Mahdi Giahi, Mohammad Erfan Zarabadipour +2Whisper-Large-V3 Automatic Speech Recognition
Mechatronics Research Laboratory, Dept. of Computer and Electrical Engineering, Qazvin Islamic Azad University, Qazvin, Iran · Department of Electrical Engineering, Qa. C., Islamic Azad University, Qazvin, Iran.
Tessera: Secure, Near-Line-Rate Weight Streaming for UMA Edge Accelerators
Apr 25, 2026Animan NaskarEdge Devices Homomorphic Encryption
Indian Institute of Technology (IIT) Ropar
FOCAL: Filtered On-device Continuous Activity Logging for Efficient Personal Desktop Summarization
Apr 21, 2026Haoran Yin, Zhiyuan Wen, Jiannong Cao +2Summarization Streaming
The Hong Kong Polytechnic University Hong Kong, China · China Mobile Communications Company Limited Research Institute Beijing, China
Reducing the Offline-Streaming Gap for Unified ASR Transducer with Consistency Regularization
Apr 21, 2026Andrei Andrusenko, Vladimir Bataev, Lilit Grigoryan +3Automatic Speech Recognition Streaming
NVIDIA, Armenia · NVIDIA, USA
Intentional Updates for Streaming Reinforcement Learning
Apr 21, 2026Arsalan Sharifnassab, Mohamed Elsayed, Kris De Asis +2Gradient-Based Optimization Streaming
Openmind Research Institute · Department of Computing Science, University of Alberta.
Progressive Online Video Understanding with Evidence-Aligned Timing and Transparent Decisions
Apr 20, 2026Kecheng Zhang, Zongxin Yang, Mingfei Han +6Streaming Video Understanding Streaming
University of Science and Technology of China · Harvard University · Department of CV, MBZUAI +3
OASIS: On-Demand Hierarchical Event Memory for Streaming Video Reasoning
Apr 18, 2026Zhijia Liang, Jiaming Li, Weikai Chen +3Streaming Video Understanding Streaming
Sun Yat-sen University · OPPO AI Center · Shenzhen Loop Area Institute +1
Blue Data Intelligence Layer: Streaming Data and Agents for Multi-source Multi-modal Data-Centric Applications
Apr 16, 2026Moin Aminnaseri, Farima Fatahi Bayat, Nikita Bhutani +17Text-To-Sql Natural Language
Megagon Labs
AgileLog: A Forkable Shared Log for Agents on Data Streams
Apr 16, 2026Shreesha G. Bhat, Tony Hong, Michael Noguera +2Modern Data-Streaming Systems Production Agentic Systems
University of Illinois Urbana-Champaign
Em-Garde: A Propose-Match Framework for Proactive Streaming Video Understanding
Mar 19, 2026Yikai Zheng, Xin Ding, Yifan Yang +6Streaming Video Understanding Streaming
Institute for AI Industry Research (AIR), Tsinghua University · University of Science and Technology of China · 4Microsoft Research Asia +1
AR-CoPO: Align Autoregressive Video Generation with Contrastive Policy Optimization
Mar 18, 2026Dailan He, Guanlin Feng, Xingtong Ge +5Autoregressive Video Generation Streaming
CUHK MMLab, China · Vivix Group Limited, China · HKUST, China +1
SVCBench: A Streaming Video Counting Benchmark for Spatial-Temporal State Maintenance
Mar 13, 2026Pengyiang Liu, Zhongyue Shi, Hongye Hao +7Video Understanding Streaming
Institute of Artificial Intelligence, Beihang University, Beijing, China · Hangzhou International Innovation Institute of Beihang University, Hangzhou, China
CauScale: Neural Causal Discovery at Scale
Feb 9, 2026Bo Peng, Sirui Chen, Jiaguo Tian +2Causal Discovery Methods Causal
Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Shanghai Innovation Institute +1
TTSA3R: Training-Free Temporal-Spatial Adaptive Persistent State for Streaming 3D Reconstruction
Jan 30, 2026Zhijie Zheng, Xinhao Xiang, Jiawei Zhang3D Reconstruction Streaming
University of California, Davis · CA 95616, USA
DuaDeep-SeqAffinity: Dual-Branch Deep Learning for Tri-Stream Sequence-Based Antibody--Antigen Affinity Prediction
Dec 26, 2025Aicha Boutorh, Soumia Bouyahiaoui, Manel Kara Laouar +3Antibody Sequence Modeling
National School of Artificial Intelligence (ENSIA) Sidi Abdallah Campus, Algiers, Algeria · Lamine Debaghine University Hospital Center, CHU Bab El Oued, Algiers, Algeria
Sublinear Sketches for Approximate Nearest Neighbor and Kernel Density Estimation
Oct 27, 2025Ved Danait, Srijan Das, Sujoy BhoreApproximate Nearest-Neighbor Search Kernel Method
Department of Computer Science & Engineering, Indian Institute of Technology Bombay, Mumbai, India. · Department of Computer Science & Engineering and Centre for Machine Intelligence & Data Science (CMINDS), Indian Institute of Technology Bombay, Mumbai, India.
StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modeling
Jul 7, 2025Meng Wei, Chenyang Wan, Xiqian Yu +9Vision-Language Navigation Streaming
1Shanghai AI Lab · 2The University of Hong Kong · 3Zhejiang University +1
Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstruction
Date pendingXiaoyan Liu, Jiaxin Liu, Kangrui Li +14D Generation Autoregressive Video Generation
The Chinese University of Hong Kong · The Hong Kong Polytechnic University · The University of New South Wales +1

May 26, 2026, cs.CVJ/K move · Enter open · S save

IPIBench: Evaluating Interactive Proactive Intelligence of MLLMs under Continuous Streams

Jinzhao Li, Yinuo Chen, Wenxuan Song, Yijia Lei+4

College of AI, Tsinghua University · 2ByteDance

Proactive Multimodal Large Language Models Streaming Question-Answer Pairs

Open paper AskPDF arXiv

Recent multimodal large language models (MLLMs) achieve strong performance on reactive question answering, but real-world streaming assistants require proactive reasoning over continuous visual inputs. Existing benchmarks mainly study reactive or proactive interactions in isolated single-turn settings, overlooking dynamic multi-turn scenarios where users may add, modify, or cancel proactive requests alongside interleaved reactive queries. To address this gap, we introduce IPIBench, the first benchmark for evaluating Interactive Proactive Intelligence of MLLMs under streaming video settings. IPIBench covers proactive monitoring, proactive task management, and interleaved reactive-proactive requests. Evaluations on representative MLLMs reveal two major limitations: unstable proactive triggering and weak coordination between reactive and proactive behaviors. We further propose IPI-Agent, a training-free agentic framework with an interaction-control policy and a temporal-gating mechanism for stabilizing proactive triggering and coordinating multi-turn interactions. Experiments show that IPI-Agent consistently improves existing MLLMs across all benchmark settings.

Momentum

Related topics

Latest papers 171