Video Editing

Follow this topic Ask about this topic

AI video editing studies how to change footage—such as removing or inserting objects, altering motion or appearance, and assembling clips—while preserving the content that should remain. Common approaches adapt video diffusion and flow-matching models, using text, masks, reference images, keyframes, tracks, or 3D geometry to localize and guide edits; agentic systems also plan edits and operate professional timelines. Work increasingly targets streaming and long-video editing, alongside joint audio-visual changes and physics-aware scene effects. A central challenge is balancing strong instruction following with source fidelity, temporal and cross-shot coherence, and physically plausible results, while benchmarks still expose failures on complex instructions and secondary effects.

Latest papers

178 papers23 papers in the last four weeks, up 156% on the four weeks before. 0.1% of all new papers.

Bootstrap Your Generator: Unpaired Visual Editing with Flow Matching
Jun 2, 2026Yoad Tewel, Yuval Atzmon, Gal Chechik +1Flow Matching Video Editing
1NVIDIA · 2Tel Aviv University
JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curation
Jun 2, 2026Yinan Chen, Chuming Lin, Zhennan Chen +12Video Editing Benchmarks Training Data Curation
1Zhejiang University · 2Tencent Youtu Lab · 3Nanjing University +3
Pixel Cube: Diffusion-based Portrait Video Relighting Through Realistic Lighting Reproduction
Jun 1, 2026Yufan Zhang, Yu Ji, Ayo Ajiboye +4Video Editing Image Relighting
George Mason University, Fairfax, USA · LightThought LLC, Fairfax, USA · Columbia University, New York, USA
PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motion
May 31, 2026Heyuan Gao, Bangxun Tang, Yiren Song +4Action-Conditioned Video Generation Video Diffusion Models
Utopai Studios · Nanyang Technological University · University of California, Irvine +1
AlbedoEdit: Unified Instance-Level Video Editing with Albedo Guidance
May 31, 2026Xilong Zhou, Bao-Huy Nguyen, Zheng Zeng +6Video Editing Video Object Insertion
Max Planck Institute for Informatics · University of California Santa Barbara · NVIDIA Research +1
Crayotter: Traceable Multi-Agent Workflows for Long-Form Video Editing
May 31, 2026Lecheng Yan, Yichong Zhang, Ben Pan +5Video Editing Multi-Agent Collaboration
Crayotter Project
SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer
May 28, 2026Yuyang Zhao, Yicheng Pan, Qiyuan He +6Diffusion Transformer Streaming Video Generation
1NVIDIA · 3THU · 4NUS +2
GenEraser: Generalizable Video Object Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preserver
May 28, 2026Yuqing Chen, Lin Liu, Haisu Wu +4Diffusion Model Guidance Video Diffusion Models
Tsinghua University, China · Huawei, China · Southeast University, China +2
KGEdit: Ambiguity-Aware Knowledge Graphs for Training-Free Precise Video Generation and Editing
May 28, 2026Mingshu Cai, Miao Zhang, Chenghe Yang +3Video Diffusion Models T2V Generation
Waseda University, Japan · College of Computer Engineering, Jimei University, Xiamen, Fujian, China · Department of Language Science and Technology, The Hong Kong Polytechnic University, Hong Kong, China +1
HarmoVid: Relightful Video Portrait Harmonization
May 27, 2026Jun Myeong Choi, Jae Shin Yoon, Luchao Qi +2Video Diffusion Models Video Editing
University of North Carolina at Chapel Hill · Adobe Research
SpongeBob: Sync-Aware Harmonious Audio-Visual Generative Editing
May 24, 2026Sen Liang, Cong Wang, Fengbin Guan +6Video Editing Audio-Visual Synchronization
University of Science and Technology of China · 2Tencent Hunyuan
Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editing
May 23, 2026Yan Li, Lin Liu, Xiaopeng Zhang +1Video Diffusion Models Diffusion Transformer
†The Hongkong University of Science and Technology · ‡Huawei Inc.
Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Framework
May 22, 2026Xiao Cao, Yansong Qu, Xiangzhen Chang +6Video Diffusion Models Video Editing
SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusion
May 22, 2026Xinyu Chen, Yuyi Qian, Jiang Lin +9Video Diffusion Models Video Editing
1State Key Laboratory of Novel Software Technology, Nanjing University, Nanjing, China · School of Intelligence Science and Technology, Nanjing University, Suzhou, China · 4Xi’an Jiaotong-Liverpool University +3
Occlusion-Aware Physics-Semantic Keyframe Selection for Robust Video Editing
May 22, 2026Lin Liu, Zhihan Xiao, Haohang Xu +4Video Diffusion Models Video Editing
Huawei, China · Tsinghua University, China · East China Normal University, China
Bernini: Latent Semantic Planning for Video Diffusion
May 21, 2026Bernini Team, Chenchen Liu, Junyi Chen +9Video Diffusion Models Unified Multimodal Models
Bernini Team, Bytedance · Bytedance
StreamEdit: Training-Free Video Editing via Few-Step Streaming Video Generation
May 20, 2026Guanlong Jiao, Chenyangguang Zhang, Jia Jun Cheng Xian +2Video Editing
The University of British Columbia · Vector Institute · ETH Zürich +2
Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioning
May 20, 2026Zhangchi Hu, Wenzhang Sun, Xiangchen Yin +5Video Editing Benchmarks Video Diffusion Models
University of Science and Technology of China · Li Auto Inc.
What Semantics Survive the Connector? Diagnosing VLM-to-DiT Alignment in Video Editing
May 20, 2026Hangyu Lin, Chao Wen, Chengming Xu +4Video Diffusion Models Video Editing
HKUST · FDU · ZJU +1
CutVerse: A Compositional GUI Agents Benchmark for Media Post-Production Editing
May 19, 2026Haobo Hu, Xiangwu Guo, Zhiheng Chen +4GUI Agents Video Editing
MIPG, Communication University of China · National University of Singapore · USEIT AI
Aurora: Unified Video Editing with a Tool-Using Agent
May 18, 2026Yongsheng Yu, Ziyun Zeng, Zhiyuan Xiao +4Tool Use in VLMs Video Diffusion Models
UofR · MIT-IBM · NVIDIA
InstructAV2AV: Instruction-Guided Audio-Video Joint Editing
May 18, 2026Haojie Zheng, Yixin Yang, Siqi Yang +2Audio-Video Generation Video Diffusion Models
Beijing Academy of Artificial Intelligence, Beijing, China · Peking University, Beijing, China
Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration
May 17, 2026Yiren Song, Huilin Zhong, Kevin Qinghong Lin +2Temporal Consistency in Video Generation Multi-Shot Video Generation
Show Lab, National University of Singapore · University of Oxford · Lovart AI
StreamingEffect: Real-Time Human-Centric Video Effect Generation
May 16, 2026Yiren Song, Cheng Liu, Yuxin Jiang +1Streaming Video Generation Video Editing
Show Lab, National University of Singapore
Tuning-free Instruction-based Video Editing Via Structural Noise Initialization and Guidance
May 15, 2026Song Wu, Xinyu Chen, Qian Wang +3Video Diffusion Models Diffusion Guidance
JIUTIAN Research, China · School of Intelligence Science and Technology, Nanjing University · State Key Laboratory of Novel Software Technology, Nanjing University
Sound Sparks Motion: Audio and Text Tuning for Video Editing
May 14, 2026AmirHossein Naghi Razlighi, Aryan Mikaeili, Ali Mahdavi-Amiri +2Audio-Video Generation Inference-Time Optimization
University of Cyprus, Cyprus · Simon Fraser University, Canada · Tel Aviv University, Israel +1
SEDiT: Mask-Free Video Subtitle Erasure via One-step Diffusion Transformer
May 14, 2026Zheng Hui, Yunlong BaiDiffusion Transformer Video Editing
Baidu Inc., Beijing, China.
MiVE: Multiscale Vision-language features for reference-guided video Editing
May 14, 2026Tong Wang, Meng Zou, Chengjing Wu +4Video Diffusion Models Video Editing
MT Lab, Meitu Inc., Beijing 100083, China · Beijing University of Posts and Telecommunications, Beijing 100876, China · Department of Computer Science and Technology, BNRist, IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing 100084, China
PROVE: A Perceptual RemOVal cohErence Benchmark for Visual Media
May 14, 2026Fuhao Li, Shaofeng You, Jiagao Hu +6Image Editing Evaluation Video Editing
MiLM Plus, Xiaomi Inc.
OphEdit: Training-Free Text-Guided Editing of Ophthalmic Surgical Videos
May 8, 2026Ritul Jangir, Arkya Jyoti Bagchi, Aiman Farooq +3Video Diffusion Models Video Editing
Indian Institute of Technology Jodhpur · All India Institute of Medical Sciences Delhi

Jun 2, 2026J/K move · Enter open · S save

Bootstrap Your Generator: Unpaired Visual Editing with Flow Matching

Yoad Tewel, Yuval Atzmon, Gal Chechik, Lior Wolf

1NVIDIA · 2Tel Aviv University

Flow Matching Video Editing Image Editing Cycle Consistency

Open paper AskPDF arXiv

Modern generative models possess a deep understanding of visual content, yet training them for image editing typically requires massive datasets of paired examples. This limits scalability, especially for video editing where collecting paired data is prohibitively expensive. We propose Bootstrap Your Generator (ByG), a general framework for unpaired training of flow matching editing models. It leverages the base model's knowledge without any external signal. Our approach pairs instruction-following cues extracted from the frozen model with cycle-consistency for structure preservation. To make this tractable, we propose to route gradients from downstream losses over clean predictions to noisy training states. We demonstrate state-of-the-art results on challenging data-scarce image and video editing scenarios. Extensive evaluations and user studies show that our method effectively generalizes to unseen domains and outperforms supervised baselines trained on millions of samples. Analysis reveals that our gradient routing bridges the train-inference gap, and extracting semantic cues from a base model provides a robust training signal that obviates the need for external reward models.