Overview

AI video editing studies how to change footage—such as removing or inserting objects, altering motion or appearance, and assembling clips—while preserving the content that should remain. Common approaches adapt video diffusion and flow-matching models, using text, masks, reference images, keyframes, tracks, or 3D geometry to localize and guide edits; agentic systems also plan edits and operate professional timelines. Work increasingly targets streaming and long-video editing, alongside joint audio-visual changes and physics-aware scene effects. A central challenge is balancing strong instruction following with source fidelity, temporal and cross-shot coherence, and physically plausible results, while benchmarks still expose failures on complex instructions and secondary effects.

Latest papers

CardsList

178 papers23 papers in the last four weeks, up 156% on the four weeks before. 0.1% of all new papers.

  1. EgoPlay: Event-Triggered Video Editing for Egocentric Streams

    Jul 27, 2026Jinjie Mai, Gordon Guocheng Qian, Willi Menapace +8Video Diffusion ModelsStreaming Video Generation

  2. ID-V2V: Identity-Preserving Video Restylization

    Jul 24, 2026Yuancheng Xu, Mingming He, Pablo Salamanca +5Video-Reference Video GenerationIdentity-Preserving Video Generation

  3. ElasticTTT: Prior-Preserving Test-Time Tuning for Video Editing

    Jul 23, 2026Yueyi Liu, Chi Zhang, Sen Cui +1Video Diffusion ModelsVideo Editing

  4. OSVE: One Step Video Editing with One Step Diffusion Models

    Jul 22, 2026Habin Lim, Gyeong-Moon ParkVideo EditingInstruction-Based Video Editing

  5. TOM-GS: Editable Video Representation via Temporal Opacity Modulation of Static 3D Gaussians

    Jul 21, 2026Marek Lisowski, Łukasz Smoliński, Kornel Howil +33D Gaussian Splatting3D Scene Editing

  6. AVE-Compass: Towards Holistic Evaluation for Audio-Video Editing Abilities

    Jul 17, 2026Yuqing Wen, Yukai Huang, Qianqian Xie +6Video Editing BenchmarksAgentic Video Editing

  7. From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting

    Jul 16, 2026Zizhao Chen, Ping Wei, Guang Dai +2Video Diffusion ModelsDiffusion Model Distillation

  8. Autoregressive Modeling of Film with Applications in Video Montage

    Jul 16, 2026Marcelo Sandoval-Castañeda, Fabian Caba Heilbron, Shiry Ginosar +4Video Editing

  9. LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting

    Jul 9, 2026Zixin Guo, Yehonathan Litman, Yifeng He +3Physical Consistency in Video GenerationVideo Diffusion Models

  10. Consistent and Editable: A Balanced Framework for Text-Guided Video Editing

    Jul 6, 2026Tao Jin, Li XiaoVideo Diffusion ModelsVideo Editing

  11. Goku: A Million-Scale Universal Dataset and Benchmark for Instruction-Based Video Editing

    Jun 29, 2026Sen Liang, Cong Wang, Zhentao Yu +8Video Editing BenchmarksVideo Editing

  12. HorizonRelight: Relighting Long-horizon Videos Consistently via Diffusion Transformers

    Jun 27, 2026Jing Yang, Mayoore Jaiswal, Zian Wang +4Video EditingVideo Relighting

  13. LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing

    Jun 25, 2026Xinyu Wang, Chongbo Zhao, Fangneng Zhan +1Video Diffusion ModelsVideo Editing

  14. Geometry-Instructed Video Editing

    Jun 23, 2026Chirui Chang, Xiaoyang Lyu, Yi-Hua Huang +7Video EditingInstruction-Based Video Editing

  15. Vera: A Layered Diffusion Model for Content-Preserving Video Editing

    Jun 22, 2026Hongkai Zheng, Ta-Ying Cheng, Benjamin Klein +2Video Diffusion ModelsDiffusion Transformer

  16. VideoAgent: All-in-One Framework for Video Understanding and Editing

    Jun 22, 2026Hengji Zhou, Lingxuan Huang, Jian Wang +4Video Editing BenchmarksAgentic Video Editing

  17. SteerVTE: Seamless Video Text Editing with Style and Glyph Control

    Jun 22, 2026Kai Zeng, Moran Li, Zhengwei Wang +6Video Diffusion ModelsVideo Editing

  18. IDAG-Edit: Multi-Object Video Editing via Instance-Decoupled Attention and Guidance

    Jun 20, 2026Yuan-Zhih Lin, Huu-Thang Nguyen, Huu-Phu Do +2Diffusion Model GuidanceVideo Editing

  19. Go-with-the-Track: Video Compositing and Motion Control with Point Tracking

    Jun 18, 2026Koichi Namekata, Yash Kant, Zhizheng Liu +9Point TrackingCamera-Controlled Video Generation

  20. Cinematic Compositing Using Character-Environment-Harmonized Video Generation Models

    Jun 17, 2026Tianyi Xiang, Mingming He, Li Ma +1Physical Consistency in Video GenerationVideo Diffusion Models

  21. Edit3DGS: Unified Framework for Dynamic Head Editing via 2D Instruction-Guided Diffusion and 3D Gaussian Splatting

    Jun 16, 2026Duy-Dat Tran, Trung-Nghia Le3D Scene EditingVideo Editing

  22. PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory

    Jun 15, 2026Shuai Yang, Bingjie Gao, Ziwei Liu +3Multi-View ConsistencyMemory-Augmented Video Generation

  23. Beyond Consistency: Preserving Temporal Structure in Zero-Shot Video Editing

    Jun 7, 2026Deyin Liu, Yisheng Ding, Zhe Jin +3Video Diffusion ModelsVideo Editing

  24. CoVEBench: Can Video Editing Models Handle Complex Instructions?

    Jun 7, 2026Jiangtao Wu, Jiaming Wang, Yiwen He +7Video Editing BenchmarksVideo Editing

  25. TIDE: Task-Isolated Diffusion for Unified Video Editing and Generation

    Jun 6, 2026Qi Liu, Gang Yue, Mingyu Yin +7Video Diffusion ModelsVideo Editing

  26. LoomVideo: Unifying Multimodal Inputs into Video Generation and Editing

    Jun 4, 2026Jianzong Wu, Hao Lian, Jiongfan Yang +12Video Diffusion ModelsVideo Editing