cs.SDNov 5, 2026

FoleyForge: Free-form, Controllable, Rectified-flow Editing of Sound Effects

Authors: Giovana Morais, Hugo Flores García, Prem Seetharaman, Johannes Imort, Justin Salamon, Magdalena Fuentes, Oriol Nieto

Organizations: Adobe · New York University

Abstract

We present FoleyForge, a generative model for instruction-based editing of sound effects. Given an input clip and a free-form instruction describing the desired change, it applies the edit while preserving the input's identity. A single model handles semantic, stylistic, and DSP-like changes. We introduce a data pipeline that guides an audio language model to author both DSP-based acoustic edits and similarity-preserving semantic edits, thus addressing the lack of publicly available audio editing data. Such data is then used to fine-tune a rectified-flow audio generation model, which we extend to expose attribute controls for loudness change, edit strength, and an input-derived contour envelope, each tunable via classifier-free guidance, yielding a more expressive editing model. FoleyForge achieves state-of-the-art instruction adherence at competitive audio quality and source faithfulness.

Figures & tables

Explore similar work

CardsList
  1. AUDEDIT: Inversion-Free Text-Guided Editing with Pretrained Audio Flow Models

    Jun 13, 2026Zhongyuan FuAudio EditingAudio Generation

  2. ProCraft: Instruction-Driven Music Production from Free-Form Text

    Nov 5, 2026Yuan-Chiao Cheng, Yi-Hsuan Yang, Vincent K. M. CheungAudio Editing