FAVE: Flow-based Average Velocity Establishment for Sequential Recommendation
Organizations: University of Electronic Science and Technology of China · State Key Laboratory of Internet Architecture
Abstract
Generative recommendation has emerged as a transformative paradigm for capturing the dynamic evolution of user intents in sequential recommendation. While flow-based methods improve the efficiency of diffusion models, they remain hindered by the ``Noise-to-Data'' paradigm, which introduces two critical inefficiencies: prior mismatch, where generation starts from uninformative noise, forcing a lengthy recovery trajectory; and linear redundancy, where iterative solvers waste computation on modeling deterministic preference transitions. To address these limitations, we propose a Flow-based Average Velocity Establishment (Fave) framework for one-step generation recommendation that learns a direct trajectory from an informative prior to the target distribution. Fave is structured via a progressive two-stage training strategy. In Stage 1, we establish a stable preference space through dual-end semantic alignment, applying constraints at both the source (user history) and target (next item) to prevent representation collapse. In Stage 2, we directly resolve the efficiency bottlenecks by introducing a semantic anchor prior, which initializes the flow with a masked embedding from the user's interaction history, providing an informative starting point. Then we learn a global average velocity, consolidating the multi-step trajectory into a single displacement vector, and enforce trajectory straightness via a JVP-based consistency constraint to ensure one-step generation. Extensive experiments on three benchmarks demonstrate that Fave not only achieves state-of-the-art recommendation performance but also delivers an order-of-magnitude improvement in inference efficiency, making it practical for latency-sensitive scenarios.
Figures & tables
| Model | ML-100k | Beauty | Steam | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| H@10 | H@20 | N@10 | N@20 | H@10 | H@20 | N@10 | N@20 | H@10 | H@20 | N@10 | N@20 | |
| RNN/CNN-based Models | ||||||||||||
| GRU4Rec | 12.1951 | 21.8451 | 6.0326 | 8.4727 | 1.9370 | 3.8531 | 0.9029 | 1.3804 | 5.4257 | 9.2319 | 2.6033 | 3.5572 |
| Caser | 11.2426 {}_{\!{\color[rgb]{0.7,0,0}-0.95}} | 19.5189 {}_{\!{\color[rgb]{0.7,0,0}-2.33}} | 5.0683 {}_{\!{\color[rgb]{0.7,0,0}-0.96}} | 7.1439 {}_{\!{\color[rgb]{0.7,0,0}-1.33}} | 2.8166 {}_{\!{\color[rgb]{0,0.45,0}+0.88}} | 4.4048 {}_{\!{\color[rgb]{0,0.45,0}+0.55}} | 1.3602 {}_{\!{\color[rgb]{0,0.45,0}+0.46}} | 1.7595 {}_{\!{\color[rgb]{0,0.45,0}+0.38}} | 6.4940 {}_{\!{\color[rgb]{0,0.45,0}+1.07}} | 10.9633 {}_{\!{\color[rgb]{0,0.45,0}+1.73}} | 3.0846 {}_{\!{\color[rgb]{0,0.45,0}+0.48}} | 4.2043 {}_{\!{\color[rgb]{0,0.45,0}+0.65}} |
| Transformer-based Models | ||||||||||||
| SASRec | 13.5737 | 22.6935 | 6.3427 | 8.6340 | 6.2648 | 8.9791 | 3.2305 | 3.6563 | 8.3763 | 13.6060 | 4.0489 | 5.3630 |
| Datasets | ML-100k | Beauty | ||
|---|---|---|---|---|
| Metrics | H@20 | N@20 | H@20 | N@20 |
| w/o stage | 25.2610 | 10.4645 | 11.7177 | 5.7838 |
| 24.8579 | 10.3656 | 11.8406 | 5.8031 | |
| 21.7264 | 8.8802 | 11.7805 | 5.8086 | |
| w/o prior | 20.6521 | 8.8471 | 11.7939 | 5.7417 |
| Fave | 26.1340 | 10.7879 | 11.9048 | 5.8351 |
| Dataset | Metric | DiffuRec | FMRec | Fave |
|---|---|---|---|---|
| ML-100k | FLOPs (G) | 1.26 | 1.32 | 0.04 |
| Latency (ms) | 105.97 | 98.04 | 4.44 | |
| Infer. Time (s) | 2.57 | 2.34 | 0.10 | |
| Beauty | FLOPs (G) | 1.26 | 1.96 | 0.07 |
| Latency (ms) | 103.19 | 93.74 | 4.49 | |
| Infer. Time (s) | 42.21 | 40.44 | 2.25 |
| Method | Category | ILD | NDCG@20 |
|---|---|---|---|
| Caser | CNN-based | 0.7440 | 7.1439 |
| SASRec | Transformer-based | 0.8866 | 8.6340 |
| AutoSeqRec | AutoML-based | 0.3350 | 9.4584 |
| DiffuRec | Diffusion-based | 0.8313 | 8.0459 |
| FMRec | Flow-based | 0.3786 | 9.8158 |
| Fave | Flow-based | 0.4348 | 10.7879 |
Sequential Recommendation
Sequential recommendation predicts what a user will choose next from ordered interactions, adapting to changing interests and context.
See all 132 papers