Towards Foundation Models for Consensus Rank Aggregation
Organizations: TU Dortmund University, Dortmund, Germany · Research Center Trustworthy Data Science and Security, University Alliance Ruhr, Dortmund, Germany
Abstract
Aggregating a consensus ranking from multiple input rankings is a fundamental problem with applications in recommendation systems, search engines, job recruitment, and elections. Despite decades of research in consensus ranking aggregation, minimizing the Kemeny distance remains computationally intractable. Specifically, determining an optimal aggregation of rankings with respect to the Kemeny distance is an NP-hard problem, limiting its practical application to relatively small-scale instances. We propose the Kemeny Transformer, a novel Transformer-based algorithm trained via reinforcement learning to efficiently approximate the Kemeny optimal ranking. Experimental results demonstrate that our model outperforms classical majority-heuristic and Markov-chain approaches, achieving substantially faster inference than integer linear programming solvers. Our approach thus offers a practical, scalable alternative for real-world ranking-aggregation tasks.
Figures & tables
| random 2k | repeat 10k | jiggling 10k | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Method | Obj | Gap | Time | Obj | Gap | Time | Obj | Gap | Time |
| Gurobi (exact) | 1858.48 | 0 | 25.12h | 1245.01 | 0 | 46.14h | 731.79 | 0 | 23.71h |
| Kiwisort | 1980.13 | 121.65 | 1.24m | 1343.64 | 98.63 | 6.15m | 785.61 | 53.82 | 6.14m |
| Markov Chain | 1894.02 | 35.54 | 20s | 1349.42 | 104.41 | 89.65s | 823.15 | 91.36 | 90.23s |
| Max Agreement | 1884.92 | 26.44 | 1.23m | 1314.77 | 69.75 | 6.27m | 788.76 | 56.97 | 6.28m |
| Min Regret | 1885.17 | 26.68 | 1.31m | 1309.39 | 64.37 | 6.42m | 783.96 | 52.17 | 6.61m |
| Gurobi | Kemeny Transformer (Our) | Markov Chain | Kiwisort | Minimal Regret | DECoR |
|---|---|---|---|---|---|
| Kemeny distance | |||||
| 997.63 | 1006.88 | 1039.63 | 1027.38 | 1031.38 | 1015.13 |
| Swiss | Germany | Canada | Germany | Canada | Germany |
| Germany | Canada | Germany | Canada | Australia | Swiss |
| Canada | Swiss | Australia | Swiss | Germany | Netherlands |
| Sweden | UK | USA | Australia | UK | UK |
Rank Aggregation
Rank aggregation combines ranked lists or pairwise preferences into a consensus ordering for tasks such as search, recommendation, and model evaluation.
See all 30 papers