Paper ID: 2307.14818

What Makes a Good Paraphrase: Do Automated Evaluations Work?

Anna Moskvina, Bhushan Kotnis, Chris Catacata, Michael Janz, Nasrin Saef

Paraphrasing is the task of expressing an essential idea or meaning in different words. But how different should the words be in order to be considered an acceptable paraphrase? And can we exclusively use automated metrics to evaluate the quality of a paraphrase? We attempt to answer these questions by conducting experiments on a German data set and performing automatic and expert linguistic evaluation.

Submitted: Jul 27, 2023