Multi-level Encoder with Global Topic for Task-oriented Dialogue Summarization
Organizations: College of Mathematics and Informatics, South China Agricultural University, Guangzhou, China
Abstract
Task-oriented dialogue summarization aims to automatically extract key information to generate domain summaries to improve service efficiency and quality. Task-oriented dialogue is inherently logical and surrounds specific topic. How to effectively capture the dialogue topic and the most salient information becomes one of the major challenges of this task. In this paper, we propose a task-oriented dialogue summarization model utilizing a multi-level encoder with global topic (MLEGT). This model discovers temporal and spatial dependencies through a multi-level encoder, while simultaneously obtaining a simple yet effective global topic in the process of graph construction. It not only captures the crucial details but also breaks the long-range limit and discover the intrinsic structure across the dialogue. Then, a global topic guided pointer mechanism is added into the summrizer to capture ignored but important information, which is helpful to improve the accuracy of the summary. A comprehensive study of two public datasets, including a real-world large-scale Chinese police interrogation dataset and a medical reporting service dataset proves the superiority of our method on several strong baselines.
Figures & tables
| Model | LCSPIRT | Medical DS | ||||
|---|---|---|---|---|---|---|
| Rouge-1 | Rouge-2 | Rouge-L | Rouge-1 | Rouge-2 | Rouge-L | |
| PGN | 40.03 | 25.14 | 31.7 | 62.7 | 55.77 | 57.23 |
| BART | 73.36 | 56.34 | 71.43 | 63.53 | 51.15 | 56.55 |
| T5-pegasus | 77.27 | 69.10 | 72.35 | 58.08 | 51.34 | 52.01 |
| TDS+NTM | 74.78 | 60.37 | 72.84 | 63.85 | 51.82 | 56.53 |
| GPT-4o (few-shot) | 80.04 | 67.56 | 78.59 | 61.85 | 45.39 | 55.25 |
| Ref Summary : 2017年 02月06日08时 到2017年 02月06日17时下午1218时张某某 在 蝶湖湾 花园1723201 被嫌疑人以其他 入室手段 窃走 黑色华硕牌A45笔记本电脑1台 。 From 08:00 on February 6th , 2017 to 17:00 on February 6th , 2017 at 1218 p.m. , a black Asus A45 laptop from Zhang was stolen by the suspect by other means in the Butterfly Lake Bay Garden 1723201 . |
|---|
| SDDS (baseline) : 2017年02月06日08时到2017年 2月06某某 在 昆山市玉山镇蝶湖湾花园 3 栋被嫌疑人以其他入室手段窃走1台黑色华硕牌A45型笔记本电脑 ……现金人民币500元。 某某。银行卡等物品。都是网络通讯软件的。 From 08:00 on February 6th, 2017 to February 6th, 2017 , a black Asus A45 laptop from XX was stolen by the suspect by other means in the 3 building of the Butterfly Lake Bay Garden in Yushan Town, Kunshan City . . . The cash is 500 yuan. Something. Bank cards and other items. It’s all from the network communications software. |
| MLEGT : 2017年02月06日08时到2017年 03 月06号17时下午1218时张某某在蝶湖湾花园 17232015 被嫌疑人以其他入室手段窃走黑色华硕牌A45型笔记本电脑1台。 From 08:00 on February 6th, 2017 to 17:00 on March 6th, 2017, at 1218 PM, a black Asus A45 laptop from Zhang was stolen by the suspect by other means in Butterfly Lake Bay Garden 17232015 . |
Text Summarization
Text summarization develops methods for condensing documents while preserving the information, perspective, and evidence readers need.
See all 142 papers