文章基本信息

标题：Towards a Decomposable Metric for Explainable Evaluation of Text Generation fromAMR
本地全文：下载
作者：Juri Opitz ; Anette Frank
期刊名称：Conference on European Chapter of the Association for Computational Linguistics (EACL)
出版年度：2021
卷号：2021
页码：1504-1518
DOI：10.18653/v1/2021.eacl-main.129
语种：English
出版社：ACL Anthology
摘要：Systems that generate natural language text from abstract meaning representations such as AMR are typically evaluated using automatic surface matching metrics that compare the generated texts to reference texts from which the input meaning representations were constructed. We show that besides well-known issues from which such metrics suffer, an additional problem arises when applying these metrics for AMR-to-text evaluation, since an abstract meaning representation allows for numerous surface realizations. In this work we aim to alleviate these issues by proposing.