文章基本信息

标题：Generating Alignments Using Target Foresight in Attention-Based Neural Machine Translation
本地全文：下载
作者：Jan-Thorsten Peter ; Arne Nix ; Hermann Ney 等
期刊名称：The Prague Bulletin of Mathematical Linguistics
印刷版ISSN：0032-6585
电子版ISSN：1804-0462
出版年度：2017
卷号：108
期号：1
页码：27-36
DOI：10.1515/pralin-2017-0006
语种：English
出版社：Walter de Gruyter GmbH
摘要：Neural machine translation (NMT) has shown large improvements in recent years. The currently most successful approach in this area relies on the attention mechanism, which is often interpreted as an alignment, even though it is computed without explicit knowledge of the target word. This limitation is the most likely reason that the quality of attention-based alignments is inferior to the quality of traditional alignment methods. Guided alignment training has shown that alignments are still capable of improving translation quality. In this work, we propose an extension of the attention-based NMT model that introduces target information into the attention mechanism to produce high-quality alignments. In comparison to the conventional attention-based alignments, our model halves the A er with an absolute improvement of 19.1% A er . Compared to GIZA++ it shows an absolute improvement of 2.0% A er .