Optimization for Statistical Machine Translation
A Survey
Bibliographic Data
| ID | 12156189 |
|---|---|
| Authors | Graham Neubig (0000-0002-2072-3789, Graduate School of Information Science Nara Institute of Science and Technology, corresponding author), Taro Watanabe (Google Inc.) |
| Year | 2016 |
| Volume | 42 |
| Issue | 1 |
| Pages | 1-54 |
| Publication date | 2016-02-23 |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Computational Linguistics (JOURNAL) |
| Journal identifiers | ISSN: 0891-2017 • E-ISSN: 1530-9312 |
| Publisher | Association for Computational Linguistics (PUBLISHER • US) |
| DOI | 10.1162/coli_a_00241 |
| OpenAlex | W2300537905 |
| Language | EN |
| References cited | 80 |
In statistical machine translation (SMT), the optimization of the system parameters to maximize translation accuracy is now a fundamental part of virtually all modern systems. In this article, we survey 12 years of research on optimization for SMT, from the seminal work on discriminative models (Och and Ney 2002) and minimum error rate training (Och 2003), to the most recent advances. Starting with a brief introduction to the fundamentals of SMT systems, we follow by covering a wide variety of optimization algorithms for use in both batch and online optimization. Specifically, we discuss losses based on direct error minimization, maximum likelihood, maximum margin, risk minimization, ranking, and more, along with the appropriate methods for minimizing these losses. We also cover recent topics, including large-scale optimization, nonlinear models, domain-dependent optimization, and the effect of MT evaluation measures or search on optimization. Finally, we discuss the current state of affairs in MT optimization, and point out some unresolved problems that will likely be the target of further research in optimization for MT
Algorithm · Discriminative model · Machine learning · Machine translation · Margin (machine learning · Mathematical optimization · Minification · Optimization problem · Ranking (information retrieval · Algorithms and Data Compression · Computer Science · Mathematics · Natural Language Processing Techniques · Topic Modeling · Artificial Intelligence
| Highly cited | No |
|---|