Abstract
We describe a set of experiments to explore statistical techniques for ranking and selecting the best translations in a graph of translation hypotheses. In a previous paper (Carl, 2007) we have described how the hypotheses graph is generated through shallow mapping and permutation rules . We have given examples of its
nodes consisting of vectors representing morpho-syntactic properties of words and phrases. This paper describes a number of methods for elaborating statistical feature functions from some of the vector components. The feature functions are trained off-line on different types of text and their log-linear combination is then used to retrieve the best translation paths in the graph. We compare two language modelling toolkits, the CMU and the SRI toolkit and arrive at three results: 1) word-lemma based feature function models produce better results than token-based models, 2) adding a PoS-tag feature function to the word-lemma model improves the output and 3) weights for lexical translations are suitable if the training material is similar to the texts to be translated.
nodes consisting of vectors representing morpho-syntactic properties of words and phrases. This paper describes a number of methods for elaborating statistical feature functions from some of the vector components. The feature functions are trained off-line on different types of text and their log-linear combination is then used to retrieve the best translation paths in the graph. We compare two language modelling toolkits, the CMU and the SRI toolkit and arrive at three results: 1) word-lemma based feature function models produce better results than token-based models, 2) adding a PoS-tag feature function to the word-lemma model improves the output and 3) weights for lexical translations are suitable if the training material is similar to the texts to be translated.
Original language | English |
---|---|
Title of host publication | The LREC 2008 Proceedings : The Sixth International Conference on Language Resources and Evaluation (LREC'08) |
Editors | Nicoletta Calzolari, Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias |
Number of pages | 8 |
Place of Publication | Paris |
Publisher | European Language Resources Association |
Publication date | 2008 |
Pages | 1140-1147 |
ISBN (Print) | 2951740840 |
Publication status | Published - 2008 |
Externally published | Yes |
Event | The 6th International Conference on Language Resources and Evaluation. LREC 2008 - Marrakech, Morocco Duration: 28 May 2008 → 30 May 2008 Conference number: 6 http://www.lrec-conf.org/lrec2008/ |
Conference
Conference | The 6th International Conference on Language Resources and Evaluation. LREC 2008 |
---|---|
Number | 6 |
Country/Territory | Morocco |
City | Marrakech |
Period | 28/05/2008 → 30/05/2008 |
Internet address |