Study on Phrase Processing of English Texts by Neural Machine Translation
DOI:
https://doi.org/10.13052/jicts2245-800X.1431Keywords:
Neural machine translation, English text, phrase, bilingual evaluation understudyAbstract
The current research on neural machine translation (NMT) rarely involves phrase processing, which leads to poor translation quality. This paper first gives a brief introduction to NMT and the Transformer model. Then, a statistical machine translation (SMT)-based phrase processing method that adds phrases in different suffix forms to the source-end sentences was proposed to improve translation quality. Experiments were conducted on the China Workshop on Machine Translation 2018 (CWMT2018) dataset (Chinese-English) and the WMT2014 dataset (English-German). The results showed that, among the three suffix forms, only adding the target phrase sequence in the suffix form was conducive to improving the translation quality of the Transformer model: the mean bilingual evaluation understudy (BLEU) value increased by 0.0254 on the Chinese-English dataset and by 0.0105 on the English-German dataset compared with the baseline model. Compared with NMT models such as seq2seq, the Transformer model combined with phrase processing obtained the best BLEU value, and the resulting translation was more in line with the reference translation. The results verify that the proposed method is reliable and can be applied in practice.
Downloads
References
A. Mishra, D. Ganesh, A. Sharma, R. Vignesh, “Applying Natural Language Processing for Detecting Cybersecurity Threats Using Sentimental Analysis Techniques,” International Conference on Data Science, Machine Learning and Applications, 594–600, 2025.
H. Wang, H. Wang, “An Application System for Evaluating and Optimizing the Quality of Neural Machine Translation Corpus,” in 2022 IEEE International Conference on e-Business Engineering (ICEBE), 178–183, 2022.
S. J. Hwang, C. S. Jeong, “Integrating Pre-trained Language Model into Neural Machine Translation,” 2023 2nd International Conference on Frontiers of Communications, Information System and Data Science (CISDS), 59–66, 2023.
X. Liu, J. Zeng, Z. S. J. Wang, “Exploring iterative dual domain adaptation for neural machine translation,” Knowl-based Syst., 283(Jan.11), 1.1–1.12, 2024.
Y. Xiao, L. Wu, J. Guo, J. Li, M. Zhang, T. Qin, T. Y. Liu, “A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond,” IEEE T. Pattern Anal., (10), p. 45, 2023.
Z. Yirmibesoglu, T. Gungor, “Morphologically Motivated Input Variations and Data Augmentation in Turkish-English Neural Machine Translation,” ACM T. Asian Low-reso., 22(3), 1–31, 2023.
C. Su, H. Huang, S. Shi, P. Jian, “Improving Neural Machine Translation by Transferring Knowledge from Syntactic Constituent Alignment Learning,” ACM T. Asian Low-reso., 21(5), 1–15, 2022.
C. Mi, S. Xie, “Language relatedness evaluation for multilingual neural machine translation,” Neurocomputing, 570(Feb.14), 127115.1–127115.15, 2024.
P. Wang, H. Hou, S. Sun, N. Wu, W. Jian, Z. Yang, Y. Wang, “Hot-Start Transfer Learning Combined with Approximate Distillation for Mongolian-Chinese Neural Machine Translation,” China Conference on Machine Translation, 12–23, 2022.
M. P. Sebastian, G. S. Kumar, “Malayalam Natural Language Processing: Challenges in Building a Phrase-Based Statistical Machine Translation System,” ACM T. Asian Low-reso., 22(4), 1–51, 2023.
B. Ahmadnia, B. J. Dorr, R. Aranovich, “Impact of Filtering Generated Pseudo Bilingual Texts in Low-Resource Neural Machine Translation Enhancement: The Case of Persian-Spanish,” Proc. Comput. Sci., 189, 136–141, 2021.
Q. D. E. J. Ren, Y. Su, N. Wu, “Research on Mongolian-Chinese machine translation based on the end-to-end neural network,” Int. J. Wavelets Multi, 18(01), 46–59, 2020.
Q. Li, W. Xie, Y. Wang, K. Qin, M. Huang, T. Liu, Z. Chen, L. Chen, L. Teng, Y. Fang, L. Ye, Z. Chen, J. Zhang, A. Li, W. Yang, S. Liu, “A Deep Learning Application of Capsule Endoscopic Gastric Structure Recognition Based on a Transformer Model,” J. Clin. Gastroenterol, 58(9), 937–943, 2024.
P. Warule, S. Chandratre, S. P. Mishra, S. Deb, “Detection of the common cold from speech signals using transformer model and spectral features,” Biomed Signal Proces, 93(July), 1–9, 2024.
R. Rosado, O. G. Toledano-López, H. R. González, A. J. Abreu, Y. Hernandez, “Cuban Consumer Price Index Forecasting Through Transformer with Attention,” J. Autom. Mob. Robot. Intell. Syst., 17(2), 12–17, 2023.
J. K. Kummerfeld, D. Hall, J. R. Curran, D. Klein, “Parser Showdown at the Wall Street Corral: An Empirical Investigation of Error Types in Parser Output,” in Proceeding of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, 1048–1059, 2012.
K. Grashchenkov, A. Grabovoy, I. Khabutdinov, “A Method of Multilingual Summarization For Scientific Documents,” 2022 Ivannikov Ispras Open Conference (ISPRAS), 24–30, 2022.
H. Yang, Y. Qin, Y. Deng, M. Wang, “NMT Enhancement based on Knowledge Graph Mining with Pre-trained Language Model,” in 2020 22nd International Conference on Advanced Communication Technology (ICACT), 185–189, 2020.
Y. Li, J. Li, M. Zhang, “Improving neural machine translation with latent features feedback,” Neurocomputing, 463, 368–378, 2021.
N. J. Suha, M. A. R. Khan, M. S. Hossain, “A Neural Machine Translation Approach for Translating Different Languages in English,” Trends Appl Sci Res, 18(1), 169–182, 2023.
K. Sun, T. Qian, X. Chen, M. Zhong, “Context-aware seq2seq translation model for sequential recommendation,” Inform Sciences, 581, 60–72, 2021.
S. Ishiwatari, J. Yao, S. Liu, M. Li, M. Zhou, N. Yoshinaga, M. Kitsuregawa, W. Jia, “Chunk-based Decoder for Neural Machine Translation,” in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, 1901–1912, 2017.
E. Hasler, A. de Gispert, G. Iglesias, B. Byrne, “Neural Machine Translation Decoding with Terminology Constraints,” in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 506–512, 2018.
