Home|Journals|Articles by Year|Audio Abstracts
 

Original Article

JJCIT. 2020; 6(2): 103-121


ACCURATE AND FAST RECURRENT NEURAL NETWORK SOLUTION FOR THE AUTOMATIC DIACRITIZATION OF ARABIC TEXT

Gheith Abandah, Asma Abdel Karim.




Abstract

Arabic is mostly written now without its diacritics (short vowels). Adding these diacritics decreases reading ambiguity among other benefits.This work aims to develop fast and accurate machine learning solution to diacritize Arabic text automatically.This paper uses long short-term memory (LSTM) recurrent neural networks to diacritize Arabic text. Intensive experiments are performed to evaluate proposed alternative design and data encoding options towards a fast and accurate solution. Our experiments involve investigating and handling problems in sequence lengths, proposing and evaluating alternative encodings of the diacritized output sequences, and tuning and evaluating neural network options including architecture, network size, and hyper-parameters. This paper recommends a solution that can be trained on a large dataset fast and uses four bidirectional LSTM layers to predict the diacritics of the input sequence of Arabic letters. This solution achieves diacritization error rate of 2.46% on the LDC ATB3 dataset benchmark and 1.97% on the larger new Tashkeela dataset. This latter rate is 47% improvement over the best-published previous result.

Key words: Automatic diacritization, Arabic Natural Language Processing, Sequence Transcription, Arabic Text, Recurrent Neural Networks, Long Short-Term Memory, Bidirectional Neural Network.






Full-text options


Share this Article


Online Article Submission
• ejmanager.com




ejPort - eJManager.com
Refer & Earn
JournalList
About BiblioMed
License Information
Terms & Conditions
Privacy Policy
Contact Us

The articles in Bibliomed are open access articles licensed under Creative Commons Attribution 4.0 International License (CC BY), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.