Home|Journals|Articles by Year|Audio Abstracts
 

Original Article

JJCIT. 2023; 9(1): 21-35


Effectiveness of Zero-shot Models in Automatic Arabic Poem Generation

Mohamed El Ghaly Beheitt, Moez Ben Hajhmida.




Abstract

Text generation is one of the most challenging applications in artificial intelligence and natural language processing. In recent years, text generation has gotten much attention thanks to the advances in deep learning and language modeling approaches. However, writing poetry is a challenging activity for humans that necessitates creativity and a high level of linguistic ability. Therefore, automatic poem generation is an important research issue that has piqued the interest of the Natural Language Processing (NLP) community. Several researchers have examined automatic poem generation using deep learning approaches, but little has focused on Arabic poetry. In this work, we exhibit how we utilize various GPT-2 and GPT-3 models to automatically generate Arabic poems. BLEU scores and human evaluation are used to evaluate the results of four GPT-based models. Both BLEU scores and human evaluations indicate that fine-tuned GPT-2 outperforms GPT-3 and fine-tuned GPT-3 models, with GPT-3 model having the lowest value in terms of Poeticness. To the best of the authors' knowledge, this work is the first in literature that employs and fine-tunes GPT-3 to generate Arabic poems.

Key words: Natural Language Processing (NLP), Natural Language Generation (NLG), Deep Learning, Transformer, GPT-2, GPT-3, Arabic Poems






Full-text options


Share this Article


Online Article Submission
• ejmanager.com




ejPort - eJManager.com
Refer & Earn
JournalList
About BiblioMed
License Information
Terms & Conditions
Privacy Policy
Contact Us

The articles in Bibliomed are open access articles licensed under Creative Commons Attribution 4.0 International License (CC BY), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.