Tashkeela: Novel corpus of Arabic vocalized texts, data for auto-diacritization systems

Publication date: Available online 3 February 2017
Source:Data in Brief
Author(s): Taha Zerrouki, Amar Balla
Arabic diacritics are often missed in Arabic scripts. This feature is a handicap for new learner to read َArabic, text to speech conversion systems, reading and semantic analysis of Arabic texts.The automatic diacritization systems are the best solution to handle this issue. But such automation needs resources as diactritized texts to train and evaluate such systems.In this paper, we describe our corpus of Arabic diacritized texts. This corpus is called Tashkeela. It can be used as a linguistic resource tool for natural language processing such as automatic diacritics systems, dis-ambiguity mechanism, features and data extraction.The corpus is freely available, it contains 75 million of fully vocalized words mainly 97 books from classical and modern Arabic language.The corpus is collected from manually vocalized texts using web crawling process.



http://ift.tt/2kDboDW