IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v3y2009i1p72-77.html
   My bibliography  Save this article

A machine learning approach for Arabic text classification using N-gram frequency statistics

Author

Listed:
  • Khreisat, Laila

Abstract

In this paper a machine learning approach for classifying Arabic text documents is presented. To handle the high dimensionality of text documents, embeddings are used to map each document (instance) into R (the set of real numbers) representing the tri-gram frequency statistics profiles for a document. Classification is achieved by computing a dissimilarity measure, called the Manhattan distance, between the profile of the instance to be classified and the profiles of all the instances in the training set. The class (category) to which an instance (document) belongs is the one with the least computed Manhattan measure. The Dice similarity measure is used to compare the performance of method. Results show that tri-gram text classification using the Dice measure outperforms classification using the Manhattan measure.

Suggested Citation

  • Khreisat, Laila, 2009. "A machine learning approach for Arabic text classification using N-gram frequency statistics," Journal of Informetrics, Elsevier, vol. 3(1), pages 72-77.
    • Handle: RePEc:eee:infome:v:3:y:2009:i:1:p:72-77
    DOI: 10.1016/j.joi.2008.11.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157708000709
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2008.11.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rehab M. Duwairi, 2006. "Machine learning for Arabic text categorization," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(8), pages 1005-1010, June.
    2. Leo Egghe, 2000. "The Distribution of N-Grams," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(2), pages 237-252, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Volkovich, Zeev & Granichin, Oleg & Redkin, Oleg & Bernikova, Olga, 2016. "Modeling and visualization of media in Arabic," Journal of Informetrics, Elsevier, vol. 10(2), pages 439-453.
    2. Hornik, Kurt & Mair, Patrick & Rauch, Johannes & Geiger, Wilhelm & Buchta, Christian & Feinerer, Ingo, 2013. "The textcat Package for n-Gram Based Text Categorization in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 52(i06).
    3. Dogan, Turgut & Uysal, Alper Kursat, 2020. "A novel term weighting scheme for text classification: TF-MONO," Journal of Informetrics, Elsevier, vol. 14(4).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jan M. Gerken & Martin G. Moehrle, 2012. "A new instrument for technology monitoring: novelty in patents measured by semantic patent analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 645-670, June.
    2. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    3. Piotr Gabrielczak & Tomasz Serwach, 2019. "Firm-size distribution in Poland – is power law applicable?," Lodz Economics Working Papers 3/2019, University of Lodz, Faculty of Economics and Sociology.
    4. Emad Al‐Shawakfa & Amer Al‐Badarneh & Safwan Shatnawi & Khaleel Al‐Rabab'ah & Basel Bani‐Ismail, 2010. "A comparison study of some Arabic root finding algorithms," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(5), pages 1015-1024, May.
    5. Michael Nelson & J. Stephen Downie, 2002. "Informetric analysis of a music database," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(2), pages 243-255, June.
    6. Martin G. Moehrle & Jan M. Gerken, 2012. "Measuring textual patent similarity on the basis of combined concepts: design decisions and their consequences," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 805-826, June.
    7. Mohammed Rushdi‐Saleh & M. Teresa Martín‐Valdivia & L. Alfonso Ureña‐López & José M. Perea‐Ortega, 2011. "OCA: Opinion corpus for Arabic," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(10), pages 2045-2054, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:3:y:2009:i:1:p:72-77. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.