IDEAS home Printed from https://ideas.repec.org/a/ibn/masjnl/v13y2019i10p26.html
   My bibliography  Save this article

Scaled Pearson’s Correlation Coefficient for Evaluating Text Similarity Measures

Author

Listed:
  • Issa Atoum

Abstract

Despite the ever-increasing interest in the field of text similarity methods, the development of adequate text similarity methods is lagging. Some methods are decent in entailment while others are reasonable to the degree to which two texts are similar. Very often, these methods are compared using Pearson’s correlation; however, Pearson’s correlation is bound to outliers that could affect the final correlation coefficient figure. As a result, the Pearson correlation is inadequate to find which text similarity method is better in situations where data items are very similar or are unrelated. This paper borrows the scaled Pearson correlation from the finance domain and builds a metric that can evaluate the performance of similarity methods over cross-sectional datasets. Results showed that the new metric is fine-grained with the benchmark dataset scores range as a promising alternative to Pearson’s correlation. Moreover, extrinsic results from the application of the System Usability Scale (SUS) questionnaire on the scaled Pearson correlation revealed that the proposed metric is attaining attention from scholars which implicate its usage in the academia.

Suggested Citation

  • Issa Atoum, 2019. "Scaled Pearson’s Correlation Coefficient for Evaluating Text Similarity Measures," Modern Applied Science, Canadian Center of Science and Education, vol. 13(10), pages 1-26, October.
  • Handle: RePEc:ibn:masjnl:v:13:y:2019:i:10:p:26
    as

    Download full text from publisher

    File URL: https://ccsenet.org/journal/index.php/mas/article/download/0/0/40746/42038
    Download Restriction: no

    File URL: https://ccsenet.org/journal/index.php/mas/article/view/0/40746
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Xiaomei Wu & Erli Pang & Kui Lin & Zhen-Ming Pei, 2013. "Improving the Measurement of Semantic Similarity between Gene Ontology Terms and Gene Products: Insights from an Edge- and IC-Based Hybrid Method," PLOS ONE, Public Library of Science, vol. 8(5), pages 1-11, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Charles Bettembourg & Christian Diot & Olivier Dameron, 2015. "Optimal Threshold Determination for Interpreting Semantic Similarity and Particularity: Application to the Comparison of Gene Sets and Metabolic Pathways Using GO and ChEBI," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-30, July.
    2. Gaston K Mazandu & Nicola J Mulder, 2014. "Information Content-Based Gene Ontology Functional Similarity Measures: Which One to Use for a Given Biological Data Type?," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-20, December.

    More about this item

    JEL classification:

    • R00 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General - - - General
    • Z0 - Other Special Topics - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ibn:masjnl:v:13:y:2019:i:10:p:26. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Canadian Center of Science and Education (email available below). General contact details of provider: https://edirc.repec.org/data/cepflch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.