IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v574y2021ics0378437121002922.html
   My bibliography  Save this article

Word frequency–rank relationship in tagged texts

Author

Listed:
  • Chacoma, Andrés
  • Zanette, Damián H.

Abstract

We analyze the frequency–rank relationship in sub-vocabularies corresponding to three different grammatical classes (nouns, verbs, and others) in a collection of literary works in English, whose words have been automatically tagged according to their grammatical role. Comparing with a null hypothesis which assumes that words belonging to each class are uniformly distributed across the frequency–ranked vocabulary of the whole work, we disclose statistically significant differences between the three classes. This results point to the fact that frequency–rank relationships may reflect linguistic features associated with grammatical function.

Suggested Citation

  • Chacoma, Andrés & Zanette, Damián H., 2021. "Word frequency–rank relationship in tagged texts," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 574(C).
    • Handle: RePEc:eee:phsmap:v:574:y:2021:i:c:s0378437121002922
    DOI: 10.1016/j.physa.2021.126020
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437121002922
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000
    File URL: https://libkey.io/10.1016/j.physa.2021.126020?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ficcadenti, Valerio & Cerqueti, Roy & Ausloos, Marcel & Dhesi, Gurjeet, 2020. "Words ranking and Hirsch index for identifying the core of the hapaxes in political texts," Journal of Informetrics, Elsevier, vol. 14(3).
    2. Zoubin Ghahramani, 2015. "Probabilistic machine learning and artificial intelligence," Nature, Nature, vol. 521(7553), pages 452-459, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Valero, Jordi & Pérez-Casany, Marta & Duarte-López, Ariel, 2022. "The Zipf-Polylog distribution: Modeling human interactions through social networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 603(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Masafumi Nakano & Akihiko Takahashi & Soichiro Takahashi, 2018. "State Space Approach to Adaptive Artificial Intelligence Modeling: Application to Financial Portfolio with Fuzzy System," CARF F-Series CARF-F-422, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    2. Li, Yi & Liu, Kailong & Foley, Aoife M. & Zülke, Alana & Berecibar, Maitane & Nanini-Maury, Elise & Van Mierlo, Joeri & Hoster, Harry E., 2019. "Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 113(C), pages 1-1.
    3. Qiqin Zhou, 2024. "Explainable AI in Request-for-Quote," Papers 2407.15038, arXiv.org.
    4. Valerio Ficcadenti & Roy Cerqueti & Ciro Hosseini Varde’i, 2023. "A rank-size approach to analyse soccer competitions and teams: the case of the Italian football league “Serie A"," Annals of Operations Research, Springer, vol. 325(1), pages 85-113, June.
    5. Manis, K.T. & Madhavaram, Sreedhar, 2023. "AI-Enabled marketing capabilities and the hierarchy of capabilities: Conceptualization, proposition development, and research avenues," Journal of Business Research, Elsevier, vol. 157(C).
    6. Efrat Taig & Ohad Ben-Shahar, 2019. "Gradient Surfing: A New Deterministic Approach for Low-Dimensional Global Optimization," Journal of Optimization Theory and Applications, Springer, vol. 180(3), pages 855-878, March.
    7. O’Dwyer, Edward & Pan, Indranil & Acha, Salvador & Shah, Nilay, 2019. "Smart energy systems for sustainable smart cities: Current developments, trends and future directions," Applied Energy, Elsevier, vol. 237(C), pages 581-597.
    8. Masafumi Nakano & Akihiko Takahashi & Soichiro Takahashi, 2017. "State Space Approach to Adaptive Fuzzy Modeling: Application to Financial Investment," CIRJE F-Series CIRJE-F-1067, CIRJE, Faculty of Economics, University of Tokyo.
    9. Zhixue Sun & Baosheng Jiang & Xiangling Li & Jikang Li & Kang Xiao, 2020. "A Data-Driven Approach for Lithology Identification Based on Parameter-Optimized Ensemble Learning," Energies, MDPI, vol. 13(15), pages 1-15, July.
    10. Chen-Ying Hung & Ching-Heng Lin & Tsuo-Hung Lan & Giia-Sheun Peng & Chi-Chun Lee, 2019. "Development of an intelligent decision support system for ischemic stroke risk assessment in a population-based electronic health record database," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-16, March.
    11. Cerqueti, Roy & Lupi, Claudio & Pietrovito, Filomena & Pozzolo, Alberto Franco, 2022. "Rank–size distributions for banks: A cross-country analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 585(C).
    12. Paola Perchinunno & Massimo Bilancia & Domenico Vitale, 2021. "A Statistical Analysis of Factors Affecting Higher Education Dropouts," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 156(2), pages 341-362, August.
    13. Cui, Mianshan, 2022. "District heating load prediction algorithm based on bidirectional long short-term memory network model," Energy, Elsevier, vol. 254(PA).
    14. Golsefidi, Atefeh Hemmati & Hüttel, Frederik Boe & Peled, Inon & Samaranayake, Samitha & Pereira, Francisco Câmara, 2023. "A joint machine learning and optimization approach for incremental expansion of electric vehicle charging infrastructure," Transportation Research Part A: Policy and Practice, Elsevier, vol. 178(C).
    15. Xiaojie Geng & Shunchuan Wu & Yanjie Zhang & Junlong Sun & Haiyong Cheng & Zhongxin Zhang & Shijiang Pu, 2023. "Developing hybrid XGBoost model integrated with entropy weight and Bayesian optimization for predicting tunnel squeezing intensity," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 119(1), pages 751-771, October.
    16. Mardia, Kanti V., 2024. "Fisher’s pioneering work on discriminant analysis and its impact on Artificial Intelligence," Journal of Multivariate Analysis, Elsevier, vol. 203(C).
    17. Pantano, Eleonora & Pizzi, Gabriele, 2020. "Forecasting artificial intelligence on online customer assistance: Evidence from chatbot patents analysis," Journal of Retailing and Consumer Services, Elsevier, vol. 55(C).
    18. Ramadhan, Raden A.A. & Heatubun, Yosca R.J. & Tan, Sek F. & Lee, Hyun-Jin, 2021. "Comparison of physical and machine learning models for estimating solar irradiance and photovoltaic power," Renewable Energy, Elsevier, vol. 178(C), pages 1006-1019.
    19. Zhang, Ran & Ji, ChunHui & Zhou, Xing & Liu, Tianyu & Jin, Guang & Pan, Zhengqiang & Liu, Yajie, 2024. "Capacity estimation of lithium-ion batteries with uncertainty quantification based on temporal convolutional network and Gaussian process regression," Energy, Elsevier, vol. 297(C).
    20. Qiang Liu & Qingmiao Liu & Minhuan Wang, 2024. "Sustainable Decision-Making Enhancement: Trust and Linguistic-Enhanced Conflict Measurement in Evidence Theory," Sustainability, MDPI, vol. 16(6), pages 1-25, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:574:y:2021:i:c:s0378437121002922. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.