IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v10y2022i7p1025-d777517.html
   My bibliography  Save this article

Jointly Modeling Rating Responses and Times with Fuzzy Numbers: An Application to Psychometric Data

Author

Listed:
  • Niccolò Cao

    (DPSS, University of Padova, 35131 Padova, Italy)

  • Antonio Calcagnì

    (DPSS, University of Padova, 35131 Padova, Italy)

Abstract

In several research areas, ratings data and response times have been successfully used to unfold the stagewise process through which human raters provide their responses to questionnaires and social surveys. A limitation of the standard approach to analyze this type of data is that it requires the use of independent statistical models. Although this provides an effective way to simplify the data analysis, it could potentially involve difficulties with regard to statistical inference and interpretation. In this sense, a joint analysis could be more effective. In this research article, we describe a way to jointly analyze ratings and response times by means of fuzzy numbers. A probabilistic tree model framework has been adopted to fuzzify ratings data and four-parameters triangular fuzzy numbers have been used in order to integrate crisp responses and times. Finally, a real case study on psychometric data is discussed in order to illustrate the proposed methodology. Overall, we provide initial findings to the problem of using fuzzy numbers as abstract models for representing ratings data with additional information (i.e., response times). The results indicate that using fuzzy numbers leads to theoretically sound and more parsimonious data analysis methods, which limit some statistical issues that may occur with standard data analysis procedures.

Suggested Citation

  • Niccolò Cao & Antonio Calcagnì, 2022. "Jointly Modeling Rating Responses and Times with Fuzzy Numbers: An Application to Psychometric Data," Mathematics, MDPI, vol. 10(7), pages 1-11, March.
    • Handle: RePEc:gam:jmathe:v:10:y:2022:i:7:p:1025-:d:777517
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/10/7/1025/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/10/7/1025/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. De Boeck, Paul & Partchev, Ivailo, 2012. "IRTrees: Tree-Based Item Response Models of the GLMM Family," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(c01).
    2. Michael Veall & Klaus Zimmermann, 1994. "Evaluating Pseudo-R 2 's for binary probit models," Quality & Quantity: International Journal of Methodology, Springer, vol. 28(2), pages 151-164, May.
    3. De Boeck, Paul & Bakker, Marjan & Zwitser, Robert & Nivard, Michel & Hofman, Abe & Tuerlinckx, Francis & Partchev, Ivailo, 2011. "The Estimation of Item Response Models with the lmer Function from the lme4 Package in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 39(i12).
    4. Concepción Costas & Pedro Marañon & Juan Cabrera, 1994. "Application of diffuse measurement to the evaluation of psychological structures," Quality & Quantity: International Journal of Methodology, Springer, vol. 28(3), pages 305-313, August.
    5. Bjelland, Ingvar & Krokstad, Steinar & Mykletun, Arnstein & Dahl, Alv A. & Tell, Grethe S. & Tambs, K., 2008. "Does a higher educational level protect against anxiety and depression? The HUNT study," Social Science & Medicine, Elsevier, vol. 66(6), pages 1334-1345, March.
    6. Qing Li, 2016. "Indirect membership function assignment based on ordinal regression," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(3), pages 441-460, March.
    7. Antonio Calcagnì & Luigi Lombardi, 2022. "Modeling random and non-random decision uncertainty in ratings data: a fuzzy beta model," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 106(1), pages 145-173, March.
    8. Michelle Lalla & Gisella Facchinetti & Giovanni Mastroleo, 2005. "Ordinal scales and fuzzy set systems to measure agreement: An application to the evaluation of teaching activity," Quality & Quantity: International Journal of Methodology, Springer, vol. 38(5), pages 577-601, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrés López-Sepulcre & Sebastiano De Bona & Janne K. Valkonen & Kate D.L. Umbers & Johanna Mappes, 2015. "Item Response Trees: a recommended method for analyzing categorical data in behavioral studies," Behavioral Ecology, International Society for Behavioral Ecology, vol. 26(5), pages 1268-1273.
    2. Ana M. Castaño & M. Asunción Lubiano & Antonio L. García-Izquierdo, 2020. "Gendered Beliefs in STEM Undergraduates: A Comparative Analysis of Fuzzy Rating versus Likert Scales," Sustainability, MDPI, vol. 12(15), pages 1-17, August.
    3. Syed Latifi & Okan Bulut & Mark Gierl & Thomas Christie & Shehzad Jeeva, 2016. "Differential Performance on National Exams," SAGE Open, , vol. 6(2), pages 21582440166, June.
    4. Bonaccolto-Töpfer, Marina & Castagnetti, Carolina, 2021. "The COVID-19 pandemic: A threat to higher education?," Discussion Papers 117, Friedrich-Alexander University Erlangen-Nuremberg, Chair of Labour and Regional Economics.
    5. Pavlova, Milena & Hendrix, Marijke & Nouwens, Elvira & Nijhuis, Jan & van Merode, Godefridus, 2009. "The choice of obstetric care by low-risk pregnant women in the Netherlands: Implications for policy and management," Health Policy, Elsevier, vol. 93(1), pages 27-34, November.
    6. Joshua B. Gilbert & James S. Kim & Luke W. Miratrix, 2023. "Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions," Journal of Educational and Behavioral Statistics, , vol. 48(6), pages 889-913, December.
    7. Kuan-Yu Jin & Yi-Jhen Wu & Hui-Fang Chen, 2022. "A New Multiprocess IRT Model With Ideal Points for Likert-Type Items," Journal of Educational and Behavioral Statistics, , vol. 47(3), pages 297-321, June.
    8. Minjeong Jeon & Sophia Rabe-Hesketh, 2012. "Profile-Likelihood Approach for Estimating Generalized Linear Mixed Models With Factor Structures," Journal of Educational and Behavioral Statistics, , vol. 37(4), pages 518-542, August.
    9. Dora Matzke & Conor Dolan & William Batchelder & Eric-Jan Wagenmakers, 2015. "Bayesian Estimation of Multinomial Processing Tree Models with Heterogeneity in Participants and Items," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 205-235, March.
    10. Meng-Jie Wang & Kumar Yogeeswaran & Kyle Nash & Sivanand Sivaram, 2024. "Morality and partisan social media engagement: a natural language examination of moral political messaging and engagement during the 2018 US midterm elections," Journal of Computational Social Science, Springer, vol. 7(2), pages 1699-1726, October.
    11. repec:jss:jstsof:40:i05 is not listed on IDEAS
    12. Thorsten Meiser & Fabiola Reiber, 2023. "Item-Specific Factors in IRTree Models: When They Matter and When They Don’t," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 739-744, September.
    13. Scott W. Fausti & Matthew A. Diersen & Bashir A. Qasmi & Jing Li & Brent Lange, 2013. "The effect of animal gender on producer marketing behaviour," Applied Economics Letters, Taylor & Francis Journals, vol. 20(2), pages 180-185, February.
    14. Joshua B. Gilbert & Zachary Himmelsbach & James Soland & Mridul Joshi & Benjamin W. Domingue, 2024. "Estimating Heterogeneous Treatment Effects with Item-Level Outcome Data: Insights from Item Response Theory," Papers 2405.00161, arXiv.org, revised Jan 2025.
    15. Yingbin Zhang & Zhaoxi Yang & Yehui Wang, 2022. "The Impact of Extreme Response Style on the Mean Comparison of Two Independent Samples," SAGE Open, , vol. 12(2), pages 21582440221, June.
    16. Selen CAKMAKYAPAN & Atilla GOKTAS, 2013. "A Comparison Of Binary Logit And Probit Models With A Simulation Study," Journal of Social and Economic Statistics, Bucharest University of Economic Studies, vol. 2(1), pages 1-17, JULY.
    17. Selen Cakmakyapan & Haydar Demirhan, 2017. "A Monte Carlo-based pseudo-coefficient of determination for generalized linear models with binary outcome," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(14), pages 2458-2482, October.
    18. Qing Li, 2016. "Indirect membership function assignment based on ordinal regression," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(3), pages 441-460, March.
    19. Gyu Ri Kim & Chung Mo Nam, 2017. "Temporal trends in educational inequalities in non-communicable diseases in Korea, 2007-2015," PLOS ONE, Public Library of Science, vol. 12(12), pages 1-15, December.
    20. Boris Forthmann & Philipp Doebler, 2021. "Reliability of researcher capacity estimates and count data dispersion: a comparison of Poisson, negative binomial, and Conway-Maxwell-Poisson models," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3337-3354, April.
    21. Tindara Addabbo & Maria Laura Di Tommaso & Gisella Facchinetti, 2004. "To what extent fuzzy set theory and structural equation modelling can measure functionings? An application to child well being," CHILD Working Papers wp30_04, CHILD - Centre for Household, Income, Labour and Demographic economics - ITALY.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:10:y:2022:i:7:p:1025-:d:777517. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.