IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v38y2013i1p61-80.html
   My bibliography  Save this article

Analyzing Response Times in Tests With Rank Correlation Approaches

Author

Listed:
  • Jochen Ranger

    (University of Giessen)

  • Jörg-Tobias Kuhn

    (University of Münster)

Abstract

It is common practice to log-transform response times before analyzing them with standard factor analytical methods. However, sometimes the log-transformation is not capable of linearizing the relation between the response times and the latent traits. Therefore, a more general approach to response time analysis is proposed in the current manuscript. The approach is based on the assumption that the response times can be decomposed into a linear function of latent traits and a normally distributed residual term after the response times have been transformed by a monotone, but otherwise unknown transformation function. The proposed model can be fitted by a limited information approach, using the matrix of Kendall’s τ coefficients and unweighted least squares estimation. The transformation function can be determined by resorting to discrete time. The proposed approach offers a framework for testing model fit by comparing expected and observed correlations and for investigating the hypothesis about the form of the transformation function. The adequacy of the proposed approaches to model calibration and model validation are investigated in a simulation study. Two real data sets are analyzed as a demonstration of the model’s applicability.

Suggested Citation

  • Jochen Ranger & Jörg-Tobias Kuhn, 2013. "Analyzing Response Times in Tests With Rank Correlation Approaches," Journal of Educational and Behavioral Statistics, , vol. 38(1), pages 61-80, February.
    • Handle: RePEc:sae:jedbes:v:38:y:2013:i:1:p:61-80
    DOI: 10.3102/1076998611431086
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998611431086
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998611431086?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Albert Maydeu-Olivares, 2006. "Limited information estimation and testing of discretized multivariate normal structural models," Psychometrika, Springer;The Psychometric Society, vol. 71(1), pages 57-77, March.
    2. Eric Maris, 1993. "Additive and multiplicative models for gamma distributed random variables, and their application as psychometric models for response times," Psychometrika, Springer;The Psychometric Society, vol. 58(3), pages 445-469, September.
    3. Bengt Muthén, 1978. "Contributions to factor analysis of dichotomous variables," Psychometrika, Springer;The Psychometric Society, vol. 43(4), pages 551-560, December.
    4. Christophe Croux & Catherine Dehon, 2010. "Influence functions of the Spearman and Kendall correlation measures," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 19(4), pages 497-515, November.
    5. Peter Craig, 2008. "A new reconstruction of multivariate normal orthant probabilities," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(1), pages 227-243, February.
    6. Steven J. Luck & Edward K. Vogel, 1997. "The capacity of visual working memory for features and conjunctions," Nature, Nature, vol. 390(6657), pages 279-281, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Albert Maydeu-Olivares & Harry Joe, 2006. "Limited Information Goodness-of-fit Testing in Multidimensional Contingency Tables," Psychometrika, Springer;The Psychometric Society, vol. 71(4), pages 713-732, December.
    2. Jochen Ranger & Jorg-Tobias Kuhn, 2012. "A flexible latent trait model for response times in tests," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 31-47, January.
    3. Igor S. Utochkin & Vladislav A. Khvostov & Yulia M. Stakina, 2017. "Ensemble-Based Segmentation in the Perception of Multiple Feature Conjunctions," HSE Working papers WP BRP 78/PSY/2017, National Research University Higher School of Economics.
    4. Barati, Hojjat & Yazici, Anil & Almotahari, Amirmasoud, 2024. "A methodology for ranking of critical links in transportation networks based on criticality score distributions," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    5. Pablo Aragonés‐Beltrán & Mª. Carmen González‐Cruz & Astrid León‐Camargo & Rosario Viñoles‐Cebolla, 2023. "Assessment of regional development needs according to criteria based on the Sustainable Development Goals in the Meta Region (Colombia)," Sustainable Development, John Wiley & Sons, Ltd., vol. 31(2), pages 1101-1121, April.
    6. Christopher T. Whelan, 1991. "Chronic Stress, Social Support and Psychological Distress. Published as 'The Role of Social Support in Mediating the Psychological Consequences of Economic Stress', Sociology of Health and Illness, 19," Papers WP023, Economic and Social Research Institute (ESRI).
    7. Jastrzębski, Jan & Ciechanowska, Iwona & Chuderski, Adam, 2018. "The strong link between fluid intelligence and working memory cannot be explained away by strategy use," Intelligence, Elsevier, vol. 66(C), pages 44-53.
    8. Albert Maydeu-Olivares, 2006. "Limited information estimation and testing of discretized multivariate normal structural models," Psychometrika, Springer;The Psychometric Society, vol. 71(1), pages 57-77, March.
    9. Yang Yixin & Lü Xin & Ma Jian & Qiao Han, 2014. "A Robust Factor Analysis Model for Dichotomous Data," Journal of Systems Science and Information, De Gruyter, vol. 2(5), pages 437-450, October.
    10. Aki Kondo & Jun Saiki, 2012. "Feature-Specific Encoding Flexibility in Visual Working Memory," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-8, December.
    11. Z. I. Botev, 2017. "The normal law under linear restrictions: simulation and estimation via minimax tilting," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 125-148, January.
    12. Aristidis Nikoloulopoulos & Harry Joe, 2015. "Factor Copula Models for Item Response Data," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 126-150, March.
    13. Hongwei Tan & Sebastiaan van Dijken, 2023. "Dynamic machine vision with retinomorphic photomemristor-reservoir computing," Nature Communications, Nature, vol. 14(1), pages 1-9, December.
    14. Robert W. Faff & Sebastian Kernbach, 2021. "A visualisation approach for pitching research," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(4), pages 5177-5197, December.
    15. Harrison-Trainor, Matthew, 2022. "An analysis of random elections with large numbers of voters," Mathematical Social Sciences, Elsevier, vol. 116(C), pages 68-84.
    16. Yuri A. Markov & Natalia A. Tiurina & Igor S. Utochkin, 2018. "Different features are stored independently in visual working memory but mediated by object-based representations," HSE Working papers WP BRP 101/PSY/2018, National Research University Higher School of Economics.
    17. Henry Brady, 1989. "Factor and ideal point analysis for interpersonally incomparable data," Psychometrika, Springer;The Psychometric Society, vol. 54(2), pages 181-202, June.
    18. Tullo, Domenico & Faubert, Jocelyn & Bertone, Armando, 2018. "The characterization of attention resource capacity and its relationship with fluid reasoning intelligence: A multiple object tracking study," Intelligence, Elsevier, vol. 69(C), pages 158-168.
    19. Edward Haertel, 1990. "Continuous and discrete latent structure models for item response data," Psychometrika, Springer;The Psychometric Society, vol. 55(3), pages 477-494, September.
    20. Liang Wu & Lin Guan & Feng Li & Qi Zhao & Yingjun Zhuo & Peng Chen & Yaotang Lv, 2018. "Optimal Dynamic Reactive Power Reserve for Wind Farms Addressing Short-Term Voltage Issues Caused by Wind Turbines Tripping," Energies, MDPI, vol. 11(7), pages 1-15, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:38:y:2013:i:1:p:61-80. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.