IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v38y2013i1p61-80.html
   My bibliography  Save this article

Analyzing Response Times in Tests With Rank Correlation Approaches

Author

Listed:
  • Jochen Ranger

    (University of Giessen)

  • Jörg-Tobias Kuhn

    (University of Münster)

Abstract

It is common practice to log-transform response times before analyzing them with standard factor analytical methods. However, sometimes the log-transformation is not capable of linearizing the relation between the response times and the latent traits. Therefore, a more general approach to response time analysis is proposed in the current manuscript. The approach is based on the assumption that the response times can be decomposed into a linear function of latent traits and a normally distributed residual term after the response times have been transformed by a monotone, but otherwise unknown transformation function. The proposed model can be fitted by a limited information approach, using the matrix of Kendall’s τ coefficients and unweighted least squares estimation. The transformation function can be determined by resorting to discrete time. The proposed approach offers a framework for testing model fit by comparing expected and observed correlations and for investigating the hypothesis about the form of the transformation function. The adequacy of the proposed approaches to model calibration and model validation are investigated in a simulation study. Two real data sets are analyzed as a demonstration of the model’s applicability.

Suggested Citation

  • Jochen Ranger & Jörg-Tobias Kuhn, 2013. "Analyzing Response Times in Tests With Rank Correlation Approaches," Journal of Educational and Behavioral Statistics, , vol. 38(1), pages 61-80, February.
    • Handle: RePEc:sae:jedbes:v:38:y:2013:i:1:p:61-80
    DOI: 10.3102/1076998611431086
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998611431086
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998611431086?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Albert Maydeu-Olivares, 2006. "Limited information estimation and testing of discretized multivariate normal structural models," Psychometrika, Springer;The Psychometric Society, vol. 71(1), pages 57-77, March.
    2. Eric Maris, 1993. "Additive and multiplicative models for gamma distributed random variables, and their application as psychometric models for response times," Psychometrika, Springer;The Psychometric Society, vol. 58(3), pages 445-469, September.
    3. Bengt Muthén, 1978. "Contributions to factor analysis of dichotomous variables," Psychometrika, Springer;The Psychometric Society, vol. 43(4), pages 551-560, December.
    4. Christophe Croux & Catherine Dehon, 2010. "Influence functions of the Spearman and Kendall correlation measures," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 19(4), pages 497-515, November.
    5. Peter Craig, 2008. "A new reconstruction of multivariate normal orthant probabilities," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(1), pages 227-243, February.
    6. Steven J. Luck & Edward K. Vogel, 1997. "The capacity of visual working memory for features and conjunctions," Nature, Nature, vol. 390(6657), pages 279-281, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Albert Maydeu-Olivares & Harry Joe, 2006. "Limited Information Goodness-of-fit Testing in Multidimensional Contingency Tables," Psychometrika, Springer;The Psychometric Society, vol. 71(4), pages 713-732, December.
    2. Jochen Ranger & Jorg-Tobias Kuhn, 2012. "A flexible latent trait model for response times in tests," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 31-47, January.
    3. Barati, Hojjat & Yazici, Anil & Almotahari, Amirmasoud, 2024. "A methodology for ranking of critical links in transportation networks based on criticality score distributions," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    4. Yang Yixin & Lü Xin & Ma Jian & Qiao Han, 2014. "A Robust Factor Analysis Model for Dichotomous Data," Journal of Systems Science and Information, De Gruyter, vol. 2(5), pages 437-450, October.
    5. Aki Kondo & Jun Saiki, 2012. "Feature-Specific Encoding Flexibility in Visual Working Memory," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-8, December.
    6. Aristidis Nikoloulopoulos & Harry Joe, 2015. "Factor Copula Models for Item Response Data," Psychometrika, Springer;The Psychometric Society, vol. 80(1), pages 126-150, March.
    7. Tullo, Domenico & Faubert, Jocelyn & Bertone, Armando, 2018. "The characterization of attention resource capacity and its relationship with fluid reasoning intelligence: A multiple object tracking study," Intelligence, Elsevier, vol. 69(C), pages 158-168.
    8. Heimeriks, K. & Duysters, G.M. & Vanhaverbeke, W.P.M., 2004. "The evolution of alliance capabilities," Working Papers 04.20, Eindhoven Center for Innovation Studies.
    9. Michael Pfarrhofer, 2024. "Forecasts with Bayesian vector autoregressions under real time conditions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(3), pages 771-801, April.
    10. Alvarez, Agustín & Boente, Graciela & Kudraszow, Nadia, 2019. "Robust sieve estimators for functional canonical correlation analysis," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 46-62.
    11. Jifan Zhou & Jun Yin & Tong Chen & Xiaowei Ding & Zaifeng Gao & Mowei Shen, 2011. "Visual Working Memory Capacity Does Not Modulate the Feature-Based Information Filtering in Visual Working Memory," PLOS ONE, Public Library of Science, vol. 6(9), pages 1-10, September.
    12. Li, Qian & Huang, Zhuowei (Joy) & Christianson, Kiel, 2016. "Visual attention toward tourism photographs with text: An eye-tracking study," Tourism Management, Elsevier, vol. 54(C), pages 243-258.
    13. Yuri A. Markov & Igor S. Utochkin, 2017. "The Effect of Object Distinctiveness on Object-Location Binding in Visual Working Memory," HSE Working papers WP BRP 79/PSY/2017, National Research University Higher School of Economics.
    14. S. Cerreia-Vioglio & F. Maccheroni & M. Marinacci & A. Rustichini, 2017. "Multinomial logit processes and preference discovery: inside and outside the black box," Working Papers 615, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    15. Wu, Jianmin & Bentler, Peter M., 2013. "Limited information estimation in binary factor analysis: A review and extension," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 392-403.
    16. Steffen Grønneberg & Jonas Moss & Njål Foldnes, 2020. "Partial Identification of Latent Correlations with Binary Data," Psychometrika, Springer;The Psychometric Society, vol. 85(4), pages 1028-1051, December.
    17. Bengt Muthén & Anders Christoffersson, 1981. "Simultaneous factor analysis of dichotomous variables in several groups," Psychometrika, Springer;The Psychometric Society, vol. 46(4), pages 407-419, December.
    18. Arthur Lehner & Christoph Erlacher & Matthias Schlögl & Jacob Wegerer & Thomas Blaschke & Klaus Steinnocher, 2018. "Can ISO-Defined Urban Sustainability Indicators Be Derived from Remote Sensing: An Expert Weighting Approach," Sustainability, MDPI, vol. 10(4), pages 1-31, April.
    19. Vanderford Courtney & Sang Yongli & Dang Xin, 2020. "Two symmetric and computationally efficient Gini correlations," Dependence Modeling, De Gruyter, vol. 8(1), pages 373-395, January.
    20. Markus Jäntti & Eva M. Sierminska & Philippe Van Kerm, 2015. "Modeling the Joint Distribution of Income and Wealth," Research on Economic Inequality, in: Measurement of Poverty, Deprivation, and Economic Mobility, volume 23, pages 301-327, Emerald Group Publishing Limited.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:38:y:2013:i:1:p:61-80. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.