IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v45y2020i5p534-568.html
   My bibliography  Save this article

Assessing Fit of the Lognormal Model for Response Times

Author

Listed:
  • Sandip Sinharay

    (6729Educational Testing Service)

  • Peter W. van Rijn

    (452225ETS Global)

Abstract

Response time models (RTMs) are of increasing interest in educational and psychological testing. This article focuses on the lognormal model for response times, which is one of the most popular RTMs. Several existing statistics for testing normality and the fit of factor analysis models are repurposed for testing the fit of the lognormal model. A simulation study and two real data examples demonstrate the usefulness of the statistics. The Shapiro–Wilk test of normality and a z -test for factor analysis models were the most powerful in assessing the misfit of the lognormal model.

Suggested Citation

  • Sandip Sinharay & Peter W. van Rijn, 2020. "Assessing Fit of the Lognormal Model for Response Times," Journal of Educational and Behavioral Statistics, , vol. 45(5), pages 534-568, October.
    • Handle: RePEc:sae:jedbes:v:45:y:2020:i:5:p:534-568
    DOI: 10.3102/1076998620911935
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998620911935
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998620911935?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. R. Bock & Murray Aitkin, 1981. "Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm," Psychometrika, Springer;The Psychometric Society, vol. 46(4), pages 443-459, December.
    2. Wim Linden & Fanmin Guo, 2008. "Bayesian Procedures for Identifying Aberrant Response-Time Patterns in Adaptive Testing," Psychometrika, Springer;The Psychometric Society, vol. 73(3), pages 365-384, September.
    3. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    4. Wim Linden & Cees Glas, 2010. "Statistical Tests of Conditional Independence Between Responses and/or Response Times on Test Items," Psychometrika, Springer;The Psychometric Society, vol. 75(1), pages 120-139, March.
    5. K. Jöreskog, 1967. "Some contributions to maximum likelihood factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 32(4), pages 443-482, December.
    6. Wim van der Linden, 2007. "A Hierarchical Framework for Modeling Speed and Accuracy on Test Items," Psychometrika, Springer;The Psychometric Society, vol. 72(3), pages 287-308, September.
    7. Eric Maris, 1993. "Additive and multiplicative models for gamma distributed random variables, and their application as psychometric models for response times," Psychometrika, Springer;The Psychometric Society, vol. 58(3), pages 445-469, September.
    8. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    9. Alberto Maydeu-Olivares, 2017. "Assessing the Size of Model Misfit in Structural Equation Models," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 533-558, September.
    10. Haruhiko Ogasawara, 2001. "Standard errors of fit indices using residuals in structural equation modeling," Psychometrika, Springer;The Psychometric Society, vol. 66(3), pages 421-436, September.
    11. Gunter Maris & Han Maas, 2012. "Speed-Accuracy Response Models: Scoring Rules based on Response Time and Accuracy," Psychometrika, Springer;The Psychometric Society, vol. 77(4), pages 615-633, October.
    12. Albert Satorra, 1989. "Alternative test criteria in covariance structure analysis: A unified approach," Psychometrika, Springer;The Psychometric Society, vol. 54(1), pages 131-151, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang Liu & Weimeng Wang, 2022. "Semiparametric Factor Analysis for Item-Level Response Time Data," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 666-692, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dylan Molenaar & Paul Boeck, 2018. "Response Mixture Modeling: Accounting for Heterogeneity in Item Characteristics across Response Times," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 279-297, June.
    2. Hyeon-Ah Kang & Yi Zheng & Hua-Hua Chang, 2020. "Online Calibration of a Joint Model of Item Responses and Response Times in Computerized Adaptive Testing," Journal of Educational and Behavioral Statistics, , vol. 45(2), pages 175-208, April.
    3. Yi-Hsuan Lee & Zhiliang Ying, 2015. "A Mixture Cure-Rate Model for Responses and Response Times in Time-Limit Tests," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 748-775, September.
    4. Maria Bolsinova & Paul Boeck & Jesper Tijmstra, 2017. "Modelling Conditional Dependence Between Response Time and Accuracy," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1126-1148, December.
    5. Yang Liu & Weimeng Wang, 2022. "Semiparametric Factor Analysis for Item-Level Response Time Data," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 666-692, June.
    6. Minjeong Jeon & Paul Boeck & Jevan Luo & Xiangrui Li & Zhong-Lin Lu, 2021. "Modeling Within-Item Dependencies in Parallel Data on Test Responses and Brain Activation," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 239-271, March.
    7. Guastadisegni, Lucia & Cagnone, Silvia & Moustaki, Irini & Vasdekis, Vassilis, 2022. "Use of the Lagrange multiplier test for assessing measurement invariance under model misspecification," LSE Research Online Documents on Economics 110358, London School of Economics and Political Science, LSE Library.
    8. Inhan Kang & Paul Boeck & Roger Ratcliff, 2022. "Modeling Conditional Dependence of Response Accuracy and Response Time with the Diffusion Item Response Theory Model," Psychometrika, Springer;The Psychometric Society, vol. 87(2), pages 725-748, June.
    9. Steffi Pohl & Esther Ulitzsch & Matthias Davier, 2019. "Using Response Times to Model Not-Reached Items due to Time Limits," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 892-920, September.
    10. M. Marsman & H. Sigurdardóttir & M. Bolsinova & G. Maris, 2019. "Characterizing the Manifest Probability Distributions of Three Latent Trait Models for Accuracy and Response Time," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 870-891, September.
    11. Alberto Maydeu-Olivares, 2017. "Assessing the Size of Model Misfit in Structural Equation Models," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 533-558, September.
    12. Matthias von Davier & Lale Khorramdel & Qiwei He & Hyo Jeong Shin & Haiwen Chen, 2019. "Developments in Psychometric Population Models for Technology-Based Large-Scale Assessments: An Overview of Challenges and Opportunities," Journal of Educational and Behavioral Statistics, , vol. 44(6), pages 671-705, December.
    13. Edison M. Choe & Jinming Zhang & Hua-Hua Chang, 2018. "Sequential Detection of Compromised Items Using Response Times in Computerized Adaptive Testing," Psychometrika, Springer;The Psychometric Society, vol. 83(3), pages 650-673, September.
    14. Frederik Coomans & Abe Hofman & Matthieu Brinkhuis & Han L J van der Maas & Gunter Maris, 2016. "Distinguishing Fast and Slow Processes in Accuracy - Response Time Data," PLOS ONE, Public Library of Science, vol. 11(5), pages 1-19, May.
    15. Edgar Merkle & Jinyan Fan & Achim Zeileis, 2014. "Testing for Measurement Invariance with Respect to an Ordinal Variable," Psychometrika, Springer;The Psychometric Society, vol. 79(4), pages 569-584, October.
    16. Shiyu Wang & Yinghan Chen, 2020. "Using Response Times and Response Accuracy to Measure Fluency Within Cognitive Diagnosis Models," Psychometrika, Springer;The Psychometric Society, vol. 85(3), pages 600-629, September.
    17. Hyeon-Ah Kang, 2023. "Sequential Generalized Likelihood Ratio Tests for Online Item Monitoring," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 672-696, June.
    18. Chun Wang & Gongjun Xu & Zhuoran Shang, 2018. "A Two-Stage Approach to Differentiating Normal and Aberrant Behavior in Computer Based Testing," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 223-254, March.
    19. Dylan Molenaar, 2015. "Heteroscedastic Latent Trait Models for Dichotomous Data," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 625-644, September.
    20. Renske E. Kuijpers & Ingmar Visser & Dylan Molenaar, 2021. "Testing the Within-State Distribution in Mixture Models for Responses and Response Times," Journal of Educational and Behavioral Statistics, , vol. 46(3), pages 348-373, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:45:y:2020:i:5:p:534-568. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.