IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v40y2015i3p274-306.html
   My bibliography  Save this article

Modeling Information Accumulation in Psychological Tests Using Item Response Times

Author

Listed:
  • Jochen Ranger

    (Martin-Luther-University Halle-Wittenberg)

  • Jörg-Tobias Kuhn

    (University of Münster)

Abstract

In this article, a latent trait model is proposed for the response times in psychological tests. The latent trait model is based on the linear transformation model and subsumes popular models from survival analysis, like the proportional hazards model and the proportional odds model. Core of the model is the assumption that an unspecified monotone transformation of the response times can be related to latent characteristics of the test taker. The model can be interpreted in terms of an information accumulation process, according to which test takers acquire information until they are able to respond. The rate of information accumulation can be related to the transformation function of the response times. In order to avoid strong distributional assumptions, the rate of information acquisition is approximated in a piecewise manner by a positive spline. The model can be calibrated with marginal maximum likelihood estimation. This allows a standard test of model fit as will be shown. The proposed approach to model estimation and model evaluation is investigated in a simulation study. Finally, the utility of the model is demonstrated in three real data sets.

Suggested Citation

  • Jochen Ranger & Jörg-Tobias Kuhn, 2015. "Modeling Information Accumulation in Psychological Tests Using Item Response Times," Journal of Educational and Behavioral Statistics, , vol. 40(3), pages 274-306, June.
    • Handle: RePEc:sae:jedbes:v:40:y:2015:i:3:p:274-306
    DOI: 10.3102/1076998615583903
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998615583903
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998615583903?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Francis Tuerlinckx & Paul Boeck, 2005. "Two interpretations of the discrimination parameter," Psychometrika, Springer;The Psychometric Society, vol. 70(4), pages 629-650, December.
    2. Jochen Ranger & Jorg-Tobias Kuhn, 2012. "A flexible latent trait model for response times in tests," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 31-47, January.
    3. Loeys, Tom & Legrand, Catherine & Schettino, Antonio & Pourtois, Gilles, 2014. "Semi-parametric proportional hazards models with crossed random effects for psychometric response times," LIDAM Reprints ISBA 2014035, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    4. Boracchi, Patrizia & Biganzoli, Elia & Marubini, Ettore, 2003. "Joint modelling of cause-specific hazard functions with cubic splines: an application to a large series of breast cancer patients," Computational Statistics & Data Analysis, Elsevier, vol. 42(1-2), pages 243-262, February.
    5. Steven J. Luck & Edward K. Vogel, 1997. "The capacity of visual working memory for features and conjunctions," Nature, Nature, vol. 390(6657), pages 279-281, November.
    6. Cai, Bo & Lin, Xiaoyan & Wang, Lianming, 2011. "Bayesian proportional hazards model for current status data with monotone splines," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2644-2651, September.
    7. T. Loeys & Y. Rosseel & K. Baten, 2011. "A Joint Modeling Approach for Reaction Time and Accuracy in Psycholinguistic Experiments," Psychometrika, Springer;The Psychometric Society, vol. 76(3), pages 487-503, July.
    8. José-luis Gaviria, 2005. "Increase in Precision when Estimating Parameters in Computer Assisted Testing Using Response Time," Quality & Quantity: International Journal of Methodology, Springer, vol. 39(1), pages 45-69, February.
    9. Jeffrey Douglas & Michael Kosorok & Betty Chewning, 1999. "A latent variable model for discrete multivariate psychometric waiting times," Psychometrika, Springer;The Psychometric Society, vol. 64(1), pages 69-82, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alan D. Hutson & Albert Vexler, 2018. "A Cautionary Note on Beta Families of Distributions and the Aliases Within," The American Statistician, Taylor & Francis Journals, vol. 72(2), pages 121-129, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tong-Yu Lu & Wai-Yin Poon & Siu Cheung, 2014. "A Unified Framework for the Comparison of Treatments with Ordinal Responses," Psychometrika, Springer;The Psychometric Society, vol. 79(4), pages 605-620, October.
    2. Peter W. Rijn & Usama S. Ali, 2018. "A Generalized Speed–Accuracy Response Model for Dichotomous Items," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 109-131, March.
    3. Jochen Ranger & Christoph König & Benjamin W. Domingue & Jörg-Tobias Kuhn & Andreas Frey, 2024. "A Multidimensional Partially Compensatory Response Time Model on Basis of the Log-Normal Distribution," Journal of Educational and Behavioral Statistics, , vol. 49(3), pages 431-464, June.
    4. Jochen Ranger & Jorg-Tobias Kuhn, 2012. "A flexible latent trait model for response times in tests," Psychometrika, Springer;The Psychometric Society, vol. 77(1), pages 31-47, January.
    5. Aki Kondo & Jun Saiki, 2012. "Feature-Specific Encoding Flexibility in Visual Working Memory," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-8, December.
    6. I. Ardoino & E. M. Biganzoli & C. Bajdik & P. J. Lisboa & P. Boracchi & F. Ambrogi, 2012. "Flexible parametric modelling of the hazard function in breast cancer studies," Journal of Applied Statistics, Taylor & Francis Journals, vol. 39(7), pages 1409-1421, December.
    7. Tullo, Domenico & Faubert, Jocelyn & Bertone, Armando, 2018. "The characterization of attention resource capacity and its relationship with fluid reasoning intelligence: A multiple object tracking study," Intelligence, Elsevier, vol. 69(C), pages 158-168.
    8. Jifan Zhou & Jun Yin & Tong Chen & Xiaowei Ding & Zaifeng Gao & Mowei Shen, 2011. "Visual Working Memory Capacity Does Not Modulate the Feature-Based Information Filtering in Visual Working Memory," PLOS ONE, Public Library of Science, vol. 6(9), pages 1-10, September.
    9. Udo Boehm & Maarten Marsman & Han L. J. Maas & Gunter Maris, 2021. "An Attention-Based Diffusion Model for Psychometric Analyses," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 938-972, December.
    10. Li, Qian & Huang, Zhuowei (Joy) & Christianson, Kiel, 2016. "Visual attention toward tourism photographs with text: An eye-tracking study," Tourism Management, Elsevier, vol. 54(C), pages 243-258.
    11. Yuri A. Markov & Igor S. Utochkin, 2017. "The Effect of Object Distinctiveness on Object-Location Binding in Visual Working Memory," HSE Working papers WP BRP 79/PSY/2017, National Research University Higher School of Economics.
    12. S. Cerreia-Vioglio & F. Maccheroni & M. Marinacci & A. Rustichini, 2017. "Multinomial logit processes and preference discovery: inside and outside the black box," Working Papers 615, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    13. Maria Bolsinova & Paul Boeck & Jesper Tijmstra, 2017. "Modelling Conditional Dependence Between Response Time and Accuracy," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1126-1148, December.
    14. Aldo Gardini & Carlo Trivisano & Enrico Fabrizi, 2021. "Bayesian Analysis of ANOVA and Mixed Models on the Log-Transformed Response Variable," Psychometrika, Springer;The Psychometric Society, vol. 86(2), pages 619-641, June.
    15. Chunling Wang & Xiaoyan Lin, 2022. "Bayesian Semiparametric Regression Analysis of Multivariate Panel Count Data," Stats, MDPI, vol. 5(2), pages 1-17, May.
    16. Gunter Maris & Han Maas, 2012. "Speed-Accuracy Response Models: Scoring Rules based on Response Time and Accuracy," Psychometrika, Springer;The Psychometric Society, vol. 77(4), pages 615-633, October.
    17. Ociepka, Michał & Kałamała, Patrycja & Chuderski, Adam, 2022. "High individual alpha frequency brains run fast, but it does not make them smart," Intelligence, Elsevier, vol. 92(C).
    18. Wang, Naichen & Wang, Lianming & McMahan, Christopher S., 2015. "Regression analysis of bivariate current status data under the Gamma-frailty proportional hazards model using the EM algorithm," Computational Statistics & Data Analysis, Elsevier, vol. 83(C), pages 140-150.
    19. repec:cup:judgdm:v:7:y:2012:i:3:p:254-267 is not listed on IDEAS
    20. Shaiyan Keshvari & Ronald van den Berg & Wei Ji Ma, 2013. "No Evidence for an Item Limit in Change Detection," PLOS Computational Biology, Public Library of Science, vol. 9(2), pages 1-9, February.
    21. Bin Zhu & Stephanie A. Watts, 2010. "Visualization of Network Concepts: The Impact of Working Memory Capacity Differences," Information Systems Research, INFORMS, vol. 21(2), pages 327-344, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:40:y:2015:i:3:p:274-306. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.