IDEAS home Printed from https://ideas.repec.org/a/jss/jstsof/v020i07.html
   My bibliography  Save this article

Modeling of Responses and Response Times with the Package cirt

Author

Listed:
  • Fox, Jean-Paul
  • Entink, Rinke Klein
  • van der Linden, Wilm

Abstract

In computerized testing, the test takers' responses as well as their response times on the items are recorded. The relationship between response times and response accuracies is complex and varies over levels of observation. For example, it takes the form of a tradeoff between speed and accuracy at the level of a fixed person but may become a positive correlation for a population of test takers. In order to explore such relationships and test hypotheses about them, a conjoint model is proposed. Item responses are modeled by a two-parameter normal-ogive IRT model and response times by a lognormal model. The two models are combined using a hierarchical framework based on the fact that response times and responses are nested within individuals. All parameters can be estimated simultaneously using an MCMC estimation approach. A R-package for the MCMC algorithm is presented and explained.

Suggested Citation

  • Fox, Jean-Paul & Entink, Rinke Klein & van der Linden, Wilm, 2007. "Modeling of Responses and Response Times with the Package cirt," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i07).
    • Handle: RePEc:jss:jstsof:v:020:i07
    DOI: http://hdl.handle.net/10.18637/jss.v020.i07
    as

    Download full text from publisher

    File URL: https://www.jstatsoft.org/index.php/jss/article/view/v020i07/v20i07.pdf
    Download Restriction: no
    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v020i07/v20i07.R.zip
    Download Restriction: no
    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v020i07/cirt_1.0.tar.gz
    Download Restriction: no
    File URL: https://libkey.io/http://hdl.handle.net/10.18637/jss.v020.i07?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. McCulloch, Robert E. & Polson, Nicholas G. & Rossi, Peter E., 2000. "A Bayesian analysis of the multinomial probit model with fully identified parameters," Journal of Econometrics, Elsevier, vol. 99(1), pages 173-193, November.
    2. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wim Linden & Cees Glas, 2010. "Statistical Tests of Conditional Independence Between Responses and/or Response Times on Test Items," Psychometrika, Springer;The Psychometric Society, vol. 75(1), pages 120-139, March.
    2. repec:jss:jstsof:20:i01 is not listed on IDEAS
    3. Shaw, Amy & Elizondo, Fabian & Wadlington, Patrick L., 2020. "Reasoning, fast and slow: How noncognitive factors may alter the ability-speed relationship," Intelligence, Elsevier, vol. 83(C).
    4. Wim J. van der Linden, 2009. "A Bivariate Lognormal Response-Time Model for the Detection of Collusion Between Test Takers," Journal of Educational and Behavioral Statistics, , vol. 34(3), pages 378-394, September.
    5. Maria Bolsinova & Jesper Tijmstra, 2016. "Posterior Predictive Checks for Conditional Independence Between Response Time and Accuracy," Journal of Educational and Behavioral Statistics, , vol. 41(2), pages 123-145, April.
    6. Sukaesi Marianti & Jean-Paul Fox & Marianna Avetisyan & Bernard P. Veldkamp & Jesper Tijmstra, 2014. "Testing for Aberrant Behavior in Response Time Modeling," Journal of Educational and Behavioral Statistics, , vol. 39(6), pages 426-451, December.
    7. Dylan Molenaar & Paul Boeck, 2018. "Response Mixture Modeling: Accounting for Heterogeneity in Item Characteristics across Response Times," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 279-297, June.
    8. M. Marsman & H. Sigurdardóttir & M. Bolsinova & G. Maris, 2019. "Characterizing the Manifest Probability Distributions of Three Latent Trait Models for Accuracy and Response Time," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 870-891, September.
    9. Konrad Klotzke & Jean-Paul Fox, 2019. "Modeling Dependence Structures for Response Times in a Bayesian Framework," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 649-672, September.
    10. de Leeuw, Jan & Mair, Patrick, 2007. "An Introduction to the Special Volume on "Psychometrics in R"," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 20(i01).
    11. repec:jss:jstsof:36:c01 is not listed on IDEAS
    12. Hyeon-Ah Kang & Yi Zheng & Hua-Hua Chang, 2020. "Online Calibration of a Joint Model of Item Responses and Response Times in Computerized Adaptive Testing," Journal of Educational and Behavioral Statistics, , vol. 45(2), pages 175-208, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zellner, Arnold & Ando, Tomohiro, 2010. "A direct Monte Carlo approach for Bayesian analysis of the seemingly unrelated regression model," Journal of Econometrics, Elsevier, vol. 159(1), pages 33-45, November.
    2. repec:jss:jstsof:20:i07 is not listed on IDEAS
    3. R. Klein Entink & J.-P. Fox & W. Linden, 2009. "A Multivariate Multilevel Approach to the Modeling of Accuracy and Speed of Test Takers," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 21-48, March.
    4. Buddhavarapu, Prasad & Bansal, Prateek & Prozzi, Jorge A., 2021. "A new spatial count data model with time-varying parameters," Transportation Research Part B: Methodological, Elsevier, vol. 150(C), pages 566-586.
    5. Mumtaz, Haroon & Theodoridis, Konstantinos, 2017. "Common and country specific economic uncertainty," Journal of International Economics, Elsevier, vol. 105(C), pages 205-216.
    6. Jesse Elliott & Zemin Bai & Shu-Ching Hsieh & Shannon E Kelly & Li Chen & Becky Skidmore & Said Yousef & Carine Zheng & David J Stewart & George A Wells, 2020. "ALK inhibitors for non-small cell lung cancer: A systematic review and network meta-analysis," PLOS ONE, Public Library of Science, vol. 15(2), pages 1-18, February.
    7. Christina Leuker & Thorsten Pachur & Ralph Hertwig & Timothy J. Pleskac, 2019. "Do people exploit risk–reward structures to simplify information processing in risky choice?," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 5(1), pages 76-94, August.
    8. Francois Olivier & Laval Guillaume, 2011. "Deviance Information Criteria for Model Selection in Approximate Bayesian Computation," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 10(1), pages 1-25, July.
    9. Raggi, Davide & Bordignon, Silvano, 2012. "Long memory and nonlinearities in realized volatility: A Markov switching approach," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3730-3742.
    10. Angelica Gianfreda & Francesco Ravazzolo & Luca Rossini, 2023. "Large Time‐Varying Volatility Models for Hourly Electricity Prices," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 545-573, June.
    11. Rubio, F.J. & Steel, M.F.J., 2011. "Inference for grouped data with a truncated skew-Laplace distribution," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3218-3231, December.
    12. Paleti, Rajesh, 2018. "Generalized multinomial probit Model: Accommodating constrained random parameters," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 248-262.
    13. Alessandri, Piergiorgio & Mumtaz, Haroon, 2019. "Financial regimes and uncertainty shocks," Journal of Monetary Economics, Elsevier, vol. 101(C), pages 31-46.
    14. Padilla, Juan L. & Azevedo, Caio L.N. & Lachos, Victor H., 2018. "Multidimensional multiple group IRT models with skew normal latent trait distributions," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 250-268.
    15. Svetlana V. Tishkovskaya & Paul G. Blackwell, 2021. "Bayesian estimation of heterogeneous environments from animal movement data," Environmetrics, John Wiley & Sons, Ltd., vol. 32(6), September.
    16. David Macro & Jeroen Weesie, 2016. "Inequalities between Others Do Matter: Evidence from Multiplayer Dictator Games," Games, MDPI, vol. 7(2), pages 1-23, April.
    17. Rub'en Loaiza-Maya & Didier Nibbering, 2022. "Fast variational Bayes methods for multinomial probit models," Papers 2202.12495, arXiv.org, revised Oct 2022.
    18. Robert Zeithammer & Peter Lenk, 2006. "Bayesian estimation of multivariate-normal models when dimensions are absent," Quantitative Marketing and Economics (QME), Springer, vol. 4(3), pages 241-265, September.
    19. Tautenhahn, Susanne & Heilmeier, Hermann & Jung, Martin & Kahl, Anja & Kattge, Jens & Moffat, Antje & Wirth, Christian, 2012. "Beyond distance-invariant survival in inverse recruitment modeling: A case study in Siberian Pinus sylvestris forests," Ecological Modelling, Elsevier, vol. 233(C), pages 90-103.
    20. Julian P. T. Higgins & Simon G. Thompson & David J. Spiegelhalter, 2009. "A re‐evaluation of random‐effects meta‐analysis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(1), pages 137-159, January.
    21. Simon Mak & Derek Bingham & Yi Lu, 2016. "A regional compound Poisson process for hurricane and tropical storm damage," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 65(5), pages 677-703, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jss:jstsof:v:020:i07. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum (email available below). General contact details of provider: http://www.jstatsoft.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.