IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v38y2013i4p418-438.html
   My bibliography  Save this article

Speededness and Adaptive Testing

Author

Listed:
  • Wim J. van der Linden

    (CTB/McGraw-Hill)

  • Xinhui Xiong

    (CTB/McGraw-Hill)

Abstract

Two simple constraints on the item parameters in a response–time model are proposed to control the speededness of an adaptive test. As the constraints are additive, they can easily be included in the constraint set for a shadow-test approach (STA) to adaptive testing. Alternatively, a simple heuristic is presented to control speededness in plain adaptive testing without any constraints. Both types of control are easy to implement and do not require any other real-time parameter estimation during the test than the regular update of the test taker’s ability estimate. Evaluation of the two approaches using simulated adaptive testing showed that the STA was especially effective. It guaranteed testing times that differed less than 10 seconds from a reference test across a variety of conditions.

Suggested Citation

  • Wim J. van der Linden & Xinhui Xiong, 2013. "Speededness and Adaptive Testing," Journal of Educational and Behavioral Statistics, , vol. 38(4), pages 418-438, August.
    • Handle: RePEc:sae:jedbes:v:38:y:2013:i:4:p:418-438
    DOI: 10.3102/1076998612466143
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998612466143
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998612466143?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. R. Klein Entink & J.-P. Fox & W. Linden, 2009. "A Multivariate Multilevel Approach to the Modeling of Accuracy and Speed of Test Takers," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 21-48, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Must, Olev & Must, Aasa, 2018. "Speed and the Flynn Effect," Intelligence, Elsevier, vol. 68(C), pages 37-47.
    2. Maria Bolsinova & Jesper Tijmstra, 2016. "Posterior Predictive Checks for Conditional Independence Between Response Time and Accuracy," Journal of Educational and Behavioral Statistics, , vol. 41(2), pages 123-145, April.
    3. Sukaesi Marianti & Jean-Paul Fox & Marianna Avetisyan & Bernard P. Veldkamp & Jesper Tijmstra, 2014. "Testing for Aberrant Behavior in Response Time Modeling," Journal of Educational and Behavioral Statistics, , vol. 39(6), pages 426-451, December.
    4. Xueying Tang & Zhi Wang & Qiwei He & Jingchen Liu & Zhiliang Ying, 2020. "Latent Feature Extraction for Process Data via Multidimensional Scaling," Psychometrika, Springer;The Psychometric Society, vol. 85(2), pages 378-397, June.
    5. Sun-Joo Cho & Paul Boeck & Susan Embretson & Sophia Rabe-Hesketh, 2014. "Additive Multilevel Item Structure Models with Random Residuals: Item Modeling for Explanation and Item Generation," Psychometrika, Springer;The Psychometric Society, vol. 79(1), pages 84-104, January.
    6. Steffi Pohl & Esther Ulitzsch & Matthias Davier, 2019. "Using Response Times to Model Not-Reached Items due to Time Limits," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 892-920, September.
    7. Shaw, Amy & Elizondo, Fabian & Wadlington, Patrick L., 2020. "Reasoning, fast and slow: How noncognitive factors may alter the ability-speed relationship," Intelligence, Elsevier, vol. 83(C).
    8. Lara Fontanella & Annalina Sarra & Pasquale Valentini & Simone Zio & Sara Fontanella, 2018. "Varying levels of anomie in Europe: a multilevel analysis based on multidimensional IRT models," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(4), pages 589-610, October.
    9. Fang Liu & Xiaojing Wang & Roeland Hancock & Ming-Hui Chen, 2022. "Bayesian Model Assessment for Jointly Modeling Multidimensional Response Data with Application to Computerized Testing," Psychometrika, Springer;The Psychometric Society, vol. 87(4), pages 1290-1317, December.
    10. Maria Bolsinova & Jesper Tijmstra, 2019. "Modeling Differences Between Response Times of Correct and Incorrect Responses," Psychometrika, Springer;The Psychometric Society, vol. 84(4), pages 1018-1046, December.
    11. Di Mascio, Rita & Fatima, Johra, 2018. "The role of identification in frontline employee decision-making," Journal of Retailing and Consumer Services, Elsevier, vol. 43(C), pages 131-138.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:38:y:2013:i:4:p:418-438. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.