IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v49y2024i4p658-686.html
   My bibliography  Save this article

A Multistrategy Cognitive Diagnosis Model Incorporating Item Response Times Based on Strategy Selection Theories

Author

Listed:
  • Junhuan Wei

    (Jiangxi Normal University)

  • Liufen Luo

    (Fuzhou Vocational Technical College)

  • Yan Cai
  • Dongbo Tu

    (Jiangxi Normal University)

Abstract

Response times (RTs) facilitate the quantification of underlying cognitive processes in problem-solving behavior. To provide more comprehensive diagnostic feedback on strategy selection and attribute profiles with multistrategy cognitive diagnosis model (CDM) and utilize additional information for item RTs, this study develops a multistrategy cognitive diagnosis modeling framework combined with RTs. The proposed model integrates individual response accuracy and RT into a unified framework to define strategy selection and make it closer to the individual’s strategy selection process. Simulation studies demonstrated that the proposed model had reasonable parameter recovery and attribute classification accuracy and outperformed the existing multistrategy CDMs and single-strategy CDMs in terms of performance. Empirical results further illustrated the practical application and the advantages of the proposed model.

Suggested Citation

  • Junhuan Wei & Liufen Luo & Yan Cai & Dongbo Tu, 2024. "A Multistrategy Cognitive Diagnosis Model Incorporating Item Response Times Based on Strategy Selection Theories," Journal of Educational and Behavioral Statistics, , vol. 49(4), pages 658-686, August.
    • Handle: RePEc:sae:jedbes:v:49:y:2024:i:4:p:658-686
    DOI: 10.3102/10769986231200469
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/10769986231200469
    Download Restriction: no
    File URL: https://libkey.io/10.3102/10769986231200469?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wim van der Linden, 2007. "A Hierarchical Framework for Modeling Speed and Accuracy on Test Items," Psychometrika, Springer;The Psychometric Society, vol. 72(3), pages 287-308, September.
    2. Hans-Friedrich Köhn & Chia-Yi Chiu, 2017. "A Procedure for Assessing the Completeness of the Q-Matrices of Cognitively Diagnostic Tests," Psychometrika, Springer;The Psychometric Society, vol. 82(1), pages 112-132, March.
    3. Jonathan Templin & Laine Bradshaw, 2013. "Measuring the Reliability of Diagnostic Classification Model Examinee Estimates," Journal of Classification, Springer;The Classification Society, vol. 30(2), pages 251-275, July.
    4. Tianyou Wang & Jiawei Zhang, 2006. "Optimal Partitioning of Testing Time: Theoretical Properties and Practical Implications," Psychometrika, Springer;The Psychometric Society, vol. 71(1), pages 105-120, March.
    5. Chia-Yi Chiu & Jeffrey Douglas & Xiaodong Li, 2009. "Cluster Analysis for Cognitive Diagnosis: Theory and Applications," Psychometrika, Springer;The Psychometric Society, vol. 74(4), pages 633-665, December.
    6. Maria Bolsinova & Paul Boeck & Jesper Tijmstra, 2017. "Modelling Conditional Dependence Between Response Time and Accuracy," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1126-1148, December.
    7. Jimmy de la Torre, 2011. "The Generalized DINA Model Framework," Psychometrika, Springer;The Psychometric Society, vol. 76(2), pages 179-199, April.
    8. Jimmy Torre & Jeffrey Douglas, 2004. "Higher-order latent trait models for cognitive diagnosis," Psychometrika, Springer;The Psychometric Society, vol. 69(3), pages 333-353, September.
    9. Robert Mislevy & Norman Verhelst, 1990. "Modeling item responses when different subjects employ different solution strategies," Psychometrika, Springer;The Psychometric Society, vol. 55(2), pages 195-215, June.
    10. Jimmy de la Torre & Jeffrey Douglas, 2008. "Model Evaluation and Multiple Strategies in Cognitive Diagnosis: An Analysis of Fraction Subtraction Data," Psychometrika, Springer;The Psychometric Society, vol. 73(4), pages 595-624, December.
    11. Jimmy Torre, 2011. "Erratum to: The Generalized DINA Model Framework," Psychometrika, Springer;The Psychometric Society, vol. 76(3), pages 510-510, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matthew S. Johnson & Sandip Sinharay, 2020. "The Reliability of the Posterior Probability of Skill Attainment in Diagnostic Classification Models," Journal of Educational and Behavioral Statistics, , vol. 45(1), pages 5-31, February.
    2. Hans-Friedrich Köhn & Chia-Yi Chiu, 2018. "How to Build a Complete Q-Matrix for a Cognitively Diagnostic Test," Journal of Classification, Springer;The Classification Society, vol. 35(2), pages 273-299, July.
    3. Hans-Friedrich Köhn & Chia-Yi Chiu, 2017. "A Procedure for Assessing the Completeness of the Q-Matrices of Cognitively Diagnostic Tests," Psychometrika, Springer;The Psychometric Society, vol. 82(1), pages 112-132, March.
    4. Xin Xu & Guanhua Fang & Jinxin Guo & Zhiliang Ying & Susu Zhang, 2024. "Diagnostic Classification Models for Testlets: Methods and Theory," Psychometrika, Springer;The Psychometric Society, vol. 89(3), pages 851-876, September.
    5. Laine Bradshaw & Jonathan Templin, 2014. "Combining Item Response Theory and Diagnostic Classification Models: A Psychometric Model for Scaling Ability and Diagnosing Misconceptions," Psychometrika, Springer;The Psychometric Society, vol. 79(3), pages 403-425, July.
    6. Chia-Yi Chiu & Hans-Friedrich Köhn, 2019. "Consistency Theory for the General Nonparametric Classification Method," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 830-845, September.
    7. Hans Friedrich Köhn & Chia-Yi Chiu, 2021. "A Unified Theory of the Completeness of Q-Matrices for the DINA Model," Journal of Classification, Springer;The Classification Society, vol. 38(3), pages 500-518, October.
    8. Motonori Oka & Kensuke Okada, 2023. "Scalable Bayesian Approach for the Dina Q-Matrix Estimation Combining Stochastic Optimization and Variational Inference," Psychometrika, Springer;The Psychometric Society, vol. 88(1), pages 302-331, March.
    9. James Joseph Balamuta & Steven Andrew Culpepper, 2022. "Exploratory Restricted Latent Class Models with Monotonicity Requirements under PÒLYA–GAMMA Data Augmentation," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 903-945, September.
    10. Peida Zhan & Wen-Chung Wang & Xiaomin Li, 2020. "A Partial Mastery, Higher-Order Latent Structural Model for Polytomous Attributes in Cognitive Diagnostic Assessments," Journal of Classification, Springer;The Classification Society, vol. 37(2), pages 328-351, July.
    11. Chun Wang & Jing Lu, 2021. "Learning Attribute Hierarchies From Data: Two Exploratory Approaches," Journal of Educational and Behavioral Statistics, , vol. 46(1), pages 58-84, February.
    12. Jürgen Heller & Luca Stefanutti & Pasquale Anselmi & Egidio Robusto, 2015. "On the Link between Cognitive Diagnostic Models and Knowledge Space Theory," Psychometrika, Springer;The Psychometric Society, vol. 80(4), pages 995-1019, December.
    13. Peida Zhan & Xin Qiao, 2022. "DIAGNOSTIC Classification Analysis of Problem-Solving Competence using Process Data: An Item Expansion Method," Psychometrika, Springer;The Psychometric Society, vol. 87(4), pages 1529-1547, December.
    14. Yinghan Chen & Ying Liu & Steven Andrew Culpepper & Yuguo Chen, 2021. "Inferring the Number of Attributes for the Exploratory DINA Model," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 30-64, March.
    15. Steven Andrew Culpepper, 2023. "A Note on Weaker Conditions for Identifying Restricted Latent Class Models for Binary Responses," Psychometrika, Springer;The Psychometric Society, vol. 88(1), pages 158-174, March.
    16. Seunghyun Lee & Yuqi Gu, 2024. "New Paradigm of Identifiable General-response Cognitive Diagnostic Models: Beyond Categorical Data," Psychometrika, Springer;The Psychometric Society, vol. 89(4), pages 1304-1336, December.
    17. Yinyin Chen & Steven Culpepper & Feng Liang, 2020. "A Sparse Latent Class Model for Cognitive Diagnosis," Psychometrika, Springer;The Psychometric Society, vol. 85(1), pages 121-153, March.
    18. Yinghan Chen & Shiyu Wang, 2023. "Bayesian Estimation of Attribute Hierarchy for Cognitive Diagnosis Models," Journal of Educational and Behavioral Statistics, , vol. 48(6), pages 810-841, December.
    19. Guanhua Fang & Jingchen Liu & Zhiliang Ying, 2019. "On the Identifiability of Diagnostic Classification Models," Psychometrika, Springer;The Psychometric Society, vol. 84(1), pages 19-40, March.
    20. Peida Zhan & Hong Jiao & Dandan Liao & Feiming Li, 2019. "A Longitudinal Higher-Order Diagnostic Classification Model," Journal of Educational and Behavioral Statistics, , vol. 44(3), pages 251-281, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:49:y:2024:i:4:p:658-686. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.