IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v46y2021i5p560-591.html
   My bibliography  Save this article

Adaptive Weight Estimation of Latent Ability: Application to Computerized Adaptive Testing With Response Revision

Author

Listed:
  • Shiyu Wang

    (14589University of Georgia)

  • Houping Xiao

    (1373Georgia State University)

  • Allan Cohen

    (1355University of Georgia)

Abstract

An adaptive weight estimation approach is proposed to provide robust latent ability estimation in computerized adaptive testing (CAT) with response revision. This approach assigns different weights to each distinct response to the same item when response revision is allowed in CAT. Two types of weight estimation procedures, nonfunctional and functional weight, are proposed to determine the weight adaptively based on the compatibility of each revised response with the assumed statistical model in relation to remaining observations. The application of this estimation approach to a data set collected from a large-scale multistage adaptive testing demonstrates the capability of this method to reveal more information regarding the test taker’s latent ability by using the valid response path compared with only using the very last response. Limited simulation studies were concluded to evaluate the proposed ability estimation method and to compare it with several other estimation procedures in literature. Results indicate that the proposed ability estimation approach is able to provide robust estimation results in two test-taking scenarios.

Suggested Citation

  • Shiyu Wang & Houping Xiao & Allan Cohen, 2021. "Adaptive Weight Estimation of Latent Ability: Application to Computerized Adaptive Testing With Response Revision," Journal of Educational and Behavioral Statistics, , vol. 46(5), pages 560-591, October.
    • Handle: RePEc:sae:jedbes:v:46:y:2021:i:5:p:560-591
    DOI: 10.3102/1076998620972800
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998620972800
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998620972800?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Duan Li & Wan‐Lung Ng, 2000. "Optimal Dynamic Portfolio Selection: Multiperiod Mean‐Variance Formulation," Mathematical Finance, Wiley Blackwell, vol. 10(3), pages 387-406, July.
    2. D. A. Williams, 1987. "Generalized Linear Model Diagnostics Using the Deviance and Single Case Deletions," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 36(2), pages 181-191, June.
    3. Thomas Warm, 1989. "Weighted likelihood estimation of ability in item response theory," Psychometrika, Springer;The Psychometric Society, vol. 54(3), pages 427-450, September.
    4. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    5. Robert Mislevy, 1986. "Bayes modal estimation in item response models," Psychometrika, Springer;The Psychometric Society, vol. 51(2), pages 177-195, June.
    6. Shiyu Wang & Georgios Fellouris & Hua-Hua Chang, 2019. "Statistical Foundations for Computerized Adaptive Testing with Response Revision," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 375-394, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ogasawara, Haruhiko, 2013. "Asymptotic cumulants of ability estimators using fallible item parameters," Journal of Multivariate Analysis, Elsevier, vol. 119(C), pages 144-162.
    2. David Magis, 2016. "Efficient Standard Error Formulas of Ability Estimators with Dichotomous Item Response Models," Psychometrika, Springer;The Psychometric Society, vol. 81(1), pages 184-200, March.
    3. Mariagiulia Matteucci & Bernard Veldkamp, 2013. "On the use of MCMC computerized adaptive testing with empirical prior information to improve efficiency," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 22(2), pages 243-267, June.
    4. Haruhiko Ogasawara, 2013. "Asymptotic properties of the Bayes modal estimators of item parameters in item response theory," Computational Statistics, Springer, vol. 28(6), pages 2559-2583, December.
    5. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    6. Zhou Fang, 2023. "Continuous-Time Path-Dependent Exploratory Mean-Variance Portfolio Construction," Papers 2303.02298, arXiv.org.
    7. Luca De Gennaro Aquino & Sascha Desmettre & Yevhen Havrylenko & Mogens Steffensen, 2024. "Equilibrium control theory for Kihlstrom-Mirman preferences in continuous time," Papers 2407.16525, arXiv.org, revised Oct 2024.
    8. Rui Wang & Naihua Xiu & Kim-Chuan Toh, 2021. "Subspace quadratic regularization method for group sparse multinomial logistic regression," Computational Optimization and Applications, Springer, vol. 79(3), pages 531-559, July.
    9. Mkhadri, Abdallah & Ouhourane, Mohamed, 2013. "An extended variable inclusion and shrinkage algorithm for correlated variables," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 631-644.
    10. Xiangyu Cui & Xun Li & Duan Li & Yun Shi, 2014. "Time Consistent Behavior Portfolio Policy for Dynamic Mean-Variance Formulation," Papers 1408.6070, arXiv.org, revised Aug 2015.
    11. Chen, Le-Yu & Lee, Sokbae, 2018. "Best subset binary prediction," Journal of Econometrics, Elsevier, vol. 206(1), pages 39-56.
    12. Zhang, Xili & Zhang, Weiguo & Xiao, Weilin, 2013. "Multi-period portfolio optimization under possibility measures," Economic Modelling, Elsevier, vol. 35(C), pages 401-408.
    13. Chuliá, Helena & Garrón, Ignacio & Uribe, Jorge M., 2024. "Daily growth at risk: Financial or real drivers? The answer is not always the same," International Journal of Forecasting, Elsevier, vol. 40(2), pages 762-776.
    14. Chendi Ni & Yuying Li & Peter A. Forsyth, 2023. "Neural Network Approach to Portfolio Optimization with Leverage Constraints:a Case Study on High Inflation Investment," Papers 2304.05297, arXiv.org, revised May 2023.
    15. Sung Jae Jun & Sokbae Lee, 2024. "Causal Inference Under Outcome-Based Sampling with Monotonicity Assumptions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(3), pages 998-1009, July.
    16. Xiangwei Li & Thomas Delerue & Ben Schöttker & Bernd Holleczek & Eva Grill & Annette Peters & Melanie Waldenberger & Barbara Thorand & Hermann Brenner, 2022. "Derivation and validation of an epigenetic frailty risk score in population-based cohorts of older adults," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    17. Christopher J Greenwood & George J Youssef & Primrose Letcher & Jacqui A Macdonald & Lauryn J Hagg & Ann Sanson & Jenn Mcintosh & Delyse M Hutchinson & John W Toumbourou & Matthew Fuller-Tyszkiewicz &, 2020. "A comparison of penalised regression methods for informing the selection of predictive markers," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-14, November.
    18. Heng Chen & Daniel F. Heitjan, 2022. "Analysis of local sensitivity to nonignorability with missing outcomes and predictors," Biometrics, The International Biometric Society, vol. 78(4), pages 1342-1352, December.
    19. Shihao Zhu & Jingtao Shi, 2019. "Optimal Reinsurance and Investment Strategies under Mean-Variance Criteria: Partial and Full Information," Papers 1906.08410, arXiv.org, revised Jun 2020.
    20. Bekker, Paul A., 2004. "A mean-variance frontier in discrete and continuous time," CCSO Working Papers 200406, University of Groningen, CCSO Centre for Economic Research.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:46:y:2021:i:5:p:560-591. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.