IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v56y2012i12p4399-4412.html
   My bibliography  Save this article

A Bayesian generalized multiple group IRT model with model-fit assessment tools

Author

Listed:
  • Azevedo, Caio L.N.
  • Andrade, Dalton F.
  • Fox, Jean-Paul

Abstract

The multiple group IRT model (MGM) proposed by Bock and Zimowski (1997) provides a useful framework for analyzing item response data from clustered respondents. In the MGM, the selected groups of respondents are of specific interest such that group-specific population distributions need to be defined. The main goal is to explore the potentials of an MCMC estimation procedure and Bayesian model-fit tools for the MGM. We develop a full Gibbs sampling algorithm (FGSA) for estimation as well as a Metropolis-Hastings within Gibss sampling algorithm (MHWGS) in order to use non-conjugate priors. The FGSA is compared with Bilog–MG, which uses marginal maximum likelihood (MML) and marginal maximum a posteriori (MMAP) methods. That is; Bilog–MG provides maximum likelihood (ML) and expected a posteriori (EAP) estimates for both item and population parameters, and maximum a posteriori (MAP) estimates for the latent traits. We conclude that, in general, the results from our approach are slightly better than Bilog–MG. Besides a simultaneous MCMC estimation procedure, model-fit assessment tools are developed. Furthermore, the prior sensitivity is investigated with respect to the parameters of the latent population distributions. It will be shown that the FGSA provides a wide set of model-fit tools. The proposed model assessment tools can evaluate important model assumptions of (1) the item response function (IRF) and (2) the latent trait distributions. The utility of the proposed estimation and model-fit assessment methods will be shown using data from a longitudinal data study concerning first to fourth graders of sampled Brazilian public schools.

Suggested Citation

  • Azevedo, Caio L.N. & Andrade, Dalton F. & Fox, Jean-Paul, 2012. "A Bayesian generalized multiple group IRT model with model-fit assessment tools," Computational Statistics & Data Analysis, Elsevier, vol. 56(12), pages 4399-4412.
    • Handle: RePEc:eee:csdana:v:56:y:2012:i:12:p:4399-4412
    DOI: 10.1016/j.csda.2012.03.017
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947312001430
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2012.03.017?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. A. Béguin & C. Glas, 2001. "MCMC estimation and some model-fit analysis of multidimensional IRT models," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 541-561, December.
    2. Azevedo, Caio L.N. & Bolfarine, Heleno & Andrade, Dalton F., 2011. "Bayesian inference for a skew-normal IRT model under the centred parameterization," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 353-365, January.
    3. R. Bock & Murray Aitkin, 1981. "Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm," Psychometrika, Springer;The Psychometric Society, vol. 46(4), pages 443-459, December.
    4. Robert Mislevy, 1986. "Bayes modal estimation in item response models," Psychometrika, Springer;The Psychometric Society, vol. 51(2), pages 177-195, June.
    5. Jean‐Paul Fox & Cees A. W. Glas, 2005. "Bayesian modification indices for IRT models," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 59(1), pages 95-106, February.
    6. Tufi M. Soares & Flávio B. Gonçalves & Dani Gamerman, 2009. "An Integrated Bayesian Model for DIF Analysis," Journal of Educational and Behavioral Statistics, , vol. 34(3), pages 348-377, September.
    7. Bengt Muthén & James Lehman, 1985. "Multiple Group IRT Modeling: Applications to Item Bias Analysis," Journal of Educational and Behavioral Statistics, , vol. 10(2), pages 133-142, June.
    8. da-Silva, C.Q. & Gomes, A.E., 2011. "Bayesian inference for an item response model for modeling test anxiety," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3165-3182, December.
    9. Robert Mislevy, 1984. "Estimating latent distributions," Psychometrika, Springer;The Psychometric Society, vol. 49(3), pages 359-381, September.
    10. James H. Albert, 1992. "Bayesian Estimation of Normal Ogive Item Response Curves Using Gibbs Sampling," Journal of Educational and Behavioral Statistics, , vol. 17(3), pages 251-269, September.
    11. Roberto Leon Gonzalez, 2004. "Data Augmentation in the Bayesian Multivariate Probit Model," Working Papers 2004001, The University of Sheffield, Department of Economics, revised Jan 2004.
    12. Jean-Paul Fox & Cees Glas, 2001. "Bayesian estimation of a multilevel IRT model using gibbs sampling," Psychometrika, Springer;The Psychometric Society, vol. 66(2), pages 271-288, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Padilla, Juan L. & Azevedo, Caio L.N. & Lachos, Victor H., 2018. "Multidimensional multiple group IRT models with skew normal latent trait distributions," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 250-268.
    2. Mariagiulia Matteucci & Bernard Veldkamp, 2015. "The approach of power priors for ability estimation in IRT models," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(3), pages 917-926, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Azevedo, Caio L.N. & Bolfarine, Heleno & Andrade, Dalton F., 2011. "Bayesian inference for a skew-normal IRT model under the centred parameterization," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 353-365, January.
    2. Padilla, Juan L. & Azevedo, Caio L.N. & Lachos, Victor H., 2018. "Multidimensional multiple group IRT models with skew normal latent trait distributions," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 250-268.
    3. Li Cai, 2010. "High-dimensional Exploratory Item Factor Analysis by A Metropolis–Hastings Robbins–Monro Algorithm," Psychometrika, Springer;The Psychometric Society, vol. 75(1), pages 33-57, March.
    4. Michael Edwards, 2010. "A Markov Chain Monte Carlo Approach to Confirmatory Item Factor Analysis," Psychometrika, Springer;The Psychometric Society, vol. 75(3), pages 474-497, September.
    5. Sheng, Yanyan, 2008. "Markov Chain Monte Carlo Estimation of Normal Ogive IRT Models in MATLAB," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 25(i08).
    6. Scott Monroe, 2021. "Testing Latent Variable Distribution Fit in IRT Using Posterior Residuals," Journal of Educational and Behavioral Statistics, , vol. 46(3), pages 374-398, June.
    7. Jiwei Zhang & Zhaoyuan Zhang & Jian Tao, 2021. "A Bayesian algorithm based on auxiliary variables for estimating GRM with non-ignorable missing data," Computational Statistics, Springer, vol. 36(4), pages 2643-2669, December.
    8. Mariagiulia Matteucci & Bernard Veldkamp, 2013. "On the use of MCMC computerized adaptive testing with empirical prior information to improve efficiency," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 22(2), pages 243-267, June.
    9. A. Béguin & C. Glas, 2001. "MCMC estimation and some model-fit analysis of multidimensional IRT models," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 541-561, December.
    10. Steven Andrew Culpepper & James Joseph Balamuta, 2017. "A Hierarchical Model for Accuracy and Choice on Standardized Tests," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 820-845, September.
    11. Mariagiulia Matteucci & Bernard Veldkamp, 2015. "The approach of power priors for ability estimation in IRT models," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(3), pages 917-926, May.
    12. Vitoratou, Silia & Ntzoufras, Ioannis & Moustaki, Irini, 2016. "Explaining the behavior of joint and marginal Monte Carlo estimators in latent variable models with independence assumptions," LSE Research Online Documents on Economics 57685, London School of Economics and Political Science, LSE Library.
    13. Melissa Gladstone & Gillian Lancaster & Gareth McCray & Vanessa Cavallera & Claudia R. L. Alves & Limbika Maliwichi & Muneera A. Rasheed & Tarun Dua & Magdalena Janus & Patricia Kariger, 2021. "Validation of the Infant and Young Child Development (IYCD) Indicators in Three Countries: Brazil, Malawi and Pakistan," IJERPH, MDPI, vol. 18(11), pages 1-19, June.
    14. Eijffinger, Sylvester & Mahieu, Ronald & Raes, Louis, 2018. "Inferring hawks and doves from voting records," European Journal of Political Economy, Elsevier, vol. 51(C), pages 107-120.
    15. C. Glas & Anna Dagohoy, 2007. "A Person Fit Test For Irt Models For Polytomous Items," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 159-180, June.
    16. Hanneke Geerlings & Cees Glas & Wim Linden, 2011. "Modeling Rule-Based Item Generation," Psychometrika, Springer;The Psychometric Society, vol. 76(2), pages 337-359, April.
    17. Haruhiko Ogasawara, 2013. "Asymptotic properties of the Bayes modal estimators of item parameters in item response theory," Computational Statistics, Springer, vol. 28(6), pages 2559-2583, December.
    18. Christian A. Gregory, 2020. "Are We Underestimating Food Insecurity? Partial Identification with a Bayesian 4-Parameter IRT Model," Journal of Classification, Springer;The Classification Society, vol. 37(3), pages 632-655, October.
    19. Gregory Camilli & Jean-Paul Fox, 2015. "An Aggregate IRT Procedure for Exploratory Factor Analysis," Journal of Educational and Behavioral Statistics, , vol. 40(4), pages 377-401, August.
    20. Peida Zhan & Hong Jiao & Dandan Liao & Feiming Li, 2019. "A Longitudinal Higher-Order Diagnostic Classification Model," Journal of Educational and Behavioral Statistics, , vol. 44(3), pages 251-281, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:56:y:2012:i:12:p:4399-4412. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.