IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v46y2021i1p34-57.html
   My bibliography  Save this article

A Bayesian Item Response Model for Examining Item Position Effects in Complex Survey Data

Author

Listed:
  • Matthias Trendtel

    (Center for Research on Education and School Development, 153667TU Dortmund University, Germany)

  • Alexander Robitzsch

    (IPN - 28393Leibniz Institute for Science and Mathematics Education, Kiel, Germany
    Centre for International Student Assessment)

Abstract

A multidimensional Bayesian item response model is proposed for modeling item position effects. The first dimension corresponds to the ability that is to be measured; the second dimension represents a factor that allows for individual differences in item position effects called persistence. This model allows for nonlinear item position effects on the item side as well as on the person side. Moreover, a flexible loading structure on the two dimensions is allowed. A fully Bayesian estimation procedure is proposed, and its performance is investigated by a simulation study. Further, the model is applied to empirical data collected in the Programme for International Student Assessment 2000 in the reading domain. The additional value of the model’s extended flexibility compared to more restrictive models is shown. The findings show that the linear hypothesis of change in performance during a test does not hold in general.

Suggested Citation

  • Matthias Trendtel & Alexander Robitzsch, 2021. "A Bayesian Item Response Model for Examining Item Position Effects in Complex Survey Data," Journal of Educational and Behavioral Statistics, , vol. 46(1), pages 34-57, February.
    • Handle: RePEc:sae:jedbes:v:46:y:2021:i:1:p:34-57
    DOI: 10.3102/1076998620931016
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998620931016
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998620931016?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Sophia Rabe‐Hesketh & Anders Skrondal, 2006. "Multilevel modelling of complex survey data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(4), pages 805-827, October.
    2. Carpenter, Bob & Gelman, Andrew & Hoffman, Matthew D. & Lee, Daniel & Goodrich, Ben & Betancourt, Michael & Brubaker, Marcus & Guo, Jiqiang & Li, Peter & Riddell, Allen, 2017. "Stan: A Probabilistic Programming Language," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i01).
    3. William Mollenkopf, 1950. "An experimental study of the effects on item-analysis data of changing item placement and test time limit," Psychometrika, Springer;The Psychometric Society, vol. 15(3), pages 291-315, September.
    4. Ernesto San Martín & Jean-Marie Rolin & Luis Castro, 2013. "Identification of the 1PL Model with Guessing Parameter: Parametric and Semi-parametric Results," Psychometrika, Springer;The Psychometric Society, vol. 78(2), pages 341-379, April.
    5. A. Béguin & C. Glas, 2001. "MCMC estimation and some model-fit analysis of multidimensional IRT models," Psychometrika, Springer;The Psychometric Society, vol. 66(4), pages 541-561, December.
    6. Stanislav Kolenikov, 2010. "Resampling variance estimation for complex survey data," Stata Journal, StataCorp LP, vol. 10(2), pages 165-199, June.
    7. Renard, Didier & Molenberghs, Geert & Geys, Helena, 2004. "A pairwise likelihood approach to estimation in multilevel probit models," Computational Statistics & Data Analysis, Elsevier, vol. 44(4), pages 649-667, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christian A. Gregory, 2020. "Are We Underestimating Food Insecurity? Partial Identification with a Bayesian 4-Parameter IRT Model," Journal of Classification, Springer;The Classification Society, vol. 37(3), pages 632-655, October.
    2. Aleksandra Parteka & Joanna Wolszczak-Derlacz, 2020. "Wage response to global production links: evidence for workers from 28 European countries (2005–2014)," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 156(4), pages 769-801, November.
    3. Francis,David C. & Kubinec ,Robert, 2022. "Beyond Political Connections : A Measurement Model Approach to Estimating Firm-levelPolitical Influence in 41 Economies," Policy Research Working Paper Series 10119, The World Bank.
    4. Yongping Bao & Ludwig Danwitz & Fabian Dvorak & Sebastian Fehrler & Lars Hornuf & Hsuan Yu Lin & Bettina von Helversen, 2022. "Similarity and Consistency in Algorithm-Guided Exploration," CESifo Working Paper Series 10188, CESifo.
    5. Heinrich, Torsten & Yang, Jangho & Dai, Shuanping, 2020. "Growth, development, and structural change at the firm-level: The example of the PR China," MPRA Paper 105011, University Library of Munich, Germany.
    6. Xin Xu & Yang Lu & Yupeng Zhou & Zhiguo Fu & Yanjie Fu & Minghao Yin, 2021. "An Information-Explainable Random Walk Based Unsupervised Network Representation Learning Framework on Node Classification Tasks," Mathematics, MDPI, vol. 9(15), pages 1-14, July.
    7. Steven Andrew Culpepper & James Joseph Balamuta, 2017. "A Hierarchical Model for Accuracy and Choice on Standardized Tests," Psychometrika, Springer;The Psychometric Society, vol. 82(3), pages 820-845, September.
    8. Robert E. Hall & Sam Schulhofer-Wohl, 2018. "Measuring Job-Finding Rates and Matching Efficiency with Heterogeneous Job-Seekers," American Economic Journal: Macroeconomics, American Economic Association, vol. 10(1), pages 1-32, January.
    9. M.-L. Feddag, 2016. "Pairwise likelihood estimation for the normal ogive model with binary data," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 100(2), pages 223-237, April.
    10. Xiaoyue Xi & Simon E. F. Spencer & Matthew Hall & M. Kate Grabowski & Joseph Kagaayi & Oliver Ratmann & Rakai Health Sciences Program and PANGEA‐HIV, 2022. "Inferring the sources of HIV infection in Africa from deep‐sequence data with semi‐parametric Bayesian Poisson flow models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(3), pages 517-540, June.
    11. Joseph B. Bak-Coleman & Ian Kennedy & Morgan Wack & Andrew Beers & Joseph S. Schafer & Emma S. Spiro & Kate Starbird & Jevin D. West, 2022. "Combining interventions to reduce the spread of viral misinformation," Nature Human Behaviour, Nature, vol. 6(10), pages 1372-1380, October.
    12. David M. Phillippo & Sofia Dias & A. E. Ades & Mark Belger & Alan Brnabic & Alexander Schacht & Daniel Saure & Zbigniew Kadziola & Nicky J. Welton, 2020. "Multilevel network meta‐regression for population‐adjusted treatment comparisons," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(3), pages 1189-1210, June.
    13. Martijn G. de Jong & Jan-Benedict E. M. Steenkamp & Bernard P. Veldkamp, 2009. "A Model for the Construction of Country-Specific Yet Internationally Comparable Short-Form Marketing Scales," Marketing Science, INFORMS, vol. 28(4), pages 674-689, 07-08.
    14. Yang, Tingzhong & Barnett, Ross & Jiang, Shuhan & Yu, Lingwei & Xian, Hong & Ying, Jun & Zheng, Weijun, 2016. "Gender balance and its impact on male and female smoking rates in Chinese cities," Social Science & Medicine, Elsevier, vol. 154(C), pages 9-17.
    15. Molenberghs, Geert & Verbeke, Geert & Iddi, Samuel & Demétrio, Clarice G.B., 2012. "A combined beta and normal random-effects model for repeated, overdispersed binary and binomial data," Journal of Multivariate Analysis, Elsevier, vol. 111(C), pages 94-109.
    16. Armin Falk & Fabian Kosse & Pia Pinger & Hannah Schildberg-Hörisch & Thomas Deckers, 2021. "Socioeconomic Status and Inequalities in Children’s IQ and Economic Preferences," Journal of Political Economy, University of Chicago Press, vol. 129(9), pages 2504-2545.
    17. Burbano, Vanessa & Padilla, Nicolas & Meier, Stephan, 2020. "Gender Differences in Preferences for Meaning at Work," IZA Discussion Papers 13053, Institute of Labor Economics (IZA).
    18. Robert Kubinec & Haillie Na‐Kyung Lee & Andrey Tomashevskiy, 2021. "Politically connected companies are less likely to shutdown due to COVID‐19 restrictions," Social Science Quarterly, Southwestern Social Science Association, vol. 102(5), pages 2155-2169, September.
    19. Barrington-Leigh, C.P., 2024. "The econometrics of happiness: Are we underestimating the returns to education and income?," Journal of Public Economics, Elsevier, vol. 230(C).
    20. Marion Borderon & Patrick Sakdapolrak & Raya Muttarak & Endale Kebede & Raffaella Pagogna & Eva Sporer, 2019. "Migration influenced by environmental change in Africa: A systematic review of empirical evidence," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 41(18), pages 491-544.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:46:y:2021:i:1:p:34-57. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.