IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v44y2015i4p677-705.html
   My bibliography  Save this article

Phantom Effects in Multilevel Compositional Analysis

Author

Listed:
  • Artur Pokropek

Abstract

This article combines statistical and applied research perspective showing problems that might arise when measurement error in multilevel compositional effects analysis is ignored. This article focuses on data where independent variables are constructed measures. Simulation studies are conducted evaluating methods that could overcome the measurement error problems. These methods are a multilevel regression model with reliability correction, a multilevel model with plausible values, and a multilevel latent regression model (doubly latent model). While the latter one performs best, all models have their advantages and disadvantages. Examples using data from the Trends in International Mathematics and Science Study are shown to present the behavior of the tested models in real-data situations and indicate the consequences of ignoring the problem of reliability.

Suggested Citation

  • Artur Pokropek, 2015. "Phantom Effects in Multilevel Compositional Analysis," Sociological Methods & Research, , vol. 44(4), pages 677-705, November.
    • Handle: RePEc:sae:somere:v:44:y:2015:i:4:p:677-705
    DOI: 10.1177/0049124114553801
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0049124114553801
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0049124114553801?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Maddala,G. S., 1986. "Limited-Dependent and Qualitative Variables in Econometrics," Cambridge Books, Cambridge University Press, number 9780521338257, January.
    2. Ke-Hai Yuan & Peter Bentler, 2004. "On the asymptotic distributions of two statistics for two-level covariance structure models within the class of elliptical distributions," Psychometrika, Springer;The Psychometric Society, vol. 69(3), pages 437-457, September.
    3. Jean-Paul Fox & Cees Glas, 2001. "Bayesian estimation of a multilevel IRT model using gibbs sampling," Psychometrika, Springer;The Psychometric Society, vol. 66(2), pages 271-288, June.
    4. Jean-Paul Fox & Cees Glas, 2003. "Bayesian modeling of measurement error in predictor variables using item response theory," Psychometrika, Springer;The Psychometric Society, vol. 68(2), pages 169-191, June.
    5. Jee-Seon Kim & Edward Frees, 2006. "Omitted Variables in Multilevel Models," Psychometrika, Springer;The Psychometric Society, vol. 71(4), pages 659-690, December.
    6. Ashenfelter, Orley & Krueger, Alan B, 1994. "Estimates of the Economic Returns to Schooling from a New Sample of Twins," American Economic Review, American Economic Association, vol. 84(5), pages 1157-1173, December.
    7. Geoffrey Woodhouse & Min Yang & Harvey Goldstein & Jon Rasbash, 1996. "Adjusting for Measurement Error in Multilevel Analysis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 159(2), pages 201-212, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Burger, Kaspar, 2019. "The socio-spatial dimension of educational inequality: A comparative European analysis," MPRA Paper 95309, University Library of Munich, Germany, revised 2019.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Heleno Bolfarine & Jorge Luis Bazan, 2010. "Bayesian Estimation of the Logistic Positive Exponent IRT Model," Journal of Educational and Behavioral Statistics, , vol. 35(6), pages 693-713, December.
    2. Chun Wang & Gongjun Xu & Xue Zhang, 2019. "Correction for Item Response Theory Latent Trait Measurement Error in Linear Mixed Effects Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 673-700, September.
    3. Liran Einav & Ephraim Leibtag & Aviv Nevo, 2010. "Recording discrepancies in Nielsen Homescan data: Are they present and do they matter?," Quantitative Marketing and Economics (QME), Springer, vol. 8(2), pages 207-239, June.
    4. Dinand Webbink & Sunčica Vujić & Pierre Koning & Nicholas G. Martin, 2012. "The Effect Of Childhood Conduct Disorder On Human Capital," Health Economics, John Wiley & Sons, Ltd., vol. 21(8), pages 928-945, August.
    5. Samuel Bowles & Herbert Gintis & Melissa Osborne, 2000. "The Determinants of Earnings: Skills, Preferences, and Schooling," UMASS Amherst Economics Working Papers 2000-07, University of Massachusetts Amherst, Department of Economics.
    6. Vashishtha, Ashutosh & Sharma, Anil K., 2012. "Indian financial market regulation: A dialectic model," Journal of Economics and Business, Elsevier, vol. 64(1), pages 77-89.
    7. Fossen, Frank M. & Glocker, Daniela, 2017. "Stated and revealed heterogeneous risk preferences in educational choice," European Economic Review, Elsevier, vol. 97(C), pages 1-25.
    8. Diégo Legros & Fabrice Galia, 2012. "Are innovation and R&D the only sources of firms’ knowledge that increase productivity? An empirical investigation of French manufacturing firms," Journal of Productivity Analysis, Springer, vol. 38(2), pages 167-181, October.
    9. Raaum,O. & Aabo,T.E., 1999. "The effect of schooling on earnings : the role of family background studied by a large sample of Norwegian twins," Memorandum 16/1999, Oslo University, Department of Economics.
    10. De Fraja, Gianni, 2011. "The source of differences in population distributions," Mathematical Social Sciences, Elsevier, vol. 62(2), pages 130-132, September.
    11. Kai Barron & Luis F. Gamboa & Paul Rodríguez-Lesmes, 2019. "Behavioural Response to a Sudden Health Risk: Dengue and Educational Outcomes in Colombia," Journal of Development Studies, Taylor & Francis Journals, vol. 55(4), pages 620-644, April.
    12. Hongbin Li & Mark Rosenzweig & Junsen Zhang, 2010. "Altruism, Favoritism, and Guilt in the Allocation of Family Resources: Sophie's Choice in Mao's Mass Send-Down Movement," Journal of Political Economy, University of Chicago Press, vol. 118(1), pages 1-38, February.
    13. Goodman, Joshua & Hurwitz, Michael & Smith, Jonathan & Fox, Julia, 2015. "The relationship between siblings’ college choices: Evidence from one million SAT-taking families," Economics of Education Review, Elsevier, vol. 48(C), pages 75-85.
    14. Myck, Michal & Nici?ska, Anna & Morawski, Leszek, 2009. "Count Your Hours: Returns to Education in Poland," IZA Discussion Papers 4332, Institute of Labor Economics (IZA).
    15. Stephen Machin & Sandra McNally & Olmo Silva, 2007. "New Technology in Schools: Is There a Payoff?," Economic Journal, Royal Economic Society, vol. 117(522), pages 1145-1167, July.
    16. Caroline Bayart & Patrick Bonnel, 2015. "How to Combine Survey Media (Web, Telephone, Face-to-Face): Lyon and Rhône-alps Case Study," Post-Print halshs-01663683, HAL.
    17. Simon Appleton & John Knight & Lina Song & Qingjie Xia, 2009. "The Economics of Communist Party Membership: The Curious Case of Rising Numbers and Wage Premium during China's Transition," Journal of Development Studies, Taylor & Francis Journals, vol. 45(2), pages 256-275.
    18. Fatma El-Hamidi, 2006. "General or Vocational Schooling? Evidence on School Choice, Returns, and 'Sheepskin' Effects from Egypt 1998," Journal of Economic Policy Reform, Taylor & Francis Journals, vol. 9(2), pages 157-176.
    19. Luca Grilli, 2005. "Internet start-ups access to the bank loan market: evidence from Italy," Applied Economics, Taylor & Francis Journals, vol. 37(3), pages 293-305.
    20. Momi Dahan & Udi Nisan, 2010. "The effect of benefits level on take-up rates: evidence from a natural experiment," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 17(2), pages 151-173, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:44:y:2015:i:4:p:677-705. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.