IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v44y2015i4p677-705.html
   My bibliography  Save this article

Phantom Effects in Multilevel Compositional Analysis

Author

Listed:
  • Artur Pokropek

Abstract

This article combines statistical and applied research perspective showing problems that might arise when measurement error in multilevel compositional effects analysis is ignored. This article focuses on data where independent variables are constructed measures. Simulation studies are conducted evaluating methods that could overcome the measurement error problems. These methods are a multilevel regression model with reliability correction, a multilevel model with plausible values, and a multilevel latent regression model (doubly latent model). While the latter one performs best, all models have their advantages and disadvantages. Examples using data from the Trends in International Mathematics and Science Study are shown to present the behavior of the tested models in real-data situations and indicate the consequences of ignoring the problem of reliability.

Suggested Citation

  • Artur Pokropek, 2015. "Phantom Effects in Multilevel Compositional Analysis," Sociological Methods & Research, , vol. 44(4), pages 677-705, November.
    • Handle: RePEc:sae:somere:v:44:y:2015:i:4:p:677-705
    DOI: 10.1177/0049124114553801
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0049124114553801
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0049124114553801?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jean-Paul Fox & Cees Glas, 2001. "Bayesian estimation of a multilevel IRT model using gibbs sampling," Psychometrika, Springer;The Psychometric Society, vol. 66(2), pages 271-288, June.
    2. Jee-Seon Kim & Edward Frees, 2006. "Omitted Variables in Multilevel Models," Psychometrika, Springer;The Psychometric Society, vol. 71(4), pages 659-690, December.
    3. Ashenfelter, Orley & Krueger, Alan B, 1994. "Estimates of the Economic Returns to Schooling from a New Sample of Twins," American Economic Review, American Economic Association, vol. 84(5), pages 1157-1173, December.
    4. Geoffrey Woodhouse & Min Yang & Harvey Goldstein & Jon Rasbash, 1996. "Adjusting for Measurement Error in Multilevel Analysis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 159(2), pages 201-212, March.
    5. Maddala,G. S., 1986. "Limited-Dependent and Qualitative Variables in Econometrics," Cambridge Books, Cambridge University Press, number 9780521338257, January.
    6. Ke-Hai Yuan & Peter Bentler, 2004. "On the asymptotic distributions of two statistics for two-level covariance structure models within the class of elliptical distributions," Psychometrika, Springer;The Psychometric Society, vol. 69(3), pages 437-457, September.
    7. Jean-Paul Fox & Cees Glas, 2003. "Bayesian modeling of measurement error in predictor variables using item response theory," Psychometrika, Springer;The Psychometric Society, vol. 68(2), pages 169-191, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Burger, Kaspar, 2019. "The socio-spatial dimension of educational inequality: A comparative European analysis," MPRA Paper 95309, University Library of Munich, Germany, revised 2019.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Heleno Bolfarine & Jorge Luis Bazan, 2010. "Bayesian Estimation of the Logistic Positive Exponent IRT Model," Journal of Educational and Behavioral Statistics, , vol. 35(6), pages 693-713, December.
    2. Chun Wang & Gongjun Xu & Xue Zhang, 2019. "Correction for Item Response Theory Latent Trait Measurement Error in Linear Mixed Effects Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 673-700, September.
    3. Vashishtha, Ashutosh & Sharma, Anil K., 2012. "Indian financial market regulation: A dialectic model," Journal of Economics and Business, Elsevier, vol. 64(1), pages 77-89.
    4. Raaum,O. & Aabo,T.E., 1999. "The effect of schooling on earnings : the role of family background studied by a large sample of Norwegian twins," Memorandum 16/1999, Oslo University, Department of Economics.
    5. Kai Barron & Luis F. Gamboa & Paul Rodríguez-Lesmes, 2019. "Behavioural Response to a Sudden Health Risk: Dengue and Educational Outcomes in Colombia," Journal of Development Studies, Taylor & Francis Journals, vol. 55(4), pages 620-644, April.
    6. Hongbin Li & Mark Rosenzweig & Junsen Zhang, 2010. "Altruism, Favoritism, and Guilt in the Allocation of Family Resources: Sophie's Choice in Mao's Mass Send-Down Movement," Journal of Political Economy, University of Chicago Press, vol. 118(1), pages 1-38, February.
    7. Goodman, Joshua & Hurwitz, Michael & Smith, Jonathan & Fox, Julia, 2015. "The relationship between siblings’ college choices: Evidence from one million SAT-taking families," Economics of Education Review, Elsevier, vol. 48(C), pages 75-85.
    8. Stephen Machin & Sandra McNally & Olmo Silva, 2007. "New Technology in Schools: Is There a Payoff?," Economic Journal, Royal Economic Society, vol. 117(522), pages 1145-1167, July.
    9. Simon Appleton & John Knight & Lina Song & Qingjie Xia, 2009. "The Economics of Communist Party Membership: The Curious Case of Rising Numbers and Wage Premium during China's Transition," Journal of Development Studies, Taylor & Francis Journals, vol. 45(2), pages 256-275.
    10. Luca Grilli, 2005. "Internet start-ups access to the bank loan market: evidence from Italy," Applied Economics, Taylor & Francis Journals, vol. 37(3), pages 293-305.
    11. Laurent E. Calvet & Paolo Sodini, 2014. "Twin Picks: Disentangling the Determinants of Risk-Taking in Household Portfolios," Journal of Finance, American Finance Association, vol. 69(2), pages 867-906, April.
    12. Xavier Ramos Morilla & Josep Lluís Raymond Bara & Josep Oliver Alonso, 1999. "Not All University Degrees Yield the Same Return: Private and Social Returns to Higher Education for Males in Spain," Working Papers wpdea9904, Department of Applied Economics at Universitat Autonoma of Barcelona.
    13. Violeta Misheva, 2016. "What Determines Emotional Well-Being? The Role of Adverse Experiences: Evidence Using Twin Data," Journal of Happiness Studies, Springer, vol. 17(5), pages 1921-1937, October.
    14. Cox, Thomas L. & Briggs, Hugh, 1989. "Heteroscedastic Tobit Models: The Household Demand for Fresh Potatoes Revisited," Staff Papers 200482, University of Wisconsin-Madison, Department of Agricultural and Applied Economics.
    15. Gregorio Caetano & Miguel Palacios & Harry A. Patrinos, 2019. "Measuring Aversion to Debt: An Experiment Among Student Loan Candidates," Journal of Family and Economic Issues, Springer, vol. 40(1), pages 117-131, March.
    16. Shinsuke Asakawa, 2020. "Can Child Benefits Shape Parents' Attitudes toward Childrearing in Japan?: Effects of Child Benefit Policy Expansions," Discussion Papers in Economics and Business 19-04-Rev.2, Osaka University, Graduate School of Economics.
    17. Beyene, Abebe D. & Mekonnen, Alemu & Bluffstone, Randall & Tesfaye, Yemiru, 2022. "Does Participatory Forest Management Increase Forest Resource Use to Cope with Shocks? Empirical Evidence from Ethiopia," EfD Discussion Paper 22-12, Environment for Development, University of Gothenburg.
    18. Berger, Johannes & Strohner, Ludwig, 2020. "Documentation of the PUblic Policy Model for Austria and other European countries (PUMA)," Research Papers 11, EcoAustria – Institute for Economic Research.
    19. Li Mingliang & Tobias Justin L, 2006. "Bayesian Analysis of Structural Effects in an Ordered Equation System," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 10(4), pages 1-24, December.
    20. Holmlund, Helena, 2007. "A Researcher's Guide to the Swedish Compulsory School Reform," Working Paper Series 9/2007, Stockholm University, Swedish Institute for Social Research.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:44:y:2015:i:4:p:677-705. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.