IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v53y2019i2d10.1007_s11135-018-0802-x.html
   My bibliography  Save this article

Fixed and random effects models: making an informed choice

Author

Listed:
  • Andrew Bell

    (University of Sheffield, ICOSS)

  • Malcolm Fairbrother

    (Umeå University)

  • Kelvyn Jones

    (University of Bristol)

Abstract

This paper assesses the options available to researchers analysing multilevel (including longitudinal) data, with the aim of supporting good methodological decision-making. Given the confusion in the literature about the key properties of fixed and random effects (FE and RE) models, we present these models’ capabilities and limitations. We also discuss the within-between RE model, sometimes misleadingly labelled a ‘hybrid’ model, showing that it is the most general of the three, with all the strengths of the other two. As such, and because it allows for important extensions—notably random slopes—we argue it should be used (as a starting point at least) in all multilevel analyses. We develop the argument through simulations, evaluating how these models cope with some likely mis-specifications. These simulations reveal that (1) failing to include random slopes can generate anti-conservative standard errors, and (2) assuming random intercepts are Normally distributed, when they are not, introduces only modest biases. These results strengthen the case for the use of, and need for, these models.

Suggested Citation

  • Andrew Bell & Malcolm Fairbrother & Kelvyn Jones, 2019. "Fixed and random effects models: making an informed choice," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(2), pages 1051-1074, March.
    • Handle: RePEc:spr:qualqt:v:53:y:2019:i:2:d:10.1007_s11135-018-0802-x
    DOI: 10.1007/s11135-018-0802-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-018-0802-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-018-0802-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Thomas Herndon & Michael Ash & Robert Pollin, 2014. "Does high public debt consistently stifle economic growth? A critique of Reinhart and Rogoff," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 38(2), pages 257-279.
    2. Saïd Hanchane & Tarek Mostafa, 2012. "Solving endogeneity problems in multilevel estimation: an example using education production functions," Journal of Applied Statistics, Taylor & Francis Journals, vol. 39(5), pages 1101-1114, November.
    3. Murray Aitkin, 1999. "A General Maximum Likelihood Analysis of Variance Components in Generalized Linear Models," Biometrics, The International Biometric Society, vol. 55(1), pages 117-128, March.
    4. Fiona Steele & Anna Vignoles & Andrew Jenkins, 2007. "The effect of school resources on pupil attainment: a multilevel simultaneous equation modelling approach," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(3), pages 801-824, July.
    5. Sylvie Goetgeluk & Stijn Vansteelandt, 2008. "Conditional Generalized Estimating Equations for the Analysis of Clustered and Longitudinal Data," Biometrics, The International Biometric Society, vol. 64(3), pages 772-780, September.
    6. Katja Möhring & Alexander Schmidt, 2012. "Multilevel tools," German Stata Users' Group Meetings 2012 06, Stata Users Group.
    7. King, Gary & Roberts, Margaret E., 2015. "How Robust Standard Errors Expose Methodological Problems They Do Not Fix, and What to Do About It," Political Analysis, Cambridge University Press, vol. 23(2), pages 159-179, April.
    8. Leckie, George & Charlton, Chris, 2013. "runmlwin: A Program to Run the MLwiN Multilevel Modeling Software from within Stata," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 52(i11).
    9. Andrew Bell & Kelvyn Jones & Malcolm Fairbrother, 2018. "Understanding and misunderstanding group mean centering: a commentary on Kelley et al.’s dangerous practice," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(5), pages 2031-2036, September.
    10. Carmen M. Reinhart & Kenneth S. Rogoff, 2010. "Growth in a Time of Debt," American Economic Review, American Economic Association, vol. 100(2), pages 573-578, May.
    11. Nerlove,Marc, 2005. "Essays in Panel Data Econometrics," Cambridge Books, Cambridge University Press, number 9780521022460, January.
    12. Fotouhi, Ali Reza, 2003. "Comparisons of Estimation Procedures for Nonlinear Multilevel Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 8(i09).
    13. N Bullen & K Jones & C Duncan, 1997. "Modelling Complexity: Analysing Between-Individual and Between-Place Variation—A Multilevel Tutorial," Environment and Planning A, , vol. 29(4), pages 585-609, April.
    14. Shor, Boris & Bafumi, Joseph & Keele, Luke & Park, David, 2007. "A Bayesian Multilevel Modeling Approach to Time-Series Cross-Sectional Data," Political Analysis, Cambridge University Press, vol. 15(2), pages 165-181, April.
    15. Bates, Douglas & Mächler, Martin & Bolker, Ben & Walker, Steve, 2015. "Fitting Linear Mixed-Effects Models Using lme4," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(i01).
    16. Leonardo Grilli & Carla Rampichini, 2015. "Specification of random effects in multilevel models: a review," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(3), pages 967-976, May.
    17. Mundlak, Yair, 1978. "On the Pooling of Time Series and Cross Section Data," Econometrica, Econometric Society, vol. 46(1), pages 69-85, January.
    18. Daniel Stegmueller, 2013. "How Many Countries for Multilevel Modeling? A Comparison of Frequentist and Bayesian Approaches," American Journal of Political Science, John Wiley & Sons, vol. 57(3), pages 748-761, July.
    19. John M. Neuhaus & Charles E. McCulloch, 2006. "Separating between‐ and within‐cluster covariate effects by using conditional and partitioning methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(5), pages 859-872, November.
    20. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    21. Croissant, Yves & Millo, Giovanni, 2008. "Panel Data Econometrics in R: The plm Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i02).
    22. Fairbrother, Malcolm, 2014. "Two Multilevel Modeling Techniques for Analyzing Comparative Longitudinal Survey Datasets," Political Science Research and Methods, Cambridge University Press, vol. 2(1), pages 119-140, April.
    23. Andrew Bell & Ron Johnston & Kelvyn Jones, 2015. "Stylised fact or situated messiness? The diverse effects of increasing debt on national economic growth," Journal of Economic Geography, Oxford University Press, vol. 15(2), pages 449-472.
    24. Schurer, S. & Yong, J., 2012. "Personality, well-being and the marginal utility of income: What can we learn from random coefficient models?," Health, Econometrics and Data Group (HEDG) Working Papers 12/01, HEDG, c/o Department of Economics, University of York.
    25. Beck, Nathaniel & Katz, Jonathan N., 1995. "What To Do (and Not to Do) with Time-Series Cross-Section Data," American Political Science Review, Cambridge University Press, vol. 89(3), pages 634-647, September.
    26. Zhang, Zhengzheng & Parker, Richard M. A. & Charlton, Christopher M. J. & Leckie, George & Browne, William J., 2016. "R2MLwiN: A Package to Run MLwiN from within R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 72(i10).
    27. Cora J. M. Maas & Joop J. Hox, 2004. "Robustness issues in multilevel regression analysis," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 58(2), pages 127-137, May.
    28. Kelvyn Jones & Ron Johnston & David Manley & Dewi Owen & Chris Charlton, 2015. "Ethnic Residential Segregation: A Multilevel, Multigroup, Multiscale Approach Exemplified by London in 2011," Demography, Springer;Population Association of America (PAA), vol. 52(6), pages 1995-2019, December.
    29. Bruno ARPINO & Roberta VARRIALE, 2010. "Assessing The Quality Of Institutions’ Rankings Obtained Through Multilevel Linear Regression Models," Journal of Applied Economic Sciences, Spiru Haret University, Faculty of Financial Management and Accounting Craiova, vol. 5(1(11)_Spr), pages 7-22.
    30. Stephen W. Raudenbush & JDouglas Willms, 1995. "The Estimation of School Effects," Journal of Educational and Behavioral Statistics, , vol. 20(4), pages 307-335, December.
    31. Beck, Nathaniel & Katz, Jonathan N., 2007. "Random Coefficient Models for Time-Series—Cross-Section Data: Monte Carlo Experiments," Political Analysis, Cambridge University Press, vol. 15(2), pages 182-195, April.
    32. Paul D. Allison, 1994. "Using Panel Data to Estimate the Effects of Events," Sociological Methods & Research, , vol. 23(2), pages 174-199, November.
    33. Schurer, S. & Yong, J., 2012. "Personality, well-being and the marginal utility of income: What can we learn from random coefficient models?," Health, Econometrics and Data Group (HEDG) Working Papers 12/01, HEDG, c/o Department of Economics, University of York.
    34. Brumback, Babette A. & Dailey, Amy B. & Brumback, Lyndia C. & Livingston, Melvin D. & He, Zhulin, 2010. "Adjusting for confounding by cluster using generalized linear mixed models," Statistics & Probability Letters, Elsevier, vol. 80(21-22), pages 1650-1654, November.
    35. Yongyun Shin & Stephen W. Raudenbush, 2010. "A Latent Cluster-Mean Approach to the Contextual Effects Model With Missing Data," Journal of Educational and Behavioral Statistics, , vol. 35(1), pages 26-53, February.
    36. Kerry Ard & Malcolm Fairbrother, 2017. "Pollution Prophylaxis? Social Capital and Environmental Inequality," Social Science Quarterly, Southwestern Social Science Association, vol. 98(2), pages 584-607, June.
    37. Milner, Helen V. & Kubota, Keiko, 2005. "Why the Move to Free Trade? Democracy and Trade Policy in the Developing Countries," International Organization, Cambridge University Press, vol. 59(1), pages 107-143, January.
    38. Duncan, Craig & Jones, Kelvyn & Moon, Graham, 1996. "Health-related behaviour in context: A multilevel modelling approach," Social Science & Medicine, Elsevier, vol. 42(6), pages 817-830, March.
    39. Bell, Andrew & Jones, Kelvyn, 2015. "Explaining Fixed Effects: Random Effects Modeling of Time-Series Cross-Sectional and Panel Data," Political Science Research and Methods, Cambridge University Press, vol. 3(1), pages 133-153, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aleksey Oshchepkov & Anna Shirokanova, 2020. "Multilevel Modeling For Economists: Why, When And How," HSE Working papers WP BRP 233/EC/2020, National Research University Higher School of Economics.
    2. Tibor András Marton & Anna Kis & Anna Zubor-Nemes & Anikó Kern & Nándor Fodor, 2020. "Human Impact Promotes Sustainable Corn Production in Hungary," Sustainability, MDPI, vol. 12(17), pages 1-16, August.
    3. Bell, Andrew & Jones, Kelvyn, 2015. "Explaining Fixed Effects: Random Effects Modeling of Time-Series Cross-Sectional and Panel Data," Political Science Research and Methods, Cambridge University Press, vol. 3(1), pages 133-153, January.
    4. Andrew Bell & Kelvyn Jones & Malcolm Fairbrother, 2018. "Understanding and misunderstanding group mean centering: a commentary on Kelley et al.’s dangerous practice," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(5), pages 2031-2036, September.
    5. Anders Skrondal & Sophia Rabe-Hesketh, 2022. "The Role of Conditional Likelihoods in Latent Variable Modeling," Psychometrika, Springer;The Psychometric Society, vol. 87(3), pages 799-834, September.
    6. Tsai, Tsung-Han, 2016. "A Bayesian Approach to Dynamic Panel Models with Endogenous Rarely Changing Variables," Political Science Research and Methods, Cambridge University Press, vol. 4(3), pages 595-620, September.
    7. Bartak, Jakub & Jabłoński, Łukasz & Tomkiewicz, Jacek, 2022. "Does income inequality explain public debt change in OECD countries?," International Review of Economics & Finance, Elsevier, vol. 80(C), pages 211-224.
    8. Seonho Shin, 2021. "Were they a shock or an opportunity?: The heterogeneous impacts of the 9/11 attacks on refugees as job seekers—a nonlinear multi-level approach," Empirical Economics, Springer, vol. 61(5), pages 2827-2864, November.
    9. Leo Ahrens, 2020. "Unfair Inequality and the Demand for Redistribution," LIS Working papers 771, LIS Cross-National Data Center in Luxembourg.
    10. Chenlu Li & Simon C Moore & Jesse Smith & Sarah Bauermeister & John Gallacher, 2019. "The costs of negative affect attributable to alcohol consumption in later life: A within-between random longitudinal econometric model using UK Biobank," PLOS ONE, Public Library of Science, vol. 14(2), pages 1-15, February.
    11. De la Peña Zarzuelo, Ignacio & Freire-Seoane, María Jesús & López-Bermúdez, Beatriz, 2020. "The effects of maritime container transport on economic growth in the countries on the west coast of Latin America," Revista CEPAL, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), April.
    12. İbrahim Özmen & Mihai Mutascu, 2024. "Public Debt and Growth: New Insights," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(2), pages 8706-8736, June.
    13. Isabel Neira & Fernando Bruna & Marta Portela & Adela García-Aracil, 2018. "Individual Well-Being, Geographical Heterogeneity and Social Capital," Journal of Happiness Studies, Springer, vol. 19(4), pages 1067-1090, April.
    14. Adenuga, Adewale Henry & Davis, John & Hutchinson, George & Donnellan, Trevor & Patton, Myles, 2018. "Estimation and determinants of phosphorus balance and use efficiency of dairy farms in Northern Ireland: A within and between farm random effects analysis," Agricultural Systems, Elsevier, vol. 164(C), pages 11-19.
    15. Yana Akhtyrska & Franz Fuerst, 2021. "People or Systems: Does Productivity Enhancement Matter More than Energy Management in LEED Certified Buildings?," Sustainability, MDPI, vol. 13(24), pages 1-35, December.
    16. Martin Schröder, 2018. "Income Inequality and Life Satisfaction: Unrelated Between Countries, Associated Within Countries Over Time," Journal of Happiness Studies, Springer, vol. 19(4), pages 1021-1043, April.
    17. De Vita, Glauco & Trachanas, Emmanouil & Luo, Yun, 2018. "Revisiting the bi-directional causality between debt and growth: Evidence from linear and nonlinear tests," Journal of International Money and Finance, Elsevier, vol. 83(C), pages 55-74.
    18. Mark J. McCabe & Frank Mueller-Langer, 2019. "Does Data Disclosure Increase Citations? Empirical Evidence from a Natural Experiment in Leading Economics Journals," JRC Working Papers on Digital Economy 2019-02, Joint Research Centre.
    19. Philipp Heimberger, 2023. "Do higher public debt levels reduce economic growth?," Journal of Economic Surveys, Wiley Blackwell, vol. 37(4), pages 1061-1089, September.
    20. Attahir Babaji Abubakar, 2020. "Does fiscal tightening (loosening) reduce public debt?," African Development Review, African Development Bank, vol. 32(4), pages 528-539, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:53:y:2019:i:2:d:10.1007_s11135-018-0802-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.