IDEAS home Printed from https://ideas.repec.org/a/nat/natcom/v14y2023i1d10.1038_s41467-023-41486-1.html
   My bibliography  Save this article

Cross-national analyses require additional controls to account for the non-independence of nations

Author

Listed:
  • Scott Claessens

    (University of Auckland)

  • Thanos Kyritsis

    (University of Auckland)

  • Quentin D. Atkinson

    (University of Auckland
    University of Oxford)

Abstract

Cross-national analyses test hypotheses about the drivers of variation in national outcomes. However, since nations are connected in various ways, such as via spatial proximity and shared cultural ancestry, cross-national analyses often violate assumptions of non-independence, inflating false positive rates. Here, we show that, despite being recognised as an important statistical pitfall for over 200 years, cross-national research in economics and psychology still does not sufficiently account for non-independence. In a review of the 100 highest-cited cross-national studies of economic development and values, we find that controls for non-independence are rare. When studies do control for non-independence, our simulations suggest that most commonly used methods are insufficient for reducing false positives in non-independent data. In reanalyses of twelve previous cross-national correlations, half of the estimates are compatible with no association after controlling for non-independence using global proximity matrices. We urge social scientists to sufficiently control for non-independence in cross-national research.

Suggested Citation

  • Scott Claessens & Thanos Kyritsis & Quentin D. Atkinson, 2023. "Cross-national analyses require additional controls to account for the non-independence of nations," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
  • Handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-41486-1
    DOI: 10.1038/s41467-023-41486-1
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41467-023-41486-1
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1038/s41467-023-41486-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Nathan Nunn & Diego Puga, 2012. "Ruggedness: The Blessing of Bad Geography in Africa," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 20-36, February.
    2. Rafael E. De Hoyos & Vasilis Sarafidis, 2006. "Testing for cross-sectional dependence in panel-data models," Stata Journal, StataCorp LP, vol. 6(4), pages 482-496, December.
    3. Stephen Knack & Philip Keefer, 1997. "Does Social Capital Have an Economic Payoff? A Cross-Country Investigation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(4), pages 1251-1288.
    4. Seán Roberts & James Winters, 2013. "Linguistic Diversity and Traffic Accidents: Lessons from Statistical Studies of Cultural Traits," PLOS ONE, Public Library of Science, vol. 8(8), pages 1-13, August.
    5. Enrico Spolaore & Romain Wacziarg, 2009. "The Diffusion of Development," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 469-529.
    6. Bockstette, Valerie & Chanda, Areendam & Putterman, Louis, 2002. "States and Markets: The Advantage of an Early Start," Journal of Economic Growth, Springer, vol. 7(4), pages 347-369, December.
    7. Easterly, William, 2007. "Inequality does cause underdevelopment: Insights from a new instrument," Journal of Development Economics, Elsevier, vol. 84(2), pages 755-776, November.
    8. Mark Skidmore & Hideki Toya, 2002. "Do Natural Disasters Promote Long-Run Growth?," Economic Inquiry, Western Economic Association International, vol. 40(4), pages 664-687, October.
    9. Joseph Henrich & Steve J. Heine & Ara Norenzayan, 2010. "The Weirdest People in the World?," RatSWD Working Papers 139, German Data Forum (RatSWD).
    10. Jonathan F Schulz, 2022. "Kin Networks and Institutional Development," The Economic Journal, Royal Economic Society, vol. 132(647), pages 2578-2613.
    11. Alberto Alesina & Paola Giuliano & Nathan Nunn, 2013. "On the Origins of Gender Roles: Women and the Plough," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 469-530.
    12. Edmond Awad & Sohan Dsouza & Richard Kim & Jonathan Schulz & Joseph Henrich & Azim Shariff & Jean-François Bonnefon & Iyad Rahwan, 2018. "The Moral Machine experiment," Nature, Nature, vol. 563(7729), pages 59-64, November.
    13. Joseph Watts & Oliver Sheehan & Joseph Bulbulia & Russell D. Gray & Quentin D. Atkinson, 2018. "Christianity spread faster in small, politically structured societies," Nature Human Behaviour, Nature, vol. 2(8), pages 559-564, August.
    14. Luke J Matthews & Sam Passmore & Paul M Richard & Russell D Gray & Quentin D Atkinson, 2016. "Shared Cultural History as a Predictor of Political and Economic Changes among Nation States," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-18, April.
    15. Benhabib, Jess & Spiegel, Mark M., 1994. "The role of human capital in economic development evidence from aggregate cross-country data," Journal of Monetary Economics, Elsevier, vol. 34(2), pages 143-173, October.
    16. Diego Comin & William Easterly & Erick Gong, 2010. "Was the Wealth of Nations Determined in 1000 BC?," American Economic Journal: Macroeconomics, American Economic Association, vol. 2(3), pages 65-97, July.
    17. Matthew J Page & Joanne E McKenzie & Patrick M Bossuyt & Isabelle Boutron & Tammy C Hoffmann & Cynthia D Mulrow & Larissa Shamseer & Jennifer M Tetzlaff & Elie A Akl & Sue E Brennan & Roger Chou & Jul, 2021. "The PRISMA 2020 statement: An updated guideline for reporting systematic reviews," PLOS Medicine, Public Library of Science, vol. 18(3), pages 1-15, March.
    18. Smith, Michael D. & Rabbitt, Matthew P. & Coleman- Jensen, Alisha, 2017. "Who are the World’s Food Insecure? New Evidence from the Food and Agriculture Organization’s Food Insecurity Experience Scale," World Development, Elsevier, vol. 93(C), pages 402-412.
    19. Lindell Bromham & Alexander Skeels & Hilde Schneemann & Russell Dinnage & Xia Hua, 2021. "There is little evidence that spicy food in hot countries is an adaptation to reducing infection risk," Nature Human Behaviour, Nature, vol. 5(7), pages 878-891, July.
    20. Conley, T. G., 1999. "GMM estimation with cross sectional dependence," Journal of Econometrics, Elsevier, vol. 92(1), pages 1-45, September.
    21. Sachs, Jeffrey D. & Warner, Andrew M., 2001. "The curse of natural resources," European Economic Review, Elsevier, vol. 45(4-6), pages 827-838, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wolfer, Sascha & Koplenig, Alexander, 2024. "Leakage explains the apparent superiority of Bayesian random effect models – a preregistered comment on Claessens, Kyritsis and Atkinson (2023)," OSF Preprints ex267, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James B. Ang, 2015. "Agricultural Legacy, Individualistic Culture, and Techology Adoption," Economic Growth Centre Working Paper Series 1506, Nanyang Technological University, School of Social Sciences, Economic Growth Centre.
    2. Enrico Spolaore & Romain Wacziarg, 2013. "How Deep Are the Roots of Economic Development?," Journal of Economic Literature, American Economic Association, vol. 51(2), pages 325-369, June.
    3. Maseland, Robbert, 2021. "Contingent determinants," Journal of Development Economics, Elsevier, vol. 151(C).
    4. Quamrul Ashraf & Oded Galor, 2013. "The 'Out of Africa' Hypothesis, Human Genetic Diversity, and Comparative Economic Development," American Economic Review, American Economic Association, vol. 103(1), pages 1-46, February.
    5. Nunn, Nathan, 2014. "Historical Development," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 2, chapter 7, pages 347-402, Elsevier.
    6. Oyèkọ́lá, Ọláyínká, 2021. "Where do people live longer?," Research in Economics, Elsevier, vol. 75(1), pages 21-44.
    7. Johannes C. Buggle, 2020. "Growing collectivism: irrigation, group conformity and technological divergence," Journal of Economic Growth, Springer, vol. 25(2), pages 147-193, June.
    8. Sutanuka Roy & Sudhir Gupta & Rabee Tourky, 2023. "The Impact of Long–Term Orientation Traits on Pandemic Fatigue Behavior: Evidence from the Columbian Exchange," Journal of Economic Growth, Springer, vol. 28(3), pages 397-438, September.
    9. Cemal Eren Arbatlı & Quamrul H. Ashraf & Oded Galor & Marc Klemp, 2020. "Diversity and Conflict," Econometrica, Econometric Society, vol. 88(2), pages 727-797, March.
    10. Davis, Lewis S. & Williamson, Claudia R., 2016. "Culture and the regulation of entry," Journal of Comparative Economics, Elsevier, vol. 44(4), pages 1055-1083.
    11. Andrew Dickens, 2022. "Understanding Ethnolinguistic Differences: The Roles of Geography and Trade," The Economic Journal, Royal Economic Society, vol. 132(643), pages 953-980.
    12. Sam Hak Kan Tang & Charles Ka Yui Leung, 2016. "The Deep Historical Roots of Macroeconomic Volatility," The Economic Record, The Economic Society of Australia, vol. 92(299), pages 568-589, December.
    13. James B. Ang, 2015. "Agricultural Transition And The Adoption Of Primitive Technology," Economic Inquiry, Western Economic Association International, vol. 53(4), pages 1818-1838, October.
    14. James B. Ang, 2015. "What Drives the Historical Formation and Persistent Development of Territorial States?," Scandinavian Journal of Economics, Wiley Blackwell, vol. 117(4), pages 1134-1175, October.
    15. Scott L. Fulford & Ivan Petkov & Fabio Schiantarelli, 2020. "Does it matter where you came from? Ancestry composition and economic performance of US counties, 1850–2010," Journal of Economic Growth, Springer, vol. 25(3), pages 341-380, September.
    16. Akbari, Mahsa & Bahrami-Rad, Duman & Kimbrough, Erik O., 2019. "Kinship, fractionalization and corruption," Journal of Economic Behavior & Organization, Elsevier, vol. 166(C), pages 493-528.
    17. Ang, James B. & Madsen, Jakob B. & Wang, Wen, 2021. "Rice farming, culture and democracy," European Economic Review, Elsevier, vol. 136(C).
    18. William Easterly & Ross Levine, 2016. "The European origins of economic development," Journal of Economic Growth, Springer, vol. 21(3), pages 225-257, September.
    19. Ang, James B., 2013. "Institutions and the long-run impact of early development," Journal of Development Economics, Elsevier, vol. 105(C), pages 1-18.
    20. Pavlik, Jamie Bologna & Young, Andrew T., 2019. "Did technology transfer more rapidly East–West than North–South?," European Economic Review, Elsevier, vol. 119(C), pages 216-235.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:natcom:v:14:y:2023:i:1:d:10.1038_s41467-023-41486-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.