IDEAS home Printed from https://ideas.repec.org/a/vrs/offsta/v36y2020i2p379-409n9.html
   My bibliography  Save this article

Explaining Inconsistencies in the Education Distributions of Ten Cross-National Surveys – the Role of Methodological Survey Characteristics

Author

Listed:
  • Ortmanns Verena

    (GESIS – Leibniz Institute for the Social Sciences, Department Survey Design and Methodology, P.O. Box 12 21 55, 68072 Mannheim, Germany.)

Abstract

Surveys measuring the same concept using the same measure on the same population at the same point in time should result in highly similar results. If this is not the case, this is a strong sign of lacking reliability, resulting in non-comparable data across surveys. Looking at the education variable, previous research has identified inconsistencies in the distributions of harmonised education variables, using the International Standard Classification of Education (ISCED), across surveys within the same countries and years. These inconsistencies are commonly explained by differences in the measurement, especially in the response categories of the education question, and in the harmonisation when classifying country-specific education categories into ISCED. However, other methodological characteristics of surveys, which we regard as ‘containers’ for several characteristics, may also contribute to this finding. We compare the education distributions of nine cross-national surveys with the European Union Labour Force Survey (EU-LFS), which is used as benchmark. This study analyses 15 survey characteristics to better explain the inconsistencies. The results confirm a predominant effect of the measurement instrument and harmonisation. Different sampling designs also explain inconsistencies, but to a lesser degree. Finally, we discuss the results and limitations of the study and provide ideas for improving data comparability.

Suggested Citation

  • Ortmanns Verena, 2020. "Explaining Inconsistencies in the Education Distributions of Ten Cross-National Surveys – the Role of Methodological Survey Characteristics," Journal of Official Statistics, Sciendo, vol. 36(2), pages 379-409, June.
    • Handle: RePEc:vrs:offsta:v:36:y:2020:i:2:p:379-409:n:9
    DOI: 10.2478/jos-2020-0020
    as

    Download full text from publisher

    File URL: https://doi.org/10.2478/jos-2020-0020
    Download Restriction: no
    File URL: https://libkey.io/10.2478/jos-2020-0020?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kaminska Olena & Lynn Peter, 2017. "Survey-Based Cross-Country Comparisons Where Countries Vary in Sample Design: Issues and Solutions," Journal of Official Statistics, Sciendo, vol. 33(1), pages 123-136, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ortmanns Verena, 2020. "Explaining Inconsistencies in the Education Distributions of Ten Cross-National Surveys – the Role of Methodological Survey Characteristics," Journal of Official Statistics, Sciendo, vol. 36(2), pages 379-409, June.
    2. Peter Lynn & Alita Nandi & Violetta Parutis & Lucinda Platt, 2018. "Design and implementation of a high-quality probability sample of immigrants and ethnic minorities: Lessons learnt," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 38(21), pages 513-548.
    3. Levi, Sebastian & Goldberg, Matthew H., 2021. "Democracy influences climate change concern," SocArXiv 6vk9d, Center for Open Science.
    4. Álvaro Fuentes-Merlos & Domingo Orozco-Beltrán & Jose A. Quesada Rico & Raul Reina, 2021. "Quality-of-Life Determinants in People with Diabetes Mellitus in Europe," IJERPH, MDPI, vol. 18(13), pages 1-11, June.
    5. Dolapo Adeyanju & John Mburu & Wainaina Gituro & Chepchumba Chumo & Djana Mignouna & Adebayo Ogunniyi & John Kehinde Akomolafe & Joseph Ejima, 2023. "Assessing food security among young farmers in Africa: evidence from Kenya, Nigeria, and Uganda," Agricultural and Food Economics, Springer;Italian Society of Agricultural Economics (SIDEA), vol. 11(1), pages 1-20, December.
    6. Christopher S. Walter & Marie-Rachelle Narcisse & Jennifer L. Vincenzo & Pearl A. McElfish & Holly C. Felix, 2021. "Description of Variation in Age of Onset of Functional Limitations of Native Hawaiian and Pacific Islanders Compared to Other Racial and Ethnic Groups," IJERPH, MDPI, vol. 18(5), pages 1-8, March.
    7. Abdul Waheed & Qingyu Zhang, 2022. "Effect of CSR and Ethical Practices on Sustainable Competitive Performance: A Case of Emerging Markets from Stakeholder Theory Perspective," Journal of Business Ethics, Springer, vol. 175(4), pages 837-855, February.
    8. Stavros Poupakis & Francesco Salustri, 2024. "Asynchronous fieldwork in cross-country surveys: an application to physical activity," Empirical Economics, Springer, vol. 67(3), pages 1303-1318, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:offsta:v:36:y:2020:i:2:p:379-409:n:9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.