IDEAS home Printed from https://ideas.repec.org/a/wly/sustdv/v29y2021i6p1257-1275.html
   My bibliography  Save this article

Monitoring sustainable development goals and the quest for high‐quality indicators: Learning from a practical evaluation of data on corruption

Author

Listed:
  • Giulia Mugellini
  • Jean‐Patrick Villeneuve
  • Marlen Heide

Abstract

Tracing progress in implementing the sustainable development goals (SDGs) is at the core of pushing and accounting for change. However, monitoring SDGs is challenged by a lack of purpose‐fit and high‐quality indicators based on data that are collected through a sound methodology, generated regularly, comparable over time, and publicly accessible. Assessing and improving the quality of existing data is essential for helping countries to generate an evidence base for action. General criteria for evaluating data quality are already available at the national and international level but their practical operationalization for the assessment of specific SDGs indicators is still underdeveloped. Taking target 16.5 as a case study, this paper evaluates the quality of existing corruption surveys and their relevance for SDGs. Results show that the main challenges concern data validity (they measure only one aspect of corruption), comparability (they use culturally biased definitions), periodicity (they are not regularly developed), and raw‐data accessibility. This paper develops an original framework for benchmarking the overall methodological quality of existing corruption metrics. This framework can be used beyond the immediate context of corruption measurement and SDGs assessment. The same logic and methodology can, indeed, be employed to evaluate the quality of other metrics and support national governments and practitioners in identifying the informational and methodological gaps to be addressed in order to improve and make the best use of available statistical information.

Suggested Citation

  • Giulia Mugellini & Jean‐Patrick Villeneuve & Marlen Heide, 2021. "Monitoring sustainable development goals and the quest for high‐quality indicators: Learning from a practical evaluation of data on corruption," Sustainable Development, John Wiley & Sons, Ltd., vol. 29(6), pages 1257-1275, November.
  • Handle: RePEc:wly:sustdv:v:29:y:2021:i:6:p:1257-1275
    DOI: 10.1002/sd.2223
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sd.2223
    Download Restriction: no

    File URL: https://libkey.io/10.1002/sd.2223?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Miola, Apollonia & Schiltz, Fritz, 2019. "Measuring sustainable development goals performance: How to monitor policy action in the 2030 Agenda implementation?," Ecological Economics, Elsevier, vol. 164(C), pages 1-1.
    2. Gustavo Gouvêa Maciel & Luís de Sousa, 2018. "Legal Corruption and Dissatisfaction with Democracy in the European Union," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 140(2), pages 653-674, November.
    3. Heywood, Paul M. & Rose, Jonathan, 2014. "“Close but no Cigar”: the measurement of corruption," Journal of Public Policy, Cambridge University Press, vol. 34(3), pages 507-529, December.
    4. Knack, Stephen, 2007. "Measuring Corruption: A Critique of Indicators in Eastern Europe and Central Asia," Journal of Public Policy, Cambridge University Press, vol. 27(3), pages 255-291, December.
    5. Sally Engle Merry, 2019. "The Sustainable Development Goals Confront the Infrastructure of Measurement," Global Policy, London School of Economics and Political Science, vol. 10(S1), pages 146-148, January.
    6. Itai Beeri & Doron Navot, 2013. "Local Political Corruption: Potential structural malfunctions at the central-local, local-local and intra-local levels," Public Management Review, Taylor & Francis Journals, vol. 15(5), pages 712-739, June.
    7. Cornelia Hammer & Ms. Diane C Kostroch & Mr. Gabriel Quiros-Romero, 2017. "Big Data: Potential, Challenges and Statistical Implications," IMF Staff Discussion Notes 2017/006, International Monetary Fund.
    8. Fredriksson, Anders, 2014. "Bureaucracy intermediaries, corruption and red tape," Journal of Development Economics, Elsevier, vol. 108(C), pages 256-273.
    9. Kristyna Chabova, 2017. "Erratum to: Measuring corruption in Europe: public opinion surveys and composite indices," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(4), pages 1901-1901, July.
    10. Javier Herrera & Mireille Razafindrakoto & François Roubaud, 2007. "Governance, Democracy and Poverty Reduction: Lessons Drawn from Household Surveys in Sub‐Saharan Africa and Latin America," International Statistical Review, International Statistical Institute, vol. 75(1), pages 70-95, April.
    11. Kristyna Chabova, 2017. "Measuring corruption in Europe: public opinion surveys and composite indices," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(4), pages 1877-1900, July.
    12. Ryvkin, Dmitry & Serra, Danila & Tremewan, James, 2017. "I paid a bribe: An experiment on information sharing and extortionary corruption," European Economic Review, Elsevier, vol. 94(C), pages 1-22.
    13. Cornelia Hammer & Diane C Kostroch & Gabriel Quiros-Romero, 2017. "Big Data; Potential, Challenges and Statistical Implications," IMF Staff Discussion Notes 17/06, International Monetary Fund.
    14. Steve MacFeely, 2019. "The Big (data) Bang: Opportunities and Challenges for Compiling SDG Indicators," Global Policy, London School of Economics and Political Science, vol. 10(S1), pages 121-133, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. MacFeely Steve, 2020. "Measuring the Sustainable Development Goal Indicators: An Unprecedented Statistical Challenge," Journal of Official Statistics, Sciendo, vol. 36(2), pages 361-378, June.
    2. José-Miguel Bello y Villarino, 2021. "Measuring Corruption: A Critical Analysis of the Existing Datasets and Their Suitability for Diachronic Transnational Research," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 157(2), pages 709-747, September.
    3. MacFeely Steve, 2020. "Measuring the Sustainable Development Goal Indicators: An Unprecedented Statistical Challenge," Journal of Official Statistics, Sciendo, vol. 36(2), pages 361-378, June.
    4. Demirgüç-Kunt, Asli & Lokshin, Michael & Kolchin, Vladimir, 2023. "Effects of public sector wages on corruption: Wage inequality matters," Journal of Comparative Economics, Elsevier, vol. 51(3), pages 941-959.
    5. Riccardo De Bonis & Matteo Piazza, 2021. "A silent revolution. How central bank statistics have changed in the last 25 years," PSL Quarterly Review, Economia civile, vol. 74(299), pages 347-371.
    6. Francis Rathinam & Sayak Khatua & Zeba Siddiqui & Manya Malik & Pallavi Duggal & Samantha Watson & Xavier Vollenweider, 2021. "Using big data for evaluating development outcomes: A systematic map," Campbell Systematic Reviews, John Wiley & Sons, vol. 17(3), September.
    7. Razafindrakoto, Mireille & Roubaud, François, 2010. "Are International Databases on Corruption Reliable? A Comparison of Expert Opinion Surveys and Household Surveys in Sub-Saharan Africa," World Development, Elsevier, vol. 38(8), pages 1057-1069, August.
    8. Byron Botha & Rulof Burger & Kevin Kotzé & Neil Rankin & Daan Steenkamp, 2023. "Big data forecasting of South African inflation," Empirical Economics, Springer, vol. 65(1), pages 149-188, July.
    9. Bogner Alexandra & Jerger Jürgen, 2023. "Big data in monetary policy analysis—a critical assessment," Economics and Business Review, Sciendo, vol. 9(2), pages 27-40, April.
    10. Mr. Serkan Arslanalp & Mr. Marco Marini & Ms. Patrizia Tumbarello, 2019. "Big Data on Vessel Traffic: Nowcasting Trade Flows in Real Time," IMF Working Papers 2019/275, International Monetary Fund.
    11. Ilona Wysmułek, 2019. "Using public opinion surveys to evaluate corruption in Europe: trends in the corruption items of 21 international survey projects, 1989–2017," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(5), pages 2589-2610, September.
    12. Yu Hao & Chun-Ping Chang & Zao Sun, 2018. "Women and corruption: evidence from multinational panel data," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1447-1468, July.
    13. Eugen Dimant & Guglielmo Tosato, 2018. "Causes And Effects Of Corruption: What Has Past Decade'S Empirical Research Taught Us? A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 335-356, April.
    14. Sheilendra Peerthum & Takesh Luckho, 2021. "Exploring the Linkage Between Public Corruption and Political Trust in Mauritius: a PLS-SEM Approach," Public Organization Review, Springer, vol. 21(2), pages 317-335, June.
    15. Mireille Razafindrakoto & François Roubaud, 2015. "The Governance, Peace and Security modules of the Strategy for the Harmonisation of Statistics in Africa (GPS-SHaSA): development of an innovative statistical survey methodology," Working Papers DT/2015/20, DIAL (Développement, Institutions et Mondialisation).
    16. Nicholas Charron & Paola Annoni, 2021. "What is the Influence of News Media on People’s Perception of Corruption? Parametric and Non-Parametric Approaches," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 153(3), pages 1139-1165, February.
    17. Daniel Homocianu & Aurelian-Petruș Plopeanu & Rodica Ianole-Calin, 2021. "A Robust Approach for Identifying the Major Components of the Bribery Tolerance Index," Mathematics, MDPI, vol. 9(13), pages 1-20, July.
    18. Cameron Allen & Graciela Metternicht & Thomas Wiedmann, 2021. "Priorities for science to support national implementation of the sustainable development goals: A review of progress and gaps," Sustainable Development, John Wiley & Sons, Ltd., vol. 29(4), pages 635-652, July.
    19. Alexandre Gori Maia & Jose Daniel Morales Martinez & Leticia Junqueira Marteleto & Cristina Guimaraes Rodrigues & Luiz Gustavo Sereno, 2023. "Can the Content of Social Networks Explain Epidemic Outbreaks?," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 42(1), pages 1-34, February.
    20. Farnè, Matteo & Vouldis, Angelos T., 2018. "A methodology for automised outlier detection in high-dimensional datasets: an application to euro area banks' supervisory data," Working Paper Series 2171, European Central Bank.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:sustdv:v:29:y:2021:i:6:p:1257-1275. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1002/(ISSN)1099-1719 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.