IDEAS home Printed from https://ideas.repec.org/a/bla/devpol/v39y2021i1p121-134.html
   My bibliography  Save this article

Development evaluation in authoritarian states: A case from Kazakhstan

Author

Listed:
  • Colin Knox

Abstract

Motivation Authoritarian states receive development funding from international donors for programmes and interventions, some aimed at improving their governance systems. This article reports on the evaluation of an EU‐funded programme in Kazakhstan, seen as the most progressive reformer in Central Asia. The EU Programme was aimed at enhancing Kazakhstan’s business competitiveness through better regulation and civil service modernization. Purpose This article addresses two research questions. What was the impact of the EU‐funded intervention? What role, if any, did the evaluation play in reflective policy learning for the future? Approach and Methods The research draws on quantitative and qualitative evidence. This involved analysing secondary data sources on the effectiveness of governance over time in Kazakhstan and interviews for 34 key stakeholders on the impact of the EU interventions. Findings We find no significant improvements in governance over time. While the donor responded in a flexible way to meet the changing strategic goals of the state (which were at the personal behest of the President), this did not help to embed evaluation as part of the policy cycle for future learning. The key beneficiary here was the Government of Kazakhstan. Policy implications Wider systemic change from upward accountability to downward accountability to citizens is needed to make evaluation relevant for authoritarian states. Upward accountability to the President is a feature of authoritarian regimes, which precludes citizens from being able to hold the state to account. Without these systemic changes, autocracies simply engage in development evaluation as a perfunctory exercise to meet donor requirements.

Suggested Citation

  • Colin Knox, 2021. "Development evaluation in authoritarian states: A case from Kazakhstan," Development Policy Review, Overseas Development Institute, vol. 39(1), pages 121-134, January.
  • Handle: RePEc:bla:devpol:v:39:y:2021:i:1:p:121-134
    DOI: 10.1111/dpr.12470
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/dpr.12470
    Download Restriction: no

    File URL: https://libkey.io/10.1111/dpr.12470?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Maren Duvendack & Jorge Garcia Hombrados & Richard Palmer-Jones & Hugh Waddington, 2012. "Assessing ‘what works’ in international development: meta-analysis for sophisticated dummies," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 4(3), pages 456-471, September.
    2. Wendy Olsen, 2019. "Bridging to Action Requires Mixed Methods, Not Only Randomised Control Trials," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 31(2), pages 139-162, April.
    3. Richard Hummelbrunner, 2015. "Learning, Systems Concepts and Values in Evaluation: Proposal for an Exploratory Framework to Improve Coherence," IDS Bulletin, Blackwell Publishing, vol. 46(1), pages 17-29, January.
    4. Barbara Befani & Chris Barnett & Elliot Stern, 2014. "Introduction – Rethinking Impact Evaluation for Development," IDS Bulletin, Blackwell Publishing, vol. 45(6), pages 1-5, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wendy Olsen, 2019. "Bridging to Action Requires Mixed Methods, Not Only Randomised Control Trials," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 31(2), pages 139-162, April.
    2. Terrapon-Pfaff, Julia & Gröne, Marie-Christine & Dienst, Carmen & Ortiz, Willington, 2018. "Impact pathways of small-scale energy projects in the global south – Findings from a systematic evaluation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 95(C), pages 84-94.
    3. L. Shakiyla Smith & Natalie J. Wilkins & Roderick J. McClure, 2021. "A systemic approach to achieving population‐level impact in injury and violence prevention," Systems Research and Behavioral Science, Wiley Blackwell, vol. 38(1), pages 21-30, January.
    4. Christopher Cvitanovic & Marie F Löf & Albert V Norström & Mark S Reed, 2018. "Building university-based boundary organisations that facilitate impacts on environmental policy and practice," PLOS ONE, Public Library of Science, vol. 13(9), pages 1-19, September.
    5. Janice Tripney & Jorge Hombrados & Mark Newman & Kimberly Hovish & Chris Brown & Katarzyna Steinka‐Fry & Eric Wilkey, 2013. "Technical and Vocational Education and Training (TVET) Interventions to Improve the Employability and Employment of Young People in Low‐ and Middle‐Income Countries: A Systematic Review," Campbell Systematic Reviews, John Wiley & Sons, vol. 9(1), pages 1-171.
    6. Minna-Liina Ojala & Lauri Hooli, 2022. "Development Cooperation as a Knowledge Creation Process: Rhythmanalytical Approach to a Capacity-Building Project in Zanzibar," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 34(1), pages 367-386, February.
    7. Jessie Pullar & Luke Allen & Nick Townsend & Julianne Williams & Charlie Foster & Nia Roberts & Mike Rayner & Bente Mikkelsen & Francesco Branca & Kremlin Wickramasinghe, 2018. "The impact of poverty reduction and development interventions on non-communicable diseases and their behavioural risk factors in low and lower-middle income countries: A systematic review," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-27, February.
    8. Alexis Beyuo & Nana Akua Anyidoho, 2022. "An Impact Assessment of Farmer Participation on Food Security in Northwestern Ghana," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 34(4), pages 1831-1856, August.
    9. Heinemann, E. & Van Hemelrijck, A. & Guijt, I., 2017. "IFAD RESEARCH SERIES 16 - Getting the most out of impact evaluation for learning, reporting and influence," IFAD Research Series 280054, International Fund for Agricultural Development (IFAD).
    10. Hansen, Henrik & Trifkovic, Neda, 2013. "Systematic Reviews: Questions, Methods and Usage," MPRA Paper 47993, University Library of Munich, Germany.
    11. Edward Anderson & Maria Ana Jalles D'Orey & Maren Duvendack & Lucio Esposito, 2017. "Does Government Spending Affect Income Inequality? A Meta-Regression Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 31(4), pages 961-987, September.
    12. Kluve, Jochen & Puerto, Susanna & Robalino, David & Romero, José Manuel & Rother, Friederike & Stöterau, Jonathan & Weidenkaff, Felix & Witte, Marc, 2016. "Do Youth Employment Programs Improve Labor Market Outcomes? A Systematic Review," Ruhr Economic Papers 648, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    13. Monica Roman & Liliana-Olivia Lucaciu, 2021. "Variable Selection and Data Quality Challenges in Impact Assessments," Postmodern Openings, Editura Lumen, Department of Economics, vol. 12(3Sup1), pages 01-20, September.
    14. Túlio A. Cravo & Caio Piza, 2019. "The impact of business-support services on firm performance: a meta-analysis," Small Business Economics, Springer, vol. 53(3), pages 753-770, October.
    15. Maren Duvendack, 2022. "Payment‐by‐results for health interventions in low‐ and middle‐income countries: A critical review," Development Policy Review, Overseas Development Institute, vol. 40(1), January.
    16. Graf, Sarah Lena & Oya, Carlos, 2021. "Is the system of rice intensification (SRI) pro poor? Labour, class and technological change in West Africa," Agricultural Systems, Elsevier, vol. 193(C).
    17. repec:wly:camsys:v:10:y:2014:i:1:p:1-46:b is not listed on IDEAS
    18. Valérie Pattyn, 2019. "Towards Appropriate Impact Evaluation Methods," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 31(2), pages 174-179, April.
    19. Kluve, Jochen & Puerto, Susana & Robalino, David & Romero, Jose M. & Rother, Friederike & Stöterau, Jonathan & Weidenkaff, Felix & Witte, Marc, 2019. "Do youth employment programs improve labor market outcomes? A quantitative review," World Development, Elsevier, vol. 114(C), pages 237-253.
    20. Marie Gaarder, 2019. "A Commentary to ‘Bridging to Action Requires Mixed Methods, Not Only Randomised Control Trials’," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 31(2), pages 169-173, April.
    21. Jamie Morgan, 2019. "A Realist Alternative to Randomised Control Trials: A Bridge Not a Barrier?," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 31(2), pages 180-188, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:devpol:v:39:y:2021:i:1:p:121-134. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/odioruk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.