IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0058650.html
   My bibliography  Save this article

Measuring Health System Strengthening: Application of the Balanced Scorecard Approach to Rank the Baseline Performance of Three Rural Districts in Zambia

Author

Listed:
  • Wilbroad Mutale
  • Peter Godfrey-Fausset
  • Margaret Tembo Mwanamwenge
  • Nkatya Kasese
  • Namwinga Chintu
  • Dina Balabanova
  • Neil Spicer
  • Helen Ayles

Abstract

Introduction: There is growing interest in health system performance and recently WHO launched a report on health systems strengthening emphasising the need for close monitoring using system-wide approaches. One recent method is the balanced scorecard system. There is limited application of this method in middle- and low-income countries. This paper applies the concept of balanced scorecard to describe the baseline status of three intervention districts in Zambia. Methodology: The Better Health Outcome through Mentoring and Assessment (BHOMA) project is a randomised step-wedged community intervention that aims to strengthen the health system in three districts in the Republic of Zambia. To assess the baseline status of the participating districts we used a modified balanced scorecard approach following the domains highlighted in the MOH 2011 Strategic Plan. Results: Differences in performance were noted by district and residence. Finance and service delivery domains performed poorly in all study districts. The proportion of the health workers receiving training in the past 12 months was lowest in Kafue (58%) and highest in Luangwa district (77%). Under service capacity, basic equipment and laboratory capacity scores showed major variation, with Kafue and Luangwa having lower scores when compared to Chongwe. The finance domain showed that Kafue and Chongwe had lower scores (44% and 47% respectively). Regression model showed that children's clinical observation scores were negatively correlated with drug availability (coeff −0.40, p = 0.02). Adult clinical observation scores were positively association with adult service satisfaction score (coeff 0.82, p = 0.04) and service readiness (coeff 0.54, p = 0.03). Conclusion: The study applied the balanced scorecard to describe the baseline status of 42 health facilities in three districts of Zambia. Differences in performance were noted by district and residence in most domains with finance and service delivery performing poorly in all study districts. This tool could be valuable in monitoring and evaluation of health systems.

Suggested Citation

  • Wilbroad Mutale & Peter Godfrey-Fausset & Margaret Tembo Mwanamwenge & Nkatya Kasese & Namwinga Chintu & Dina Balabanova & Neil Spicer & Helen Ayles, 2013. "Measuring Health System Strengthening: Application of the Balanced Scorecard Approach to Rank the Baseline Performance of Three Rural Districts in Zambia," PLOS ONE, Public Library of Science, vol. 8(3), pages 1-11, March.
    • Handle: RePEc:plo:pone00:0058650
    DOI: 10.1371/journal.pone.0058650
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0058650
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0058650&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0058650?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Pieter Serneels & Jose G. Montalvo & Gunilla Pettersson & Tomas Lievens & Jean Damascene Butera & Aklilu Kidanu, 2010. "Who Wants to Work in a Rural Health Post? The Role of Intrinsic Motivation, Rural Background and Faith-Based Institutions in Rwanda and Ethiopia," CSAE Working Paper Series 2010-10, Centre for the Study of African Economies, University of Oxford.
    2. Leonard, Kenneth L. & Masatu, Melkiory C., 2010. "Using the Hawthorne effect to examine the gap between a doctor's best possible practice and actual performance," Journal of Development Economics, Elsevier, vol. 93(2), pages 226-234, November.
    3. Jeff Richardson & John Wildman & Iain K. Robertson, 2003. "A critique of the World Health Organisation's evaluation of health system performance," Health Economics, John Wiley & Sons, Ltd., vol. 12(5), pages 355-366, May.
    4. Handler, A. & Issel, M. & Turnock, B., 2001. "A conceptual framework to measure performance of the public health system," American Journal of Public Health, American Public Health Association, vol. 91(8), pages 1235-1239.
    5. Anbrasi Edward & Binay Kumar & Faizullah Kakar & Ahmad Shah Salehi & Gilbert Burnham & David H Peters, 2011. "Configuring Balanced Scorecards for Measuring Health System Performance: Evidence from 5 Years' Evaluation in Afghanistan," PLOS Medicine, Public Library of Science, vol. 8(7), pages 1-9, July.
    6. Edward Anbrasi & Binay Kumar & Faizullah Kakar & Ahmed Shah Salehi & Gilbert Burnham & David H Peters, 2011. "Configuring Balanced Scorecards for Measuring Health System Performance: Evidence from 5 Years’ Evaluation in Afghanistan," Working Papers id:4362, eSocialSciences.
    7. Gauld, Robin & Al-wahaibi, Suhaila & Chisholm, Johanna & Crabbe, Rebecca & Kwon, Boomi & Oh, Timothy & Palepu, Raja & Rawcliffe, Nic & Sohn, Stephen, 2011. "Scorecards for health system performance assessment: The New Zealand example," Health Policy, Elsevier, vol. 103(2), pages 200-208.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joan T Price & Benjamin H Chi & Winifreda M Phiri & Helen Ayles & Namwinga Chintu & Roma Chilengi & Jeffrey S A Stringer & Wilbroad Mutale, 2018. "Associations between health systems capacity and mother-to-child HIV prevention program outcomes in Zambia," PLOS ONE, Public Library of Science, vol. 13(9), pages 1-13, September.
    2. Wilbroad Mutale & Jeffrey Stringer & Namwinga Chintu & Roma Chilengi & Margaret Tembo Mwanamwenge & Nkatya Kasese & Dina Balabanova & Neil Spicer & James Lewis & Helen Ayles, 2014. "Application of Balanced Scorecard in the Evaluation of a Complex Health System Intervention: 12 Months Post Intervention Findings from the BHOMA Intervention: A Cluster Randomised Trial in Zambia," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-10, April.
    3. Phillip Koni & Nathaniel Chishinga & Lameck Nyirenda & Prisca Kasonde & Richard Nsakanya & Michael Welsh, 2015. "Health Facility Graduation from Donor-Supported Intensive Technical Assistance and Associated Factors in Zambia," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-13, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wilbroad Mutale & Jeffrey Stringer & Namwinga Chintu & Roma Chilengi & Margaret Tembo Mwanamwenge & Nkatya Kasese & Dina Balabanova & Neil Spicer & James Lewis & Helen Ayles, 2014. "Application of Balanced Scorecard in the Evaluation of a Complex Health System Intervention: 12 Months Post Intervention Findings from the BHOMA Intervention: A Cluster Randomised Trial in Zambia," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-10, April.
    2. Cheick Sidya Sidibé & Ousmane Touré & Jacqueline E W Broerse & Marjolein Dieleman, 2019. "Rural pipeline and willingness to work in rural areas: Mixed method study on students in midwifery and obstetric nursing in Mali," PLOS ONE, Public Library of Science, vol. 14(9), pages 1-13, September.
    3. Reneé Pereyra-Elías & Percy Mayta-Tristán & Juan José Montenegro-Idrogo & Christian R Mejia & Gabriel Abudinén A. & Rita Azucas-Peralta & Jorge Barrezueta-Fernandez & Luis Cerna-Urrutia & Adrián DaSil, 2016. "Differences on Primary Care Labor Perceptions in Medical Students from 11 Latin American Countries," PLOS ONE, Public Library of Science, vol. 11(7), pages 1-12, July.
    4. Vujicic, Marko & Shengelia, Bakhuti & Alfano, Marco & Thu, Ha Bui, 2011. "Physician shortages in rural Vietnam: Using a labor market approach to inform policy," Social Science & Medicine, Elsevier, vol. 73(7), pages 970-977.
    5. Olivier, Jill & Wodon, Quentin, 2012. "Satisfaction with faith-inspired health care services in Africa: review and evidence from household surveys," MPRA Paper 45374, University Library of Munich, Germany.
    6. Timothy Besley & Maitreesh Ghatak, 2005. "Competition and Incentives with Motivated Agents," American Economic Review, American Economic Association, vol. 95(3), pages 616-636, June.
    7. Berhanu Feysia & Christopher H. Herbst & Wuleta Lemma & Agnes Soucat, 2012. "The Health Workforce in Ethiopia : Addressing the Remaining Challenges," World Bank Publications - Books, The World Bank Group, number 2226.
    8. Olena Kalinichenko & Carla A. F. Amado & Sérgio P. Santos, 2013. "Performance Assessment in Primary Health Care: A Systematic Literature Review," CEFAGE-UE Working Papers 2013_03, University of Evora, CEFAGE-UE (Portugal).
    9. Edward, Anbrasi & Branchini, Casey & Aitken, Iain & Roach, Melissa & Osei-Bonsu, Kojo & Arwal, Said Habib, 2015. "Toward universal coverage in Afghanistan: A multi-stakeholder assessment of capacity investments in the community health worker system," Social Science & Medicine, Elsevier, vol. 145(C), pages 173-183.
    10. Ndikumana David Emmanuel & Maria Elo & Rebecca Piekkari, 2019. "Human stickiness as a counterforce to brain drain: Purpose-driven behaviour among Tanzanian medical doctors and implications for policy," Journal of International Business Policy, Palgrave Macmillan, vol. 2(4), pages 314-332, December.
    11. Sonja Fagernäs & Panu Pelkonen, 2011. "Whether to Hire Local Contract Teachers? Trade-off Between Skills and Preferences in India," Working Paper Series 1811, Department of Economics, University of Sussex Business School.
    12. Sonja Fagernäs & Panu Pelkonen, 2012. "Preferences and skills of Indian public sector teachers," IZA Journal of Labor & Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 1(1), pages 1-31, December.
    13. Fagernäs, Sonja & Pelkonen, Panu, 2017. "Where's the Teacher? How Teacher Workplace Segregation Impedes Teacher Allocation in India," IZA Discussion Papers 10595, Institute of Labor Economics (IZA).
    14. Ernestina Coast & Nicola Jones & Umutoni Marie Francoise & Workneh Yadete & Roberte Isimbi & Kiya Gezahegne & Letisha Lunin, 2019. "Adolescent Sexual and Reproductive Health in Ethiopia and Rwanda: A Qualitative Exploration of the Role of Social Norms," SAGE Open, , vol. 9(1), pages 21582440198, March.
    15. Carolina Lopez & Anja Sautmann & Simone Schaner, 2022. "Does Patient Demand Contribute to the Overuse of Prescription Drugs?," American Economic Journal: Applied Economics, American Economic Association, vol. 14(1), pages 225-260, January.
    16. Claudiu CICEA, 2011. "Consideration Regarding Cost’S Evaluation In Healthcare Area," Business Excellence and Management, Faculty of Management, Academy of Economic Studies, Bucharest, Romania, vol. 1(1), pages 37-48, December.
    17. Eugenio Zucchelli & Andrew M Jones & Nigel Rice, 2012. "The evaluation of health policies through dynamic microsimulation methods," International Journal of Microsimulation, International Microsimulation Association, vol. 5(1), pages 2-20.
    18. Esther Atukunda & Anne Fitzpatrick, 2015. "An Evaluation of Factors Affecting Drug Quality: Evidence from the Antimalarial Market in Uganda," Working Papers 2015_03, University of Massachusetts Boston, Economics Department.
    19. Simons, Andrew M. & Beltramo, Theresa & Blalock, Garrick & Levine, David I., 2017. "Using unobtrusive sensors to measure and minimize Hawthorne effects: Evidence from cookstoves," Journal of Environmental Economics and Management, Elsevier, vol. 86(C), pages 68-80.
    20. Natina Yaduma & Mika Kortelainen & Ada Wossink, 2013. "Estimating Mortality and Economic Costs of Particulate Air Pollution in Developing Countries: The Case of Nigeria," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 54(3), pages 361-387, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0058650. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.