IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0224746.html
   My bibliography  Save this article

“What gets measured better gets done better”: The landscape of validation of global maternal and newborn health indicators through key informant interviews

Author

Listed:
  • Lenka Benova
  • Ann-Beth Moller
  • Allisyn C Moran

Abstract

Background: A large number of indicators are currently used to monitor the state of maternal and newborn health, including those capturing dimensions of health system and input, care access and availability, care quality and safety, coverage and outcomes, and impact. Validity of these indicators is a key issue in the process of assessing indicator performance and suitability. This paper aims to understand the meaning of indicator validity in the field of maternal and newborn health, and to identify key recommendations for future research. Methods: This qualitative study used purposive sampling to identify key informants until thematic saturation was achieved. We interviewed 32 respondents from a variety of backgrounds using semi-structured interviews covering five themes: the meaning of indicator validity, methodological approaches to assessing validity, acceptable levels of indicator validity, gaps in validation research, and recommendations for addressing these gaps. Interview transcripts were analysed data using thematic content approach. Results: Three conceptually different definitions of indicator validity were described by respondents. They considered indicator validity to encompass meaning and potential to spur action, going beyond diagnostic validity. Indicator validation was seen as an ongoing process of building and synthesising a wide range of evidence rather than a one-size-fits-all cut-off in diagnostic validity tests. Gaps identified included assessing validity of indicators of quality of care and indicators based on facility-level data, as well as expanding studies to a broader range of global settings. The key recommendation was to develop a coordinated approach to summarising and evaluating research on indicator validity, including capacity building in appraising and communicating the available evidence for country-specific needs. Conclusion: The findings will inform future recommendations around indicator testing and validation.

Suggested Citation

  • Lenka Benova & Ann-Beth Moller & Allisyn C Moran, 2019. "“What gets measured better gets done better”: The landscape of validation of global maternal and newborn health indicators through key informant interviews," PLOS ONE, Public Library of Science, vol. 14(11), pages 1-16, November.
    • Handle: RePEc:plo:pone00:0224746
    DOI: 10.1371/journal.pone.0224746
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0224746
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0224746&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0224746?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Sara Bennett & Irene Akua Agyepong & Kabir Sheikh & Kara Hanson & Freddie Ssengooba & Lucy Gilson, 2011. "Building the Field of Health Policy and Systems Research: An Agenda for Action," PLOS Medicine, Public Library of Science, vol. 8(8), pages 1-5, August.
    2. Ann-Beth Moller & Holly Newby & Claudia Hanson & Alison Morgan & Shams El Arifeen & Doris Chou & Theresa Diaz & Lale Say & Ian Askew & Allisyn C Moran, 2018. "Measures matter: A scoping review of maternal and newborn indicators," PLOS ONE, Public Library of Science, vol. 13(10), pages 1-19, October.
    3. Lucy Gilson & Kara Hanson & Kabir Sheikh & Irene Akua Agyepong & Freddie Ssengooba & Sara Bennett, 2011. "Building the Field of Health Policy and Systems Research: Social Science Matters," PLOS Medicine, Public Library of Science, vol. 8(8), pages 1-6, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mamothena Carol Mothupi & Jeroen De Man & Hanani Tabana & Lucia Knight, 2021. "Development and testing of a composite index to monitor the continuum of maternal health service delivery at provincial and district level in South Africa," PLOS ONE, Public Library of Science, vol. 16(5), pages 1-16, May.
    2. Lenka Benova & Ann-Beth Moller & Kathleen Hill & Lara M E Vaz & Alison Morgan & Claudia Hanson & Katherine Semrau & Shams Al Arifeen & Allisyn C Moran, 2020. "What is meant by validity in maternal and newborn health measurement? A conceptual framework for understanding indicator validation," PLOS ONE, Public Library of Science, vol. 15(5), pages 1-19, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Topp, Stephanie M. & Tully, Josslyn & Cummins, Rachel & Graham, Veronica & Yashadhana, Aryati & Elliott, Lana & Taylor, Sean, 2022. "Building patient trust in health systems: A qualitative study of facework in the context of the Aboriginal and Torres Strait Islander Health Worker role in Queensland, Australia," Social Science & Medicine, Elsevier, vol. 302(C).
    2. Josephine Borghi & Garrett W. Brown, 2022. "Taking Systems Thinking to the Global Level: Using the WHO Building Blocks to Describe and Appraise the Global Health System in Relation to COVID‐19," Global Policy, London School of Economics and Political Science, vol. 13(2), pages 193-207, May.
    3. Taufique Joarder & Asha George & Syed Masud Ahmed & Sabina Faiz Rashid & Malabika Sarker, 2017. "What constitutes responsiveness of physicians: A qualitative study in rural Bangladesh," PLOS ONE, Public Library of Science, vol. 12(12), pages 1-19, December.
    4. Magrath, Priscilla & Nichter, Mark, 2012. "Paying for performance and the social relations of health care provision: An anthropological perspective," Social Science & Medicine, Elsevier, vol. 75(10), pages 1778-1785.
    5. Closser, Svea & Mendenhall, Emily & Brown, Peter & Neill, Rachel & Justice, Judith, 2022. "The anthropology of health systems: A history and review," Social Science & Medicine, Elsevier, vol. 300(C).
    6. Taghreed Adam & Saad Ahmad & Maryam Bigdeli & Abdul Ghaffar & John-Arne Røttingen, 2011. "Trends in Health Policy and Systems Research over the Past Decade: Still Too Little Capacity in Low-Income Countries," PLOS ONE, Public Library of Science, vol. 6(11), pages 1-10, November.
    7. Colvin, Christopher J., 2022. "Understanding global health policy engagements with qualitative research: Qualitative evidence syntheses and the OptimizeMNH guidelines," Social Science & Medicine, Elsevier, vol. 300(C).
    8. Claudia Nieto-Sanchez & Benjamin R Bates & Darwin Guerrero & Sylvia Jimenez & Esteban G Baus & Koen Peeters Grietens & Mario J Grijalva, 2019. "Home improvement and system-based health promotion for sustainable prevention of Chagas disease: A qualitative study," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 13(6), pages 1-24, June.
    9. Taghreed El Hajj & Stefanie Gregorius & Justin Pulford & Imelda Bates, 2020. "Strengthening capacity for natural sciences research: A qualitative assessment to identify good practices, capacity gaps and investment priorities in African research institutions," PLOS ONE, Public Library of Science, vol. 15(1), pages 1-21, January.
    10. Edwine W Barasa & Anthony M Manyara & Sassy Molyneux & Benjamin Tsofa, 2017. "Recentralization within decentralization: County hospital autonomy under devolution in Kenya," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-18, August.
    11. Mladovsky, Philipa, 2020. "Fragmentation by design: Universal health coverage policies as governmentality in Senegal," Social Science & Medicine, Elsevier, vol. 260(C).
    12. Shilpa Surendran & Chuan De Foo & Chen Hee Tam & Elaine Qiao Ying Ho & David Bruce Matchar & Josip Car & Gerald Choon Huat Koh, 2021. "The Missed Opportunity of Patient-Centered Medical Homes to Thrive in an Asian Context," IJERPH, MDPI, vol. 18(4), pages 1-11, February.
    13. Hutchinson, Eleanor & Mundua, Sunday & Ochero, Lydia & Mbonye, Anthony & Clarke, Sian E., 2022. "Life in the buffer zone: Social relations and surplus health workers in Uganda's medicines retail sector," Social Science & Medicine, Elsevier, vol. 300(C).
    14. Kerry Scott & Asha S George & Steven A Harvey & Shinjini Mondal & Gupteswar Patel & Rajani Ved & Surekha Garimella & Kabir Sheikh, 2017. "Beyond form and functioning: Understanding how contextual factors influence village health committees in northern India," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-17, August.
    15. Obinna Onwujekwe & Enyi Etiaba & Chinyere Mbachu & Ifeyinwa Arize & Chikezie Nwankwor & Uchenna Ezenwaka & Chinyere Okeke & Nkoli Ezumah & Benjamin Uzochukwu, 2020. "Does improving the skills of researchers and decision-makers in health policy and systems research lead to enhanced evidence-based decision making in Nigeria?—A short term evaluation," PLOS ONE, Public Library of Science, vol. 15(9), pages 1-18, September.
    16. Das, Priya & Newton-Lewis, Tom & Khalil, Karima & Rajadhyaksha, Madhavi & Nagpal, Phalasha, 2022. "How performance targets can ingrain a culture of ‘performing out’: An ethnography of two Indian primary healthcare facilities," Social Science & Medicine, Elsevier, vol. 300(C).
    17. Coburn, Josie & Yaqub, Ohid & Chataway, Joanna, 2022. "Targeting research to address societal needs: What can we learn from 30 years of targeting neglected diseases?," SocArXiv 65ws7, Center for Open Science.
    18. Maryam Bigdeli & Shamsa Zafar & Hafeez Assad & Adbul Ghaffar, 2013. "Health System Barriers to Access and Use of Magnesium Sulfate for Women with Severe Pre-Eclampsia and Eclampsia in Pakistan: Evidence for Policy and Practice," PLOS ONE, Public Library of Science, vol. 8(3), pages 1-9, March.
    19. Kline, Nolan, 2022. "Health and immigration systems as an ethnographic field: Methodological lessons from examining immigration enforcement and health in the US," Social Science & Medicine, Elsevier, vol. 300(C).
    20. Meena Daivadanam & Maia Ingram & Kristi Sidney Annerstedt & Gary Parker & Kirsty Bobrow & Lisa Dolovich & Gillian Gould & Michaela Riddell & Rajesh Vedanthan & Jacqui Webster & Pilvikki Absetz & Helle, 2019. "The role of context in implementation research for non-communicable diseases: Answering the ‘how-to’ dilemma," PLOS ONE, Public Library of Science, vol. 14(4), pages 1-22, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0224746. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.