IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v73y2019icp176-186.html
   My bibliography  Save this article

Assessing research impact: Australian Research Council criteria and the case of Family Wellbeing research

Author

Listed:
  • Tsey, Komla
  • Onnis, Leigh-ann
  • Whiteside, Mary
  • McCalman, Janya
  • Williams, Megan
  • Heyeres, Marion
  • Lui, Siu Man (Carrie)
  • Klieve, Helen
  • Cadet-James, Yvonne
  • Baird, Leslie
  • Brown, Catherine
  • Watkin Lui, Felecia
  • Grainger, Daniel
  • Gabriel, Zona
  • Millgate, Nigel
  • Cheniart, Ben
  • Hunter, Tahalani
  • Liu, Hong-Bo
  • Yinghong, Yang
  • Yan, Li
  • Lovett, Ray
  • Chong, Alwin
  • Kinchin, Irina

Abstract

Researchers worldwide are increasingly reporting the societal impact of their research as part of national research productivity assessments. However, the challenges they encounter in developing their impact case studies against specified government assessment criteria and how pitfalls can be mitigated are not reported. This paper examines the key steps taken to develop an Aboriginal Family Wellbeing (FWB) empowerment research impact case study in the context of an Australian Research Council (ARC) pilot research impact assessment exercise and the challenges involved in applying the ARC criteria. The requirement that researchers demonstrate how their institutions support them to conduct impactful research has the potential to create supportive environments for researchers to be more responsive to the needs of users outside academia. However, the 15-year reference period for the associated research underpinning the reported impact and the focus on researcher’s current institutional affiliation constitute potential constraints to demonstrating the true impact of research. For researchers working with Indigenous people, relationships that build over long periods of time, irrespective of university affiliation, are critical to conducting impactful research. A more open-ended time-frame, with no institutional restrictions for the ‘associated research’ provides the best opportunity to demonstrate the true benefits of research not only for Indigenous people but for Australian society more broadly.

Suggested Citation

  • Tsey, Komla & Onnis, Leigh-ann & Whiteside, Mary & McCalman, Janya & Williams, Megan & Heyeres, Marion & Lui, Siu Man (Carrie) & Klieve, Helen & Cadet-James, Yvonne & Baird, Leslie & Brown, Catherine , 2019. "Assessing research impact: Australian Research Council criteria and the case of Family Wellbeing research," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 176-186.
    • Handle: RePEc:eee:epplan:v:73:y:2019:i:c:p:176-186
    DOI: 10.1016/j.evalprogplan.2019.01.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718918302088
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2019.01.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Carlyn E Orians & Joanne Abed & Christina H Drew & Shyanika Wijesinha Rose & Jennifer H Cohen & Jerry Phelps, 2009. "Scientific and public health impacts of the NIEHS Extramural Asthma Research Program: insights from primary data," Research Evaluation, Oxford University Press, vol. 18(5), pages 375-385, December.
    2. Alene, Arega D. & Coulibaly, Ousmane, 2009. "The impact of agricultural research on productivity and poverty in sub-Saharan Africa," Food Policy, Elsevier, vol. 34(2), pages 198-209, April.
    3. Walker, Tom & Ryan, Jim & Kelley, Tim, 2010. "Impact Assessment of Policy-Oriented International Agricultural Research: Evidence and Insights from Case Studies," World Development, Elsevier, vol. 38(10), pages 1453-1461, October.
    4. Onnis, Leigh-ann & Klieve, Helen & Tsey, Komla, 2018. "The evidence needed to demonstrate impact: A synthesis of the evidence from a phased social and emotional wellbeing intervention," Evaluation and Program Planning, Elsevier, vol. 70(C), pages 35-43.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Samal, Parshuram & Mondal, Biswajit & Jambhulkar, Nitiprasad Namdeorao & Verma, Ramlakhan & Das, Anup Kumar & Singh, Onkar Nath, 2023. "Evaluation of crop research institutes under data and resource constraints: An alternative approach," Evaluation and Program Planning, Elsevier, vol. 97(C).
    2. Grainger, Daniel & Watkin-Lui, Felecia & Cheer, Karen, 2021. "The value of informed agency for Torres Strait climate change," Ecological Economics, Elsevier, vol. 180(C).
    3. Rene Brauer & Mirek Dymitrow, 2020. "The Language of Sustainable Tourism as a Proxy Indicator of Quality," Sustainability, MDPI, vol. 13(1), pages 1-17, December.
    4. Dotti, Nicola Francesco & Walczyk, Julia, 2022. "What is the societal impact of university research? A policy-oriented review to map approaches, identify monitoring methods and success factors," Evaluation and Program Planning, Elsevier, vol. 95(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Heyeres, Marion & Tsey, Komla & Yang, Yinghong & Yan, Li & Jiang, Hua, 2019. "The characteristics and reporting quality of research impact case studies: A systematic review," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 10-23.
    2. Thanos Fragkandreas, 2022. "Three Decades of Research on Innovation and Inequality: Causal Scenarios, Explanatory Factors, and Suggestions," Working Papers 60, Birkbeck Centre for Innovation Management Research, revised Feb 2022.
    3. Smale, Melinda & Kergna, Alpha O. & Assima, Amidou & Weltzien, Eva & Rattunde, Fred, 2014. "An Overview and Economic Assessment of Sorghum Improvement in Mali," Food Security International Development Working Papers 198186, Michigan State University, Department of Agricultural, Food, and Resource Economics.
    4. Aftab Ahmad, 2020. "Poverty Terrorism Nexus: A Case Study Of Pakistan," Bulletin of Business and Economics (BBE), Research Foundation for Humanity (RFH), vol. 9(4), pages 162-172, December.
    5. Msangi, Siwa, 2009. "Biofuels, Growth and Agricultural Development," 2009 Conference, August 16-22, 2009, Beijing, China 51723, International Association of Agricultural Economists.
    6. Alessandro Magrini & Fabio Bartolini & Alessandra Coli & Barbara Pacini, 2019. "A structural equation model to assess the impact of agricultural research expenditure on multiple dimensions," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(4), pages 2063-2080, July.
    7. Komla Tsey & Siu Man (Carrie) Lui & Marion Heyeres & Josephine Pryce & Li Yan & Sharee Bauld, 2018. "Developing Soft Skills: Exploring the Feasibility of an Australian Well-Being Program for Health Managers and Leaders in Timor-Leste," SAGE Open, , vol. 8(4), pages 21582440188, November.
    8. Onnis, Leigh-ann & Hakendorf, Marcia & Diamond, Mark & Tsey, Komla, 2019. "CQI approaches for evaluating management development programs: A case study with health service managers from geographically remote settings," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 91-101.
    9. Zuzana Smeets Kristkova & Edward Smeets & Hans van Meijl, 2016. "Agricultural R&D investments, biofuel policy and food security – a CGE analysis," EcoMod2016 9966, EcoMod.
    10. Hannes J. König & Frieder Graef & Jana Schindler & Anja Fasse & Khamaldin Daud Mutabazi & Christine Lambert & Pamela Ngwenya & Götz Uckert & Henry Mahoo & Fred F. Hattermann & Stefan Sieber, 2017. "Combining participatory, qualitative and quantitative methods for impact assessment of food value chains into an integrated framework," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 9(6), pages 1309-1321, December.
    11. Jourdain C. Lokossou & Hippolyte D. Affognon & Alphonse Singbo & Michel B. Vabi & Ayoni Ogunbayo & Paul Tanzubil & Alcade C. Segnon & Geoffrey Muricho & Haile Desmae & Hakeem Ajeigbe, 2022. "Welfare impacts of improved groundnut varieties adoption and food security implications in the semi-arid areas of West Africa," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 14(3), pages 709-728, June.
    12. Apata, Temidayo, 2021. "Effect of public spending on agricultural productivity in Nigeria (1981-2018)," Revista Galega de Economía, University of Santiago de Compostela. Faculty of Economics and Business., vol. 30(2), pages 1-21.
    13. Bannor, Frank & Dikgang, Johane & Gelo, Dambala, 2021. "Agricultural total factor productivity growth, technical efficiency, and climate variability in sub-Saharan Africa," EconStor Preprints 231310, ZBW - Leibniz Information Centre for Economics.
    14. Nin-Pratt, Alejandro & Johnson, Michael E. & Yu, Bingxin, 2012. "Improved performance of agriculture in Africa South of the Sahara: Taking off or bouncing back?," IFPRI discussion papers 1224, International Food Policy Research Institute (IFPRI).
    15. Moinoddini, Zeinab, 2015. "Related to Agricultural Research, Distribution of Income and Agricultural Value Added," International Journal of Agricultural Management and Development (IJAMAD), Iranian Association of Agricultural Economics, vol. 5(2), June.
    16. Wossen, Tesfamicheal & Alene, Arega & Abdoulaye, Tahirou & Feleke, Shiferaw & Manyong, Victor, 2019. "Agricultural technology adoption and household welfare: Measurement and evidence," Food Policy, Elsevier, vol. 87(C), pages 1-1.
    17. Hwang, JaeHee & Lee, SeongWoo, 2015. "The effect of the rural tourism policy on non-farm income in South Korea," Tourism Management, Elsevier, vol. 46(C), pages 501-513.
    18. Jaehee Hwang & Jonghoon Park & Seongwoo Lee, 2018. "The Impact of the Comprehensive Rural Village Development Program on Rural Sustainability in Korea," Sustainability, MDPI, vol. 10(7), pages 1-21, July.
    19. Chaminuka, Petronella, 2019. "Public agricultural research and development spending in South Africa – update," Agrekon, Agricultural Economics Association of South Africa (AEASA), vol. 58(01), February.
    20. Haynes, Emma & Marawili, Minitja & Marika, Brendan Makungun & Mitchell, Alice G. & Phillips, Jodi & Bessarab, Dawn & Walker, Roz & Cook, Jeff & Ralph, Anna P., 2019. "Community-based participatory action research on rheumatic heart disease in an Australian Aboriginal homeland: Evaluation of the ‘On track watch’ project," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 38-53.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:73:y:2019:i:c:p:176-186. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.