IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v10y2013i7p2621-2642d26722.html
   My bibliography  Save this article

Perspectives to Performance of Environment and Health Assessments and Models—From Outputs to Outcomes?

Author

Listed:
  • Mikko V. Pohjola

    (National Institute for Health and Welfare, Department of Environmental Health, P.O. Box 95, Kuopio FI-70701, Finland
    Nordem Oy, Jynkänmäenkatu 1 D 1, Kuopio 70840, Finland)

  • Pasi Pohjola

    (National Institute for Health and Welfare, Service System Department, P.O. Box 30, Helsinki FI-00271, Finland)

  • Marko Tainio

    (Systems Research Institute, Polish Academy of Sciences, Newelska 6, Warszawa 01-447, Poland)

  • Jouni T. Tuomisto

    (National Institute for Health and Welfare, Department of Environmental Health, P.O. Box 95, Kuopio FI-70701, Finland)

Abstract

The calls for knowledge-based policy and policy-relevant research invoke a need to evaluate and manage environment and health assessments and models according to their societal outcomes. This review explores how well the existing approaches to assessment and model performance serve this need. The perspectives to assessment and model performance in the scientific literature can be called: (1) quality assurance/control, (2) uncertainty analysis, (3) technical assessment of models, (4) effectiveness and (5) other perspectives, according to what is primarily seen to constitute the goodness of assessments and models. The categorization is not strict and methods, tools and frameworks in different perspectives may overlap. However, altogether it seems that most approaches to assessment and model performance are relatively narrow in their scope. The focus in most approaches is on the outputs and making of assessments and models. Practical application of the outputs and the consequential outcomes are often left unaddressed. It appears that more comprehensive approaches that combine the essential characteristics of different perspectives are needed. This necessitates a better account of the mechanisms of collective knowledge creation and the relations between knowledge and practical action. Some new approaches to assessment, modeling and their evaluation and management span the chain from knowledge creation to societal outcomes, but the complexity of evaluating societal outcomes remains a challenge.

Suggested Citation

  • Mikko V. Pohjola & Pasi Pohjola & Marko Tainio & Jouni T. Tuomisto, 2013. "Perspectives to Performance of Environment and Health Assessments and Models—From Outputs to Outcomes?," IJERPH, MDPI, vol. 10(7), pages 1-22, June.
  • Handle: RePEc:gam:jijerp:v:10:y:2013:i:7:p:2621-2642:d:26722
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/10/7/2621/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1660-4601/10/7/2621/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ekboir, Javier, 2003. "Why impact analysis should not be used for research evaluation and what the alternatives are," Agricultural Systems, Elsevier, vol. 78(2), pages 166-184, November.
    2. Cash, David & Clark, William & Alcock, Frank & Dickson, Nancy & Eckley, Noelle & Jager, Jill, 2002. "Salience, Credibility, Legitimacy and Boundaries: Linking Research, Assessment and Decision Making," Working Paper Series rwp02-046, Harvard University, John F. Kennedy School of Government.
    3. Blackstock, K.L. & Kelly, G.J. & Horsey, B.L., 2007. "Developing and applying a framework to evaluate participatory research for sustainability," Ecological Economics, Elsevier, vol. 60(4), pages 726-742, February.
    4. Guido Vonk & Stan Geertman & Paul Schot, 2005. "Bottlenecks Blocking Widespread Usage of Planning Support Systems," Environment and Planning A, , vol. 37(5), pages 909-924, May.
    5. Mark Colyvan, 2008. "Is Probability the Only Coherent Approach to Uncertainty?," Risk Analysis, John Wiley & Sons, vol. 28(3), pages 645-652, June.
    6. Emanuele Borgonovo, 2008. "Sensitivity Analysis of Model Output with Input Constraints: A Generalized Rationale for Local Methods," Risk Analysis, John Wiley & Sons, vol. 28(3), pages 667-680, June.
    7. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    2. Kristjanson, Patti & Reid, Robin & Dickson, Nancy & Clark, William C. & Vishnubhotla, Prasad & Romney, Dannie & Bezkorowajnyj, Peter & Said, Mohammed & Kaelo, Dickson & Makui, Ogeli & Nkedianye, David, 2008. "Linking International Agricultural Research Knowledge with Action for Sustainable Poverty Alleviation: What Works?," Working Paper Series rwp08-045, Harvard University, John F. Kennedy School of Government.
    3. te Brömmelstroet, Marco, 2017. "Towards a pragmatic research agenda for the PSS domain," Transportation Research Part A: Policy and Practice, Elsevier, vol. 104(C), pages 77-83.
    4. Bach Quang Ho & Yuki Inoue, 2020. "Driving Network Externalities in Education for Sustainable Development," Sustainability, MDPI, vol. 12(20), pages 1-16, October.
    5. Klerkx, Laurens & Leeuwis, Cees, 2008. "Institutionalizing end-user demand steering in agricultural R&D: Farmer levy funding of R&D in The Netherlands," Research Policy, Elsevier, vol. 37(3), pages 460-472, April.
    6. Lifshitz, Chen Chana, 2017. "Fostering employability among youth at-risk in a multi-cultural context: Insights from a pilot intervention program," Children and Youth Services Review, Elsevier, vol. 76(C), pages 20-34.
    7. Martin J Wassen & Hens Runhaar & Aat Barendregt & Tomasz Okruszko, 2011. "Evaluating the Role of Participation in Modeling Studies for Environmental Planning," Environment and Planning B, , vol. 38(2), pages 338-358, April.
    8. Blackstock, K.L. & Kelly, G.J. & Horsey, B.L., 2007. "Developing and applying a framework to evaluate participatory research for sustainability," Ecological Economics, Elsevier, vol. 60(4), pages 726-742, February.
    9. Marco Te Brömmelstroet & Luca Bertolini, 2010. "Integrating land use and transport knowledge in strategy-making," Transportation, Springer, vol. 37(1), pages 85-104, January.
    10. Natalie A Jones & Pascal Perez & Thomas G Measham & Gail J Kelly & Patrick D’Aquino & Katherine Daniell & Anne Dray & Nils Ferrand, 2008. "Evaluating Participatory Modeling: Developing a Framework for Cross-case Analysis," Socio-Economics and the Environment in Discussion (SEED) Working Paper Series 2008-11, CSIRO Sustainable Ecosystems.
    11. Andy Hall & Norman Clark, 2010. "What do complex adaptive systems look like and what are the implications for innovation policy?," Journal of International Development, John Wiley & Sons, Ltd., vol. 22(3), pages 308-324.
    12. Tessa Eikelboom & Ron Janssen, 2015. "Comparison of Geodesign Tools to Communicate Stakeholder Values," Group Decision and Negotiation, Springer, vol. 24(6), pages 1065-1087, November.
    13. Geertman, Stan, 2017. "PSS: Beyond the implementation gap," Transportation Research Part A: Policy and Practice, Elsevier, vol. 104(C), pages 70-76.
    14. Elena Bakhanova & Jaime A. Garcia & William L. Raffe & Alexey Voinov, 2023. "Gamification Framework for Participatory Modeling: A Proposal," Group Decision and Negotiation, Springer, vol. 32(5), pages 1167-1182, October.
    15. Zeigermann, Ulrike & Böcher, Michael, 2020. "Challenges for bridging the gap between knowledge and governance in sustainability policy – The case of OECD ‘Focal Points’ for Policy Coherence for Development," Forest Policy and Economics, Elsevier, vol. 114(C).
    16. Rossing, Walter A.H. & Albicette, Maria Marta & Aguerre, Veronica & Leoni, Carolina & Ruggia, Andrea & Dogliotti, Santiago, 2021. "Crafting actionable knowledge on ecological intensification: Lessons from co-innovation approaches in Uruguay and Europe," Agricultural Systems, Elsevier, vol. 190(C).
    17. Bullock Graham, 2015. "Signaling the credibility of private actors as public agents: transparency, independence, and expertise in environmental evaluations of products and companies," Business and Politics, De Gruyter, vol. 17(2), pages 177-219, August.
    18. Haozhi Pan & Stan Geertman & Brian Deal, 2020. "What does urban informatics add to planning support technology?," Environment and Planning B, , vol. 47(8), pages 1317-1325, October.
    19. Gillian L. Galford & Julie Nash & Alan K. Betts & Sam Carlson & Sarah Ford & Ann Hoogenboom & Deborah Markowitz & Andrew Nash & Elizabeth Palchak & Sarah Pears & Kristen L. Underwood, 2016. "Bridging the climate information gap: a framework for engaging knowledge brokers and decision makers in state climate assessments," Climatic Change, Springer, vol. 138(3), pages 383-395, October.
    20. Dragana Bojovic & Andria Nicodemou & Asun Lera St.Clair & Isadora Christel & Francisco J. Doblas-Reyes, 2022. "Exploring the landscape of seasonal forecast provision by Global Producing Centres," Climatic Change, Springer, vol. 172(1), pages 1-23, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:10:y:2013:i:7:p:2621-2642:d:26722. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.