IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v10y2013i7p2621-2642d26722.html
   My bibliography  Save this article

Perspectives to Performance of Environment and Health Assessments and Models—From Outputs to Outcomes?

Author

Listed:
  • Mikko V. Pohjola

    (National Institute for Health and Welfare, Department of Environmental Health, P.O. Box 95, Kuopio FI-70701, Finland
    Nordem Oy, Jynkänmäenkatu 1 D 1, Kuopio 70840, Finland)

  • Pasi Pohjola

    (National Institute for Health and Welfare, Service System Department, P.O. Box 30, Helsinki FI-00271, Finland)

  • Marko Tainio

    (Systems Research Institute, Polish Academy of Sciences, Newelska 6, Warszawa 01-447, Poland)

  • Jouni T. Tuomisto

    (National Institute for Health and Welfare, Department of Environmental Health, P.O. Box 95, Kuopio FI-70701, Finland)

Abstract

The calls for knowledge-based policy and policy-relevant research invoke a need to evaluate and manage environment and health assessments and models according to their societal outcomes. This review explores how well the existing approaches to assessment and model performance serve this need. The perspectives to assessment and model performance in the scientific literature can be called: (1) quality assurance/control, (2) uncertainty analysis, (3) technical assessment of models, (4) effectiveness and (5) other perspectives, according to what is primarily seen to constitute the goodness of assessments and models. The categorization is not strict and methods, tools and frameworks in different perspectives may overlap. However, altogether it seems that most approaches to assessment and model performance are relatively narrow in their scope. The focus in most approaches is on the outputs and making of assessments and models. Practical application of the outputs and the consequential outcomes are often left unaddressed. It appears that more comprehensive approaches that combine the essential characteristics of different perspectives are needed. This necessitates a better account of the mechanisms of collective knowledge creation and the relations between knowledge and practical action. Some new approaches to assessment, modeling and their evaluation and management span the chain from knowledge creation to societal outcomes, but the complexity of evaluating societal outcomes remains a challenge.

Suggested Citation

  • Mikko V. Pohjola & Pasi Pohjola & Marko Tainio & Jouni T. Tuomisto, 2013. "Perspectives to Performance of Environment and Health Assessments and Models—From Outputs to Outcomes?," IJERPH, MDPI, vol. 10(7), pages 1-22, June.
  • Handle: RePEc:gam:jijerp:v:10:y:2013:i:7:p:2621-2642:d:26722
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/10/7/2621/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1660-4601/10/7/2621/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ekboir, Javier, 2003. "Why impact analysis should not be used for research evaluation and what the alternatives are," Agricultural Systems, Elsevier, vol. 78(2), pages 166-184, November.
    2. Cash, David & Clark, William & Alcock, Frank & Dickson, Nancy & Eckley, Noelle & Jager, Jill, 2002. "Salience, Credibility, Legitimacy and Boundaries: Linking Research, Assessment and Decision Making," Working Paper Series rwp02-046, Harvard University, John F. Kennedy School of Government.
    3. Blackstock, K.L. & Kelly, G.J. & Horsey, B.L., 2007. "Developing and applying a framework to evaluate participatory research for sustainability," Ecological Economics, Elsevier, vol. 60(4), pages 726-742, February.
    4. Guido Vonk & Stan Geertman & Paul Schot, 2005. "Bottlenecks Blocking Widespread Usage of Planning Support Systems," Environment and Planning A, , vol. 37(5), pages 909-924, May.
    5. Mark Colyvan, 2008. "Is Probability the Only Coherent Approach to Uncertainty?," Risk Analysis, John Wiley & Sons, vol. 28(3), pages 645-652, June.
    6. Emanuele Borgonovo, 2008. "Sensitivity Analysis of Model Output with Input Constraints: A Generalized Rationale for Local Methods," Risk Analysis, John Wiley & Sons, vol. 28(3), pages 667-680, June.
    7. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Genowefa Blundo-Canto & Bernard Triomphe & Guy Faure & Danielle Barret & Aurelle de Romemont & Etienne Hainzelin, 2019. "Building a culture of impact in an international agricultural research organization: Process and reflective learning," Research Evaluation, Oxford University Press, vol. 28(2), pages 136-144.
    2. Sadie McEvoy & Frans H. M. van de Ven & Reinder Brolsma & Jill H. Slinger, 2019. "Evaluating a Planning Support System’s Use and Effects in Urban Adaptation: An Exploratory Case Study from Berlin, Germany," Sustainability, MDPI, vol. 12(1), pages 1-27, December.
    3. Keith B. Matthews & Ansel Renner & Kirsty L. Blackstock & Kerry A. Waylen & Dave G. Miller & Doug H. Wardell-Johnson & Alba Juarez-Bourke & Juan Cadillo-Benalcazar & Joep F. Schyns & Mario Giampietro, 2021. "Old Wine in New Bottles: Exploiting Data from the EU’s Farm Accountancy Data Network for Pan-EU Sustainability Assessments of Agricultural Production Systems," Sustainability, MDPI, vol. 13(18), pages 1-26, September.
    4. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    5. Kristjanson, Patti & Reid, Robin & Dickson, Nancy & Clark, William C. & Vishnubhotla, Prasad & Romney, Dannie & Bezkorowajnyj, Peter & Said, Mohammed & Kaelo, Dickson & Makui, Ogeli & Nkedianye, David, 2008. "Linking International Agricultural Research Knowledge with Action for Sustainable Poverty Alleviation: What Works?," Working Paper Series rwp08-045, Harvard University, John F. Kennedy School of Government.
    6. te Brömmelstroet, Marco, 2017. "Towards a pragmatic research agenda for the PSS domain," Transportation Research Part A: Policy and Practice, Elsevier, vol. 104(C), pages 77-83.
    7. Bach Quang Ho & Yuki Inoue, 2020. "Driving Network Externalities in Education for Sustainable Development," Sustainability, MDPI, vol. 12(20), pages 1-16, October.
    8. Klerkx, Laurens & Leeuwis, Cees, 2008. "Institutionalizing end-user demand steering in agricultural R&D: Farmer levy funding of R&D in The Netherlands," Research Policy, Elsevier, vol. 37(3), pages 460-472, April.
    9. Sofia Eckersten & Berit Balfors & Ulrika Gunnarsson-Östling, 2021. "Challenges and Opportunities in Early Stage Planning of Transport Infrastructure Projects: Environmental Aspects in the Strategic Choice of Measures Approach," Sustainability, MDPI, vol. 13(3), pages 1-18, January.
    10. Chiara Cocco & Piotr Jankowski & Michele Campagna, 2019. "An Analytic Approach to Understanding Process Dynamics in Geodesign Studies," Sustainability, MDPI, vol. 11(18), pages 1-21, September.
    11. Lifshitz, Chen Chana, 2017. "Fostering employability among youth at-risk in a multi-cultural context: Insights from a pilot intervention program," Children and Youth Services Review, Elsevier, vol. 76(C), pages 20-34.
    12. Vandermeulen, V. & Van Huylenbroeck, G., 2008. "Designing trans-disciplinary research to support policy formulation for sustainable agricultural development," Ecological Economics, Elsevier, vol. 67(3), pages 352-361, October.
    13. Raitzer, David A. & Kelley, Timothy G., 2008. "Benefit-cost meta-analysis of investment in the International Agricultural Research Centers of the CGIAR," Agricultural Systems, Elsevier, vol. 96(1-3), pages 108-123, March.
    14. Martin J Wassen & Hens Runhaar & Aat Barendregt & Tomasz Okruszko, 2011. "Evaluating the Role of Participation in Modeling Studies for Environmental Planning," Environment and Planning B, , vol. 38(2), pages 338-358, April.
    15. Blackstock, K.L. & Kelly, G.J. & Horsey, B.L., 2007. "Developing and applying a framework to evaluate participatory research for sustainability," Ecological Economics, Elsevier, vol. 60(4), pages 726-742, February.
    16. LaVelle, John M. & Davies, Randall, 2021. "Seeking consensus: Defining foundational concepts for a graduate level introductory program evaluation course," Evaluation and Program Planning, Elsevier, vol. 88(C).
    17. Marco Te Brömmelstroet & Luca Bertolini, 2010. "Integrating land use and transport knowledge in strategy-making," Transportation, Springer, vol. 37(1), pages 85-104, January.
    18. Melz, Heidi & Fromknecht, Anne E. & Masters, Loren D. & Richards, Tammy & Sun, Jing, 2023. "Incorporating multiple data sources to assess changes in organizational capacity in child welfare systems," Evaluation and Program Planning, Elsevier, vol. 97(C).
    19. Natalie A Jones & Pascal Perez & Thomas G Measham & Gail J Kelly & Patrick D’Aquino & Katherine Daniell & Anne Dray & Nils Ferrand, 2008. "Evaluating Participatory Modeling: Developing a Framework for Cross-case Analysis," Socio-Economics and the Environment in Discussion (SEED) Working Paper Series 2008-11, CSIRO Sustainable Ecosystems.
    20. Andy Hall & Norman Clark, 2010. "What do complex adaptive systems look like and what are the implications for innovation policy?," Journal of International Development, John Wiley & Sons, Ltd., vol. 22(3), pages 308-324.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:10:y:2013:i:7:p:2621-2642:d:26722. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.