IDEAS home Printed from https://ideas.repec.org/p/vua/wpaper/2002-5.html
   My bibliography  Save this paper

Accounting for dependence among study results in Meta-Analysis: methodology and applications to the valuation and use of natural resources

Author

Listed:
  • Florax, R.J.G.M.

    (Vrije Universiteit Amsterdam, Faculteit der Economische Wetenschappen en Econometrie (Free University Amsterdam, Faculty of Economics Sciences, Business Administration and Economitrics)

Abstract

Meta-analysis refers to the statistical analysis of empirical estimates obtained in previous studies, and is increasingly used in environmental and natural resource economics as a complement to a state-of-the-art literature review. The occurrence of dependence or auto-correlation among study results, for multiple estimates from the same study or for estimates from different studies, is a compelling problem that is usually ignored. This paper suggests that autocorrelation tests and estimators developed for other types of data constitute an appropriate solution to measuring and remedying dependence in meta-analysis. Moreover, visualization by means of a scatterplot provides a useful tool for the interpretation of dependence, and helps to detect outliers. The paper provides illustrations of the techniques through meta-analyses on the valuation of wetlands and the price elasticity of residential water demand. The applications show that between-study dependence is usually sufficiently modeled by means of variability in study characteristics. Ignoring within-study dependence, however, can result in biased estimators and makes inferences from meta-analyses imprecise in size and significante.

Suggested Citation

  • Florax, R.J.G.M., 2002. "Accounting for dependence among study results in Meta-Analysis: methodology and applications to the valuation and use of natural resources," Serie Research Memoranda 0005, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    • Handle: RePEc:vua:wpaper:2002-5
    as

    Download full text from publisher

    File URL: http://degree.ubvu.vu.nl/repec/vua/wpaper/pdf/20020005.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kevin J. Boyle & Gregory L. Poe & John C. Bergstrom, 1994. "What Do We Know About Groundwater Values? Preliminary Implications from a Meta Analysis of Contingent-Valuation Studies," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 76(5), pages 1055-1061.
    2. Cavlovic, Therese A. & Baker, Kenneth H. & Berrens, Robert P. & Gawande, Kishore, 2000. "A Meta-Analysis of Environmental Kuznets Curve Studies," Agricultural and Resource Economics Review, Cambridge University Press, vol. 29(1), pages 32-42, April.
    3. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    4. Richard T. Carson & Nicholas E. Flores & Kerry M. Martin & Jennifer L. Wright, 1996. "Contingent Valuation and Revealed Preference Methodologies: Comparing the Estimates for Quasi-Public Goods," Land Economics, University of Wisconsin Press, vol. 72(1), pages 80-99.
    5. Raymond J.G.M. Florax & Peter Nijkamp & Kenneth G. Willis (ed.), 2002. "Comparative Environmental Economic Assessment," Books, Edward Elgar Publishing, number 1945.
    6. Jasper M. Dalhuisen & Raymond J.G.M. Florax & Henri L.F.M. de Groot & Peter Nijkamp, 2001. "Price and Income Elasticities of Residential Water Demand: Why Empirical Estimates differ," Tinbergen Institute Discussion Papers 01-057/3, Tinbergen Institute.
    7. Hedges, Larry V., 1997. "The promise of replication in labour economics," Labour Economics, Elsevier, vol. 4(2), pages 111-114, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fan, Yubing & Wang, Chenggang & Nan, Zhibiao, 2016. "Determining water use efficiency for wheat and cotton: A meta-regression analysis," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 236059, Agricultural and Applied Economics Association.
    2. Marc van der Steeg & Roel van Elk & Dinand Webbink, 2012. "Does intensive coaching reduce school dropout?," CPB Discussion Paper 224.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    3. Melo, Patricia C. & Graham, Daniel J. & Noland, Robert B., 2009. "A meta-analysis of estimates of urban agglomeration economies," Regional Science and Urban Economics, Elsevier, vol. 39(3), pages 332-342, May.
    4. Simonetta Longhi & Peter Nijkamp & Jacques Poot, 2005. "A Meta‐Analytic Assessment of the Effect of Immigration on Wages," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 451-477, July.
    5. Alexandros Dimitropoulos & Piet Rietveld & Jos N. van Ommeren, 2011. "Consumer Valuation of Driving Range: A Meta-Analysis," Tinbergen Institute Discussion Papers 11-133/3, Tinbergen Institute.
    6. Patricia C Melo & Yakubu Abdul-Salam & Deborah Roberts & Alana Gilbert & Robin Matthews & Liesbeth Colen & Sergio Gomez Y Paloma, 2015. "Income Elasticities of Food Demand in Africa: A Meta-Analysis," JRC Research Reports JRC98812, Joint Research Centre.
    7. Kees Folmer, 2009. "Why do macro wage elasticities diverge? A meta analysis," CPB Discussion Paper 122, CPB Netherlands Bureau for Economic Policy Analysis.
    8. repec:got:cegedp:67 is not listed on IDEAS
    9. Fan, Yubing & Wang, Chenggang & Nan, Zhibiao, 2018. "Determining water use efficiency of wheat and cotton: A meta-regression analysis," Agricultural Water Management, Elsevier, vol. 199(C), pages 48-60.
    10. Sebastian Hess & Stephan Von Cramon‐Taubadel, 2008. "A Meta‐Analysis of General and Partial Equilibrium Simulations of Trade Liberalisation under the Doha Development Agenda," The World Economy, Wiley Blackwell, vol. 31(6), pages 804-840, June.
    11. Mauro L. Ghinamo, 2012. "Explaining The Variation In The Empirical Estimates Of Academic Knowledge Spillovers," Journal of Regional Science, Wiley Blackwell, vol. 52(4), pages 606-634, October.
    12. Kees Folmer, 2009. "Why do macro wage elasticities diverge?," CPB Memorandum 224.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    13. Hess, Sebastian & von Cramon-Taubadel, Stephan, 2007. "Assessing general and partial equilibrium simulations of Doha round outcomes using meta-analysis," University of Göttingen Working Papers in Economics 67, University of Goettingen, Department of Economics.
    14. Raymond J. G. M. Florax & Chiara M. Travisi & Peter Nijkamp, 2005. "A meta-analysis of the willingness to pay for reductions in pesticide risk exposure," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 32(4), pages 441-467, December.
    15. Liu, Boying & Richard Shumway, C., 2016. "Substitution elasticities between GHG-polluting and nonpolluting inputs in agricultural production: A meta-regression," Energy Economics, Elsevier, vol. 54(C), pages 123-132.
    16. Kees Folmer, 2009. "Why do macro wage elasticities diverge?," CPB Memorandum 224, CPB Netherlands Bureau for Economic Policy Analysis.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raymond J.G.M. Florax & Henri L.F. de Groot & Ruud A. de Mooij, 2002. "Meta-analysis: A Tool for Upgrading Inputs of Macroeconomic Policy Models," Tinbergen Institute Discussion Papers 02-041/3, Tinbergen Institute.
    2. Bergstrom, John C. & Taylor, Laura O., 2006. "Using meta-analysis for benefits transfer: Theory and practice," Ecological Economics, Elsevier, vol. 60(2), pages 351-360, December.
    3. Lindhjem, Henrik, 2007. "20 years of stated preference valuation of non-timber benefits from Fennoscandian forests: A meta-analysis," Journal of Forest Economics, Elsevier, vol. 12(4), pages 251-277, February.
    4. Ojea, Elena & Loureiro, Maria L., 2011. "Identifying the scope effect on a meta-analysis of biodiversity valuation studies," Resource and Energy Economics, Elsevier, vol. 33(3), pages 706-724, September.
    5. Jonas Schmidt & Tammo H. A. Bijmolt, 2020. "Accurately measuring willingness to pay for consumer goods: a meta-analysis of the hypothetical bias," Journal of the Academy of Marketing Science, Springer, vol. 48(3), pages 499-518, May.
    6. Bayham, Jude & Muñoz-García, Félix & Espínola-Arredondo, Ana, 2019. "International coordination of environmental policies: is it always worth the effort?," Environment and Development Economics, Cambridge University Press, vol. 24(3), pages 294-316, June.
    7. Adalja, Aaron & Hanson, James & Towe, Charles & Tselepidakis, Elina, 2015. "An Examination of Consumer Willingness to Pay for Local Products," Agricultural and Resource Economics Review, Northeastern Agricultural and Resource Economics Association, vol. 44(3), pages 1-22, December.
    8. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    9. Haghani, Milad & Bliemer, Michiel C.J. & Rose, John M. & Oppewal, Harmen & Lancsar, Emily, 2021. "Hypothetical bias in stated choice experiments: Part I. Macro-scale analysis of literature and integrative synthesis of empirical evidence from applied economics, experimental psychology and neuroimag," Journal of choice modelling, Elsevier, vol. 41(C).
    10. Christian A. Vossler & Maurice Doyon & Daniel Rondeau, 2012. "Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 4(4), pages 145-171, November.
    11. Brander, Luke M. & Ghermandi, Andrea & Kuik, Onno & Markandya, Anil & Nunes, Paulo A.L.D. & Schaafsma, Marije & Wagtendonk, Alfred, 2010. "Scaling up Ecosystem Services Values: Methodology, Applicability and a Case Study," Sustainable Development Papers 60689, Fondazione Eni Enrico Mattei (FEEM).
    12. Bruno S. Frey & Simon Luechinger, 2005. "Measuring terrorism," Chapters, in: Alain Marciano & Jean-Michel Josselin (ed.), Law and the State, chapter 6, Edward Elgar Publishing.
    13. Johansson-Stenman, Olof & Svedsäter, Henrik, 2011. "Self-Image and Valuation of Moral Goods: Stated versus Real Willingness to Pay," Working Papers in Economics 484, University of Gothenburg, Department of Economics.
    14. Richard C. Bishop & Kevin J. Boyle, 2019. "Reliability and Validity in Nonmarket Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 72(2), pages 559-582, February.
    15. Carina Cavalcanti & Andreas Leibbrandt, 2017. "A glance into the willingness to reduce overfishing: Field evidence from a fishnet exchange program," Monash Economics Working Papers 09-17, Monash University, Department of Economics.
    16. Daniel A. Brent & Lata Gangadharan & Anke D. Leroux & Paul A. Raschky, 2022. "Reducing bias in preference elicitation for environmental public goods," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(2), pages 280-308, April.
    17. Londoño, Luz M. & Johnston, Robert J., 2012. "Enhancing the reliability of benefit transfer over heterogeneous sites: A meta-analysis of international coral reef values," Ecological Economics, Elsevier, vol. 78(C), pages 80-89.
    18. Rosenberger, Randall S. & Loomis, John B., 2000. "Panel Stratification In Meta-Analysis Of Economic Studies: An Investigation Of Its Effects In The Recreation Valuation Literature," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 32(3), pages 1-12, December.
    19. John C. Whitehead & Subhrendu K. Pattanayak & George L. Van Houtven & Brett R. Gelso, 2008. "Combining Revealed And Stated Preference Data To Estimate The Nonmarket Value Of Ecological Services: An Assessment Of The State Of The Science," Journal of Economic Surveys, Wiley Blackwell, vol. 22(5), pages 872-908, December.
    20. Tuan, Tran Hu & Lindhjem, Henrik, 2008. "Meta-analysis of nature conservation values in Asia & Oceania: Data heterogeneity and benefit transfer issues," MPRA Paper 11470, University Library of Munich, Germany.

    More about this item

    Keywords

    meta-analysis; autocorrelation; dependence; heterogeneity;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis
    • Q25 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Renewable Resources and Conservation - - - Water

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vua:wpaper:2002-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: R. Dam (email available below). General contact details of provider: https://edirc.repec.org/data/fewvunl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.