IDEAS home Printed from https://ideas.repec.org/a/taf/jecmet/v2y1995i2p201-222.html
   My bibliography  Save this article

The economist-as-audience needs a methodology of plausible inference

Author

Listed:
  • Robert Goldfarb

Abstract

Economists often try to make plausible inferences from a sizable empirical literature addressing a particular measurement, direction-of-effect, or testing issue. There are serious methodological problems associated with drawing such inferences. This article sets out some of these problems in order to make a case for their importance. After discussing these problems, the paper presents three case study examples of inference difficulties in specific literatures. It then proposes a new hypothesis about the time pattern of publication bias in empirical economics literatures. As support for this hypothesis, it presents evidence that 'reversals in findings' in empirical literatures in economics are not uncommon. Similarities are pointed out between the focus on inference problems in this paper, and the meta-analysis literatures in psychology and medical clinical trials.

Suggested Citation

  • Robert Goldfarb, 1995. "The economist-as-audience needs a methodology of plausible inference," Journal of Economic Methodology, Taylor & Francis Journals, vol. 2(2), pages 201-222.
    • Handle: RePEc:taf:jecmet:v:2:y:1995:i:2:p:201-222
    DOI: 10.1080/13501789500000015
    as

    Download full text from publisher

    File URL: http://www.tandfonline.com/doi/abs/10.1080/13501789500000015
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/13501789500000015?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Smith, V. Kerry & Osborne, Laura L., 1996. "Do Contingent Valuation Estimates Pass a "Scope" Test? A Meta-analysis," Journal of Environmental Economics and Management, Elsevier, vol. 31(3), pages 287-301, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mark J. Koetse & Henri L.F. de Groot & Raymond J.G.M. Florax, 2011. "A Meta-Regression Analysis of the Investment–Uncertainty Relationship," Chapters, in: Raymond J.G.M. Florax & Henri L.F. de Groot & Peter Mulder (ed.), Improving Energy Efficiency through Technology, chapter 7, Edward Elgar Publishing.
    2. Neves, Pedro Cunha & Afonso, Óscar & Silva, Sandra Tavares, 2016. "A Meta-Analytic Reassessment of the Effects of Inequality on Growth," World Development, Elsevier, vol. 78(C), pages 386-400.
    3. Thomas Mayer, "undated". "The Domain Of Theories And Tests By The Realism Of Assumptions," Department of Economics 98-11, California Davis - Department of Economics.
    4. Houcine Senoussi, 2021. "Inflation and Inflation Uncertainty in Growth Model of Barro: An Application of Random Forest Method," International Econometric Review (IER), Econometric Research Association, vol. 13(1), pages 4-23, March.
    5. Stanley, T.D. & Doucouliagos, Chris & Jarrell, Stephen B., 2008. "Meta-regression analysis as the socio-economics of economics research," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(1), pages 276-292, February.
    6. Afonso, Oscar & Neves, Pedro Cunha & Pinto, Tiago, 2020. "The non-observed economy and economic growth: A meta-analysis," Economic Systems, Elsevier, vol. 44(1).
    7. T. D. Stanley, 2004. "Does unemployment hysteresis falsify the natural rate hypothesis? a meta‐regression analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 18(4), pages 589-612, September.
    8. Nils Goldschmidt & Benedikt Szmrecsanyi, 2007. "What Do Economists Talk About? A Linguistic Analysis of Published Writing in Economic Journals," American Journal of Economics and Sociology, Wiley Blackwell, vol. 66(2), pages 335-378, April.
    9. Havranek, Tomas & Irsova, Zuzana & Janda, Karel, 2012. "Demand for gasoline is more price-inelastic than commonly thought," Energy Economics, Elsevier, vol. 34(1), pages 201-207.
    10. Tomáš Havránek, 2010. "Rose effect and the euro: is the magic gone?," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 146(2), pages 241-261, June.
    11. JS Armstrong & Roderick J. Brodie & Andrew G. Parsons, 2004. "Hypotheses in Marketing Science: Literature Review and Publication Audit," General Economics and Teaching 0412013, University Library of Munich, Germany.
    12. Stanley, T. D., 2000. "An empirical critique of the Lucas critique," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 29(1), pages 91-107.
    13. Bergeijk Peter A.G. van & Demena Binyam A. & Reta Alemayehu & Jativa Gabriela Benalcazar & Kimararungu Patrick, 2019. "Could the literature on the economic determinants of sanctions be biased?," Peace Economics, Peace Science, and Public Policy, De Gruyter, vol. 25(4), pages 1-4, December.
    14. Peter A. G. van Bergeijk, 2020. "Can the Sanction Debate Be Resolved?," CESifo Forum, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 20(04), pages 3-8, January.
    15. Chris Doucouliagos & T.D. Stanley, 2013. "Are All Economic Facts Greatly Exaggerated? Theory Competition And Selectivity," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 316-339, April.
    16. Thomas Mayer, 2006. "The Empirical Significance of Econometric Models," Working Papers 620, University of California, Davis, Department of Economics.
    17. Tomáš Havránek, 2009. "Rose Effect and the Euro: The Magic is Gone," Working Papers IES 2009/20, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Aug 2009.
    18. Demena, B.A. & Benalcazar Jativa, G. & Reta, A.S. & Kimararungu, P.B. & van Bergeijk, P.A.G., 2021. "Does research on economic sanctions suffer from publication bias?," ISS Working Papers - General Series 674, International Institute of Social Studies of Erasmus University Rotterdam (ISS), The Hague.
    19. Mariusz Maziarz, 2019. "The unrealistic realist philosophy. The ontology of econometrics revisited," The Journal of Philosophical Economics, Bucharest Academy of Economic Studies, The Journal of Philosophical Economics, vol. 13(1), pages 39-64, November.
    20. Mariusz MAZIARZ, 2017. "‘Growth in a Time of Debt’ as an example of the logical-positivist science," The Journal of Philosophical Economics, Bucharest Academy of Economic Studies, The Journal of Philosophical Economics, vol. 10(2), pages 47-64, May.
    21. Havranek, Tomas & Kokes, Ondrej, 2015. "Income elasticity of gasoline demand: A meta-analysis," Energy Economics, Elsevier, vol. 47(C), pages 77-86.
    22. Mark J. Koetse & Raymond J.G.M. Florax & Henri L.F. de Groot, 2007. "The Impact of Effect Size Heterogeneity on Meta-Analysis: A Monte Carlo Experiment," Tinbergen Institute Discussion Papers 07-052/3, Tinbergen Institute.
    23. Tomas Havranek & Zuzana Irsova, 2012. "Survey Article: Publication Bias in the Literature on Foreign Direct Investment Spillovers," Journal of Development Studies, Taylor & Francis Journals, vol. 48(10), pages 1375-1396, October.
    24. Calvin Blackwell, 2007. "A Meta-Analysis of Tax Compliance Experiments," International Center for Public Policy Working Paper Series, at AYSPS, GSU paper0724, International Center for Public Policy, Andrew Young School of Policy Studies, Georgia State University.
    25. T. D. Stanley, 2001. "Wheat from Chaff: Meta-analysis as Quantitative Literature Review," Journal of Economic Perspectives, American Economic Association, vol. 15(3), pages 131-150, Summer.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chilton, S. M. & Hutchinson, W. G., 2003. "A qualitative examination of how respondents in a contingent valuation study rationalise their WTP responses to an increase in the quantity of the environmental good," Journal of Economic Psychology, Elsevier, vol. 24(1), pages 65-75, February.
    2. W. Michael Hanemann, 1994. "Valuing the Environment through Contingent Valuation," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 19-43, Fall.
    3. John Loomis & Bryon Allen, 2008. "Using Non Market Valuation to Inform the Choice Between Permits and Fees in Environmental Regulation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 40(3), pages 329-337, July.
    4. Richard T. Carson & Miko_aj Czajkowski, 2014. "The discrete choice experiment approach to environmental contingent valuation," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 9, pages 202-235, Edward Elgar Publishing.
    5. McDaniels, Timothy L. & Gregory, Robin & Arvai, Joseph & Chuenpagdee, Ratana, 2003. "Decision structuring to alleviate embedding in environmental valuation," Ecological Economics, Elsevier, vol. 46(1), pages 33-46, August.
    6. John C. Whitehead & Timothy C. Haab & Ju‐Chin Huang, 1998. "Part‐Whole Bias in Contingent Valuation: Will Scope Effects Be Detected with Inexpensive Survey Methods?," Southern Economic Journal, John Wiley & Sons, vol. 65(1), pages 160-168, July.
    7. Graham Loomes & Judith Mehta, 2007. "The sensitivity of subjective probability to time and elicitation method," Journal of Risk and Uncertainty, Springer, vol. 34(3), pages 201-216, June.
    8. Oltmer, Katrin & Florax, Raymond J.G.M., 2001. "Impacts Of Agricultural Policy Reform On Land Prices: A Quantitative Analysis Of The Literature," 2001 Annual meeting, August 5-8, Chicago, IL 20507, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    9. Catherine L. Kling & Daniel J. Phaneuf & Jinhua Zhao, 2012. "From Exxon to BP: Has Some Number Become Better Than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 26(4), pages 3-26, Fall.
    10. Powe, N. A. & Bateman, I. J., 2003. "Ordering effects in nested 'top-down' and 'bottom-up' contingent valuation designs," Ecological Economics, Elsevier, vol. 45(2), pages 255-270, June.
    11. Diane Dupont, 2003. "CVM Embedding Effects When There Are Active, Potentially Active and Passive Users of Environmental Goods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 25(3), pages 319-341, July.
    12. Banzhaf, H. Spencer & Desvousges, William H. & Johnson, F. Reed, 1996. "Assessing the externalities of electricity generation in the Midwest," Resource and Energy Economics, Elsevier, vol. 18(4), pages 395-421, December.
    13. Carson, Richard T. & Hanemann, W. Michael & Kopp, Raymond J. & Krosnick, Jon A. & Mitchell, Robert C. & Presser, Stanley & Ruud, Paul A. & Smith, V. Kerry & Conaway, Michael & Martin, Kerry, 1996. "Was the NOAA Panel Correct about Contingent Valuation?," Discussion Papers 10503, Resources for the Future.
    14. Rosenberger, Randall S. & Loomis, John B. & Shrestha, Ram K., 1999. "Panel Stratification In Meta-Analysis Of Environmental And Natural Resource Economic Studies," 1999 Annual Meeting, July 11-14, 1999, Fargo, ND 35705, Western Agricultural Economics Association.
    15. Mäntymaa, Erkki & Juutinen, Artti & Tyrväinen, Liisa & Karhu, Jouni & Kurttila, Mikko, 2018. "Participation and compensation claims in voluntary forest landscape conservation: The case of the Ruka-Kuusamo tourism area, Finland," Journal of Forest Economics, Elsevier, vol. 33(C), pages 14-24.
    16. Bergstrom, John C. & Taylor, Laura O., 2006. "Using meta-analysis for benefits transfer: Theory and practice," Ecological Economics, Elsevier, vol. 60(2), pages 351-360, December.
    17. Zandersen, Marianne & Tol, Richard S.J., 2009. "A meta-analysis of forest recreation values in Europe," Journal of Forest Economics, Elsevier, vol. 15(1-2), pages 109-130, January.
    18. Chris Dumas & Pete Schuhmann & John C. Whitehead, 2004. "Measuring the Economic Benefits of Water Quality Improvement with the Benefit Transfer Method: An Introduction for Non-Economists," Working Papers 04-12, Department of Economics, Appalachian State University.
    19. Alston, Julian M. & Wyatt, T. J. & Pardey, Philip G. & Marra, Michele C. & Chan-Kang, Connie, 2000. "A meta-analysis of rates of return to agricultural R & D: ex pede Herculem?," Research reports 113, International Food Policy Research Institute (IFPRI).
    20. Erwin Bulte & G. van Kooten, 1999. "Marginal Valuation of Charismatic Species: Implications for Conservation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 14(1), pages 119-130, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jecmet:v:2:y:1995:i:2:p:201-222. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/RJEC20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.