IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/17047.html
   My bibliography  Save this paper

The Role of Theory in Field Experiments

Author

Listed:
  • David Card
  • Stefano DellaVigna
  • Ulrike Malmendier

Abstract

We propose a new classification of experiments that captures the extent to which the experimental design and analysis are linked to economic theory. We then use this system to classify all published field experiments in the five top economics journals from 1975 to 2010. We find that the vast majority of field experiments (68%) are Descriptive studies that lack any explicit model; 18% are Single Model studies that test a single model-based hypothesis; 6% are Competing Models studies that test competing model-based hypotheses; and 8% are Parameter Estimation studies that estimate structural parameters in a completely specified model. Using the same system to classify laboratory experiments published over the same period, we find that economic theory has played a more central role in the laboratory than in the field. Finally, we discuss in detail three sets of field experiments, on gift exchange, on charitable giving, and on negative income tax, that illustrate both the benefits and the potential costs of a tighter link between experimental design and theoretical underpinnings.

Suggested Citation

  • David Card & Stefano DellaVigna & Ulrike Malmendier, 2011. "The Role of Theory in Field Experiments," NBER Working Papers 17047, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:17047
    Note: CH ED EEE EH IO LE LS PE POL
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w17047.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Louise Forsetlund & Iain Chalmers & Arild Bjørndal, 2007. "When Was Random Allocation First Used To Generate Comparison Groups In Experiments To Assess The Effects Of Social Interventions?," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 16(5), pages 371-384.
    2. Stefano DellaVigna & John A. List & Ulrike Malmendier, 2012. "Testing for Altruism and Social Pressure in Charitable Giving," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(1), pages 1-56.
    3. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    4. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-336, June.
    5. Angus Deaton, 2010. "Understanding the Mechanisms of Economic Development," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 3-16, Summer.
    6. Ernst Fehr & Georg Kirchsteiger & Arno Riedl, 1993. "Does Fairness Prevent Market Clearing? An Experimental Investigation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(2), pages 437-459.
    7. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2010. "Social Incentives in the Workplace," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 77(2), pages 417-458.
    8. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    9. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    10. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2007. "Incentives for Managers and Inequality among Workers: Evidence from a Firm-Level Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(2), pages 729-773.
    11. repec:bla:jfinan:v:53:y:1998:i:5:p:1775-1798 is not listed on IDEAS
    12. repec:pri:rpdevs:deaton_understanding_mechanisms_of_economic_development_with_abstract_apr is not listed on IDEAS
    13. Nicholas Barberis & Wei Xiong, 2009. "What Drives the Disposition Effect? An Analysis of a Long‐Standing Preference‐Based Explanation," Journal of Finance, American Finance Association, vol. 64(2), pages 751-784, April.
    14. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2009. "Social Connections and Incentives in the Workplace: Evidence From Personnel Data," Econometrica, Econometric Society, vol. 77(4), pages 1047-1094, July.
    15. Michael C. Keeley & Philip K. Robins, 1980. "Experimental Design, the Conlisk-Watts Assignment Model, and the Proper Estimation of Behavioral Response," Journal of Human Resources, University of Wisconsin Press, vol. 15(4), pages 480-498.
    16. Terry R. Johnson & John H. Pencavel, 1982. "Forecasting the Effects of a Negative Income Tax Program," ILR Review, Cornell University, ILR School, vol. 35(2), pages 221-234, January.
    17. repec:pri:rpdevs:deaton_understanding_mechanisms_of_economic_development_with_abstract_apr_2010 is not listed on IDEAS
    18. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    19. Daniel S. Nagin & James B. Rebitzer & Seth Sanders & Lowell J. Taylor, 2002. "Monitoring, Motivation, and Management: The Determinants of Opportunistic Behavior in a Field Experiment," American Economic Review, American Economic Association, vol. 92(4), pages 850-873, September.
    20. Ashenfelter, Orley & Plant, Mark W, 1990. "Nonparametric Estimates of the Labor-Supply Effects of Negative Income Tax Programs," Journal of Labor Economics, University of Chicago Press, vol. 8(1), pages 396-415, January.
    21. David K. Levine, 1998. "Modeling Altruism and Spitefulness in Experiment," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 1(3), pages 593-622, July.
    22. Ernst Fehr & Lorenz Goette, 2007. "Do Workers Work More if Wages Are High? Evidence from a Randomized Field Experiment," American Economic Review, American Economic Association, vol. 97(1), pages 298-317, March.
    23. Uri Gneezy & John A List, 2006. "Putting Behavioral Economics to Work: Testing for Gift Exchange in Labor Markets Using Field Experiments," Econometrica, Econometric Society, vol. 74(5), pages 1365-1384, September.
    24. Rabin, Matthew, 1993. "Incorporating Fairness into Game Theory and Economics," American Economic Review, American Economic Association, vol. 83(5), pages 1281-1302, December.
    25. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    26. Tuma, Nancy Brandon & Robins, Philip K, 1980. "A Dynamic Model of Employment Behavior: An Application to the Seattle and Denver Income Maintenance Experiments," Econometrica, Econometric Society, vol. 48(4), pages 1031-1052, May.
    27. George A. Akerlof, 1982. "Labor Contracts as Partial Gift Exchange," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 97(4), pages 543-569.
    28. Blank, Rebecca M, 1991. "The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence from The American Economic Review," American Economic Review, American Economic Association, vol. 81(5), pages 1041-1067, December.
    29. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-1286, December.
    30. Bruce Sacerdote, 2001. "Peer Effects with Random Assignment: Results for Dartmouth Roommates," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 681-704.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    2. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    3. Dur, Robert & Roelfsema, Hein, 2010. "Social exchange and common agency in organizations," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(1), pages 55-63, January.
    4. Sliwka, Dirk & Werner, Peter, 2016. "How Do Agents React to Dynamic Wage Increases? An Experimental Study," IZA Discussion Papers 9855, Institute of Labor Economics (IZA).
    5. Currie, Janet & Lin, Wanchuan & Meng, Juanjuan, 2013. "Social networks and externalities from gift exchange: Evidence from a field experiment," Journal of Public Economics, Elsevier, vol. 107(C), pages 19-30.
    6. Christian Thoeni & Simon Gaechter, 2011. "Peer Effects and Social Preferences in Voluntary Cooperation," Discussion Papers 2011-09, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    7. Kocher, Martin G. & Luhan, Wolfgang J. & Sutter, Matthias, 2012. "Testing a forgotten aspect of Akerlof’s gift exchange hypothesis: Relational contracts with individual and uniform wages," Discussion Papers in Economics 12816, University of Munich, Department of Economics.
    8. Axel Ockenfels & Dirk Sliwka & Peter Werner, 2015. "Bonus Payments and Reference Point Violations," Management Science, INFORMS, vol. 61(7), pages 1496-1513, July.
    9. Fortuna Casoria & Arno Riedl, 2013. "Experimental Labor Markets And Policy Considerations: Incomplete Contracts And Macroeconomic Aspects," Journal of Economic Surveys, Wiley Blackwell, vol. 27(3), pages 398-420, July.
    10. Alain Cohn & Ernst Fehr & Lorenz Goette, 2015. "Fair Wages and Effort Provision: Combining Evidence from a Choice Experiment and a Field Experiment," Management Science, INFORMS, vol. 61(8), pages 1777-1794, August.
    11. Johannes Becker & Daniel Hopp & Karolin Süß, 2020. "How Altruistic Is Indirect Reciprocity? - Evidence from Gift-Exchange Games in the Lab," CESifo Working Paper Series 8423, CESifo.
    12. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    13. Simon Gächter & Esther Kaiser & Manfred Königstein, 2024. "Incentive contracts crowd out voluntary cooperation: Evidence from gift-exchange experiments," Discussion Papers 2024-02, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    14. Thöni, Christian & Gächter, Simon, 2015. "Peer effects and social preferences in voluntary cooperation: A theoretical and experimental analysis," Journal of Economic Psychology, Elsevier, vol. 48(C), pages 72-88.
    15. Simon Gaechter & Esther Kessler & Manfred Koenigstein, 2011. "The roles of incentives and voluntary cooperation for contractual compliance," Discussion Papers 2011-06, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    16. Christian Thoeni & Simon Gaechter, 2011. "Peer Effects and Social Preferences in Voluntary Cooperation," Discussion Papers 2011-09, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    17. Fortuna Casoria & Arno Riedl, 2013. "Experimental Labor Markets And Policy Considerations: Incomplete Contracts And Macroeconomic Aspects," Journal of Economic Surveys, Wiley Blackwell, vol. 27(3), pages 398-420, July.
    18. Ulrike Malmendier & Klaus M. Schmidt, 2017. "You Owe Me," American Economic Review, American Economic Association, vol. 107(2), pages 493-526, February.
    19. Grossmann, Volker, 2002. "Is it rational to internalize the personal norm that one should reciprocate?," Journal of Economic Psychology, Elsevier, vol. 23(1), pages 27-48, February.
    20. Ernst Fehr & Simon Gächter, 2000. "Fairness and Retaliation: The Economics of Reciprocity," Journal of Economic Perspectives, American Economic Association, vol. 14(3), pages 159-181, Summer.

    More about this item

    JEL classification:

    • C9 - Mathematical and Quantitative Methods - - Design of Experiments
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:17047. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.