IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/12931.html
   My bibliography  Save this paper

Methodological Frontiers of Public Finance Field Experiments

Author

Listed:
  • Jeffrey R. Kling

Abstract

The purpose of this article is to demonstrate how a rich array of methods can be applied to increase the relevance of field experiments in public economics. Two cross-cutting themes are important in multiple phases of the research. First, greater statistical sophistication can draw more value from a field experiment without obscuring the simple and compelling information from the differences in average outcomes of intervention and control groups. Second, the methodological frontier is interdisciplinary, drawing on knowledge and techniques developed in psychology, anthropology, and sociology that can be adapted in order to make public finance field experiments more useful.

Suggested Citation

  • Jeffrey R. Kling, 2007. "Methodological Frontiers of Public Finance Field Experiments," NBER Working Papers 12931, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:12931
    Note: CH ED LS PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w12931.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    2. Robert Moffitt, 2002. "The role of randomized field trials in social science research: a perspective from evaluations of reforms of social welfare programs," CeMMAP working papers CWP23/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. Jeffrey Smith & Jeremy Lise & Shannon N. Seitz, 2003. "Equilibrium Policy Experiments And The Evaluation Of Social Programs," Working Paper 1012, Economics Department, Queen's University.
    4. Peter Z. Schochet & Sheena McConnell & John Burghardt, "undated". "National Job Corps Study: Findings Using Administrative Earnings Records Data," Mathematica Policy Research Reports 9da2c5a07ad046419448e94e1, Mathematica Policy Research.
    5. Esther Duflo & William Gale & Jeffrey Liebman & Peter Orszag & Emmanuel Saez, 2006. "Saving Incentives for Low- and Middle-Income Families: Evidence from a Field Experiment with H&R Block," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 121(4), pages 1311-1346.
    6. John A. List & David Lucking-Reiley, 2002. "The Effects of Seed Money and Refunds on Charitable Giving: Experimental Evidence from a University Capital Campaign," Journal of Political Economy, University of Chicago Press, vol. 110(1), pages 215-233, February.
    7. Lisa Sanbonmatsu & Jeffrey R. Kling & Greg J. Duncan & Jeanne Brooks-Gunn, 2006. "Neighborhoods and Academic Achievement: Results from the Moving to Opportunity Experiment," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    8. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    9. Dean Karlan & John A. List, 2007. "Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field Experiment," American Economic Review, American Economic Association, vol. 97(5), pages 1774-1793, December.
    10. Jeffrey R. Kling & Jens Ludwig & Lawrence F. Katz, 2005. "Neighborhood Effects on Crime for Female and Male Youth: Evidence from a Randomized Housing Voucher Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(1), pages 87-130.
    11. Esther Duflo & Emmanuel Saez, 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 815-842.
    12. Jeremy Lise & Shannon Seitz & Jeffrey Smith, 2015. "Evaluating search and matching models using experimental data," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-35, December.
    13. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    14. Lawrence F. Katz & Jeffrey R. Kling & Jeffrey B. Liebman, 2001. "Moving to Opportunity in Boston: Early Results of a Randomized Mobility Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 607-654.
    15. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    16. Jens Ludwig & Jeffrey R. Kling, 2007. "Is Crime Contagious?," Journal of Law and Economics, University of Chicago Press, vol. 50(3), pages 491-518.
    17. Bruno S. Frey & Stephan Meier, 2004. "Social Comparisons and Pro-social Behavior: Testing "Conditional Cooperation" in a Field Experiment," American Economic Review, American Economic Association, vol. 94(5), pages 1717-1722, December.
    18. Catherine Eckel, 2005. "Subsidizing Charitable Contributions: A Field Test Comparing Matching and Rebate Subsidies," Working Papers 2098, The Field Experiments Website.
    19. David Greenberg & Mark Shroder & Matthew Onstott, 1999. "The Social Experiment Market," Journal of Economic Perspectives, American Economic Association, vol. 13(3), pages 157-172, Summer.
    20. Rivlin, Alice M, 1974. "How Can Experiments Be More Useful?," American Economic Review, American Economic Association, vol. 64(2), pages 346-354, May.
    21. Catherine C. Eckel & Philip J. Grossman, 2006. "Subsidizing Charitable Contributions in the Field: Evidence from a Non-Secular Charity," Monash Economics Working Papers archive-44, Monash University, Department of Economics.
    22. Bruno Frey & Stephan Meier, 2004. "In a field experiment," Natural Field Experiments 00243, The Field Experiments Website.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Antonio Estache, 2010. "A survey of impact evaluations of infrastructure projects, programs and policies," Working Papers ECARES 2010_005, ULB -- Universite Libre de Bruxelles.
    2. Jens Ludwig & Jeffrey R. Kling & Sendhil Mullainathan, 2011. "Mechanism Experiments and Policy Evaluations," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 17-38, Summer.
    3. Hjelm, Lisa & Handa, Sudhanshu & de Hoop, Jacobus & Palermo, Tia, 2017. "Poverty and perceived stress: Evidence from two unconditional cash transfer programs in Zambia," Social Science & Medicine, Elsevier, vol. 177(C), pages 110-117.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    2. Dimant, Eugen, 2015. "On Peer Effects: Behavioral Contagion of (Un)Ethical Behavior and the Role of Social Identity," MPRA Paper 68732, University Library of Munich, Germany.
    3. Christina Fong & Erzo Luttmer, 2007. "What determines giving to hurricane katrina victims? Experimental evidence on income, race, and fairness," Artefactual Field Experiments 00046, The Field Experiments Website.
    4. John List, 2008. "Introduction to field experiments in economics with applications to the economics of charity," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 203-212, September.
    5. Jesse Rothstein & Till von Wachter, 2016. "Social Experiments in the Labor Market," NBER Working Papers 22585, National Bureau of Economic Research, Inc.
    6. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-47, April.
    7. Huck, Steffen & Rasul, Imran, 2011. "Matched fundraising: Evidence from a natural field experiment," Journal of Public Economics, Elsevier, vol. 95(5), pages 351-362.
    8. Sara B. Heller & Anuj K. Shah & Jonathan Guryan & Jens Ludwig & Sendhil Mullainathan & Harold A. Pollack, 2017. "Thinking, Fast and Slow? Some Field Experiments to Reduce Crime and Dropout in Chicago," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(1), pages 1-54.
    9. Rachel Croson & Jen Shang, 2006. "Field experiments in charitable contribution: The impact of social influence on the voluntary provision of public goods," Natural Field Experiments 00323, The Field Experiments Website.
    10. Jacob Vigdor & Jens Ludwig, 2007. "Segregation and the Black-White Test Score Gap," NBER Working Papers 12988, National Bureau of Economic Research, Inc.
    11. Sara Heller & Harold A. Pollack & Roseanna Ander & Jens Ludwig, 2013. "Preventing Youth Violence and Dropout: A Randomized Field Experiment," NBER Working Papers 19014, National Bureau of Economic Research, Inc.
    12. Patrick Bayer & Stephen L. Ross, 2006. "Identifying Individual and Group Effects in the Presence of Sorting: A Neighborhood Effects Application," Working papers 2006-13, University of Connecticut, Department of Economics, revised Jan 2009.
    13. Bonan, Jacopo & Battiston, Pietro & Bleck, Jaimie & LeMay-Boucher, Philippe & Pareglio, Stefano & Sarr, Bassirou & Tavoni, Massimo, 2021. "Social interaction and technology adoption: Experimental evidence from improved cookstoves in Mali," World Development, Elsevier, vol. 144(C).
    14. Levin, Tova & Levitt, Steven D. & List, John A., 2023. "A Glimpse into the world of high capacity givers: Experimental evidence from a university capital campaign," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 644-658.
    15. Gallier, Carlo & Goeschl, Timo & Kesternich, Martin & Lohse, Johannes & Reif, Christiane & Römer, Daniel, 2023. "Inter-charity competition under spatial differentiation: Sorting, crowding, and spillovers," Journal of Economic Behavior & Organization, Elsevier, vol. 216(C), pages 457-468.
    16. Seals, Richard Alan & Stern, Liliana V., 2013. "Cognitive ability and the division of labor in urban ghettos: Evidence from gang activity in U.S. data," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 44(C), pages 140-149.
    17. Abramitzky, Ran & Lavy, Victor & Pérez, Santiago, 2021. "The long-term spillover effects of changes in the return to schooling," Journal of Public Economics, Elsevier, vol. 196(C).
    18. Ludwig, Jens & Duncan, Greg J. & Katz, Lawrence F. & Kessler, Ronald & Kling, Jeffrey R. & Gennetian, Lisa A. & Sanbonmatsu, Lisa, 2012. "Neighborhood Effects on the Long-Term Well-Being of Low-Income Adults," Scholarly Articles 11870359, Harvard University Department of Economics.
    19. Jonathan M.V. Davis & Sara B. Heller, 2017. "Rethinking the Benefits of Youth Employment Programs: The Heterogeneous Effects of Summer Jobs," NBER Working Papers 23443, National Bureau of Economic Research, Inc.
    20. G�nther Fink & Margaret McConnell & Sebastian Vollmer, 2014. "Testing for heterogeneous treatment effects in experimental data: false discovery risks and correction procedures," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(1), pages 44-57, January.

    More about this item

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • H0 - Public Economics - - General
    • I0 - Health, Education, and Welfare - - General
    • J18 - Labor and Demographic Economics - - Demographic Economics - - - Public Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:12931. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.