IDEAS home Printed from https://ideas.repec.org/a/bes/jnlbes/v13y1995i2p151-61.html
   My bibliography  Save this article

Natural and Quasi-experiments in Economics

Author

Listed:
  • Meyer, Bruce D

Abstract

Using research designs patterned after randomized experiments, many recent economic studies examine outcome measures for treatment groups and comparison groups that are not randomly assigned. By using variation in explanatory variables generated by changes in state laws, government draft mechanisms, or other means, these studies obtain variation that is readily examined and is plausibly exogenous. This article describes the advantages of these studies and suggests how they can be improved. It also provides aids in judging the validity of inferences that they draw. Design complications such as multiple treatment and comparison groups and multiple preintervention or postintervention observations are advocated.

Suggested Citation

  • Meyer, Bruce D, 1995. "Natural and Quasi-experiments in Economics," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(2), pages 151-161, April.
    • Handle: RePEc:bes:jnlbes:v:13:y:1995:i:2:p:151-61
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Lawrence Katz & Alan Krueger, 1992. "The Effect of the Minimum Wage on the Fast Food Industry," Working Papers 678, Princeton University, Department of Economics, Industrial Relations Section..
    2. Hausman, Jerry A & Wise, David A, 1979. "Attrition Bias in Experimental and Panel Data: The Gary Income Maintenance Experiment," Econometrica, Econometric Society, vol. 47(2), pages 455-473, March.
    3. Charles F. Manski, 1989. "Anatomy of the Selection Problem," Journal of Human Resources, University of Wisconsin Press, vol. 24(3), pages 343-360.
    4. Meyer, Bruce D & Viscusi, W Kip & Durbin, David L, 1995. "Workers' Compensation and Injury Duration: Evidence from a Natural Experiment," American Economic Review, American Economic Association, vol. 85(3), pages 322-340, June.
    5. Philip J. Cook & George Tauchen, 1982. "The Effect of Liquor Taxes on Heavy Drinking," Bell Journal of Economics, The RAND Corporation, vol. 13(2), pages 379-390, Autumn.
    6. Meyer, Bruce D, 1990. "Unemployment Insurance and Unemployment Spells," Econometrica, Econometric Society, vol. 58(4), pages 757-782, July.
    7. Lawrence F. Katz & Alan B. Krueger, 1992. "The Effect of the Minimum Wage on the Fast-Food Industry," ILR Review, Cornell University, ILR School, vol. 46(1), pages 6-21, October.
    8. Pakes, Ariel & Ericson, Richard, 1998. "Empirical Implications of Alternative Models of Firm Dynamics," Journal of Economic Theory, Elsevier, vol. 79(1), pages 1-45, March.
    9. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    10. Imbens, Guido & van der Klaauw, Wilbert, 1995. "Evaluating the Cost of Conscription in The Netherlands," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(2), pages 207-215, April.
    11. David Card, 1990. "The Impact of the Mariel Boatlift on the Miami Labor Market," ILR Review, Cornell University, ILR School, vol. 43(2), pages 245-257, January.
    12. Alan B. Krueger, 1990. "Workers' Compensation Insurance and the Duration of Workplace Injuries," NBER Working Papers 3253, National Bureau of Economic Research, Inc.
    13. Angrist, Joshua & Krueger, Alan B, 1994. "Why Do World War II Veterans Earn More Than Nonveterans?," Journal of Labor Economics, University of Chicago Press, vol. 12(1), pages 74-97, January.
    14. Robert G. Spiegelman & Stephen A. Woodbury, 1990. "Controlled Experiments and the Unemployment Insurance System," Book chapters authored by Upjohn Institute researchers, in: W. Lee Hansen & James F. Byers (ed.),Unemploymenmt Insurance: the Second Half-Century, pages 355-392, W.E. Upjohn Institute for Employment Research.
    15. Gruber, Jonathan, 1994. "The Incidence of Mandated Maternity Benefits," American Economic Review, American Economic Association, vol. 84(3), pages 622-641, June.
    16. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-1286, December.
    17. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    18. Besley, Timothy & Case, Anne, 2000. "Unnatural Experiments? Estimating the Incidence of Endogenous Policies," Economic Journal, Royal Economic Society, vol. 110(467), pages 672-694, November.
    19. Manski, C.F., 1990. "The Selection Problem," Working papers 90-12, Wisconsin Madison - Social Systems.
    20. Jason G. Cummins & Kevin A. Hassett & R. Glenn Hubbard, 1994. "A Reconsideration of Investment Behavior Using Tax Reforms as Natural Experiments," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 25(2), pages 1-74.
    21. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-336, June.
    22. Solon, Gary R, 1985. "Work Incentive Effects of Taxing Unemployment Benefits," Econometrica, Econometric Society, vol. 53(2), pages 295-306, March.
    23. Stephen A. Woodbury, 2009. "Unemployment," Chapters, in: Kenneth G. Dau-Schmidt & Seth D. Harris & Orly Lobel (ed.), Labor and Employment Law and Economics, chapter 17, Edward Elgar Publishing.
    24. Janet Currie & Jonathan Gruber, 1994. "Saving Babies: The Efficacy and Cost of Recent Expansions of Medicaid Eligibility for Pregnant Women," NBER Working Papers 4644, National Bureau of Economic Research, Inc.
    25. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
    26. David Card, 1992. "Using Regional Variation in Wages to Measure the Effects of the Federal Minimum Wage," ILR Review, Cornell University, ILR School, vol. 46(1), pages 22-37, October.
    27. Alan Krueger, 1990. "Worker's Compensation Insurance and the Duration of Workplace Injuries," Working Papers 641, Princeton University, Department of Economics, Industrial Relations Section..
    28. Ashenfelter, Orley & Card, David, 1985. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," The Review of Economics and Statistics, MIT Press, vol. 67(4), pages 648-660, November.
    29. Patricia M. Anderson & Bruce D. Meyer, 1994. "Unemployment Insurance Benefits and Takeup Rates," NBER Working Papers 4787, National Bureau of Economic Research, Inc.
    30. Bruce D. Meyer, 1989. "A Quasi-Experimental Approach to the Effects of Unemployment Insurance," NBER Working Papers 3159, National Bureau of Economic Research, Inc.
    31. Aaron S. Yelowitz, 1995. "The Medicaid Notch, Labor Supply, and Welfare Participation: Evidence from Eligibility Expansions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(4), pages 909-939.
    32. repec:fth:prinin:300 is not listed on IDEAS
    33. Green, David A & Riddell, W Craig, 1993. "The Economic Effects of Unemployment Insurance in Canada: An Empirical Analysis of UI Disentitlement," Journal of Labor Economics, University of Chicago Press, vol. 11(1), pages 96-147, January.
    34. C. F. Manski, "undated". "Learning about social programs from experiments with random assignment of treatments," Institute for Research on Poverty Discussion Papers 1061-95, University of Wisconsin Institute for Research on Poverty.
    35. repec:fth:prinin:261 is not listed on IDEAS
    36. Rosenzweig, Mark R & Wolpin, Kenneth I, 1980. "Testing the Quantity-Quality Fertility Model: The Use of Twins as a Natural Experiment," Econometrica, Econometric Society, vol. 48(1), pages 227-240, January.
    37. repec:fth:prinin:298 is not listed on IDEAS
    38. William P. Curington, 1994. "Compensation for Permanent Impairment and the Duration of Work Absence: Evidence from Four Natural Experiments," Journal of Human Resources, University of Wisconsin Press, vol. 29(3), pages 888-910.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    2. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    3. Cockx, Bart & Ridder, Geert, 2001. "Social Employment of Welfare Recipients in Belgium: An Evaluation," Economic Journal, Royal Economic Society, vol. 111(470), pages 322-352, April.
    4. Committee, Nobel Prize, 2021. "Answering causal questions using observational data," Nobel Prize in Economics documents 2021-2, Nobel Prize Committee.
    5. Krueger, Alan B. & Meyer, Bruce D., 2002. "Labor supply effects of social insurance," Handbook of Public Economics, in: A. J. Auerbach & M. Feldstein (ed.), Handbook of Public Economics, edition 1, volume 4, chapter 33, pages 2327-2392, Elsevier.
    6. Lechner, Michael, 2011. "The Estimation of Causal Effects by Difference-in-Difference Methods," Foundations and Trends(R) in Econometrics, now publishers, vol. 4(3), pages 165-224, November.
    7. van der Klaauw, Bas, 2014. "From micro data to causality: Forty years of empirical labor economics," Labour Economics, Elsevier, vol. 30(C), pages 88-97.
    8. David Card, 2022. "Design-Based Research in Empirical Microeconomics," American Economic Review, American Economic Association, vol. 112(6), pages 1773-1781, June.
    9. Markus Frölich, 2004. "Programme Evaluation with Multiple Treatments," Journal of Economic Surveys, Wiley Blackwell, vol. 18(2), pages 181-224, April.
    10. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    11. Rösner, Anja & Haucap, Justus & Heimeshoff, Ulrich, 2020. "The impact of consumer protection in the digital age: Evidence from the European Union," International Journal of Industrial Organization, Elsevier, vol. 73(C).
    12. Jeff Borland & Yi-Ping Tseng & Roger Wilkins, 2005. "Experimental and Quasi-Experimental Methods of Microeconomic Program and Policy Evaluation," Melbourne Institute Working Paper Series wp2005n08, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    13. Jonathan Gruber, 1998. "Health Insurance and the Labor Market," NBER Working Papers 6762, National Bureau of Economic Research, Inc.
    14. Lewbel, Arthur & Yang, Thomas Tao, 2016. "Identifying the average treatment effect in ordered treatment models without unconfoundedness," Journal of Econometrics, Elsevier, vol. 195(1), pages 1-22.
    15. Tito Boeri & Jan van Ours, 2013. "The Economics of Imperfect Labor Markets: Second Edition," Economics Books, Princeton University Press, edition 1, number 10142.
    16. Torun, Huzeyfe & Tumen, Semih, 2016. "The effects of compulsory military service exemption on education and labor market outcomes: Evidence from a natural experiment," Economics of Education Review, Elsevier, vol. 54(C), pages 16-35.
    17. Nicolas R. Ziebarth & Martin Karlsson, 2014. "The Effects Of Expanding The Generosity Of The Statutory Sickness Insurance System," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(2), pages 208-230, March.
    18. Fortin, B. & Lanoie, P., 1998. "Effects of Workers' Compensation : A Survey," Papers 9816, Laval - Recherche en Politique Economique.
    19. Jonathan Gruber, 1994. "The Consumption Smoothing Benefits of Unemployment Insurance," NBER Working Papers 4750, National Bureau of Economic Research, Inc.
    20. Guido W. Imbens, 2022. "Causality in Econometrics: Choice vs Chance," Econometrica, Econometric Society, vol. 90(6), pages 2541-2566, November.

    More about this item

    JEL classification:

    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C9 - Mathematical and Quantitative Methods - - Design of Experiments

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bes:jnlbes:v:13:y:1995:i:2:p:151-61. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum (email available below). General contact details of provider: http://www.amstat.org/publications/jbes/index.cfm?fuseaction=main .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.