IDEAS home Printed from https://ideas.repec.org/p/fip/fedlwp/96540.html
   My bibliography  Save this paper

How Much Should We Trust Regional-Exposure Designs?

Author

Listed:

Abstract

Many prominent studies in macroeconomics, labor, and trade use panel data on regions to identify the local effects of aggregate shocks. These studies construct regional-exposure instruments as an observed aggregate shock times an observed regional exposure to that shock. We argue that the most economically plausible source of identification in these settings is uncorrelatedness of observed and unobserved aggregate shocks. Even when the regression estimator is consistent, we show that inference is complicated by cross-regional residual correlations induced by unobserved aggregate shocks. We suggest two-way clustering, two-way heteroskedasticity- and autocorrelation-consistent standard errors, and randomization inference as options to solve this inference problem. We also develop a feasible optimal instrument to improve efficiency. In an application to the estimation of regional fiscal multipliers, we show that the standard practice of clustering by region generates confidence intervals that are too small. When we construct confidence intervals with robust methods, we can no longer reject multipliers close to zero at the 95% level. The feasible optimal instrument more than doubles statistical power; however, we still cannot reject low multipliers. Our results underscore that the precision promised by regional data may disappear with correct inference.

Suggested Citation

  • Jeremy Majerovitz & Karthik Sastry, 2023. "How Much Should We Trust Regional-Exposure Designs?," Working Papers 2023-018, Federal Reserve Bank of St. Louis.
  • Handle: RePEc:fip:fedlwp:96540
    DOI: 10.20955/wp.2023.018
    as

    Download full text from publisher

    File URL: https://s3.amazonaws.com/real.stlouisfed.org/wp/2023/2023-018.pdf
    File Function: Full text
    Download Restriction: no

    File URL: https://libkey.io/10.20955/wp.2023.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andrew T. Foerster & Pierre-Daniel G. Sarte & Mark W. Watson, 2011. "Sectoral versus Aggregate Shocks: A Structural Factor Analysis of Industrial Production," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 1-38.
    2. Adam Guren & Alisdair McKay & Emi Nakamura & Jón Steinsson, 2021. "What Do We Learn from Cross-Regional Empirical Estimates in Macroeconomics?," NBER Macroeconomics Annual, University of Chicago Press, vol. 35(1), pages 175-223.
    3. David H. Autor & David Dorn & Gordon H. Hanson, 2013. "The China Syndrome: Local Labor Market Effects of Import Competition in the United States," American Economic Review, American Economic Association, vol. 103(6), pages 2121-2168, October.
    4. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    5. Kirill Borusyak & Peter Hull & Xavier Jaravel, 2022. "Quasi-Experimental Shift-Share Research Designs," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(1), pages 181-213.
    6. Keith Finlay & Leandro M. Magnusson, 2009. "Implementing weak-instrument robust tests for a general class of instrumental-variables models," Stata Journal, StataCorp LP, vol. 9(3), pages 398-421, September.
    7. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    8. Marcelo J. Moreira, 2003. "A Conditional Likelihood Ratio Test for Structural Models," Econometrica, Econometric Society, vol. 71(4), pages 1027-1048, July.
    9. John C. Driscoll & Aart C. Kraay, 1998. "Consistent Covariance Matrix Estimation With Spatially Dependent Panel Data," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 549-560, November.
    10. Timothy J. Bartik, 1991. "Who Benefits from State and Local Economic Development Policies?," Books from Upjohn Press, W.E. Upjohn Institute for Employment Research, number wbsle, November.
    11. Donald W. K. Andrews & Marcelo J. Moreira & James H. Stock, 2006. "Optimal Two-Sided Invariant Similar Tests for Instrumental Variables Regression," Econometrica, Econometric Society, vol. 74(3), pages 715-752, May.
    12. Gabriel Chodorow-Reich & Plamen T. Nenov & Alp Simsek, 2021. "Stock Market Wealth and the Real Economy: A Local Labor Market Approach," American Economic Review, American Economic Association, vol. 111(5), pages 1613-1657, May.
    13. Xavier Gabaix, 2011. "The Granular Origins of Aggregate Fluctuations," Econometrica, Econometric Society, vol. 79(3), pages 733-772, May.
    14. Emi Nakamura & J?n Steinsson, 2014. "Fiscal Stimulus in a Monetary Union: Evidence from US Regions," American Economic Review, American Economic Association, vol. 104(3), pages 753-792, March.
    15. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    16. Card, David, 2001. "Immigrant Inflows, Native Outflows, and the Local Labor Market Impacts of Higher Immigration," Journal of Labor Economics, University of Chicago Press, vol. 19(1), pages 22-64, January.
    17. David Rezza Baqaee & Emmanuel Farhi, 2019. "The Macroeconomic Impact of Microeconomic Shocks: Beyond Hulten's Theorem," Econometrica, Econometric Society, vol. 87(4), pages 1155-1203, July.
    18. Chamberlain, Gary, 1987. "Asymptotic efficiency in estimation with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 34(3), pages 305-334, March.
    19. Paul Goldsmith-Pinkham & Isaac Sorkin & Henry Swift, 2020. "Bartik Instruments: What, When, Why, and How," American Economic Review, American Economic Association, vol. 110(8), pages 2586-2624, August.
    20. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xavier Gabaix & Ralph S. J. Koijen, 2024. "Granular Instrumental Variables," Journal of Political Economy, University of Chicago Press, vol. 132(7), pages 2274-2303.
    2. Daniel A. Broxterman & William D. Larson, 2020. "An empirical examination of shift‐share instruments," Journal of Regional Science, Wiley Blackwell, vol. 60(4), pages 677-711, September.
    3. Burchardi, Konrad & Terry, Stephen & Chaney, Thomas & Tarquinio, Lisa & Hassan, Tarek, 2020. "Immigration, Innovation, and Growth," CEPR Discussion Papers 14719, C.E.P.R. Discussion Papers.
    4. Dmitry Arkhangelsky & Vasily Korovkin, 2020. "On Policy Evaluation with Aggregate Time-Series Shocks," CERGE-EI Working Papers wp657, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    5. Kirill Borusyak & Peter Hull & Xavier Jaravel, 2023. "Design-Based Identification with Formula Instruments: A Review," NBER Working Papers 31393, National Bureau of Economic Research, Inc.
    6. Peter Haan & Izabela Wnuk, 2024. "The Effect of Migration on Careers of Natives: Evidence from Long-term Care," Discussion Papers of DIW Berlin 2070, DIW Berlin, German Institute for Economic Research.
    7. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    8. Rodrigo Adão & Costas Arkolakis & Federico Esposito, 2019. "General Equilibrium Effects in Space: Theory and Measurement," NBER Working Papers 25544, National Bureau of Economic Research, Inc.
    9. Stuhler, Jan & Jaeger, David & Ruist, Joakim, 2018. "Shift-Share Instruments and the Impact of Immigration," CEPR Discussion Papers 12701, C.E.P.R. Discussion Papers.
    10. Greg Howard & Jack Liebersohn, 2023. "Regional Divergence and House Prices," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 49, pages 312-350, July.
    11. Zou, Yanchi, 2024. "The impact of fiscal stimulus on employment: Evidence from China’s four-trillion RMB package," Economic Modelling, Elsevier, vol. 131(C).
    12. Komarek, Timothy M. & Butts, Kyle & Wagner, Gary A., 2022. "Government Contracting, Labor Intensity, and the Local Effects of Fiscal Consolidation: Evidence from the Budget Control Act of 2011," Journal of Urban Economics, Elsevier, vol. 132(C).
    13. Amuedo-Dorantes, Catalina & Arenas-Arroyo, Esther & Sevilla, Almudena, 2020. "Labor market impacts of states issuing of driver's licenses to undocumented immigrants," Labour Economics, Elsevier, vol. 63(C).
    14. Michael Pollmann, 2020. "Causal Inference for Spatial Treatments," Papers 2011.00373, arXiv.org, revised Jan 2023.
    15. Amuedo-Dorantes, Catalina & Arenas-Arroyo, Esther & Sevilla, Almudena, 2018. "Immigration enforcement and economic resources of children with likely unauthorized parents," Journal of Public Economics, Elsevier, vol. 158(C), pages 63-78.
    16. Joan Monras, 2020. "Immigration and Wage Dynamics: Evidence from the Mexican Peso Crisis," Journal of Political Economy, University of Chicago Press, vol. 128(8), pages 3017-3089.
    17. Lee, Jongkwan, 2021. "The Role of a University in Cluster Formation: Evidence from a National Institute of Science and Technology in Korea," Regional Science and Urban Economics, Elsevier, vol. 86(C).
    18. Wenjie Wang & Yichong Zhang, 2021. "Wild Bootstrap for Instrumental Variables Regressions with Weak and Few Clusters," Papers 2108.13707, arXiv.org, revised Jan 2024.
    19. Ager, Philipp & Abramitzky, Ran & Boustan, Leah & Cohen, Elior David & Hansen, Casper Worm, 2019. "The Effects of Immigration on the Economy: Lessons from the 1920s Border Closure," CEPR Discussion Papers 14165, C.E.P.R. Discussion Papers.
    20. James G. MacKinnon, 2019. "How cluster‐robust inference is changing applied econometrics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 52(3), pages 851-881, August.

    More about this item

    Keywords

    applied econometrics; regional data; shift-share instruments;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation
    • F16 - International Economics - - Trade - - - Trade and Labor Market Interactions
    • R12 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General Regional Economics - - - Size and Spatial Distributions of Regional Economic Activity; Interregional Trade (economic geography)

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedlwp:96540. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Anna Oates (email available below). General contact details of provider: https://edirc.repec.org/data/frbslus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.