IDEAS home Printed from https://ideas.repec.org/p/cep/cepdps/dp1760.html
   My bibliography  Save this paper

Opening up military innovation: causal effects of 'bottom-up' reforms to U.S. defense research

Author

Listed:
  • Sabrina T. Howell
  • Jason Rathje
  • John Van Reenen
  • Jun Wong

Abstract

Organizations investing in R&D must decide whether to solicit specific technologies or allow innovators to suggest ideas. Using administrative data, we study the 'Open' reform to U.S. Air Force R&D procurement, which invited firms to suggest any new potentially useful technology. The new program was run simultaneously with the traditional top-down 'Conventional' program. Our regression discontinuity design offers the first causal evaluation of a defense R&D program. We document benefits from winning an Open award for VC funding, military technology, and innovation, and no benefits from Conventional, which instead fosters incumbency. The bottom-up approach appears to help explain Open's success.

Suggested Citation

  • Sabrina T. Howell & Jason Rathje & John Van Reenen & Jun Wong, 2021. "Opening up military innovation: causal effects of 'bottom-up' reforms to U.S. defense research," CEP Discussion Papers dp1760, Centre for Economic Performance, LSE.
    • Handle: RePEc:cep:cepdps:dp1760
    as

    Download full text from publisher

    File URL: https://cep.lse.ac.uk/pubs/download/dp1760.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Carril, Rodrigo & Duggan, Mark, 2020. "The impact of industry consolidation on government procurement: Evidence from Department of Defense contracting," Journal of Public Economics, Elsevier, vol. 184(C).
    2. Ufuk Akcigit & John Grigsby & Tom Nicholas, 2017. "The Rise of American Ingenuity: Innovation and Inventors of the Golden Age," Working Papers 2017-6, Princeton University. Economics Department..
    3. Nicholas Bloom & Charles I. Jones & John Van Reenen & Michael Webb, 2020. "Are Ideas Getting Harder to Find?," American Economic Review, American Economic Association, vol. 110(4), pages 1104-1144, April.
    4. Raffaello Bronzini & Eleonora Iachini, 2014. "Are Incentives for R&D Effective? Evidence from a Regression Discontinuity Approach," American Economic Journal: Economic Policy, American Economic Association, vol. 6(4), pages 100-134, November.
    5. Chad Syverson, 2017. "Challenges to Mismeasurement Explanations for the US Productivity Slowdown," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 165-186, Spring.
    6. Nicholas Bloom & John Van Reenen & Heidi Williams, 2019. "A toolkit of policies to promote innovation," Voprosy Ekonomiki, NP Voprosy Ekonomiki, issue 10.
    7. Bloom, Nick & Griffith, Rachel & Van Reenen, John, 2002. "Do R&D tax credits work? Evidence from a panel of countries 1979-1997," Journal of Public Economics, Elsevier, vol. 85(1), pages 1-31, July.
    8. Matthew R. Denes & Sabrina T. Howell & Filippo Mezzanotti & Xinxin Wang & Ting Xu, 2020. "Investor Tax Credits and Entrepreneurship: Evidence from U.S. States," NBER Working Papers 27751, National Bureau of Economic Research, Inc.
    9. Ufuk Akcigit & Stefanie Stantcheva, 2020. "Taxation and Innovation: What Do We Know?," NBER Chapters, in: Innovation and Public Policy, pages 189-212, National Bureau of Economic Research, Inc.
    10. Sabrina T. Howell, 2017. "Financing Innovation: Evidence from R&D Grants," American Economic Review, American Economic Association, vol. 107(4), pages 1136-1164, April.
    11. Andrew Middleton & Steven Bowns & Keith Hartley & James Reid, 2006. "The Effect Of Defence R&D On Military Equipment Quality," Defence and Peace Economics, Taylor & Francis Journals, vol. 17(2), pages 117-139.
    12. Pierre Azoulay & Joshua S. Graff Zivin & Gustavo Manso, 2011. "Incentives and creativity: evidence from the academic life sciences," RAND Journal of Economics, RAND Corporation, vol. 42(3), pages 527-554, September.
    13. Moretti, Enrico & Wilson, Daniel J., 2014. "State incentives for innovation, star scientists and jobs: Evidence from biotech," Journal of Urban Economics, Elsevier, vol. 79(C), pages 20-38.
    14. Joshua Krieger & Danielle Li & Dimitris Papanikolaou, 2022. "Missing Novelty in Drug Development," The Review of Financial Studies, Society for Financial Studies, vol. 35(2), pages 636-679.
    15. John DiNardo & Justin L. Tobias, 2001. "Nonparametric Density and Regression Estimation," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 11-28, Fall.
    16. Bronwyn H. Hall, 1993. "R&D Tax Policy during the 1980s: Success or Failure?," NBER Chapters, in: Tax Policy and the Economy, Volume 7, pages 1-36, National Bureau of Economic Research, Inc.
    17. Pierre Azoulay & Joshua S Graff Zivin & Danielle Li & Bhaven N Sampat, 2019. "Public R&D Investments and Private-sector Patenting: Evidence from NIH Funding Rules," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(1), pages 117-152.
    18. Roberto Perotti, 2014. "Defense Government Spending Is Contractionary, Civilian Government Spending Is Expansionary," NBER Working Papers 20179, National Bureau of Economic Research, Inc.
    19. Billette de Villemeur, Etienne & Versaevel, Bruno, 2019. "One lab, two firms, many possibilities: On R&D outsourcing in the biopharmaceutical industry," Journal of Health Economics, Elsevier, vol. 65(C), pages 260-283.
    20. Zhao Chen & Zhikuo Liu & Juan Carlos Suárez Serrato & Daniel Yi Xu, 2021. "Notching R&D Investment with Corporate Income Tax Cuts in China," American Economic Review, American Economic Association, vol. 111(7), pages 2065-2100, July.
    21. Rao, Nirupama, 2016. "Do tax credits stimulate R&D spending? The effect of the R&D tax credit in its first decade," Journal of Public Economics, Elsevier, vol. 140(C), pages 1-12.
    22. Goolsbee, Austan, 1998. "Does Government R&D Policy Mainly Benefit Scientists and Engineers?," American Economic Review, American Economic Association, vol. 88(2), pages 298-302, May.
    23. Ryan A. Decker & John Haltiwanger & Ron S. Jarmin & Javier Miranda, 2016. "Declining Business Dynamism: What We Know and the Way Forward," American Economic Review, American Economic Association, vol. 106(5), pages 203-207, May.
    24. Ramana Nanda & Ken Younge & Lee Fleming, 2014. "Innovation and Entrepreneurship in Renewable Energy," NBER Chapters, in: The Changing Frontier: Rethinking Science and Innovation Policy, pages 199-232, National Bureau of Economic Research, Inc.
    25. Manuel Trajtenberg & Rebecca Henderson & Adam Jaffe, 1997. "University Versus Corporate Patents: A Window On The Basicness Of Invention," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 5(1), pages 19-50.
    26. Tirole, Jean, 1986. "Procurement and Renegotiation," Journal of Political Economy, University of Chicago Press, vol. 94(2), pages 235-259, April.
    27. Lucia Foster & John Haltiwanger & Chad Syverson, 2008. "Reallocation, Firm Turnover, and Efficiency: Selection on Productivity or Profitability?," American Economic Review, American Economic Association, vol. 98(1), pages 394-425, March.
    28. Adam B. Jaffe & Karen Palmer, 1997. "Environmental Regulation And Innovation: A Panel Data Study," The Review of Economics and Statistics, MIT Press, vol. 79(4), pages 610-619, November.
    29. Lichtenberg, Frank R, 1984. "The Relationship between Federal Contract R&D and Company R&D," American Economic Review, American Economic Association, vol. 74(2), pages 73-78, May.
    30. William P. Rogerson, 1994. "Economic Incentives and the Defense Procurement Process," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 65-90, Fall.
    31. Saul Lach, 2002. "Do R&D Subsidies Stimulate or Displace Private R&D? Evidence from Israel," Journal of Industrial Economics, Wiley Blackwell, vol. 50(4), pages 369-390, December.
    32. Lerner, Josh, 1999. "The Government as Venture Capitalist: The Long-Run Impact of the SBIR Program," The Journal of Business, University of Chicago Press, vol. 72(3), pages 285-318, July.
    33. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    34. John Haltiwanger & Ron S. Jarmin & Javier Miranda, 2013. "Who Creates Jobs? Small versus Large versus Young," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 347-361, May.
    35. Manju Puri & Rebecca Zarutskie, 2012. "On the Life Cycle Dynamics of Venture-Capital- and Non-Venture-Capital-Financed Firms," Journal of Finance, American Finance Association, vol. 67(6), pages 2247-2293, December.
    36. Daniel P. Gross & Bhaven N. Sampat, 2023. "America, Jump-Started: World War II R&D and the Takeoff of the US Innovation System," American Economic Review, American Economic Association, vol. 113(12), pages 3323-3356, December.
    37. Billette de Villemeur, Etienne & Versaevel, Bruno, 2019. "One lab, two firms, many possibilities: On R&D outsourcing in the biopharmaceutical industry," Journal of Health Economics, Elsevier, vol. 65(C), pages 260-283.
    38. Pierre Azoulay & Danielle Li, 2020. "Scientific Grant Funding," NBER Chapters, in: Innovation and Public Policy, pages 117-150, National Bureau of Economic Research, Inc.
    39. Lauren Lanahan & Maryann P. Feldman, 2018. "Approximating Exogenous Variation in R&D: Evidence from the Kentucky and North Carolina SBIR State Match Programs," The Review of Economics and Statistics, MIT Press, vol. 100(4), pages 740-752, October.
    40. Vivek Bhattacharya, 2021. "An Empirical Model of R&D Procurement Contests: An Analysis of the DOD SBIR Program," Econometrica, Econometric Society, vol. 89(5), pages 2189-2224, September.
    41. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    42. Draca, Mirko, 2013. "Reagan’s Innovation Dividend? Technological Impacts of the 1980s US Defense Build-Up," CAGE Online Working Paper Series 168, Competitive Advantage in the Global Economy (CAGE).
    43. Samuel Kortum & Josh Lerner, 2000. "Assessing the Contribution of Venture Capital to Innovation," RAND Journal of Economics, The RAND Corporation, vol. 31(4), pages 674-692, Winter.
    44. Robert J. Barro & Charles J. Redlick, 2011. "Macroeconomic Effects From Government Purchases and Taxes," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 51-102.
    45. Emi Nakamura & J?n Steinsson, 2014. "Fiscal Stimulus in a Monetary Union: Evidence from US Regions," American Economic Review, American Economic Association, vol. 104(3), pages 753-792, March.
    46. Sabrina Howell & Josh Lerner & Ramana Nanda & Richard Townsend, 2020. "Financial Distancing: How Venture Capital Follows the Economy Down and Curtails Innovation," Harvard Business School Working Papers 20-115, Harvard Business School.
    47. Scott J. Wallsten, 2000. "The Effects of Government-Industry R&D Programs on Private R&D: The Case of the Small Business Innovation Research Program," RAND Journal of Economics, The RAND Corporation, vol. 31(1), pages 82-100, Spring.
    48. Mowery, David C., 2012. "Defense-related R&D as a model for “Grand Challenges” technology policies," Research Policy, Elsevier, vol. 41(10), pages 1703-1715.
    49. Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
    50. Pierre Azoulay & Danielle Li, 2020. "Scientific Grant Funding," NBER Working Papers 26889, National Bureau of Economic Research, Inc.
    51. Ashish Arora & Sharon Belenzon & Andrea Patacconi, 2018. "The decline of science in corporate R&D," Strategic Management Journal, Wiley Blackwell, vol. 39(1), pages 3-32, January.
    52. Sharon Belenzon & Larisa C. Cioaca, 2021. "Guaranteed Markets and Corporate Scientific Research," NBER Working Papers 28644, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Daniel P. Gross & Bhaven N. Sampat, 2022. "Crisis Innovation Policy from World War II to COVID-19," Entrepreneurship and Innovation Policy and the Economy, University of Chicago Press, vol. 1(1), pages 135-181.
    2. Teichgraeber, Andreas & Van Reenen, John, 2022. "A policy toolkit to increase research and innovation in the European Union," LSE Research Online Documents on Economics 117801, London School of Economics and Political Science, LSE Library.
    3. Chiappinelli, Olga & Giuffrida, Leonardo M. & Spagnolo, Giancarlo, 2023. "Public procurement as an innovation policy: Where do we stand?," ZEW Discussion Papers 23-002, ZEW - Leibniz Centre for European Economic Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Howell, Sabrina T. & Rathje, Jason & Van Reenen, John & Wong, Jun, 2021. "Opening up military innovation: causal effects of reforms to US defense research," LSE Research Online Documents on Economics 114430, London School of Economics and Political Science, LSE Library.
    2. Pallante, Gianluca & Russo, Emanuele & Roventini, Andrea, 2023. "Does public R&D funding crowd-in private R&D investment? Evidence from military R&D expenditures for US states," Research Policy, Elsevier, vol. 52(8).
    3. Feld, Lars P. & Schmidt, Christoph M. & Schnabel, Isabel & Truger, Achim & Wieland, Volker, 2019. "Den Strukturwandel meistern. Jahresgutachten 2019/20 [Dealing with Structural Change. Annual Report 2019/20]," Annual Economic Reports / Jahresgutachten, German Council of Economic Experts / Sachverständigenrat zur Begutachtung der gesamtwirtschaftlichen Entwicklung, volume 127, number 201920, February.
    4. Pietro Santoleri & Andrea Mina & Alberto Di Minin & Irene Martelli, 2024. "The Causal Effects of R&D Grants: Evidence from a Regression Discontinuity," The Review of Economics and Statistics, MIT Press, vol. 106(6), pages 1495-1510, November.
    5. Enrico Moretti & Claudia Steinwender & John Van Reenen, 2019. "The intellectual spoils of war? Defense R&D, productivity and international spillovers," CEP Discussion Papers dp1662, Centre for Economic Performance, LSE.
    6. Tania Babina & Sabrina T. Howell, 2018. "Entrepreneurial Spillovers from Corporate R&D," NBER Working Papers 25360, National Bureau of Economic Research, Inc.
    7. Tania Babina & Alex Xi He & Sabrina T. Howell & Elisabeth Ruth Perlman & Joseph Staudt, 2020. "The Color of Money: Federal vs. Industry Funding of University Research," NBER Working Papers 28160, National Bureau of Economic Research, Inc.
    8. Bronzini, Raffaello & Piselli, Paolo, 2016. "The impact of R&D subsidies on firm innovation," Research Policy, Elsevier, vol. 45(2), pages 442-457.
    9. Thomas H. W. Ziesemer, 2021. "The Effects of R&D Subsidies and Publicly Performed R&D on Business R&D: A Survey," Hacienda Pública Española / Review of Public Economics, IEF, vol. 236(1), pages 171-205, March.
    10. Dechezlepretre, Antoine & Einiö, Elias & Martin, Ralf & Nguyen, Kieu-Trang & Reenen, John Van, 2016. "Do tax incentives for research increase firm innovation? An RD design for R&D, patents and spillovers," LSE Research Online Documents on Economics 66428, London School of Economics and Political Science, LSE Library.
    11. Nadine Levratto & Aurelien Quignon, 2021. "Innovation Performance and the Signal Effect: Evidence from a European Program," Working Papers halshs-03466903, HAL.
    12. Sabrina T. Howell & Filippo Mezzanotti, 2019. "Financing Entrepreneurship through the Tax Code: Angel Investor Tax Credits," NBER Working Papers 26486, National Bureau of Economic Research, Inc.
    13. Antoine Dechezlepretre & Elias Einio & Ralf Martin & Kieu-Trang Nguyen & John Van Reenen, 2016. "Do tax incentives for research increase firm innovation? An RD design for R&D," GRI Working Papers 230, Grantham Research Institute on Climate Change and the Environment.
    14. Widmann, Rainer, 2024. "The behavioral additionality of government research grants," International Journal of Industrial Organization, Elsevier, vol. 93(C).
    15. Aurélien Quignon & Nadine Levratto, 2021. "Innovation Performance and the Signal Effect: Evidence from a European Program," EconomiX Working Papers 2021-34, University of Paris Nanterre, EconomiX.
    16. Rainer Widmann, 2023. "The Behavioral Additionality of Government Research Grants," Rationality and Competition Discussion Paper Series 417, CRC TRR 190 Rationality and Competition.
    17. Martin Beraja & David Y Yang & Noam Yuchtman, 2023. "Data-intensive Innovation and the State: Evidence from AI Firms in China," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(4), pages 1701-1723.
    18. Gianluca Pallante & Emanuele Russo & Andrea Roventini, 2020. "Does mission-oriented funding stimulate private R&D? Evidence from military R&D for US states," Working Papers hal-04097530, HAL.
    19. Morten Henningsen & Torbjørn Hægeland & Jarle Møen, 2015. "Estimating the additionality of R&D subsidies using proposal evaluation data to control for research intentions," The Journal of Technology Transfer, Springer, vol. 40(2), pages 227-251, April.
    20. Koh, Yumi & Lee, Gea M., 2023. "R&D subsidies in permissive and restrictive environment: Evidence from Korea," Research Policy, Elsevier, vol. 52(1).

    More about this item

    Keywords

    innovation; defense; R&D; procurement;
    All these keywords.

    JEL classification:

    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy
    • H56 - Public Economics - - National Government Expenditures and Related Policies - - - National Security and War
    • H57 - Public Economics - - National Government Expenditures and Related Policies - - - Procurement

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cep:cepdps:dp1760. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://cep.lse.ac.uk/_new/publications/discussion-papers/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.