IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v44y2015i10p1844-1855.html
   My bibliography  Save this article

The impact of R&D subsidies during the crisis

Author

Listed:
  • Hud, Martin
  • Hussinger, Katrin

Abstract

This study investigates the impact of public R&D subsidies on R&D investment of small and medium-sized enterprises (SMEs) in Germany during the most recent economic crisis. Our analysis is based on firm-level data of the Mannheim Innovation Panel (MIP) covering the period 2006–2010. While we find an overall positive effect of R&D subsidies on SMEs’ R&D investment behavior, there is evidence for a crowding out effect for the crisis year 2009. In 2010, when the German economy started to recover, the subsidy effect is smaller than in the pre-crisis years, but positive and significant. Additional tests indicate that the temporary crowding out effect was caused by reluctant innovation investment behavior of the subsidy recipients rather than by Germany’s countercyclical innovation policy during the crisis.

Suggested Citation

  • Hud, Martin & Hussinger, Katrin, 2015. "The impact of R&D subsidies during the crisis," Research Policy, Elsevier, vol. 44(10), pages 1844-1855.
    • Handle: RePEc:eee:respol:v:44:y:2015:i:10:p:1844-1855
    DOI: 10.1016/j.respol.2015.06.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733315001006
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2015.06.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Philippe Aghion & Diego Comin & Peter Howitt & Isabel Tecu, 2016. "When Does Domestic Savings Matter for Economic Growth?," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 64(3), pages 381-407, August.
    2. Liliana Gelabert & Andrea Fosfuri & Josep A. Tribó, 2009. "Does The Effect Of Public Support For R&D Depend On The Degree Of Appropriability?," Journal of Industrial Economics, Wiley Blackwell, vol. 57(4), pages 736-767, December.
    3. Bronwyn H. Hall, 1992. "Investment and Research and Development at the Firm Level: Does the Source of Financing Matter?," NBER Working Papers 4096, National Bureau of Economic Research, Inc.
    4. Almus, Matthias & Czarnitzki, Dirk, 2003. "The Effects of Public R&D Subsidies on Firms' Innovation Activities: The Case of Eastern Germany," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(2), pages 226-236, April.
    5. David, Paul A. & Hall, Bronwyn H. & Toole, Andrew A., 2000. "Is public R&D a complement or substitute for private R&D? A review of the econometric evidence," Research Policy, Elsevier, vol. 29(4-5), pages 497-529, April.
    6. Aghion, Philippe & Angeletos, George-Marios & Banerjee, Abhijit & Manova, Kalina, 2010. "Volatility and growth: Credit constraints and the composition of investment," Journal of Monetary Economics, Elsevier, vol. 57(3), pages 246-265, April.
    7. Gene M. Grossman & Elhanan Helpman, 1994. "Endogenous Innovation in the Theory of Growth," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 23-44, Winter.
    8. Bronwyn H. Hall, 1990. "The Impact of Corporate Restructuring on Industrial Research and Development," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 21(1990 Micr), pages 85-135.
    9. Charles Bérubé & Pierre Mohnen, 2009. "Are firms that receive R&D subsidies more innovative?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 42(1), pages 206-225, February.
    10. Veugelers, Reinhilde & Hottenrott, Hanna & Lopes Bento, Cindy, 2014. "Direct and Cross-Scheme Effects in a Research and Development Subsidy Program," CEPR Discussion Papers 10181, C.E.P.R. Discussion Papers.
    11. Archibugi, Daniele & Filippetti, Andrea & Frenz, Marion, 2013. "Economic crisis and innovation: Is destruction prevailing over accumulation?," Research Policy, Elsevier, vol. 42(2), pages 303-314.
    12. Nick Bloom & Stephen Bond & John Van Reenen, 2007. "Uncertainty and Investment Dynamics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(2), pages 391-415.
    13. Czarnitzki, Dirk & Lopes-Bento, Cindy, 2013. "Value for money? New microeconometric evidence on public R&D grants in Flanders," Research Policy, Elsevier, vol. 42(1), pages 76-89.
    14. Philippe Aghion & Philippe Askenazy & Nicolas Berman & Gilbert Cette & Laurent Eymard, 2012. "Credit Constraints And The Cyclicality Of R&D Investment: Evidence From France," Journal of the European Economic Association, European Economic Association, vol. 10(5), pages 1001-1024, October.
    15. DUGUET Emmanuel, 2004. "Are R&D subsidies a substitute or a complement to privately funded R&D? Evidence from France using propensity score methods for non- experimental data," Public Economics 0411007, University Library of Munich, Germany.
    16. Adriana Arreaza & Bent E. Sgrensen & Oved Yosha, 1999. "Consumption Smoothing through Fiscal Policy in OECD and EU Countries," NBER Chapters, in: Fiscal Institutions and Fiscal Performance, pages 59-80, National Bureau of Economic Research, Inc.
    17. repec:bla:jindec:v:50:y:2002:i:4:p:369-90 is not listed on IDEAS
    18. Richard Blundell & Monica Costa Dias, 2000. "Evaluation methods for non-experimental data," Fiscal Studies, Institute for Fiscal Studies, vol. 21(4), pages 427-468, January.
    19. Saint-Paul, Gilles, 1993. "Productivity growth and the structure of the business cycle," European Economic Review, Elsevier, vol. 37(4), pages 861-883, May.
    20. Zvi Griliches, 1998. "Productivity and R&D at the Firm Level," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 100-133, National Bureau of Economic Research, Inc.
    21. Makkonen, Teemu, 2013. "Government science and technology budgets in times of crisis," Research Policy, Elsevier, vol. 42(3), pages 817-822.
    22. Archibugi, Daniele & Filippetti, Andrea & Frenz, Marion, 2013. "The impact of the economic crisis on innovation: Evidence from Europe," Technological Forecasting and Social Change, Elsevier, vol. 80(7), pages 1247-1260.
    23. Aschhoff Birgit, 2010. "Who Gets the Money?: The Dynamics of R&D Project Subsidies in Germany," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 230(5), pages 522-546, October.
    24. Zvi Griliches, 1998. "Issues in Assessing the Contribution of Research and Development to Productivity Growth," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 17-45, National Bureau of Economic Research, Inc.
    25. José Ángel Zúñiga-Vicente & César Alonso-Borrego & Francisco J. Forcadell & José I. Galán, 2014. "Assessing The Effect Of Public Subsidies On Firm R&D Investment: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 28(1), pages 36-67, February.
    26. Katrin Hussinger, 2008. "R&D and subsidies at the firm level: an application of parametric and semiparametric two-step selection models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(6), pages 729-747.
    27. Zvi Griliches, 1984. "R&D, Patents, and Productivity," NBER Books, National Bureau of Economic Research, Inc, number gril84-1.
    28. Rammer, Christian, 2011. "Auswirkungen der Wirtschaftskrise auf die Innovationstätigkeit der Unternehmen," ZEW Wachstums- und Konjunkturanalysen, ZEW - Leibniz Centre for European Economic Research, vol. 14(1), pages 8-9.
    29. Bronwyn Hall & Alessandro Maffioli, 2008. "Evaluating the impact of technology development funds in emerging economies: evidence from Latin America," The European Journal of Development Research, Taylor and Francis Journals, vol. 20(2), pages 172-198.
    30. Aghion, Philippe & Saint-Paul, Gilles, 1998. "VIRTUES OF BAD TIMES Interaction Between Productivity Growth and Economic Fluctuations," Macroeconomic Dynamics, Cambridge University Press, vol. 2(3), pages 322-344, September.
    31. Arvanitis, Spyros & Hollenstein, Heinz & Lenz, Stephan, 2002. "The Effectiveness of Government Promotion of Advanced Manufacturing Technologies (AMT): An Economic Analysis Based on Swiss Micro Data," Small Business Economics, Springer, vol. 19(4), pages 321-340, December.
    32. Himmelberg, Charles P & Petersen, Bruce C, 1994. "R&D and Internal Finance: A Panel Study of Small Firms in High-Tech Industries," The Review of Economics and Statistics, MIT Press, vol. 76(1), pages 38-51, February.
    33. Aghion, P. & Askenazy, P. & Berman, N. & Cette, G. & Eymard, L., 2008. "Credit Constraints and the Cyclicality of R&D Investment: Evidence from France," Working papers 198, Banque de France.
    34. Shleifer, Andrei, 1986. "Implementation Cycles," Journal of Political Economy, University of Chicago Press, vol. 94(6), pages 1163-1190, December.
    35. González, Xulia & Pazó, Consuelo, 2008. "Do public subsidies stimulate private R&D spending?," Research Policy, Elsevier, vol. 37(3), pages 371-389, April.
    36. Xulia González & Jordi Jaumandreu & Consuelo Pazo, 2005. "Barriers to Innovation and Subsidy Effectiveness," RAND Journal of Economics, The RAND Corporation, vol. 36(4), pages 930-949, Winter.
    37. Aerts, Kris & Czarnitzki, Dirk, 2004. "Using Innovation Survey Data to Evaluate R&D Policy: The Case of Belgium," ZEW Discussion Papers 04-55, ZEW - Leibniz Centre for European Economic Research.
    38. Dirk Czarnitzki & Bernd Ebersberger & Andreas Fier, 2007. "The relationship between R&D collaboration, subsidies and R&D performance: Empirical evidence from Finland and Germany," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(7), pages 1347-1366.
    39. Christian Rammer, 2011. "Auswirkungen der Wirtschaftskrise auf die Innovationstätigkeit der Unternehmen in Deutschland," Vierteljahrshefte zur Wirtschaftsforschung / Quarterly Journal of Economic Research, DIW Berlin, German Institute for Economic Research, vol. 80(3), pages 13-34.
    40. CZARNITZKI Dirk & LOPES BENTO Cindy, 2010. "Evaluation of public R&D policies: A cross-country comparison," LISER Working Paper Series 2010-31, Luxembourg Institute of Socio-Economic Research (LISER).
    41. Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.
    42. Brautzsch, Hans-Ulrich & Günther, Jutta & Loose, Brigitte & Ludwig, Udo & Nulsch, Nicole, 2015. "Can R&D subsidies counteract the economic crisis? – Macroeconomic effects in Germany," Research Policy, Elsevier, vol. 44(3), pages 623-633.
    43. Jens Matthias Arnold & Katrin Hussinger, 2005. "Export Behavior and Firm Productivity in German Manufacturing: A Firm-Level Analysis," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 141(2), pages 219-243, July.
    44. Philippe Aghion & Peter Howitt, 2009. "The Economics of Growth," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262012634, April.
    45. Filippetti, Andrea & Archibugi, Daniele, 2011. "Innovation in times of crisis: National Systems of Innovation, structure, and demand," Research Policy, Elsevier, vol. 40(2), pages 179-192, March.
    46. Saul Lach, 2002. "Do R&D Subsidies Stimulate or Displace Private R&D? Evidence from Israel," Journal of Industrial Economics, Wiley Blackwell, vol. 50(4), pages 369-390, December.
    47. Abbott, Andrew & Jones, Philip, 2012. "Intergovernmental transfers and procyclical public spending," Economics Letters, Elsevier, vol. 115(3), pages 447-451.
    48. Geroski, P A & Walters, C F, 1995. "Innovative Activity over the Business Cycle," Economic Journal, Royal Economic Society, vol. 105(431), pages 916-928, July.
    49. Min Ouyang, 2011. "On the Cyclicality of R&D," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 542-553, May.
    50. Grossman, Gene M. & Helpman, Elhanan, 1991. "Trade, knowledge spillovers, and growth," European Economic Review, Elsevier, vol. 35(2-3), pages 517-526, April.
    51. Klette, Tor Jakob & Moen, Jarle & Griliches, Zvi, 2000. "Do subsidies to commercial R&D reduce market failures? Microeconometric evaluation studies1," Research Policy, Elsevier, vol. 29(4-5), pages 471-495, April.
    52. Matthew Rafferty & Mark Funk, 2008. "Asymmetric Effects Of The Business Cycle On Firm-Financed R&D," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 17(5), pages 497-510.
    53. Isabel Busom, 2000. "An Empirical Evaluation of The Effects of R&D Subsidies," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 9(2), pages 111-148.
    54. Paunov, Caroline, 2012. "The global crisis and firms’ investments in innovation," Research Policy, Elsevier, vol. 41(1), pages 24-35.
    55. Ulrich Doraszelski & Jordi Jaumandreu, 2013. "R&D and Productivity: Estimating Endogenous Productivity," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(4), pages 1338-1383.
    56. Bettina Peters & Christian Rammer, 2013. "Innovation panel surveys in Germany," Chapters, in: Fred Gault (ed.), Handbook of Innovation Indicators and Measurement, chapter 6, pages 135-177, Edward Elgar Publishing.
    57. Dirk Czarnitzki & Andrew Toole, 2007. "Business R&D and the Interplay of R&D Subsidies and Product Market Uncertainty," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 31(3), pages 169-181, November.
    58. Abbott, Andrew & Jones, Philip, 2011. "Procyclical government spending: Patterns of pressure and prudence in the OECD," Economics Letters, Elsevier, vol. 111(3), pages 230-232, June.
    59. Aerts, Kris & Schmidt, Tobias, 2008. "Two for the price of one?: Additionality effects of R&D subsidies: A comparison between Flanders and Germany," Research Policy, Elsevier, vol. 37(5), pages 806-822, June.
    60. repec:zbw:bofrdp:2008_007 is not listed on IDEAS
    61. Czarnitzki, Dirk & Fier, Andreas, 2002. "Do Innovation Subsidies Crowd Out Private Investment? Evidence from the German Service Sector," ZEW Discussion Papers 02-04, ZEW - Leibniz Centre for European Economic Research.
    62. Lane, Philip R., 2003. "The cyclical behaviour of fiscal policy: evidence from the OECD," Journal of Public Economics, Elsevier, vol. 87(12), pages 2661-2675, December.
    63. Czarnitzki, Dirk & Hussinger, Katrin, 2004. "The Link Between R&D Subsidies, R&D Spending and Technological Performance," ZEW Discussion Papers 04-56, ZEW - Leibniz Centre for European Economic Research.
    64. Giovanni Cerulli & Bianca Potì, 2010. "The differential impact of privately and publicly funded R&D on R&D investment and innovation: The Italian case," Working Papers 10, Doctoral School of Economics, Sapienza University of Rome, revised 2010.
    65. Fred Gault (ed.), 2013. "Handbook of Innovation Indicators and Measurement," Books, Edward Elgar Publishing, number 14427.
    66. repec:adr:anecst:y:1998:i:49-50:p:16 is not listed on IDEAS
    67. Gadi Barlevy, 2007. "On the Cyclicality of Research and Development," American Economic Review, American Economic Association, vol. 97(4), pages 1131-1164, September.
    68. Dietmar Harhoff, 1998. "Are there Financing Constraints for R&D and Investment in German Manufacturing Firms," Annals of Economics and Statistics, GENES, issue 49-50, pages 421-456.
    69. Scott J. Wallsten, 2000. "The Effects of Government-Industry R&D Programs on Private R&D: The Case of the Small Business Innovation Research Program," RAND Journal of Economics, The RAND Corporation, vol. 31(1), pages 82-100, Spring.
    70. Joseph E. Stiglitz, 1993. "Endogenous Growth and Cycles," NBER Working Papers 4286, National Bureau of Economic Research, Inc.
    71. James M. Poterba & Jürgen von Hagen, 1999. "Fiscal Institutions and Fiscal Performance," NBER Books, National Bureau of Economic Research, Inc, number pote99-1.
    72. Holger Görg & Eric Strobl, 2007. "The Effect of R&D Subsidies on Private R&D," Economica, London School of Economics and Political Science, vol. 74(294), pages 215-234, May.
    73. David Romer, 1993. "The New Keynesian Synthesis," Journal of Economic Perspectives, American Economic Association, vol. 7(1), pages 5-22, Winter.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas H. W. Ziesemer, 2021. "The Effects of R&D Subsidies and Publicly Performed R&D on Business R&D: A Survey," Hacienda Pública Española / Review of Public Economics, IEF, vol. 236(1), pages 171-205, March.
    2. Bettina Becker, 2013. "The Determinants of R&D Investment: A Survey of the Empirical Research," Discussion Paper Series 2013_09, Department of Economics, Loughborough University, revised Sep 2013.
    3. José Ángel Zúñiga-Vicente & César Alonso-Borrego & Francisco J. Forcadell & José I. Galán, 2014. "Assessing The Effect Of Public Subsidies On Firm R&D Investment: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 28(1), pages 36-67, February.
    4. Ugur, Mehmet & Trushin, Eshref & Solomon, Edna, 2015. "UK and EU subsidies and private R&D investment: Is there input additionality?," MPRA Paper 68009, University Library of Munich, Germany, revised 16 Nov 2015.
    5. Syoum Negassi & Jean-Francois Sattin, 2014. "Evaluation of Public R&D Policy: A Meta-Regression Analysis," Working Papers 14-09, University of Delaware, Department of Economics.
    6. Aschhoff, Birgit, 2009. "The effect of subsidies on R&D investment and success: do subsidy history and size matter?," ZEW Discussion Papers 09-032, ZEW - Leibniz Centre for European Economic Research.
    7. Czarnitzki, Dirk & Lopes-Bento, Cindy, 2013. "Value for money? New microeconometric evidence on public R&D grants in Flanders," Research Policy, Elsevier, vol. 42(1), pages 76-89.
    8. LOPES BENTO Cindy & CZARNITZKI Dirk, 2012. "Value for money? New microeconomic evidence on public R&D grants in Flanders," LISER Working Paper Series 2012-19, Luxembourg Institute of Socio-Economic Research (LISER).
    9. Pellens, Maikel & Peters, Bettina & Hud, Martin & Rammer, Christian & Licht, Georg, 2018. "Public investment in R&D in reaction to economic crises: A longitudinal study for OECD countries," ZEW Discussion Papers 18-005, ZEW - Leibniz Centre for European Economic Research.
    10. Dirk Czarnitzki & Cindy Lopes-Bento, 2014. "Innovation Subsidies: Does the Funding Source Matter for Innovation Intensity and Performance? Empirical Evidence from Germany," Industry and Innovation, Taylor & Francis Journals, vol. 21(5), pages 380-409, July.
    11. Ugur, Mehmet & Trushin, Eshref, 2018. "Asymmetric information and heterogeneous effects of R&D subsidies: evidence on R&D investment and employment of R&D personel," Greenwich Papers in Political Economy 21943, University of Greenwich, Greenwich Political Economy Research Centre.
    12. Michel Dumont, 2015. "Working Paper 05-15 - Evaluation of federal tax incentives for private R&D in Belgium: An update," Working Papers 1505, Federal Planning Bureau, Belgium.
    13. Katrin Hussinger, 2008. "R&D and subsidies at the firm level: an application of parametric and semiparametric two-step selection models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(6), pages 729-747.
    14. Giebel, Marek & Kraft, Kornelius, 2020. "R&D investment under financing constraints," ZEW Discussion Papers 20-018, ZEW - Leibniz Centre for European Economic Research.
    15. Aerts, Kris & Schmidt, Tobias, 2008. "Two for the price of one?: Additionality effects of R&D subsidies: A comparison between Flanders and Germany," Research Policy, Elsevier, vol. 37(5), pages 806-822, June.
    16. Correa, Paulo & Andres, Luis & Borja-Vega, Christian, 2013. "The impact of government support on firm R&D investments : a meta-analysis," Policy Research Working Paper Series 6532, The World Bank.
    17. Marino, Marianna & Lhuillery, Stephane & Parrotta, Pierpaolo & Sala, Davide, 2016. "Additionality or crowding-out? An overall evaluation of public R&D subsidy on private R&D expenditure," Research Policy, Elsevier, vol. 45(9), pages 1715-1730.
    18. Huergo, Elena & Trenado, Mayte & Ubierna, Andrés, 2016. "The impact of public support on firm propensity to engage in R&D: Spanish experience," Technological Forecasting and Social Change, Elsevier, vol. 113(PB), pages 206-219.
    19. Álvarez-Ayuso, Inmaculada C. & Kao, Chihwa & Romero-Jordán, Desiderio, 2018. "Long run effect of public grants and tax credits on R&D investment: A non-stationary panel data approach," Economic Modelling, Elsevier, vol. 75(C), pages 93-104.
    20. Becker, Lasse & Bizer, Kilian, 2015. "Federalism and innovation support for small and medium-sized enterprises: Empirical evidence in Europe," University of Göttingen Working Papers in Economics 245, University of Goettingen, Department of Economics.

    More about this item

    Keywords

    R&D; Subsidies; Policy evaluation; Economic crisis; Treatment effects;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • G01 - Financial Economics - - General - - - Financial Crises
    • H50 - Public Economics - - National Government Expenditures and Related Policies - - - General
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:44:y:2015:i:10:p:1844-1855. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.