IDEAS home Printed from https://ideas.repec.org/p/cep/cepdps/dp1977.html
   My bibliography  Save this paper

Does subsidising business advice improve firm performance? Evidence from a large RCT

Author

Listed:
  • Gonzalo Nunez-Chaim
  • Henry G. Overman
  • Capucine Riom

Abstract

We evaluate the impact of the UK's Growth Vouchers Programme, which offered subsidised business advice to 15,207 randomly selected small and medium size enterprises. Using administrative and survey data, we show that the programme increased turnover by 8.2% but only in the short-term and potentially at the expense of non-supported firms. We find that subsidised advice appears to improve firms' capabilities and practices in a way that is consistent with the increase in turnover. We also demonstrate that propensity score matching introduces a sizeable upward bias to estimated effects on turnover and employment and that this bias grows over time.

Suggested Citation

  • Gonzalo Nunez-Chaim & Henry G. Overman & Capucine Riom, 2024. "Does subsidising business advice improve firm performance? Evidence from a large RCT," CEP Discussion Papers dp1977, Centre for Economic Performance, LSE.
    • Handle: RePEc:cep:cepdps:dp1977
    as

    Download full text from publisher

    File URL: https://cep.lse.ac.uk/pubs/download/dp1977.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stiglitz, J E, 1979. "Equilibrium in Product Markets with Imperfect Information," American Economic Review, American Economic Association, vol. 69(2), pages 339-345, May.
    2. Robert W. Fairlie & Dean Karlan & Jonathan Zinman, 2015. "Behind the GATE Experiment: Evidence on Effects of and Rationales for Subsidized Entrepreneurship Training," American Economic Journal: Economic Policy, American Economic Association, vol. 7(2), pages 125-161, May.
    3. Dean Karlan & Martin Valdivia, 2011. "Teaching Entrepreneurship: Impact of Business Training on Microfinance Clients and Institutions," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 510-527, May.
    4. Francesco Manaresi & Alessandro Palma & Luca Salvatici & Vincenzo Scrutinio, 2022. "Managerial input and firm performance. Evidence from a policy experiment," CEP Discussion Papers dp1871, Centre for Economic Performance, LSE.
    5. Valdivia, Martín, 2015. "Business training plus for female entrepreneurship? Short and medium-term experimental evidence from Peru," Journal of Development Economics, Elsevier, vol. 113(C), pages 33-51.
    6. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    7. Grossman, Sanford J & Stiglitz, Joseph E, 1980. "On the Impossibility of Informationally Efficient Markets," American Economic Review, American Economic Association, vol. 70(3), pages 393-408, June.
    8. Tommaso Nannicini, 2007. "Simulation-based sensitivity analysis for matching estimators," Stata Journal, StataCorp LP, vol. 7(3), pages 334-350, September.
    9. Miriam Bruhn & Dean Karlan & Antoinette Schoar, 2018. "The Impact of Consulting Services on Small and Medium Enterprises: Evidence from a Randomized Trial in Mexico," Journal of Political Economy, University of Chicago Press, vol. 126(2), pages 635-687.
    10. Petra E. Todd & Jeffrey A. Smith, 2001. "Reconciling Conflicting Evidence on the Performance of Propensity-Score Matching Methods," American Economic Review, American Economic Association, vol. 91(2), pages 112-118, May.
    11. Criscuolo, Chiara & Martin, Ralf & Overman, Henry & Van Reenen, John, 2012. "The Causal Effects of an Industrial Policy," IZA Discussion Papers 6323, Institute of Labor Economics (IZA).
    12. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    13. Arnaldo Camuffo & Alessandro Cordova & Alfonso Gambardella & Chiara Spina, 2020. "A Scientific Approach to Entrepreneurial Decision Making: Evidence from a Randomized Control Trial," Management Science, INFORMS, vol. 66(2), pages 564-586, February.
    14. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    15. Nagel, Hanskje & Rosendahl Huber, Laura & Van Praag, Mirjam & Goslinga, Sjoerd, 2019. "The effect of a tax training program on tax compliance and business outcomes of starting entrepreneurs: Evidence from a field experiment," Journal of Business Venturing, Elsevier, vol. 34(2), pages 261-283.
    16. David McKenzie & Christopher Woodruff, 2014. "What Are We Learning from Business Training and Entrepreneurship Evaluations around the Developing World?," The World Bank Research Observer, World Bank, vol. 29(1), pages 48-82.
    17. Charles Michalopoulos & Howard S. Bloom & Carolyn J. Hill, 2004. "Can Propensity-Score Methods Match the Findings from a Random Assignment Evaluation of Mandatory Welfare-to-Work Programs?," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 156-179, February.
    18. Stephen J. Anderson & Rajesh Chandy & Bilal Zia, 2018. "Pathways to Profits: The Impact of Marketing vs. Finance Skills on Business Performance," Management Science, INFORMS, vol. 64(12), pages 5559-5583, December.
    19. Miriam Bruhn & Bilal Zia, 2013. "Stimulating managerial capital in emerging markets: the impact of business training for young entrepreneurs," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 5(2), pages 232-266, June.
    20. Morten Bennedsen & Kasper Meisner Nielsen & Francisco Perez-Gonzalez & Daniel Wolfenzon, 2007. "Inside the Family Firm: The Role of Families in Succession Decisions and Performance," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(2), pages 647-691.
    21. Mark Hart & Stephen Roper, 2003. "Modelling the Effects of Public Support to Small Firms in the UK - Paradise Gained?," ERSA conference papers ersa03p413, European Regional Science Association.
    22. Johan Lambrecht & Fabrice Pirnay, 2005. "An evaluation of public support measures for private external consultancies to SMEs in the Walloon Region of Belgium," Entrepreneurship & Regional Development, Taylor & Francis Journals, vol. 17(2), pages 89-108, March.
    23. Gary Solon & Steven J. Haider & Jeffrey M. Wooldridge, 2015. "What Are We Weighting For?," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 301-316.
    24. Chiara Criscuolo & Ralf Martin & Henry G. Overman & John Van Reenen, 2019. "Some Causal Effects of an Industrial Policy," American Economic Review, American Economic Association, vol. 109(1), pages 48-85, January.
    25. Nicholas Bloom & John Van Reenen, 2010. "Why Do Management Practices Differ across Firms and Countries?," Journal of Economic Perspectives, American Economic Association, vol. 24(1), pages 203-224, Winter.
    26. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    27. Bilitis Schoonjans & Philippe Van Cauwenberge & Heidi Vander Bauwhede, 2013. "Knowledge networking and growth in service firms," The Service Industries Journal, Taylor & Francis Journals, vol. 33(11), pages 1051-1067, August.
    28. Joseph P. Romano & Michael Wolf, 2005. "Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 94-108, March.
    29. Elizabeth Ty Wilde & Robinson Hollister, 2007. "How close is close enough? Evaluating propensity score matching using data from a class size reduction experiment," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(3), pages 455-477.
    30. Andreas Georgiadis & Christos N. Pitelis, 2016. "The Impact of Employees' and Managers' Training on the Performance of Small- and Medium-Sized Enterprises: Evidence from a Randomized Natural Experiment in the UK Service Sector," British Journal of Industrial Relations, London School of Economics, vol. 54(2), pages 409-421, June.
    31. Juan Jose Diaz & Sudhanshu Handa, 2006. "An Assessment of Propensity Score Matching as a Nonexperimental Impact Estimator: Evidence from Mexico’s PROGRESA Program," Journal of Human Resources, University of Wisconsin Press, vol. 41(2).
    32. Thomas Fraker & Rebecca Maynard, 1987. "The Adequacy of Comparison Group Designs for Evaluations of Employment-Related Programs," Journal of Human Resources, University of Wisconsin Press, vol. 22(2), pages 194-227.
    33. David Bartle & Michele Morris, 2010. "Evaluating the impacts of government business assistance programmes: approaches to testing additionality," Research Evaluation, Oxford University Press, vol. 19(4), pages 275-280, October.
    34. Robson, Paul J A & Bennett, Robert J, 2000. "SME Growth: The Relationship with Business Advice and External Collaboration," Small Business Economics, Springer, vol. 15(3), pages 193-208.
    35. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    36. Thomas C. Powell, 1995. "Total quality management as competitive advantage: A review and empirical study," Strategic Management Journal, Wiley Blackwell, vol. 16(1), pages 15-37.
    37. Ben Weidmann & Luke Miratrix, 2021. "Lurking Inferential Monsters? Quantifying Selection Bias In Evaluations Of School Programs," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(3), pages 964-986, June.
    38. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    39. Roberto Agodini & Mark Dynarski, 2004. "Are Experiments the Only Option? A Look at Dropout Prevention Programs," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 180-194, February.
    40. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    41. Cumming, Douglas J. & Fischer, Eileen, 2012. "Publicly funded business advisory services and entrepreneurial outcomes," Research Policy, Elsevier, vol. 41(2), pages 467-481.
    42. Karlan, Dean & Knight, Ryan & Udry, Christopher, 2015. "Consulting and capital experiments with microenterprise tailors in Ghana," Journal of Economic Behavior & Organization, Elsevier, vol. 118(C), pages 281-302.
    43. Elena Bardasi & Marine Gassier & Markus Goldstein & Alaka Holla, 2021. "The Profits of Wisdom: The Impact of a Business Support Program in Tanzania," The World Bank Economic Review, World Bank, vol. 35(2), pages 328-347.
    44. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Ferraro, Paul J. & Miranda, Juan José, 2014. "The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 344-365.
    3. Flores, Carlos A. & Mitnik, Oscar A., 2009. "Evaluating Nonexperimental Estimators for Multiple Treatments: Evidence from Experimental Data," IZA Discussion Papers 4451, Institute of Labor Economics (IZA).
    4. Andrea Ichino & Fabrizia Mealli & Tommaso Nannicini, 2008. "From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 305-327.
    5. Islam, Abu Hayat, 2015. "Can Integrated Rice-Fish System Increase Welfare of the Marginalized Extreme Poor in Bangladesh? A DID Matching Approach," 2015 Conference, August 9-14, 2015, Milan, Italy 211792, International Association of Agricultural Economists.
    6. Mckenzie,David J., 2020. "Small Business Training to Improve Management Practices in Developing Countries: Reassessingthe Evidence for 'Training Doesn’t Work'," Policy Research Working Paper Series 9408, The World Bank.
    7. Vivian C. Wong & Peter M. Steiner & Kylie L. Anglin, 2018. "What Can Be Learned From Empirical Evaluations of Nonexperimental Methods?," Evaluation Review, , vol. 42(2), pages 147-175, April.
    8. Tommaso Nannicini, 2007. "Simulation-based sensitivity analysis for matching estimators," Stata Journal, StataCorp LP, vol. 7(3), pages 334-350, September.
    9. Mano, Yukichi & Akoten, John & Yoshino, Yutaka & Sonobe, Tetsushi, 2014. "Teaching KAIZEN to small business owners: An experiment in a metalworking cluster in Nairobi," Journal of the Japanese and International Economies, Elsevier, vol. 33(C), pages 25-42.
    10. Candon, David, 2018. "The effect of cancer on the labor supply of employed men over the age of 65," Economics & Human Biology, Elsevier, vol. 31(C), pages 184-199.
    11. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    12. Suzuki, Aya & Igei, Kengo, 2017. "Can Efficient Provision of Business Development Services Bring Better Results for SMEs?: Evidence from a Networking Project in Thailand," Working Papers 147, JICA Research Institute.
    13. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    14. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    15. Carlson, Deven & Haveman, Robert & Kaplan, Tom & Wolfe, Barbara, 2012. "Long-term earnings and employment effects of housing voucher receipt," Journal of Urban Economics, Elsevier, vol. 71(1), pages 128-150.
    16. Ferman, Bruno, 2021. "Matching estimators with few treated and many control observations," Journal of Econometrics, Elsevier, vol. 225(2), pages 295-307.
    17. David Alfaro‐Serrano & Tanay Balantrapu & Ritam Chaurey & Ana Goicoechea & Eric Verhoogen, 2021. "Interventions to promote technology adoption in firms: A systematic review," Campbell Systematic Reviews, John Wiley & Sons, vol. 17(4), December.
    18. Black, Dan A. & Joo, Joonhwi & LaLonde, Robert & Smith, Jeffrey A. & Taylor, Evan J., 2022. "Simple Tests for Selection: Learning More from Instrumental Variables," Labour Economics, Elsevier, vol. 79(C).
    19. Delius, Antonia & Sterck, Olivier, 2024. "Cash transfers and micro-enterprise performance: Theory and quasi-experimental evidence from Kenya," Journal of Development Economics, Elsevier, vol. 167(C).
    20. Kristen Harknett, 2006. "Does Receiving an Earnings Supplement Affect Union Formation? Estimating Effects for Program Participants Using Propensity Score Matching," Evaluation Review, , vol. 30(6), pages 741-778, December.

    More about this item

    Keywords

    firm performance; enterprise growth; entrepreneurship; industrial strategy;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cep:cepdps:dp1977. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://cep.lse.ac.uk/_new/publications/discussion-papers/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.