IDEAS home Printed from https://ideas.repec.org/p/hbs/wpaper/16-013.html
   My bibliography  Save this paper

Are “Better” Ideas More Likely to Succeed? An Empirical Analysis of Startup Evaluation

Author

Listed:
  • Erin L. Scott

    (National University of Singapore Business School)

  • Pian Shu

    (Harvard Business School, Technology and Operations Management Unit)

  • Roman M. Lubynsky

    (Massachusetts Institute of Technology)

Abstract

Entrepreneurs face high uncertainty, and often make costly investments in new business ideas without knowing the expected payoff. This paper empirically examines whether ex-ante assessment of early-stage startup ideas can predict their subsequent commercialization. We leverage an entrepreneurship program at the Massachusetts Institute of Technology in which early-stage venture ideas, presented in the form of succinct standardized summaries, elicit subjective evaluations from a large set of experienced entrepreneurs and executives. Using data on 652 ventures in multiple industry sectors, evaluated over an 8-year period, we find that ideas that elicit more positive evaluations are significantly more likely to ultimately reach commercialization. We further show that these results are driven by venture ideas with documented intellectual capital in research-and-development-intensive sectors, such as life sciences and medical devices. We find no evidence, by contrast, that experts can effectively assess the commercial potential of venture ideas in non-R&D-intensive sectors such as consumer web and enterprise software. Finally, we find that industry-specific and scientific expertise is not critical to experts' collective ability to predict ventures' commercial viability.

Suggested Citation

  • Erin L. Scott & Pian Shu & Roman M. Lubynsky, 2015. "Are “Better” Ideas More Likely to Succeed? An Empirical Analysis of Startup Evaluation," Harvard Business School Working Papers 16-013, Harvard Business School.
  • Handle: RePEc:hbs:wpaper:16-013
    as

    Download full text from publisher

    File URL: http://www.hbs.edu/faculty/pages/download.aspx?name=16-013.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. William R. Kerr & Josh Lerner & Antoinette Schoar, 2014. "The Consequences of Entrepreneurial Finance: Evidence from Angel Financings," The Review of Financial Studies, Society for Financial Studies, vol. 27(1), pages 20-55, January.
    2. Gustavo Manso, 2011. "Motivating Innovation," Journal of Finance, American Finance Association, vol. 66(5), pages 1823-1860, October.
    3. Benjamin F. Jones, 2009. "The Burden of Knowledge and the "Death of the Renaissance Man": Is Innovation Getting Harder?," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(1), pages 283-317.
    4. Roberts, Kevin & Weitzman, Martin L, 1981. "Funding Criteria for Research, Development, and Exploration Projects," Econometrica, Econometric Society, vol. 49(5), pages 1261-1288, September.
    5. Nathan Rosenberg, 2009. "Uncertainty and Technological Change," World Scientific Book Chapters, in: Nathan Rosenberg (ed.), Studies On Science And The Innovation Process Selected Works of Nathan Rosenberg, chapter 8, pages 153-172, World Scientific Publishing Co. Pte. Ltd..
    6. Daniel Kahneman & Dan Lovallo, 1993. "Timid Choices and Bold Forecasts: A Cognitive Perspective on Risk Taking," Management Science, INFORMS, vol. 39(1), pages 17-31, January.
    7. Aghion, Philippe & Howitt, Peter, 1992. "A Model of Growth through Creative Destruction," Econometrica, Econometric Society, vol. 60(2), pages 323-351, March.
    8. Thomas Åstebro & Samir Elhedhli, 2006. "The Effectiveness of Simple Decision Heuristics: Forecasting Commercial Success for Early-Stage Ventures," Management Science, INFORMS, vol. 52(3), pages 395-409, March.
    9. Raghuram G. Rajan & Luigi Zingales, 2001. "The Firm as a Dedicated Hierarchy: A Theory of the Origins and Growth of Firms," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(3), pages 805-851.
    10. Ramana Nanda & Matthew Rhodes-Kropf, 2016. "Financing Entrepreneurial Experimentation," Innovation Policy and the Economy, University of Chicago Press, vol. 16(1), pages 1-23.
    11. Chan, Yuk-Shee, 1983. "On the Positive Role of Financial Intermediation in Allocation of Venture Capital in a Market with Imperfect Information," Journal of Finance, American Finance Association, vol. 38(5), pages 1543-1568, December.
    12. Klevorick, Alvin K. & Rothschild, Michael & Winship, Christopher, 1984. "Information processing and jury decisionmaking," Journal of Public Economics, Elsevier, vol. 23(3), pages 245-278, April.
    13. Jonathan T. Eckhardt & Scott Shane & Frédéric Delmar, 2006. "Multistage Selection and the Financing of New Ventures," Management Science, INFORMS, vol. 52(2), pages 220-232, February.
    14. Dirk Bergemann & Ulrigh Hege, 2005. "The Financing of Innovation: Learning and Stopping," RAND Journal of Economics, The RAND Corporation, vol. 36(4), pages 719-752, Winter.
    15. Bergemann, Dirk & Hege, Ulrich, 1998. "Venture capital financing, moral hazard, and learning," Journal of Banking & Finance, Elsevier, vol. 22(6-8), pages 703-735, August.
    16. Raghuram G. Rajan & Luigi Zingales, 2001. "The Influence of the Financial Revolution on the Nature of Firms," American Economic Review, American Economic Association, vol. 91(2), pages 206-211, May.
    17. Thomas Hellmann & Manju Puri, 2002. "Venture Capital and the Professionalization of Start‐Up Firms: Empirical Evidence," Journal of Finance, American Finance Association, vol. 57(1), pages 169-197, February.
    18. repec:bla:jfinan:v:59:y:2004:i:4:p:1805-1844 is not listed on IDEAS
    19. Marcel Fafchamps & Christopher Woodruff, 2017. "Identifying Gazelles: Expert Panels vs. Surveys as a Means to Identify Firms with Rapid Growth Potential," The World Bank Economic Review, World Bank, vol. 31(3), pages 670-686.
    20. Raghuram G. Rajan, 2012. "Presidential Address: The Corporation in Finance," Journal of Finance, American Finance Association, vol. 67(4), pages 1173-1217, August.
    21. Romer, Paul M, 1990. "Endogenous Technological Change," Journal of Political Economy, University of Chicago Press, vol. 98(5), pages 71-102, October.
    22. Sah, Raaj Kumar & Stiglitz, Joseph E, 1988. "Committees, Hierarchies and Polyarchies," Economic Journal, Royal Economic Society, vol. 98(391), pages 451-470, June.
    23. Giuseppe Moscarini & Lones Smith, 2001. "The Optimal Level of Experimentation," Econometrica, Econometric Society, vol. 69(6), pages 1629-1644, November.
    24. William R. Kerr & Ramana Nanda & Matthew Rhodes-Kropf, 2014. "Entrepreneurship as Experimentation," Journal of Economic Perspectives, American Economic Association, vol. 28(3), pages 25-48, Summer.
    25. Lerner, Josh, 1995. "Venture Capitalists and the Oversight of Private Firms," Journal of Finance, American Finance Association, vol. 50(1), pages 301-318, March.
    26. Jensen, Richard, 1983. "Innovation adoption and diffusion when there are competing innovations," Journal of Economic Theory, Elsevier, vol. 29(1), pages 161-171, February.
    27. Baum, Joel A. C. & Silverman, Brian S., 2004. "Picking winners or building them? Alliance, intellectual, and human capital as selection criteria in venture financing and performance of biotechnology startups," Journal of Business Venturing, Elsevier, vol. 19(3), pages 411-436, May.
    28. Bhattacharya, Sudipto & Chatterjee, Kalyan & Samuelson, Larry, 1986. "Sequential Research and the Adoption of Innovations," Oxford Economic Papers, Oxford University Press, vol. 38(0), pages 219-243, Suppl. No.
    29. Ryan Decker & John Haltiwanger & Ron Jarmin & Javier Miranda, 2014. "The Role of Entrepreneurship in US Job Creation and Economic Dynamism," Journal of Economic Perspectives, American Economic Association, vol. 28(3), pages 3-24, Summer.
    30. Hao Li & Sherwin Rosen & Wing Suen, 2001. "Conflicts and Common Interests in Committees," American Economic Review, American Economic Association, vol. 91(5), pages 1478-1497, December.
    31. Steven N. Kaplan & Berk A. Sensoy & Per Strömberg, 2009. "Should Investors Bet on the Jockey or the Horse? Evidence from the Evolution of Firms from Early Business Plans to Public Companies," Journal of Finance, American Finance Association, vol. 64(1), pages 75-115, February.
    32. Gorman, Michael & Sahlman, William A., 1989. "What do venture capitalists do?," Journal of Business Venturing, Elsevier, vol. 4(4), pages 231-248, July.
    33. Ashish Arora & Anand Nandkumar, 2011. "Cash-Out or Flameout! Opportunity Cost and Entrepreneurial Strategy: Theory, and Evidence from the Information Security Industry," Management Science, INFORMS, vol. 57(10), pages 1844-1860, October.
    34. Weitzman, Martin L, 1979. "Optimal Search for the Best Alternative," Econometrica, Econometric Society, vol. 47(3), pages 641-654, May.
    35. Yingyi Qian & Chenggang Xu, 1998. "Innovation and Bureaucracy Under Soft and Hard Budget Constraints," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(1), pages 151-164.
    36. Zacharakis, Andrew L. & Meyer, G. Dale, 2000. "The potential of actuarial decision models: Can they improve the venture capital investment decision?," Journal of Business Venturing, Elsevier, vol. 15(4), pages 323-346, July.
    37. Sahlman, William A., 1990. "The structure and governance of venture-capital organizations," Journal of Financial Economics, Elsevier, vol. 27(2), pages 473-521, October.
    38. Robert E. Hall & Susan E. Woodward, 2010. "The Burden of the Nondiversifiable Risk of Entrepreneurship," American Economic Review, American Economic Association, vol. 100(3), pages 1163-1194, June.
    39. Jones, Charles I, 1995. "R&D-Based Models of Economic Growth," Journal of Political Economy, University of Chicago Press, vol. 103(4), pages 759-784, August.
    40. Lee Fleming & Olav Sorenson, 2004. "Science as a map in technological search," Strategic Management Journal, Wiley Blackwell, vol. 25(8‐9), pages 909-928, August.
    41. Lerner, Josh, 1999. "The Government as Venture Capitalist: The Long-Run Impact of the SBIR Program," The Journal of Business, University of Chicago Press, vol. 72(3), pages 285-318, July.
    42. Raghuram Rajan, 2012. "The Corporation in Finance," NBER Working Papers 17760, National Bureau of Economic Research, Inc.
    43. John Haltiwanger & Ron S. Jarmin & Javier Miranda, 2013. "Who Creates Jobs? Small versus Large versus Young," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 347-361, May.
    44. Scott Shane, 2000. "Prior Knowledge and the Discovery of Entrepreneurial Opportunities," Organization Science, INFORMS, vol. 11(4), pages 448-469, August.
    45. Raphael Amit & Lawrence Glosten & Eitan Muller, 1990. "Entrepreneurial Ability, Venture Investments, and Risk Sharing," Management Science, INFORMS, vol. 36(10), pages 1233-1246, October.
    46. Hong Luo, 2014. "When to Sell Your Idea: Theory and Evidence from the Movie Industry," Management Science, INFORMS, vol. 60(12), pages 3067-3086, December.
    47. Dan Lovallo & Colin Camerer, 1999. "Overconfidence and Excess Entry: An Experimental Approach," American Economic Review, American Economic Association, vol. 89(1), pages 306-318, March.
    48. Hao Li & Wing Suen, 2004. "Delegating Decisions to Experts," Journal of Political Economy, University of Chicago Press, vol. 112(S1), pages 311-335, February.
    49. Bernstein, Shai & Korteweg, Arthur & Laws, Kevin, 2014. "Attracting Early Stage Investors: Evidence from a Randomized Field Experiment," Research Papers 3006, Stanford University, Graduate School of Business.
    50. Lee Fleming, 2001. "Recombinant Uncertainty in Technological Search," Management Science, INFORMS, vol. 47(1), pages 117-132, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. McKenzie, David & Sansone, Dario, 2019. "Predicting entrepreneurial success is hard: Evidence from a business plan competition in Nigeria," Journal of Development Economics, Elsevier, vol. 141(C).
    2. McKenzie, David & Sansone, Dario, 2017. "Man vs. Machine in Predicting Successful Entrepreneurs: Evidence from a Business Plan Competition in Nigeria," CEPR Discussion Papers 12523, C.E.P.R. Discussion Papers.
    3. Young In Koh & Sung H. Han & Junseong Park, 2022. "A systematic process for generating new blockchain-service business model ideas," Service Business, Springer;Pan-Pacific Business Association, vol. 16(1), pages 187-209, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Erin L. Scott & Pian Shu & Roman M. Lubynsky, 2020. "Entrepreneurial Uncertainty and Expert Evaluation: An Empirical Analysis," Management Science, INFORMS, vol. 66(3), pages 1278-1299, March.
    2. Rin, Marco Da & Hellmann, Thomas & Puri, Manju, 2013. "A Survey of Venture Capital Research," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 573-648, Elsevier.
    3. William R. Kerr & Ramana Nanda & Matthew Rhodes-Kropf, 2014. "Entrepreneurship as Experimentation," Journal of Economic Perspectives, American Economic Association, vol. 28(3), pages 25-48, Summer.
    4. Ewens, Michael & Nanda, Ramana & Rhodes-Kropf, Matthew, 2018. "Cost of experimentation and the evolution of venture capital," Journal of Financial Economics, Elsevier, vol. 128(3), pages 422-442.
    5. Ramana Nanda & Matthew Rhodes-Kropf, 2012. "Innovation Policies," Harvard Business School Working Papers 13-038, Harvard Business School, revised Mar 2017.
    6. Ramana Nanda & William R. Kerr, 2015. "Financing Innovation," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 445-462, December.
    7. repec:zbw:bofrdp:2015_028 is not listed on IDEAS
    8. repec:zbw:bofrdp:urn:nbn:fi:bof-201512141480 is not listed on IDEAS
    9. Georg Gebhardt & Klaus M. Schmidt, 2002. "Der Markt für Venture Capital: Anreizprobleme, Governance Strukturen und staatliche Interventionen," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 3(3), pages 235-255, August.
    10. Ramana Nanda & William R. Kerr, 2015. "Financing Innovation," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 445-462, December.
    11. repec:bof:bofrdp:urn:nbn:fi:bof-201512141480 is not listed on IDEAS
    12. Andrew Metrick & Ayako Yasuda, 2011. "Venture Capital and Other Private Equity: a Survey," European Financial Management, European Financial Management Association, vol. 17(4), pages 619-654, September.
    13. Ewens, Michael & Malenko, Nadya, 2020. "Board Dynamics over the Startup Life Cycle," SocArXiv t96yq, Center for Open Science.
    14. Sorensen, Morten, 2007. "Learning by Investing: Evidence from Venture Capital," SIFR Research Report Series 53, Institute for Financial Research.
    15. Lahr, Henry & Mina, Andrea, 2016. "Venture capital investments and the technological performance of portfolio firms," Research Policy, Elsevier, vol. 45(1), pages 303-318.
    16. Jens Burchardt & Ulrich Hommel & Dzidziso Samuel Kamuriwo & Carolina Billitteri, 2016. "Venture Capital Contracting in Theory and Practice: Implications for Entrepreneurship Research," Entrepreneurship Theory and Practice, , vol. 40(1), pages 25-48, January.
    17. de Bettignies, Jean-Etienne & Ries, John, 2023. "When less is more: Information and the financing of innovation," Journal of Economic Behavior & Organization, Elsevier, vol. 214(C), pages 346-369.
    18. Fabio Bertoni & Diego D’Adda & Luca Grilli, 2016. "Cherry-picking or frog-kissing? A theoretical analysis of how investors select entrepreneurial ventures in thin venture capital markets," Small Business Economics, Springer, vol. 46(3), pages 391-405, March.
    19. Sascha O Becker & Hans K Hvide, 2022. "Entrepreneur Death and Startup Performance [The knowledge spillover theory of entrepreneurship]," Review of Finance, European Finance Association, vol. 26(1), pages 163-185.
    20. Josh Lerner & Ramana Nanda, 2020. "Venture Capital's Role in Financing Innovation: What We Know and How Much We Still Need to Learn," Journal of Economic Perspectives, American Economic Association, vol. 34(3), pages 237-261, Summer.
    21. Valérie Revest & Alessandro Sapio, 2012. "Financing technology-based small firms in Europe: what do we know?," Small Business Economics, Springer, vol. 39(1), pages 179-205, July.
    22. Ajay Agrawal & Joshua S. Gans & Scott Stern, 2021. "Enabling Entrepreneurial Choice," Management Science, INFORMS, vol. 67(9), pages 5510-5524, September.
    23. Andrey Malenko & Ramana Nanda & Matthew Rhodes-Kropf & Savitar Sundaresan, 2021. "Catching Outliers: Committee Voting and the Limits of Consensus when Financing Innovation," Harvard Business School Working Papers 21-131, Harvard Business School, revised Nov 2023.

    More about this item

    JEL classification:

    • L26 - Industrial Organization - - Firm Objectives, Organization, and Behavior - - - Entrepreneurship
    • M13 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration - - - New Firms; Startups
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • G32 - Financial Economics - - Corporate Finance and Governance - - - Financing Policy; Financial Risk and Risk Management; Capital and Ownership Structure; Value of Firms; Goodwill

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hbs:wpaper:16-013. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: HBS (email available below). General contact details of provider: https://edirc.repec.org/data/harbsus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.