IDEAS home Printed from https://ideas.repec.org/a/wly/finmar/v27y2018i2p49-86.html
   My bibliography  Save this article

A skeptical appraisal of the bootstrap approach in fund performance evaluation

Author

Listed:
  • Huazhu Zhang
  • Cheng Yan

Abstract

It has become standard practice in the fund performance evaluation literature to use the bootstrap approach to distinguish “skills” from “luck”, while its reliability has not been subject to rigorous statistical analysis. This paper reviews and critiques the bootstrap schemes used in the literature, and provides a simulation analysis of the validity and reliability of the bootstrap approach by applying it to evaluating the performance of hypothetical funds under various assumptions. We argue that this approach can be misleading, regardless of using alpha estimates or their t‐statistics. While alternative bootstrap schemes can result in improvements, they are not foolproof either. The case can be worse if the benchmark model is misspecified. It is therefore only with caution that we can use the bootstrap approach to evaluate the performance of funds and we offer some suggestions for improving it.

Suggested Citation

  • Huazhu Zhang & Cheng Yan, 2018. "A skeptical appraisal of the bootstrap approach in fund performance evaluation," Financial Markets, Institutions & Instruments, John Wiley & Sons, vol. 27(2), pages 49-86, May.
    • Handle: RePEc:wly:finmar:v:27:y:2018:i:2:p:49-86
    DOI: 10.1111/fmii.12093
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/fmii.12093
    Download Restriction: no
    File URL: https://libkey.io/10.1111/fmii.12093?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michael C. Jensen, 1968. "The Performance Of Mutual Funds In The Period 1945–1964," Journal of Finance, American Finance Association, vol. 23(2), pages 389-416, May.
    2. Henriksson, Roy D & Merton, Robert C, 1981. "On Market Timing and Investment Performance. II. Statistical Procedures for Evaluating Forecasting Skills," The Journal of Business, University of Chicago Press, vol. 54(4), pages 513-533, October.
    3. Blake, David & Caulfield, Tristan & Ioannidis, Christos & Tonks, Ian, 2014. "Improved inference in the evaluation of mutual fund performance using panel bootstrap methods," Journal of Econometrics, Elsevier, vol. 183(2), pages 202-210.
    4. repec:bla:jfinan:v:55:y:2000:i:4:p:1655-1703 is not listed on IDEAS
    5. Laurent Barras & Olivier Scaillet & Russ Wermers, 2010. "False Discoveries in Mutual Fund Performance: Measuring Luck in Estimated Alphas," Journal of Finance, American Finance Association, vol. 65(1), pages 179-216, February.
    6. Jonathan B. Berk & Richard C. Green, 2004. "Mutual Fund Flows and Performance in Rational Markets," Journal of Political Economy, University of Chicago Press, vol. 112(6), pages 1269-1295, December.
    7. Cheng, Tingting & Yan, Cheng, 2017. "Evaluating the size of the bootstrap method for fund performance evaluation," Economics Letters, Elsevier, vol. 156(C), pages 36-41.
    8. Berk, Jonathan B. & van Binsbergen, Jules H., 2015. "Measuring skill in the mutual fund industry," Journal of Financial Economics, Elsevier, vol. 118(1), pages 1-20.
    9. Chen, Yong & Cliff, Michael & Zhao, Haibei, 2017. "Hedge Funds: The Good, the Bad, and the Lucky," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 52(3), pages 1081-1109, June.
    10. Robert Kosowski & Allan Timmermann & Russ Wermers & Hal White, 2006. "Can Mutual Fund “Stars” Really Pick Stocks? New Evidence from a Bootstrap Analysis," Journal of Finance, American Finance Association, vol. 61(6), pages 2551-2595, December.
    11. Cuthbertson, Keith & Nitzsche, Dirk & O'Sullivan, Niall, 2008. "UK mutual fund performance: Skill or luck?," Journal of Empirical Finance, Elsevier, vol. 15(4), pages 613-634, September.
    12. Blake, David & Caulfield, Tristan & Ioannidis, Christos & Tonks, Ian, 2017. "New Evidence on Mutual Fund Performance: A Comparison of Alternative Bootstrap Methods," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 52(3), pages 1279-1299, June.
    13. Chen, Hsiu-Lang & Jegadeesh, Narasimhan & Wermers, Russ, 2000. "The Value of Active Mutual Fund Management: An Examination of the Stockholdings and Trades of Fund Managers," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 35(3), pages 343-368, September.
    14. Russ Wermers, 2000. "Mutual Fund Performance: An Empirical Decomposition into Stock‐Picking Talent, Style, Transactions Costs, and Expenses," Journal of Finance, American Finance Association, vol. 55(4), pages 1655-1695, August.
    15. Elton, Edwin J, et al, 1993. "Efficiency with Costly Information: A Reinterpretation of Evidence from Managed Portfolios," The Review of Financial Studies, Society for Financial Studies, vol. 6(1), pages 1-22.
    16. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    17. Malkiel, Burton G, 1995. "Returns from Investing in Equity Mutual Funds 1971 to 1991," Journal of Finance, American Finance Association, vol. 50(2), pages 549-572, June.
    18. Ferson, Wayne E & Schadt, Rudi W, 1996. "Measuring Fund Strategy and Performance in Changing Economic Conditions," Journal of Finance, American Finance Association, vol. 51(2), pages 425-461, June.
    19. Christopherson, Jon A & Ferson, Wayne E & Glassman, Debra A, 1998. "Conditioning Manager Alphas on Economic Information: Another Look at the Persistence of Performance," The Review of Financial Studies, Society for Financial Studies, vol. 11(1), pages 111-142.
    20. Russ Wermers, 2011. "Performance Measurement of Mutual Funds, Hedge Funds, and Institutional Accounts," Annual Review of Financial Economics, Annual Reviews, vol. 3(1), pages 537-574, December.
    21. Wayne E. Ferson, 2010. "Investment Performance Evaluation," Annual Review of Financial Economics, Annual Reviews, vol. 2(1), pages 207-234, December.
    22. David Blake & Alberto G. Rossi & Allan Timmermann & Ian Tonks & Russ Wermers, 2013. "Decentralized Investment Management: Evidence from the Pension Fund Industry," Journal of Finance, American Finance Association, vol. 68(3), pages 1133-1178, June.
    23. Kosowski, Robert & Naik, Narayan Y. & Teo, Melvyn, 2007. "Do hedge funds deliver alpha? A Bayesian and bootstrap analysis," Journal of Financial Economics, Elsevier, vol. 84(1), pages 229-264, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cai, Biqing & Cheng, Tingting & Yan, Cheng, 2018. "Time-varying skills (versus luck) in U.S. active mutual funds and hedge funds," Journal of Empirical Finance, Elsevier, vol. 49(C), pages 81-106.
    2. Huang, Rong & Pilbeam, Keith & Pouliot, William, 2021. "Do actively managed US mutual funds produce positive alpha?," Journal of Economic Behavior & Organization, Elsevier, vol. 182(C), pages 472-492.
    3. Angelidis, Timotheos & Giamouridis, Daniel & Tessaromatis, Nikolaos, 2013. "Revisiting mutual fund performance evaluation," Journal of Banking & Finance, Elsevier, vol. 37(5), pages 1759-1776.
    4. Andrew Clare & Mariana Clare, 2019. "An examination of ex ante fund performance: identifying indicators of future performance," Journal of Asset Management, Palgrave Macmillan, vol. 20(3), pages 175-195, May.
    5. Blake, David & Caulfield, Tristan & Ioannidis, Christos & Tonks, Ian, 2014. "Improved inference in the evaluation of mutual fund performance using panel bootstrap methods," Journal of Econometrics, Elsevier, vol. 183(2), pages 202-210.
    6. Cuthbertson, Keith & Nitzsche, Dirk, 2013. "Performance, stock selection and market timing of the German equity mutual fund industry," Journal of Empirical Finance, Elsevier, vol. 21(C), pages 86-101.
    7. Cuthbertson, Keith & Nitzsche, Dirk & O'Sullivan, Niall, 2008. "UK mutual fund performance: Skill or luck?," Journal of Empirical Finance, Elsevier, vol. 15(4), pages 613-634, September.
    8. Jiang, George J. & Zaynutdinova, Gulnara R. & Zhang, Huacheng, 2021. "Stock-selection timing," Journal of Banking & Finance, Elsevier, vol. 125(C).
    9. Zhang, Jinhua & Wang, Guipu & Yan, Cheng, 2020. "Can foreign equity funds outperform their benchmarks? New evidence from fund-holding data for China," Economic Modelling, Elsevier, vol. 90(C), pages 11-20.
    10. Matallín-Sáez, Juan Carlos & Soler-Domínguez, Amparo & Tortosa-Ausina, Emili, 2016. "On the robustness of persistence in mutual fund performance," The North American Journal of Economics and Finance, Elsevier, vol. 36(C), pages 192-231.
    11. Ľuboš Pástor & Robert F. Stambaugh & Lucian A. Taylor, 2017. "Do Funds Make More When They Trade More?," Journal of Finance, American Finance Association, vol. 72(4), pages 1483-1528, August.
    12. Keith Cuthbertson & Dirk Nitzsche & Niall O'Sullivan, 2012. "False Discoveries in UK Mutual Fund Performance," European Financial Management, European Financial Management Association, vol. 18(3), pages 444-463, June.
    13. Keith Pilbeam & Hamish Preston, 2019. "An Empirical Investigation of the Performance of Japanese Mutual Funds: Skill or Luck?," IJFS, MDPI, vol. 7(1), pages 1-16, January.
    14. Korteweg, Arthur & Sorensen, Morten, 2017. "Skill and luck in private equity performance," Journal of Financial Economics, Elsevier, vol. 124(3), pages 535-562.
    15. Cheng, Tingting & Yan, Cheng & Yan, Yayi, 2021. "Improved inference for fund alphas using high-dimensional cross-sectional tests," Journal of Empirical Finance, Elsevier, vol. 61(C), pages 57-81.
    16. Grønborg, Niels S. & Lunde, Asger & Timmermann, Allan & Wermers, Russ, 2021. "Picking funds with confidence," Journal of Financial Economics, Elsevier, vol. 139(1), pages 1-28.
    17. Hunter, David & Kandel, Eugene & Kandel, Shmuel & Wermers, Russ, 2014. "Mutual fund performance evaluation with active peer benchmarks," Journal of Financial Economics, Elsevier, vol. 112(1), pages 1-29.
    18. Chen, Li-Wen & Adams, Andrew & Taffler, Richard, 2013. "What style-timing skills do mutual fund “stars” possess?," Journal of Empirical Finance, Elsevier, vol. 21(C), pages 156-173.
    19. Barras, Laurent & Gagliardini, Patrick & Scaillet, Olivier, 2018. "The Cross-Sectional Distribution of Fund Skill Measures," Working Papers unige:110006, University of Geneva, Geneva School of Economics and Management.
    20. Laurent Barras & Patrick Gagliardini & Olivier Scaillet, 2022. "Skill, Scale, and Value Creation in the Mutual Fund Industry," Journal of Finance, American Finance Association, vol. 77(1), pages 601-638, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:finmar:v:27:y:2018:i:2:p:49-86. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.