IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/22134.html
   My bibliography  Save this paper

Rethinking Performance Evaluation

Author

Listed:
  • Campbell R. Harvey
  • Yan Liu

Abstract

We show that the standard equation-by-equation OLS used in performance evaluation ignores information in the alpha population and leads to severely biased estimates for the alpha population. We propose a new framework that treats fund alphas as random effects. Our framework allows us to make inference on the alpha population while controlling for various sources of estimation risk. At the individual fund level, our method pools information from the entire alpha distribution to make density forecast for the fund's alpha, offering a new way to think about performance evaluation. In simulations, we show that our method generates parameter estimates that universally dominate the OLS estimates, both at the population and at the individual fund level. While it is generally accepted that few if any mutual funds outperform, we find that the fraction of funds that generate positive alphas is accurately estimated at over 10%. An out-of-sample forecasting exercise also shows that our method generates superior alpha forecasts.

Suggested Citation

  • Campbell R. Harvey & Yan Liu, 2016. "Rethinking Performance Evaluation," NBER Working Papers 22134, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:22134
    Note: AP
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w22134.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Peter Bickel & Bo Li & Alexandre Tsybakov & Sara Geer & Bin Yu & Teófilo Valdés & Carlos Rivero & Jianqing Fan & Aad Vaart, 2006. "Regularization in statistics," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 15(2), pages 271-344, September.
    2. Klaas P. Baks & Andrew Metrick & Jessica Wachter, 2001. "Should Investors Avoid All Actively Managed Mutual Funds? A Study in Bayesian Performance Evaluation," Journal of Finance, American Finance Association, vol. 56(1), pages 45-85, February.
    3. Laurent Barras & Olivier Scaillet & Russ Wermers, 2010. "False Discoveries in Mutual Fund Performance: Measuring Luck in Estimated Alphas," Journal of Finance, American Finance Association, vol. 65(1), pages 179-216, February.
    4. Randolph B. Cohen & Joshua D. Coval & Ľuboš Pástor, 2005. "Judging Fund Managers by the Company They Keep," Journal of Finance, American Finance Association, vol. 60(3), pages 1057-1096, June.
    5. Mark M. Carhart & Jennifer N. Carpenter & Anthony W. Lynch & David K. Musto, 2002. "Mutual Fund Survivorship," The Review of Financial Studies, Society for Financial Studies, vol. 15(5), pages 1439-1463.
    6. J. G. Booth & J. P. Hobert, 1999. "Maximizing generalized linear mixed model likelihoods with an automated Monte Carlo EM algorithm," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(1), pages 265-285.
    7. Jonathan B. Berk & Richard C. Green, 2004. "Mutual Fund Flows and Performance in Rational Markets," Journal of Political Economy, University of Chicago Press, vol. 112(6), pages 1269-1295, December.
    8. Avramov, Doron & Wermers, Russ, 2006. "Investing in mutual funds when returns are predictable," Journal of Financial Economics, Elsevier, vol. 81(2), pages 339-377, August.
    9. Brown, Stephen J, et al, 1992. "Survivorship Bias in Performance Studies," The Review of Financial Studies, Society for Financial Studies, vol. 5(4), pages 553-580.
    10. Eugene F. Fama & Kenneth R. French, 2010. "Luck versus Skill in the Cross‐Section of Mutual Fund Returns," Journal of Finance, American Finance Association, vol. 65(5), pages 1915-1947, October.
    11. Bekaert, Geert & Harvey, Campbell R, 1995. "Time-Varying World Market Integration," Journal of Finance, American Finance Association, vol. 50(2), pages 403-444, June.
    12. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    13. Richard B. Evans, 2010. "Mutual Fund Incubation," Journal of Finance, American Finance Association, vol. 65(4), pages 1581-1611, August.
    14. Edwin J. Elton & Martin J. Gruber & Christopher R. Blake, 2001. "A First Look at the Accuracy of the CRSP Mutual Fund Database and a Comparison of the CRSP and Morningstar Mutual Fund Databases," Journal of Finance, American Finance Association, vol. 56(6), pages 2415-2430, December.
    15. Jeffrey A. Busse & Paul J. Irvine, 2006. "Bayesian Alphas and Mutual Fund Persistence," Journal of Finance, American Finance Association, vol. 61(5), pages 2251-2288, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hamid Reza Mohammadi Ojan & Mohammad Karimi & Ebrahim Kardgar & Mehdi Ahrari, 2018. "The Extraction of Influencing Indicators for Scoring of Insurance Companies Branches Based on GMDH Neural Network," Iranian Economic Review (IER), Faculty of Economics,University of Tehran.Tehran,Iran, vol. 22(2), pages 527-556, Spring.
    2. Grønborg, Niels S. & Lunde, Asger & Timmermann, Allan & Wermers, Russ, 2021. "Picking funds with confidence," Journal of Financial Economics, Elsevier, vol. 139(1), pages 1-28.
    3. Naveed Ahmad Khan & Andrija Mihoci & Silke Michalk & Kirill Sarachuk & Hafiz Ali Javed, 2022. "Employee Performance Measures Appraised by Training and Labor Market: Evidence from the Banking Sector of Germany," Administrative Sciences, MDPI, vol. 12(4), pages 1-13, October.
    4. James W. Kolari & Jianhua Z. Huang & Wei Liu & Huiling Liao, 2022. "Further Tests of the ZCAPM Asset Pricing Model," JRFM, MDPI, vol. 15(3), pages 1-23, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. DeMiguel, Victor & Gil-Bazo, Javier & Nogales, Francisco J. & Santos, André A.P., 2023. "Machine learning and fund characteristics help to select mutual funds with positive alpha," Journal of Financial Economics, Elsevier, vol. 150(3).
    2. Elton, Edwin J. & Gruber, Martin J., 2013. "Mutual Funds," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1011-1061, Elsevier.
    3. Victor DeMiguel & Javier Gil-Bazo & Francisco J. Nogales & André A. P. Santos, 2021. "Can Machine Learning Help to Select Portfolios of Mutual Funds?," Working Papers 1245, Barcelona School of Economics.
    4. Omneya Abdelsalam & Meryem Duygun & Juan Carlos Matallín-Sáez & Emili Tortosa-Ausina, 2014. "Is Ethical Money Sensitive to Past Returns? The Case of Portfolio Constraints and Persistence of Islamic and Socially Responsible Funds," Working Papers 2014/19, Economics Department, Universitat Jaume I, Castellón (Spain).
    5. Omneya Abdelsalam & Meryem Duygun & Juan Carlos Matallín-Sáez & Emili Tortosa-Ausina, 2017. "Is Ethical Money Sensitive to Past Returns? The Case of Portfolio Constraints and Persistence in Islamic Funds," Journal of Financial Services Research, Springer;Western Finance Association, vol. 51(3), pages 363-384, June.
    6. Pástor, Ľuboš & Stambaugh, Robert F. & Taylor, Lucian A., 2015. "Scale and skill in active management," Journal of Financial Economics, Elsevier, vol. 116(1), pages 23-45.
    7. Fisher, Mark & Jensen, Mark J., 2022. "Bayesian nonparametric learning of how skill is distributed across the mutual fund industry," Journal of Econometrics, Elsevier, vol. 230(1), pages 131-153.
    8. Bianchi, Daniele & Babiak, Mykola, 2022. "On the performance of cryptocurrency funds," Journal of Banking & Finance, Elsevier, vol. 138(C).
    9. Pástor, Ľuboš & Stambaugh, Robert F. & Taylor, Lucian A., 2015. "Scale and skill in active management," Journal of Financial Economics, Elsevier, vol. 116(1), pages 23-45.
    10. Campbell R. Harvey & Yan Liu, 2020. "False (and Missed) Discoveries in Financial Economics," Papers 2006.04269, arXiv.org.
    11. Ferson, Wayne E., 2013. "Investment Performance: A Review and Synthesis," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 969-1010, Elsevier.
    12. Matallín-Sáez, Juan Carlos & Soler-Domínguez, Amparo & Tortosa-Ausina, Emili, 2016. "On the robustness of persistence in mutual fund performance," The North American Journal of Economics and Finance, Elsevier, vol. 36(C), pages 192-231.
    13. Yee Loon, 2011. "Model uncertainty, performance persistence and flows," Review of Quantitative Finance and Accounting, Springer, vol. 36(2), pages 153-205, February.
    14. Korteweg, Arthur & Sorensen, Morten, 2017. "Skill and luck in private equity performance," Journal of Financial Economics, Elsevier, vol. 124(3), pages 535-562.
    15. Gil-Bazo, Javier & Ruiz-Verdú, Pablo, 2006. "Yet another puzzle? the relation between price and performance in the mutual fund industry," DEE - Working Papers. Business Economics. WB wb066519, Universidad Carlos III de Madrid. Departamento de Economía de la Empresa.
    16. Harry Mamaysky & Matthew Spiegel & Hong Zhang, 2007. "Improved Forecasting of Mutual Fund Alphas and Betas," Review of Finance, European Finance Association, vol. 11(3), pages 359-400.
    17. Cai, Biqing & Cheng, Tingting & Yan, Cheng, 2018. "Time-varying skills (versus luck) in U.S. active mutual funds and hedge funds," Journal of Empirical Finance, Elsevier, vol. 49(C), pages 81-106.
    18. Huij, Joop & Verbeek, Marno, 2007. "Cross-sectional learning and short-run persistence in mutual fund performance," Journal of Banking & Finance, Elsevier, vol. 31(3), pages 973-997, March.
    19. Christiansen, Charlotte & Grønborg, Niels S. & Nielsen, Ole L., 2020. "Mutual fund selection for realistically short samples," Journal of Empirical Finance, Elsevier, vol. 55(C), pages 218-240.
    20. Y. Chung & Thomas Kim, 2015. "The win–loss ratio as an ability signal of mutual fund managers: a measure that is less influenced by luck," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 29(4), pages 301-335, November.

    More about this item

    JEL classification:

    • G10 - Financial Economics - - General Financial Markets - - - General (includes Measurement and Data)
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates
    • G14 - Financial Economics - - General Financial Markets - - - Information and Market Efficiency; Event Studies; Insider Trading
    • G23 - Financial Economics - - Financial Institutions and Services - - - Non-bank Financial Institutions; Financial Instruments; Institutional Investors

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:22134. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.