IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v183y2014i2p202-210.html
   My bibliography  Save this article

Improved inference in the evaluation of mutual fund performance using panel bootstrap methods

Author

Listed:
  • Blake, David
  • Caulfield, Tristan
  • Ioannidis, Christos
  • Tonks, Ian

Abstract

Two new methodologies are introduced to improve inference in the evaluation of mutual fund performance against benchmarks. First, the benchmark models are estimated using panel methods with both fund and time effects. Second, the non-normality of individual mutual fund returns is accounted for by using panel bootstrap methods. We also augment the standard benchmark factors with fund-specific characteristics, such as fund size. Using a dataset of UK equity mutual fund returns, we find that fund size has a negative effect on the average fund manager’s benchmark-adjusted performance. Further, when we allow for time effects and the non-normality of fund returns, we find that there is no evidence that even the best performing fund managers can significantly out-perform the augmented benchmarks after fund management charges are taken into account.

Suggested Citation

  • Blake, David & Caulfield, Tristan & Ioannidis, Christos & Tonks, Ian, 2014. "Improved inference in the evaluation of mutual fund performance using panel bootstrap methods," Journal of Econometrics, Elsevier, vol. 183(2), pages 202-210.
  • Handle: RePEc:eee:econom:v:183:y:2014:i:2:p:202-210
    DOI: 10.1016/j.jeconom.2014.05.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407614001134
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2014.05.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yan, Xuemin (Sterling), 2008. "Liquidity, Investment Style, and the Relation between Fund Size and Fund Performance," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 43(3), pages 741-767, September.
    2. Michael C. Jensen, 1968. "The Performance Of Mutual Funds In The Period 1945–1964," Journal of Finance, American Finance Association, vol. 23(2), pages 389-416, May.
    3. Lauren Cohen & Andrea Frazzini & Christopher Malloy, 2008. "The Small World of Investing: Board Connections and Mutual Fund Returns," Journal of Political Economy, University of Chicago Press, vol. 116(5), pages 951-979, October.
    4. Henriksson, Roy D & Merton, Robert C, 1981. "On Market Timing and Investment Performance. II. Statistical Procedures for Evaluating Forecasting Skills," The Journal of Business, University of Chicago Press, vol. 54(4), pages 513-533, October.
    5. A. Bhargava & L. Franzini & W. Narendranathan, 2006. "Serial Correlation and the Fixed Effects Model," World Scientific Book Chapters, in: Econometrics, Statistics And Computational Approaches In Food And Health Sciences, chapter 4, pages 61-77, World Scientific Publishing Co. Pte. Ltd..
    6. David Blake & Allan Timmermann, 1998. "Mutual Fund Performance: Evidence from the UK," Review of Finance, European Finance Association, vol. 2(1), pages 57-77.
    7. Laurent Barras & Olivier Scaillet & Russ Wermers, 2010. "False Discoveries in Mutual Fund Performance: Measuring Luck in Estimated Alphas," Journal of Finance, American Finance Association, vol. 65(1), pages 179-216, February.
    8. Keim, Donald B. & Madhavan, Ananth, 1995. "Anatomy of the trading process Empirical evidence on the behavior of institutional traders," Journal of Financial Economics, Elsevier, vol. 37(3), pages 371-398, March.
    9. Elton, Edwin J & Gruber, Martin J & Blake, Christopher R, 1996. "Survivorship Bias and Mutual Fund Performance," The Review of Financial Studies, Society for Financial Studies, vol. 9(4), pages 1097-1120.
    10. Mitchell A. Petersen, 2009. "Estimating Standard Errors in Finance Panel Data Sets: Comparing Approaches," The Review of Financial Studies, Society for Financial Studies, vol. 22(1), pages 435-480, January.
    11. Judith Chevalier & Glenn Ellison, 1999. "Are Some Mutual Fund Managers Better Than Others? Cross‐Sectional Patterns in Behavior and Performance," Journal of Finance, American Finance Association, vol. 54(3), pages 875-899, June.
    12. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    13. repec:bla:jfinan:v:53:y:1998:i:5:p:1589-1622 is not listed on IDEAS
    14. Judith Chevalier & Glenn Ellison, 1999. "Career Concerns of Mutual Fund Managers," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 389-432.
    15. Jonathan B. Berk & Richard C. Green, 2004. "Mutual Fund Flows and Performance in Rational Markets," Journal of Political Economy, University of Chicago Press, vol. 112(6), pages 1269-1295, December.
    16. Jinyong Hahn & Guido Kuersteiner, 2002. "Asymptotically Unbiased Inference for a Dynamic Panel Model with Fixed Effects when Both "n" and "T" Are Large," Econometrica, Econometric Society, vol. 70(4), pages 1639-1657, July.
    17. Joseph Chen & Harrison Hong & Wenxi Jiang & Jeffrey D. Kubik, 2013. "Outsourcing Mutual Fund Management: Firm Boundaries, Incentives, and Performance," Journal of Finance, American Finance Association, vol. 68(2), pages 523-558, April.
    18. Malkiel, Burton G, 1995. "Returns from Investing in Equity Mutual Funds 1971 to 1991," Journal of Finance, American Finance Association, vol. 50(2), pages 549-572, June.
    19. Carpenter, Jennifer N. & Lynch, Anthony W., 1999. "Survivorship bias and attrition effects in measures of performance persistence," Journal of Financial Economics, Elsevier, vol. 54(3), pages 337-374, December.
    20. Harrison Hong & Jeffrey D. Kubik & Jeremy C. Stein, 2005. "Thy Neighbor's Portfolio: Word‐of‐Mouth Effects in the Holdings and Trades of Money Managers," Journal of Finance, American Finance Association, vol. 60(6), pages 2801-2824, December.
    21. Ferson, Wayne E & Schadt, Rudi W, 1996. "Measuring Fund Strategy and Performance in Changing Economic Conditions," Journal of Finance, American Finance Association, vol. 51(2), pages 425-461, June.
    22. Joseph Chen & Harrison Hong & Ming Huang & Jeffrey D. Kubik, 2004. "Does Fund Size Erode Mutual Fund Performance? The Role of Liquidity and Organization," American Economic Review, American Economic Association, vol. 94(5), pages 1276-1302, December.
    23. Alan Gregory & Rajesh Tharyan & Angela Christidis, 2013. "Constructing and Testing Alternative Versions of the Fama–French and Carhart Models in the UK," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 40(1-2), pages 172-214, January.
    24. David Blake & Alberto G. Rossi & Allan Timmermann & Ian Tonks & Russ Wermers, 2013. "Decentralized Investment Management: Evidence from the Pension Fund Industry," Journal of Finance, American Finance Association, vol. 68(3), pages 1133-1178, June.
    25. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    26. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    27. Robert Kosowski & Allan Timmermann & Russ Wermers & Hal White, 2006. "Can Mutual Fund “Stars” Really Pick Stocks? New Evidence from a Bootstrap Analysis," Journal of Finance, American Finance Association, vol. 61(6), pages 2551-2595, December.
    28. G. Kapetanios, 2008. "A bootstrap procedure for panel data sets with many cross-sectional units," Econometrics Journal, Royal Economic Society, vol. 11(2), pages 377-395, July.
    29. Cuthbertson, Keith & Nitzsche, Dirk & O'Sullivan, Niall, 2008. "UK mutual fund performance: Skill or luck?," Journal of Empirical Finance, Elsevier, vol. 15(4), pages 613-634, September.
    30. Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-1426, November.
    31. Vikram Nanda, 2004. "Family Values and the Star Phenomenon: Strategies of Mutual Fund Families," The Review of Financial Studies, Society for Financial Studies, vol. 17(3), pages 667-698.
    32. Fama, Eugene F & MacBeth, James D, 1973. "Risk, Return, and Equilibrium: Empirical Tests," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 607-636, May-June.
    33. Alok Bhargava, 2006. "Wald Tests And Systems Of Stochastic Equations," World Scientific Book Chapters, in: Econometrics, Statistics And Computational Approaches In Food And Health Sciences, chapter 2, pages 29-48, World Scientific Publishing Co. Pte. Ltd..
    34. Eugene F. Fama & Kenneth R. French, 2010. "Luck versus Skill in the Cross‐Section of Mutual Fund Returns," Journal of Finance, American Finance Association, vol. 65(5), pages 1915-1947, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Artamonov, Nikita & Voronina, Anna & Emelyanov, Nikita & Kurbatskii, Aleksei, 2020. "Estimation of interest rates’ impact on mutual funds’ performance in the USA," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 58, pages 55-75.
    2. Cai, Biqing & Cheng, Tingting & Yan, Cheng, 2018. "Time-varying skills (versus luck) in U.S. active mutual funds and hedge funds," Journal of Empirical Finance, Elsevier, vol. 49(C), pages 81-106.
    3. Lazzarino, Marco & Berrill, Jenny & Šević, Aleksandar, 2022. "The importance of distinguishing between precious and industrial metals when investing in mining stocks," Resources Policy, Elsevier, vol. 78(C).
    4. Jiti Gao & Bin Peng & Yayi Yan, 2022. "Higher-order Expansions and Inference for Panel Data Models," Papers 2205.00577, arXiv.org, revised Jun 2023.
    5. Emmanuel Mamatzakis & Mike G. Tsionas, 2021. "Testing for persistence in US mutual funds’ performance: a Bayesian dynamic panel model," Annals of Operations Research, Springer, vol. 299(1), pages 1203-1233, April.
    6. Christiansen, Charlotte & Grønborg, Niels S. & Nielsen, Ole L., 2020. "Mutual fund selection for realistically short samples," Journal of Empirical Finance, Elsevier, vol. 55(C), pages 218-240.
    7. Cheng, Tingting & Yan, Cheng & Yan, Yayi, 2021. "Improved inference for fund alphas using high-dimensional cross-sectional tests," Journal of Empirical Finance, Elsevier, vol. 61(C), pages 57-81.
    8. Emmanuel Mamatzakis & Mike Tsionas, 2018. "A Bayesian dynamic model to test persistence in funds' performance," Working Paper series 18-23, Rimini Centre for Economic Analysis.
    9. Jiti Gao & Bin Peng & Yayi Yan, 2022. "A Simple Bootstrap Method for Panel Data Inferences," Monash Econometrics and Business Statistics Working Papers 7/22, Monash University, Department of Econometrics and Business Statistics.
    10. Wolfgang Bessler & David Blake & Peter Lückoff & Ian Tonks, 2018. "Fund Flows, Manager Changes, and Performance Persistence [Does motivation matter when assessing trade performance? An analysis of mutual funds]," Review of Finance, European Finance Association, vol. 22(5), pages 1911-1947.
    11. Cheng, Tingting & Yan, Cheng, 2017. "Evaluating the size of the bootstrap method for fund performance evaluation," Economics Letters, Elsevier, vol. 156(C), pages 36-41.
    12. Abramov, Alexander (Абрамов, Александр) & Akshentseva, Kseniya (Акшенцева, Ксения) & Radygin, Alexander (Радыгин, Александр), 2015. "The effectiveness of mutual funds: theoretical approaches and the experience of Russia [Эффективность Паевых Инвестиционных Фондов: Теоретические Подходы И Опыт России]," Ekonomicheskaya Politika / Economic Policy, Russian Presidential Academy of National Economy and Public Administration, vol. 4, pages 60-86.
    13. Huazhu Zhang & Cheng Yan, 2018. "A skeptical appraisal of the bootstrap approach in fund performance evaluation," Financial Markets, Institutions & Instruments, John Wiley & Sons, vol. 27(2), pages 49-86, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cuthbertson, Keith & Nitzsche, Dirk, 2013. "Performance, stock selection and market timing of the German equity mutual fund industry," Journal of Empirical Finance, Elsevier, vol. 21(C), pages 86-101.
    2. Cuthbertson, Keith & Nitzsche, Dirk & O'Sullivan, Niall, 2016. "A review of behavioural and management effects in mutual fund performance," International Review of Financial Analysis, Elsevier, vol. 44(C), pages 162-176.
    3. Wolfgang Bessler & Thomas Conlon & Diego Víctor de Mingo‐López & Juan Carlos Matallín‐Sáez, 2022. "Mutual fund performance and changes in factor exposure," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 45(1), pages 17-52, March.
    4. Cuthbertson, Keith & Nitzsche, Dirk & O'Sullivan, Niall, 2008. "UK mutual fund performance: Skill or luck?," Journal of Empirical Finance, Elsevier, vol. 15(4), pages 613-634, September.
    5. Elton, Edwin J. & Gruber, Martin J., 2013. "Mutual Funds," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1011-1061, Elsevier.
    6. Andrew Clare & Mariana Clare, 2019. "An examination of ex ante fund performance: identifying indicators of future performance," Journal of Asset Management, Palgrave Macmillan, vol. 20(3), pages 175-195, May.
    7. Alda, Mercedes & Andreu, Laura & Sarto, José Luis, 2017. "Learning about individual managers’ performance in UK pension funds: The importance of specialization," The North American Journal of Economics and Finance, Elsevier, vol. 42(C), pages 654-667.
    8. Cujean, Julien, 2018. "Idea Sharing and the Performance of Mutual Funds," CEPR Discussion Papers 13111, C.E.P.R. Discussion Papers.
    9. Keith Pilbeam & Hamish Preston, 2019. "An Empirical Investigation of the Performance of Japanese Mutual Funds: Skill or Luck?," IJFS, MDPI, vol. 7(1), pages 1-16, January.
    10. Vidal-García, Javier & Vidal, Marta & Boubaker, Sabri & Uddin, Gazi Salah, 2016. "The short-term persistence of international mutual fund performance," Economic Modelling, Elsevier, vol. 52(PB), pages 926-938.
    11. Cujean, Julien, 2020. "Idea sharing and the performance of mutual funds," Journal of Financial Economics, Elsevier, vol. 135(1), pages 88-119.
    12. Ľuboš Pástor & Robert F. Stambaugh & Lucian A. Taylor, 2017. "Do Funds Make More When They Trade More?," Journal of Finance, American Finance Association, vol. 72(4), pages 1483-1528, August.
    13. Pástor, Ľuboš & Stambaugh, Robert F. & Taylor, Lucian A., 2015. "Scale and skill in active management," Journal of Financial Economics, Elsevier, vol. 116(1), pages 23-45.
    14. Pástor, Ľuboš & Stambaugh, Robert F. & Taylor, Lucian A., 2015. "Scale and skill in active management," Journal of Financial Economics, Elsevier, vol. 116(1), pages 23-45.
    15. Campbell R. Harvey & Yan Liu, 2020. "False (and Missed) Discoveries in Financial Economics," Papers 2006.04269, arXiv.org.
    16. Huazhu Zhang & Cheng Yan, 2018. "A skeptical appraisal of the bootstrap approach in fund performance evaluation," Financial Markets, Institutions & Instruments, John Wiley & Sons, vol. 27(2), pages 49-86, May.
    17. Ferson, Wayne E., 2013. "Investment Performance: A Review and Synthesis," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 969-1010, Elsevier.
    18. Mason, Andrew & Agyei-Ampomah, Sam & Skinner, Frank, 2016. "Realism, skill, and incentives: Current and future trends in investment management and investment performance," International Review of Financial Analysis, Elsevier, vol. 43(C), pages 31-40.
    19. Stein, Roberto, 2023. "Are mutual fund managers good gamblers?," Journal of Financial Markets, Elsevier, vol. 64(C).
    20. Yi, Li & He, Lei, 2016. "False discoveries in style timing of Chinese mutual funds," Pacific-Basin Finance Journal, Elsevier, vol. 38(C), pages 194-208.

    More about this item

    Keywords

    Mutual funds; Unit trusts; Open-ended investment companies; Performance measurement; Factor benchmark models; Panel methods; Bootstrap methods;
    All these keywords.

    JEL classification:

    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G23 - Financial Economics - - Financial Institutions and Services - - - Non-bank Financial Institutions; Financial Instruments; Institutional Investors

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:183:y:2014:i:2:p:202-210. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.