IDEAS home Printed from https://ideas.repec.org/a/spr/alstar/v96y2012i3p343-383.html
   My bibliography  Save this article

Multiple tests for the performance of different investment strategies

Author

Listed:
  • Gabriel Frahm
  • Tobias Wickern
  • Christof Wiechers

Abstract

In the context of modern portfolio theory, we compare the out-of-sample performance of eight investment strategies which are based on statistical methods with the out-of-sample performance of a family of trivial strategies. A wide range of approaches is considered in this work, including the traditional sample-based approach, several minimum-variance techniques, a shrinkage, and a minimax approach. In contrast to similar studies in the literature, we also consider short-selling constraints and a risk-free asset. We provide a way to extend the concept of minimum-variance strategies in the context of short-selling constraints. A main drawback of most empirical studies on that topic is the use of simple testing procedures which do not account for the effects of multiple testing. For that reason we conduct several hypothesis tests which are proposed in the multiple-testing literature. We test whether it is possible to beat a trivial strategy by at least one of the non-trivial strategies, whether the trivial strategy is better than every non-trivial strategy, and which of the non-trivial strategies is significantly outperformed by naive diversification. The empirical part of our study is conducted using US stock returns from the last four decades, obtained via the CRSP database. Copyright Springer-Verlag 2012

Suggested Citation

  • Gabriel Frahm & Tobias Wickern & Christof Wiechers, 2012. "Multiple tests for the performance of different investment strategies," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 96(3), pages 343-383, July.
  • Handle: RePEc:spr:alstar:v:96:y:2012:i:3:p:343-383
    DOI: 10.1007/s10182-011-0166-1
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10182-011-0166-1
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s10182-011-0166-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joseph P. Romano & Michael Wolf, 2005. "Stepwise Multiple Testing as Formalized Data Snooping," Econometrica, Econometric Society, vol. 73(4), pages 1237-1282, July.
    2. Klein, Roger W. & Bawa, Vijay S., 1976. "The effect of estimation risk on optimal portfolio choice," Journal of Financial Economics, Elsevier, vol. 3(3), pages 215-231, June.
    3. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    4. Kan, Raymond & Zhou, Guofu, 2007. "Optimal Portfolio Choice with Parameter Uncertainty," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 42(3), pages 621-656, September.
    5. Romano, Joseph P. & Shaikh, Azeem M. & Wolf, Michael, 2008. "Formalized Data Snooping Based On Generalized Error Rates," Econometric Theory, Cambridge University Press, vol. 24(2), pages 404-447, April.
    6. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    7. Sebastián Ceria & Robert A Stubbs, 2006. "Incorporating estimation errors into portfolio selection: Robust portfolio construction," Journal of Asset Management, Palgrave Macmillan, vol. 7(2), pages 109-127, July.
    8. Kalymon, Basil A., 1971. "Estimation Risk in the Portfolio Selection Model," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 6(1), pages 559-582, January.
    9. Ledoit, Oliver & Wolf, Michael, 2008. "Robust performance hypothesis testing with the Sharpe ratio," Journal of Empirical Finance, Elsevier, vol. 15(5), pages 850-859, December.
    10. Alexander Kempf & Christoph Memmel, 2006. "Estimating the global Minimum Variance Portfolio," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 58(4), pages 332-348, October.
    11. Frahm, Gabriel & Memmel, Christoph, 2008. "Dominating estimators for the global minimum variance portfolio," Discussion Papers in Econometrics and Statistics 2/08, University of Cologne, Institute of Econometrics and Statistics.
    12. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    13. repec:bla:jfinan:v:58:y:2003:i:4:p:1651-1684 is not listed on IDEAS
    14. Lorenzo Garlappi & Raman Uppal & Tan Wang, 2007. "Portfolio Selection with Parameter and Model Uncertainty: A Multi-Prior Approach," The Review of Financial Studies, Society for Financial Studies, vol. 20(1), pages 41-81, January.
    15. Jobson, J D & Korkie, Bob M, 1981. "Performance Hypothesis Testing with the Sharpe and Treynor Measures," Journal of Finance, American Finance Association, vol. 36(4), pages 889-908, September.
    16. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    17. D. Goldfarb & G. Iyengar, 2003. "Robust Portfolio Selection Problems," Mathematics of Operations Research, INFORMS, vol. 28(1), pages 1-38, February.
    18. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    19. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    20. J. Tobin, 1958. "Liquidity Preference as Behavior Towards Risk," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 25(2), pages 65-86.
    21. Andrews, Donald W K & Monahan, J Christopher, 1992. "An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 60(4), pages 953-966, July.
    22. Jorion, Philippe, 1986. "Bayes-Stein Estimation for Portfolio Analysis," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 21(3), pages 279-292, September.
    23. Frahm, Gabriel, 2007. "Testing for the best alternative with an application to performance measurement," Discussion Papers in Econometrics and Statistics 7/07, University of Cologne, Institute of Econometrics and Statistics.
    24. Bade, Alexander & Frahm, Gabriel & Jaekel, Uwe, 2008. "A general approach to Bayesian portfolio optimization," Discussion Papers in Econometrics and Statistics 1/08, University of Cologne, Institute of Econometrics and Statistics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. A. Burak Paç & Mustafa Ç. Pınar, 2018. "On robust portfolio and naïve diversification: mixing ambiguous and unambiguous assets," Annals of Operations Research, Springer, vol. 266(1), pages 223-253, July.
    2. Gabriel Frahm, 2015. "A theoretical foundation of portfolio resampling," Theory and Decision, Springer, vol. 79(1), pages 107-132, July.
    3. Gabriel Frahm, 2018. "An Intersection–Union Test for the Sharpe Ratio," Risks, MDPI, vol. 6(2), pages 1-13, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michele Costola & Bertrand Maillet & Zhining Yuan & Xiang Zhang, 2024. "Mean–variance efficient large portfolios: a simple machine learning heuristic technique based on the two-fund separation theorem," Annals of Operations Research, Springer, vol. 334(1), pages 133-155, March.
    2. André Alves Portela Santos, 2010. "The Out-of-Sample Performance of Robust Portfolio Optimization," Brazilian Review of Finance, Brazilian Society of Finance, vol. 8(2), pages 141-166.
    3. DeMiguel, Victor & Martin-Utrera, Alberto & Nogales, Francisco J., 2013. "Size matters: Optimal calibration of shrinkage estimators for portfolio selection," Journal of Banking & Finance, Elsevier, vol. 37(8), pages 3018-3034.
    4. Yuanyuan Zhang & Xiang Li & Sini Guo, 2018. "Portfolio selection problems with Markowitz’s mean–variance framework: a review of literature," Fuzzy Optimization and Decision Making, Springer, vol. 17(2), pages 125-158, June.
    5. Hsu, Po-Hsuan & Han, Qiheng & Wu, Wensheng & Cao, Zhiguang, 2018. "Asset allocation strategies, data snooping, and the 1 / N rule," Journal of Banking & Finance, Elsevier, vol. 97(C), pages 257-269.
    6. Behr, Patrick & Guettler, Andre & Truebenbach, Fabian, 2012. "Using industry momentum to improve portfolio performance," Journal of Banking & Finance, Elsevier, vol. 36(5), pages 1414-1423.
    7. repec:hal:journl:peer-00741629 is not listed on IDEAS
    8. Schanbacher Peter, 2015. "Averaging Across Asset Allocation Models," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 235(1), pages 61-81, February.
    9. Istvan Varga-Haszonits & Fabio Caccioli & Imre Kondor, 2016. "Replica approach to mean-variance portfolio optimization," Papers 1606.08679, arXiv.org.
    10. Kourtis, Apostolos & Dotsis, George & Markellos, Raphael N., 2012. "Parameter uncertainty in portfolio selection: Shrinking the inverse covariance matrix," Journal of Banking & Finance, Elsevier, vol. 36(9), pages 2522-2531.
    11. Caner, Mehmet & Medeiros, Marcelo & Vasconcelos, Gabriel F.R., 2023. "Sharpe Ratio analysis in high dimensions: Residual-based nodewise regression in factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 393-417.
    12. Frahm, Gabriel, 2010. "An analytical investigation of estimators for expected asset returns from the perspective of optimal asset allocation," Discussion Papers in Econometrics and Statistics 1/10, University of Cologne, Institute of Econometrics and Statistics.
    13. Kellerer, Belinda, 2019. "Portfolio Optimization and Ambiguity Aversion," Junior Management Science (JUMS), Junior Management Science e. V., vol. 4(3), pages 305-338.
    14. Varga-Haszonits, Istvan & Caccioli, Fabio & Kondor, Imre, 2016. "Replica approach to mean-variance portfolio optimization," LSE Research Online Documents on Economics 68955, London School of Economics and Political Science, LSE Library.
    15. Miguel, Victor de & Nogales, Francisco J., 2013. "Parameter uncertainty in multiperiod portfolio optimization with transaction costs," DES - Working Papers. Statistics and Econometrics. WS ws132119, Universidad Carlos III de Madrid. Departamento de Estadística.
    16. Han, Chulwoo, 2020. "A nonparametric approach to portfolio shrinkage," Journal of Banking & Finance, Elsevier, vol. 120(C).
    17. Frank Fabozzi & Dashan Huang & Guofu Zhou, 2010. "Robust portfolios: contributions from operations research and finance," Annals of Operations Research, Springer, vol. 176(1), pages 191-220, April.
    18. Joo, Young C. & Park, Sung Y., 2021. "Optimal portfolio selection using a simple double-shrinkage selection rule," Finance Research Letters, Elsevier, vol. 43(C).
    19. Wickern, Tobias, 2011. "Confidence in prior knowledge: Calibration and impact on portfolio performance," Discussion Papers in Econometrics and Statistics 7/11, University of Cologne, Institute of Econometrics and Statistics.
    20. Olivier Ledoit & Michael Wolf, 2018. "Robust performance hypothesis testing with smooth functions of population moments," ECON - Working Papers 305, Department of Economics - University of Zurich.
    21. Michael Wolf & Dan Wunderli, 2009. "Fund-of-funds construction by statistical multiple testing methods," IEW - Working Papers 445, Institute for Empirical Research in Economics - University of Zurich.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:alstar:v:96:y:2012:i:3:p:343-383. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.