IDEAS home Printed from https://ideas.repec.org/p/jmp/jm2018/plo493.html
   My bibliography  Save this paper

On the backtesting of trading strategies

Author

Listed:
  • Yen H. Lok

Abstract

The contribution of this paper is two-fold. The first contribution is the development of a filter-combine scheme for trading strategies to diversify model risk. Multiple statistical machine learning models are used to predict the price direction of multiple assets. We demonstrate the effectiveness of model-averaging after under-performing models are removed via a filtering algorithm. The second contribution is the identification of appropriate measures of performance for selecting models. In the literature, different measures are usually designed for different applications and purposes, and it is not always clear as to whether certain measures are relevant to a particular trading strategy. By identifying relevant measures, one can identify the key drivers underlying well-performing models, and allocate more resources in optimising and improving the appropriate models.

Suggested Citation

  • Yen H. Lok, 2018. "On the backtesting of trading strategies," 2018 Papers plo493, Job Market Papers.
    • Handle: RePEc:jmp:jm2018:plo493
    as

    Download full text from publisher

    File URL: https://ideas.repec.org/jmp/2018/plo493.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Duan Li & Wan‐Lung Ng, 2000. "Optimal Dynamic Portfolio Selection: Multiperiod Mean‐Variance Formulation," Mathematical Finance, Wiley Blackwell, vol. 10(3), pages 387-406, July.
    2. Ledoit, Oliver & Wolf, Michael, 2008. "Robust performance hypothesis testing with the Sharpe ratio," Journal of Empirical Finance, Elsevier, vol. 15(5), pages 850-859, December.
    3. Jegadeesh, Narasimhan & Titman, Sheridan, 1993. "Returns to Buying Winners and Selling Losers: Implications for Stock Market Efficiency," Journal of Finance, American Finance Association, vol. 48(1), pages 65-91, March.
    4. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    5. Tashman, Leonard J., 2000. "Out-of-sample tests of forecasting accuracy: an analysis and review," International Journal of Forecasting, Elsevier, vol. 16(4), pages 437-450.
    6. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    7. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    8. Raffaella Giacomini & Barbara Rossi, 2010. "Forecast comparisons in unstable environments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 595-620.
    9. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qi Lin, 2020. "Idiosyncratic momentum and the cross‐section of stock returns: Further evidence," European Financial Management, European Financial Management Association, vol. 26(3), pages 579-627, June.
    2. Walkshäusl, Christian & Lobe, Sebastian, 2010. "Fundamental indexing around the world," Review of Financial Economics, Elsevier, vol. 19(3), pages 117-127, August.
    3. Christian Walkshäusl & Sebastian Lobe, 2010. "Fundamental indexing around the world," Review of Financial Economics, John Wiley & Sons, vol. 19(3), pages 117-127, August.
    4. Sebastian Lobe & Christian Walkshäusl, 2016. "Vice versus virtue investing around the world," Review of Managerial Science, Springer, vol. 10(2), pages 303-344, March.
    5. Zanetti Chini, Emilio, 2018. "Forecasting dynamically asymmetric fluctuations of the U.S. business cycle," International Journal of Forecasting, Elsevier, vol. 34(4), pages 711-732.
    6. Zaremba, Adam & Czapkiewicz, Anna, 2017. "The cross section of international government bond returns," Economic Modelling, Elsevier, vol. 66(C), pages 171-183.
    7. Marie Brière & Ariane Szafarz, 2021. "When it rains, it pours: Multifactor asset management in good and bad times," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 44(3), pages 641-669, September.
    8. David C. Ling & Andy Naranjo & Benjamin Scheick, 2014. "Investor Sentiment, Limits to Arbitrage and Private Market Returns," Real Estate Economics, American Real Estate and Urban Economics Association, vol. 42(3), pages 531-577, September.
    9. Caldeira, João F & Moura, Guilherme Valle & Santos, André Alves Portela, 2013. "Seleção de carteiras utilizando o modelo Fama-French-Carhart," Revista Brasileira de Economia - RBE, EPGE Brazilian School of Economics and Finance - FGV EPGE (Brazil), vol. 67(1), April.
    10. Cyril Bachelard & Apostolos Chalkis & Vissarion Fisikopoulos & Elias Tsigaridas, 2022. "Randomized geometric tools for anomaly detection in stock markets," Papers 2205.03852, arXiv.org, revised May 2022.
    11. Fortin, Alain-Philippe & Simonato, Jean-Guy & Dionne, Georges, 2023. "Forecasting expected shortfall: Should we use a multivariate model for stock market factors?," International Journal of Forecasting, Elsevier, vol. 39(1), pages 314-331.
    12. Flögel, Volker & Schlag, Christian & Zunft, Claudia, 2021. "Momentum-managed equity factors," SAFE Working Paper Series 317, Leibniz Institute for Financial Research SAFE.
    13. Massimiliano Caporin & Grégory M. Jannin & Francesco Lisi & Bertrand B. Maillet, 2014. "A Survey On The Four Families Of Performance Measures," Journal of Economic Surveys, Wiley Blackwell, vol. 28(5), pages 917-942, December.
    14. Gensler, André & Sick, Bernhard & Vogt, Stephan, 2018. "A review of uncertainty representations and metaverification of uncertainty assessment techniques for renewable energies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 96(C), pages 352-379.
    15. Ardia, David & Boudt, Kris, 2018. "The peer performance ratios of hedge funds," Journal of Banking & Finance, Elsevier, vol. 87(C), pages 351-368.
    16. Long, Huaigang & Zaremba, Adam & Zhou, Wenyu & Bouri, Elie, 2022. "Macroeconomics matter: Leading economic indicators and the cross-section of global stock returns," Journal of Financial Markets, Elsevier, vol. 61(C).
    17. Botshekan, Mahmoud & Kraeussl, Roman & Lucas, Andre, 2012. "Cash Flow and Discount Rate Risk in Up and Down Markets: What Is Actually Priced?," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 47(6), pages 1279-1301, December.
    18. Goetzmann, William N. & Huang, Simon, 2018. "Momentum in Imperial Russia," Journal of Financial Economics, Elsevier, vol. 130(3), pages 579-591.
    19. Cyril Bachelard & Apostolos Chalkis & Vissarion Fisikopoulos & Elias Tsigaridas, 2024. "Randomized Control in Performance Analysis and Empirical Asset Pricing," Papers 2403.00009, arXiv.org.
    20. Malte Knüppel & Guido Schultefrankenfeld, 2017. "Interest rate assumptions and predictive accuracy of central bank forecasts," Empirical Economics, Springer, vol. 53(1), pages 195-215, August.

    More about this item

    JEL classification:

    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jmp:jm2018:plo493. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePEc Team (email available below). General contact details of provider: https://ideas.repec.org/jmp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.