IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/3001.html
   My bibliography  Save this paper

Data-Snooping Biases in Tests of Financial Asset Pricing Models

Author

Listed:
  • Andrew W. Lo
  • A. Craig MacKinlay

Abstract

We investigate the extent to which tests of financial asset pricing models may be biased by using properties of the data to construct the test statistics. Specifically, we focus on tests using returns to portfolios of common stock where portfolios are constructed by sorting on some empirically motivated characteristic of the securities such as market value of equity. We present both analytical calculations and Monte Carlo simulations that show the effects of this type of data-snooping to be substantial. Even when the sorting characteristic is only marginally correlated with individual security statistics, 5 percent tests based on sorted portfolio returns may reject with probability one under the null hypothesis. This bias is shown to worsen as the number of securities increases given a fixed number of portfolios, and as the number of portfolios decreases given a fixed number of securities. We provide an empirical example that illustrates the practical relevance of these biases.

Suggested Citation

  • Andrew W. Lo & A. Craig MacKinlay, 1989. "Data-Snooping Biases in Tests of Financial Asset Pricing Models," NBER Working Papers 3001, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:3001
    Note: ME
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w3001.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Huberman, Gur & Kandel, Shmuel & Stambaugh, Robert F, 1987. "Mimicking Portfolios and Exact Arbitrage Pricing," Journal of Finance, American Finance Association, vol. 42(1), pages 1-9, March.
    2. Huberman, Gur & Kandel, Shmuel, 1987. "Mean-Variance Spanning," Journal of Finance, American Finance Association, vol. 42(4), pages 873-888, September.
    3. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    4. Shanken, Jay, 1985. "Multivariate tests of the zero-beta CAPM," Journal of Financial Economics, Elsevier, vol. 14(3), pages 327-348, September.
    5. Banz, Rolf W., 1981. "The relationship between return and market value of common stocks," Journal of Financial Economics, Elsevier, vol. 9(1), pages 3-18, March.
    6. Gibbons, Michael R & Ross, Stephen A & Shanken, Jay, 1989. "A Test of the Efficiency of a Given Portfolio," Econometrica, Econometric Society, vol. 57(5), pages 1121-1152, September.
    7. Blume, Marshall E, 1970. "Portfolio Theory: A Step Toward Its Practical Application," The Journal of Business, University of Chicago Press, vol. 43(2), pages 152-173, April.
    8. Chamberlain, Gary, 1983. "Funds, Factors, and Diversification in Arbitrage Pricing Models," Econometrica, Econometric Society, vol. 51(5), pages 1305-1323, September.
    9. Connor, Gregory & Korajczyk, Robert A., 1988. "Risk and return in an equilibrium APT : Application of a new test methodology," Journal of Financial Economics, Elsevier, vol. 21(2), pages 255-289, September.
    10. Fama, Eugene F & MacBeth, James D, 1973. "Risk, Return, and Equilibrium: Empirical Tests," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 607-636, May-June.
    11. Merton, Robert C., 1985. "On the current state of the stock market rationality hypothesis," Working papers 1717-85., Massachusetts Institute of Technology (MIT), Sloan School of Management.
    12. repec:bla:jfinan:v:43:y:1988:i:2:p:309-25 is not listed on IDEAS
    13. Josef Lakonishok, Seymour Smidt, 1988. "Are Seasonal Anomalies Real? A Ninety-Year Perspective," The Review of Financial Studies, Society for Financial Studies, vol. 1(4), pages 403-425.
    14. Kandel, Shmuel & Stambaugh, Robert F., 1987. "On correlations and inferences about mean-variance efficiency," Journal of Financial Economics, Elsevier, vol. 18(1), pages 61-90, March.
    15. Lehmann, Bruce N. & Modest, David M., 1988. "The empirical foundations of the arbitrage pricing theory," Journal of Financial Economics, Elsevier, vol. 21(2), pages 213-254, September.
    16. Arne Sandström, 1987. "Asymptotic normality of linear functions of concomitants of order statistics," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 34(1), pages 129-142, December.
    17. Chen, Nai-Fu & Roll, Richard & Ross, Stephen A, 1986. "Economic Forces and the Stock Market," The Journal of Business, University of Chicago Press, vol. 59(3), pages 383-403, July.
    18. MacKinlay, A. Craig, 1987. "On multivariate tests of the CAPM," Journal of Financial Economics, Elsevier, vol. 18(2), pages 341-371, June.
    19. Gibbons, Michael R., 1982. "Multivariate tests of financial models : A new approach," Journal of Financial Economics, Elsevier, vol. 10(1), pages 3-27, March.
    20. Brown, Philip & Kleidon, Allan W. & Marsh, Terry A., 1983. "New evidence on the nature of size-related anomalies in stock prices," Journal of Financial Economics, Elsevier, vol. 12(1), pages 33-56, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. MacKinlay, A. Craig, 1995. "Multifactor models do not explain deviations from the CAPM," Journal of Financial Economics, Elsevier, vol. 38(1), pages 3-28, May.
    2. Shanken, Jay & Weinstein, Mark I., 2006. "Economic forces and the stock market revisited," Journal of Empirical Finance, Elsevier, vol. 13(2), pages 129-144, March.
    3. Fernando Rubio, 2005. "Eficiencia De Mercado, Administracion De Carteras De Fondos Y Behavioural Finance," Finance 0503028, University Library of Munich, Germany, revised 23 Jul 2005.
    4. A. Craig MacKinlay, 1994. "Multifactor Models Do Not Explain Deviations from the CAPM," NBER Working Papers 4756, National Bureau of Economic Research, Inc.
    5. Enrique Sentana, 1993. "The econometrics of the stock market II: asset pricing," Investigaciones Economicas, Fundación SEPI, vol. 17(3), pages 421-444, September.
    6. Amit Goyal, 2012. "Empirical cross-sectional asset pricing: a survey," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 26(1), pages 3-38, March.
    7. Attiya Y. Javed, 2000. "Alternative Capital Asset Pricing Models: A Review of Theory and Evidence," PIDE-Working Papers 2000:179, Pakistan Institute of Development Economics.
    8. Zura Kakushadze, 2014. "4-Factor Model for Overnight Returns," Papers 1410.5513, arXiv.org, revised Jun 2015.
    9. Wayne E. Ferson & Campbell R. Harvey, 1999. "Conditioning Variables and the Cross Section of Stock Returns," Journal of Finance, American Finance Association, vol. 54(4), pages 1325-1360, August.
    10. Harvey, Campbell R, 1995. "Predictable Risk and Returns in Emerging Markets," The Review of Financial Studies, Society for Financial Studies, vol. 8(3), pages 773-816.
    11. Zura Kakushadze & Willie Yu, 2016. "Multifactor Risk Models and Heterotic CAPM," Papers 1602.04902, arXiv.org, revised Mar 2016.
    12. Jagannathan, Ravi & Wang, Zhenyu, 1996. "The Conditional CAPM and the Cross-Section of Expected Returns," Journal of Finance, American Finance Association, vol. 51(1), pages 3-53, March.
    13. Erdinc Altay, 2003. "The Effect of Macroeconomic Factors on Asset Returns: A Comparative Analysis of the German and the Turkish Stock Markets in an APT Framework," Finance 0307006, University Library of Munich, Germany.
    14. Zura Kakushadze & Jim Kyung-Soo Liew, 2015. "Custom v. Standardized Risk Models," Risks, MDPI, vol. 3(2), pages 1-27, May.
    15. Lo, Andrew W. & Mackinlay, A. Craig, 1997. "Maximizing Predictability In The Stock And Bond Markets," Macroeconomic Dynamics, Cambridge University Press, vol. 1(1), pages 102-134, January.
    16. Brennan, Michael J. & Chordia, Tarun & Subrahmanyam, Avanidhar, 1998. "Alternative factor specifications, security characteristics, and the cross-section of expected stock returns," Journal of Financial Economics, Elsevier, vol. 49(3), pages 345-373, September.
    17. Ericsson, Johan & Karlsson, Sune, 2003. "Choosing Factors in a Multifactor Asset Pricing Model: A Bayesian Approach," SSE/EFI Working Paper Series in Economics and Finance 524, Stockholm School of Economics, revised 12 Feb 2004.
    18. Choi, Yoon K., 1995. "The sensitivity in tests of the efficiency of a portfolio and portfolio performance measurement," The Quarterly Review of Economics and Finance, Elsevier, vol. 35(2), pages 187-206.
    19. Grauer, Robert R. & Janmaat, Johannus A., 2009. "On the power of cross-sectional and multivariate tests of the CAPM," Journal of Banking & Finance, Elsevier, vol. 33(5), pages 775-787, May.
    20. Zura Kakushadze, 2014. "Russian-Doll Risk Models," Papers 1412.4342, arXiv.org, revised Nov 2017.

    More about this item

    JEL classification:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:3001. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.