IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v10y1990i1p131-136.html
   My bibliography  Save this article

The Effects of Publication Selection on Test Probabilities and Estimator Distributions

Author

Listed:
  • Frank T. Denton

Abstract

Editorial decisions, based in part on reported hypothesis test results, affect the probabilities associated with those results: the probabilities of Type I and Type II errors thus become different for readers than for authors. The distributions of published parameter estimates are similarly affected. A framework for studying the consequences of test‐based information filtering is developed and illustrative examples are provided. The examples indicate that filtering can markedly distort the power functions of hypothesis tests and can induce large estimator biases and increases in mean square error. It is argued that test‐based filtering is relevant not only to journal publication but to other forms of information dissemination as well.

Suggested Citation

  • Frank T. Denton, 1990. "The Effects of Publication Selection on Test Probabilities and Estimator Distributions," Risk Analysis, John Wiley & Sons, vol. 10(1), pages 131-136, March.
    • Handle: RePEc:wly:riskan:v:10:y:1990:i:1:p:131-136
    DOI: 10.1111/j.1539-6924.1990.tb01027.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1539-6924.1990.tb01027.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1539-6924.1990.tb01027.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Denton, Frank T, 1985. "Data Mining as an Industry," The Review of Economics and Statistics, MIT Press, vol. 67(1), pages 124-127, February.
    2. Denton, Frank T., 1987. "The power function of a published hypothesis test," Economics Letters, Elsevier, vol. 25(2), pages 101-104.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. A. Rashad Abdel†Khalik, 1986. "A critique of “Market reactions to mandated interest capitalization.†," Contemporary Accounting Research, John Wiley & Sons, vol. 2(2), pages 242-251, March.
    2. Kilpatrick, Henry E., Jr., 1998. "Some useful methods for measuring the benefits of social science research," Impact assessments 5, International Food Policy Research Institute (IFPRI).
    3. Chatelain, Jean-Bernard, 2010. "Can statistics do without artefacts?," MPRA Paper 42867, University Library of Munich, Germany.
    4. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    5. Ebersberger, Bernd & Galia, Fabrice & Laursen, Keld & Salter, Ammon, 2021. "Inbound Open Innovation and Innovation Performance: A Robustness Study," Research Policy, Elsevier, vol. 50(7).
    6. Michael Cooper & Huseyin Gulen, 2006. "Is Time-Series-Based Predictability Evident in Real Time?," The Journal of Business, University of Chicago Press, vol. 79(3), pages 1263-1292, May.
    7. Fang, Jiali & Jacobsen, Ben & Qin, Yafeng, 2014. "Predictability of the simple technical trading rules: An out-of-sample test," Review of Financial Economics, Elsevier, vol. 23(1), pages 30-45.
    8. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    9. Krämer Walter & Arminger Gerhard, 2011. "“True Believers” or Numerical Terrorism at the Nuclear Power Plant," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 231(5-6), pages 608-620, October.
    10. Abel Brodeur & Mathias Lé & Marc Sangnier & Yanos Zylberberg, 2016. "Star Wars: The Empirics Strike Back," American Economic Journal: Applied Economics, American Economic Association, vol. 8(1), pages 1-32, January.
    11. Todd Mitton, 2022. "Methodological Variation in Empirical Corporate Finance," The Review of Financial Studies, Society for Financial Studies, vol. 35(2), pages 527-575.
    12. Adam Okulicz-Kozaryn, 2014. "‘Freedom From’ and ‘Freedom To’ Across Countries," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 118(3), pages 1009-1029, September.
    13. Julia Campos & Neil R. Ericsson, 1999. "Contructive data mining: modeling consumers' expenditure in Venezuela," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 226-240.
    14. Julia Campos & Neil R. Ericsson & David F. Hendry, 2005. "General-to-specific modeling: an overview and selected bibliography," International Finance Discussion Papers 838, Board of Governors of the Federal Reserve System (U.S.).
    15. Cefis, Elena & Coad, Alex & Lucini-Paioni, Alessandro, 2023. "Landmarks as lighthouses: firms' innovation and modes of exit during the business cycle," Research Policy, Elsevier, vol. 52(8).
    16. Alfredo Di Tillio & Marco Ottaviani & Peter Norman Sørensen, 2017. "Persuasion Bias in Science: Can Economics Help?," Economic Journal, Royal Economic Society, vol. 127(605), pages 266-304, October.
    17. Alex Coad & Stjepan Srhoj, 2020. "Catching Gazelles with a Lasso: Big data techniques for the prediction of high-growth firms," Small Business Economics, Springer, vol. 55(3), pages 541-565, October.
    18. repec:bla:jfinan:v:58:y:2003:i:5:p:1969-1996 is not listed on IDEAS
    19. David Roodman, 2009. "A Note on the Theme of Too Many Instruments," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(1), pages 135-158, February.
    20. Todd E. Clark, 2004. "Can out-of-sample forecast comparisons help prevent overfitting?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(2), pages 115-139.
    21. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:10:y:1990:i:1:p:131-136. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.