IDEAS home Printed from https://ideas.repec.org/p/biu/wpaper/2011-10.html
   My bibliography  Save this paper

The Regression Tournament: A Novel Approach to Prediction Model Assessment

Author

Listed:
  • Adi Schnytzer

    (Bar-Ilan University)

  • Janez Šušteršič

    (University of Primorska)

Abstract

Standard methods to assess the statistical quality of econometric models implicitly assume there is only one person in the world, namely the forecaster with her model(s), and that there exists an objective and independent reality to which the model predictions may be compared. However, on many occasions, the reality with which we compare our predictions and in which we take our actions is co-determined and changed constantly by actions taken by other actors based on their own models. We propose a new method, called a regression tournament, to assess the utility of forecasting models and taking these interactions into account. We present an empirical case of betting on Australian Rules Football matches where the most accurate predictive model does not yield the highest betting return, or, in our terms, does not win a regression tournament.

Suggested Citation

  • Adi Schnytzer & Janez Šušteršič, 2011. "The Regression Tournament: A Novel Approach to Prediction Model Assessment," Working Papers 2011-10, Bar-Ilan University, Department of Economics.
  • Handle: RePEc:biu:wpaper:2011-10
    as

    Download full text from publisher

    File URL: https://www2.biu.ac.il/soc/ec/wp/2011-10.pdf
    File Function: Working paper
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ronen Bar-El & Teresa García-Muñoz & Shoshana Neuman & Yossef Tobol, 2013. "The evolution of secularization: cultural transmission, religion and fertility—theory, simulations and evidence," Journal of Population Economics, Springer;European Society for Population Economics, vol. 26(3), pages 1129-1174, July.
    2. Ravi Kanbur & Hillel Rapoport, 2005. "Migration selectivity and the evolution of spatial inequality," Journal of Economic Geography, Oxford University Press, vol. 5(1), pages 43-57, January.
    3. Daniel Levy & Dongwon Lee & Haipeng (Allan) Chen & Robert J. Kauffman & Mark Bergen, 2011. "Price Points and Price Rigidity," The Review of Economics and Statistics, MIT Press, vol. 93(4), pages 1417-1431, November.
    4. Young, Andrew T. & Higgins, Matthew J. & Levy, Daniel, 2008. "Sigma Convergence versus Beta Convergence: Evidence from U.S. County-Level Data," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 40(5), pages 1083-1093.
    5. Matthew Higgins & Daniel Levy & Andrew T. Young, 2003. "Growth and Convergence across the US: Evidence from County-Level Data," Working Papers 2003-03, Bar-Ilan University, Department of Economics.
    6. Chen, Haipeng (Allan) & Levy, Daniel & Ray, Sourav & Bergen, Mark, 2008. "Asymmetric price adjustment in the small," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 728-737, May.
    7. Ray, Sourav & Chen, Haipeng (Allan) & Bergen, Mark & Levy, Daniel, 2006. "Asymmetric Wholesale Pricing: Theory and Evidence," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 25(2), pages 109-201.
    8. Leonid V. Azarnert, 2008. "Involuntary Integration in Public Education, Fertility and Human Capital," Working Papers 2008-07, Bar-Ilan University, Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Young, Andrew T. & Levy, Daniel, 2014. "Explicit Evidence of an Implicit Contract," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 30(4), pages 804-832.
    2. Gil Epstein & Alessandra Venturini, 2011. "The Impact of Worker Effort on Public Sentiment Towards Temporary Migrants," RF Berlin - CReAM Discussion Paper Series 1109, Rockwool Foundation Berlin (RF Berlin) - Centre for Research and Analysis of Migration (CReAM).
    3. Arthur Fishman & Nadav Levy, 2011. "Search Costs and Risky Investment in Quality," Working Papers 2011-04, Bar-Ilan University, Department of Economics.
    4. Adi Schnytzer & Yisrael Schnytzer, 2011. "Animal Modeling of Earthquakes and Prediction Market," Working Papers 2011-20, Bar-Ilan University, Department of Economics.
    5. Adi Schnytzer & Guy Weinberg, 2011. "Testing for Home Team and Favorite Biases in the Australian Rules Football Fixed Odds and Point Spread Betting Markets," Working Papers 2011-13, Bar-Ilan University, Department of Economics.
    6. Adi Schnytzer & Sara Westreich, 2011. "Information and Attitudes to Risk at the Track," Working Papers 2011-16, Bar-Ilan University, Department of Economics.
    7. Stephen E. Spear & Warren Young, 2011. "MD Dialog on: Optimum Savings and Optimal Growth: the Cass-Malinvaud-Koopmans Nexus," Working Papers 2011-22, Bar-Ilan University, Department of Economics.
    8. Adi Schnytzer & Barbara Luppi, 2008. "Painful Regret and Elation at the Track," Journal of Gambling Business and Economics, University of Buckingham Press, vol. 2(3), pages 85-99, December.
    9. Eyal Baharad & Jacob Goldberger & Moshe Koppel & Shmuel Nitzan, 2012. "Beyond Condorcet: optimal aggregation rules using voting records," Theory and Decision, Springer, vol. 72(1), pages 113-130, January.
    10. Igal Milchtaich, 2010. "Network Topology and Equilibrium Existence in Weighted Network Congestion Games," Working Papers 2010-09, Bar-Ilan University, Department of Economics.
    11. Ray, Sourav & Snir, Avichai & Levy, Daniel, 2023. "Retail Pricing Format and Rigidity of Regular Prices," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, pages 1-1.
    12. Snir, Avichai & (Allan) Chen, Haipeng & Levy, Daniel, 2022. "Zero-ending prices, cognitive convenience, and price rigidity," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 519-542.
    13. Levy, Daniel & Snir, Avichai & Gotler, Alex & Chen, Haipeng (Allan), 2020. "Not all price endings are created equal: Price points and asymmetric price rigidity," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, issue forthcomi.
    14. Snir, Avichai & Levy, Daniel & Chen, Haipeng (Allan), 2017. "End of 9-endings, price recall, and price perceptions," Economics Letters, Elsevier, vol. 155(C), pages 157-163.
    15. Snir, Avichai & Levy, Daniel, 2021. "If You Think 9-Ending Prices Are Low, Think Again," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 6(1 (Forthc).
    16. Matthew Higgins & Andrew Young & Daniel Levy, 2009. "Federal, state, and local governments: evaluating their separate roles in US growth," Public Choice, Springer, vol. 139(3), pages 493-507, June.
    17. Claire Loupias & Patrick Sevestre, 2013. "Costs, Demand, and Producer Price Changes," The Review of Economics and Statistics, MIT Press, vol. 95(1), pages 315-327, March.
    18. Levy, Daniel & Snir, Avichai, 2013. "Shrinking Goods," MPRA Paper 46040, University Library of Munich, Germany.
    19. Young, Andrew T. & Higgins, Matthew J. & Levy, Daniel, 2013. "Heterogeneous Convergence," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 120(2), pages 238-241.
    20. Heckelman, Jac C. & Young, Andrew, 2018. "How Global is Globalization?," Journal of Regional Analysis and Policy, Mid-Continent Regional Science Association, vol. 48(3), August.

    More about this item

    JEL classification:

    • L83 - Industrial Organization - - Industry Studies: Services - - - Sports; Gambling; Restaurants; Recreation; Tourism

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:biu:wpaper:2011-10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Department of Economics (email available below). General contact details of provider: https://edirc.repec.org/data/debaril.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.