IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v36y2020i4p1329-1341.html
   My bibliography  Save this article

Extension of the Elo rating system to margin of victory

Author

Listed:
  • Kovalchik, Stephanie

Abstract

The Elo rating system is one of the most popular methods for estimating the ability of competitors over time in sport. The standard Elo system focuses on predicting wins and losses, but there is often also interest in the margin of victory (MOV) because it reflects the magnitude of a result. There have been few theoretical investigations and comparisons of Elo-based models. In the present study, we propose four model options for an MOV Elo system: linear, joint additive, multiplicative, and logistic. Notations and guidance for tuning each model are provided. The models were applied to men’s tennis for several MOV choices. The results showed that all MOV approaches using within-set statistics improved the predictive performance compared with the standard Elo system, but only the joint additive model yielded unbiased ratings with stable variance in the simulation study. This general framework for MOV Elo ratings provide sports modelers with a new set of tools for building systems to rate competitors and forecast outcomes in sport.

Suggested Citation

  • Kovalchik, Stephanie, 2020. "Extension of the Elo rating system to margin of victory," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1329-1341.
  • Handle: RePEc:eee:intfor:v:36:y:2020:i:4:p:1329-1341
    DOI: 10.1016/j.ijforecast.2020.01.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207020300157
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2020.01.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Steven E. Stern, 2011. "Moderated paired comparisons: a generalized Bradley–Terry model for continuous data using a discontinuous penalized likelihood function," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 60(3), pages 397-415, May.
    2. McHale, Ian & Morton, Alex, 2011. "A Bradley-Terry type model for forecasting tennis match results," International Journal of Forecasting, Elsevier, vol. 27(2), pages 619-630, April.
    3. Nash, John C., 2014. "On Best Practice Optimization Methods in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 60(i02).
    4. Baker, Rose D. & McHale, Ian G., 2014. "A dynamic paired comparisons model: Who is the greatest tennis player?," European Journal of Operational Research, Elsevier, vol. 236(2), pages 677-684.
    5. Kovalchik, Stephanie & Reid, Machar, 2019. "A calibration method with dynamic updates for within-match forecasting of wins in tennis," International Journal of Forecasting, Elsevier, vol. 35(2), pages 756-766.
    6. Mark E. Glickman, 1999. "Parameter Estimation in Large Dynamic Paired Comparison Experiments," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 48(3), pages 377-394.
    7. Benjamin Wright & M. Ryan Rodenberg & Jeff Sackmann, 2013. "Incentives in Best of N Contests: Quasi-Simpson’s Paradox in Tennis," International Journal of Performance Analysis in Sport, Taylor & Francis Journals, vol. 13(3), pages 790-802, December.
    8. Mark Glickman, 2001. "Dynamic paired comparison models with stochastic variances," Journal of Applied Statistics, Taylor & Francis Journals, vol. 28(6), pages 673-689.
    9. Boulier, Bryan L. & Stekler, H. O., 1999. "Are sports seedings good predictors?: an evaluation," International Journal of Forecasting, Elsevier, vol. 15(1), pages 83-91, February.
    10. McHale, Ian & Morton, Alex, 2011. "A Bradley-Terry type model for forecasting tennis match results," International Journal of Forecasting, Elsevier, vol. 27(2), pages 619-630.
    11. Kovalchik Stephanie Ann, 2016. "Searching for the GOAT of tennis win prediction," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 12(3), pages 127-138, September.
    12. Stern, Hal S., 2004. "Statistics and the College Football Championship," The American Statistician, American Statistical Association, vol. 58, pages 179-185, August.
    13. Stefani Ray, 2011. "The Methodology of Officially Recognized International Sports Rating Systems," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 7(4), pages 1-22, October.
    14. Constantinou Anthony Costa & Fenton Norman Elliott, 2013. "Determining the level of ability of football teams by dynamic ratings based on the relative discrepancies in scores between adversaries," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 9(1), pages 37-50, March.
    15. Hvattum, Lars Magnus & Arntzen, Halvard, 2010. "Using ELO ratings for match result prediction in association football," International Journal of Forecasting, Elsevier, vol. 26(3), pages 460-470, July.
    16. Barrow Daniel & Drayer Ian & Elliott Peter & Gaut Garren & Osting Braxton, 2013. "Ranking rankings: an empirical comparison of the predictive power of sports ranking methods," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 9(2), pages 187-202, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alberto Arcagni & Vincenzo Candila & Rosanna Grassi, 2023. "A new model for predicting the winner in tennis based on the eigenvector centrality," Annals of Operations Research, Springer, vol. 325(1), pages 615-632, June.
    2. Szczecinski Leszek, 2022. "G-Elo: generalization of the Elo algorithm by modeling the discretized margin of victory," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 18(1), pages 1-14, March.
    3. Angelini, Giovanni & Candila, Vincenzo & De Angelis, Luca, 2022. "Weighted Elo rating for tennis match predictions," European Journal of Operational Research, Elsevier, vol. 297(1), pages 120-132.
    4. Stokes Tyrel & Bagga Gurashish & Kroetch Kimberly & Kumagai Brendan & Welsh Liam, 2024. "A generative approach to frame-level multi-competitor races," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 20(4), pages 365-383.
    5. He, Xue-Zhong & Treich, Nicolas, 2017. "Prediction market prices under risk aversion and heterogeneous beliefs," Journal of Mathematical Economics, Elsevier, vol. 70(C), pages 105-114.
    6. Lim, Alejandro & Chiang, Chin-Tsang & Teng, Jen-Chieh, 2021. "Estimating robot strengths with application to selection of alliance members in FIRST robotics competitions," Computational Statistics & Data Analysis, Elsevier, vol. 158(C).
    7. Marc Garnica-Caparrós & Daniel Memmert & Fabian Wunderlich, 2022. "Artificial data in sports forecasting: a simulation framework for analysing predictive models in sports," Information Systems and e-Business Management, Springer, vol. 20(3), pages 551-580, September.
    8. Lasek, Jan & Gagolewski, Marek, 2021. "Interpretable sports team rating models based on the gradient descent algorithm," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1061-1071.
    9. Ramirez, Philip & Reade, J. James & Singleton, Carl, 2023. "Betting on a buzz: Mispricing and inefficiency in online sportsbooks," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1413-1423.
    10. Hua, Hsuan-Fu & Chang, Ching-Ju & Lin, Tse-Ching & Weng, Ruby Chiu-Hsing, 2024. "Rating players by Laplace’s approximation and dynamic modeling," International Journal of Forecasting, Elsevier, vol. 40(3), pages 1152-1165.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Angelini, Giovanni & Candila, Vincenzo & De Angelis, Luca, 2022. "Weighted Elo rating for tennis match predictions," European Journal of Operational Research, Elsevier, vol. 297(1), pages 120-132.
    2. Kovalchik Stephanie Ann, 2016. "Searching for the GOAT of tennis win prediction," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 12(3), pages 127-138, September.
    3. Ramirez, Philip & Reade, J. James & Singleton, Carl, 2023. "Betting on a buzz: Mispricing and inefficiency in online sportsbooks," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1413-1423.
    4. Collingwood, James A.P. & Wright, Michael & Brooks, Roger J, 2022. "Evaluating the effectiveness of different player rating systems in predicting the results of professional snooker matches," European Journal of Operational Research, Elsevier, vol. 296(3), pages 1025-1035.
    5. P. Gorgi & Siem Jan (S.J.) Koopman & R. Lit, 2018. "The analysis and forecasting of ATP tennis matches using a high-dimensional dynamic model," Tinbergen Institute Discussion Papers 18-009/III, Tinbergen Institute.
    6. Vincenzo Candila & Lucio Palazzo, 2020. "Neural Networks and Betting Strategies for Tennis," Risks, MDPI, vol. 8(3), pages 1-19, June.
    7. Kovalchik, Stephanie & Reid, Machar, 2019. "A calibration method with dynamic updates for within-match forecasting of wins in tennis," International Journal of Forecasting, Elsevier, vol. 35(2), pages 756-766.
    8. He, Xue-Zhong & Treich, Nicolas, 2017. "Prediction market prices under risk aversion and heterogeneous beliefs," Journal of Mathematical Economics, Elsevier, vol. 70(C), pages 105-114.
    9. Irons David J. & Buckley Stephen & Paulden Tim, 2014. "Developing an improved tennis ranking system," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 10(2), pages 109-118, June.
    10. Araki, Kenji & Hirose, Yoshihiro & Komaki, Fumiyasu, 2019. "Paired comparison models with age effects modeled as piecewise quadratic splines," International Journal of Forecasting, Elsevier, vol. 35(2), pages 733-740.
    11. Alberto Arcagni & Vincenzo Candila & Rosanna Grassi, 2023. "A new model for predicting the winner in tennis based on the eigenvector centrality," Annals of Operations Research, Springer, vol. 325(1), pages 615-632, June.
    12. Baker, Rose D. & McHale, Ian G., 2014. "A dynamic paired comparisons model: Who is the greatest tennis player?," European Journal of Operational Research, Elsevier, vol. 236(2), pages 677-684.
    13. Blaž Krese & Erik Štrumbelj, 2021. "A Bayesian approach to time-varying latent strengths in pairwise comparisons," PLOS ONE, Public Library of Science, vol. 16(5), pages 1-17, May.
    14. Halkos, George & Tzeremes, Nickolaos, 2012. "Evaluating professional tennis players’ career performance: A Data Envelopment Analysis approach," MPRA Paper 41516, University Library of Munich, Germany.
    15. Devlin Stephen & Treloar Thomas & Creagar Molly & Cassels Samuel, 2021. "An iterative Markov rating method," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 17(2), pages 117-127, June.
    16. Blackburn McKinley L., 2013. "Ranking the performance of tennis players: an application to women’s professional tennis," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 9(4), pages 367-378, December.
    17. Asif, M. & McHale, I.G., 2019. "A generalized non-linear forecasting model for limited overs international cricket," International Journal of Forecasting, Elsevier, vol. 35(2), pages 634-640.
    18. J. James Reade & Carl Singleton & Alasdair Brown, 2021. "Evaluating strange forecasts: The curious case of football match scorelines," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(2), pages 261-285, May.
    19. Vaughan Williams Leighton & Liu Chunping & Dixon Lerato & Gerrard Hannah, 2021. "How well do Elo-based ratings predict professional tennis matches?," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 17(2), pages 91-105, June.
    20. Hua, Hsuan-Fu & Chang, Ching-Ju & Lin, Tse-Ching & Weng, Ruby Chiu-Hsing, 2024. "Rating players by Laplace’s approximation and dynamic modeling," International Journal of Forecasting, Elsevier, vol. 40(3), pages 1152-1165.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:36:y:2020:i:4:p:1329-1341. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.