IDEAS home Printed from https://ideas.repec.org/a/bpj/jqsprt/v15y2019i3p163-183n1.html
   My bibliography  Save this article

nflWAR: a reproducible method for offensive player evaluation in football

Author

Listed:
  • Yurko Ronald

    (Carnegie Mellon University, Statistics and Data Science, Pittsburgh, PA 15213, USA)

  • Ventura Samuel

    (Carnegie Mellon University, Statistics and Data Science, Pittsburgh, PA 15213, USA)

  • Horowitz Maksim

    (Carnegie Mellon University, Statistics and Data Science, Pittsburgh, PA 15213, USA)

Abstract

Existing methods for player evaluation in American football rely heavily on proprietary data, are often not reproducible, lag behind those of other major sports, and are not interpretable in terms of game outcomes. We present four contributions to the study of football statistics to address these issues. First, we develop the R package nflscrapR to provide easy access to publicly available play-by-play data from the National Football League (NFL). Second, we introduce a novel multinomial logistic regression approach for estimating the expected points for each play. Third, we use the expected points as input into a generalized additive model for estimating the win probability for each play. Fourth, we introduce our nflWAR framework, using multilevel models to isolate the contributions of individual offensive skill players in terms of their wins above replacement (WAR). We assess the uncertainty in WAR through a resampling approach specifically designed for football, and we present results for the 2017 NFL season. We discuss how our reproducible WAR framework can be extended to estimate WAR for players at any position if researchers have data specifying the players on the field during each play. Finally, we discuss the potential implications of this work for NFL teams.

Suggested Citation

  • Yurko Ronald & Ventura Samuel & Horowitz Maksim, 2019. "nflWAR: a reproducible method for offensive player evaluation in football," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 15(3), pages 163-183, September.
  • Handle: RePEc:bpj:jqsprt:v:15:y:2019:i:3:p:163-183:n:1
    DOI: 10.1515/jqas-2018-0010
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jqas-2018-0010
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.

    File URL: https://libkey.io/10.1515/jqas-2018-0010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Macdonald Brian, 2011. "A Regression-Based Adjusted Plus-Minus Statistic for NHL Players," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 7(3), pages 1-31, July.
    2. Becker Adrian & Sun Xu Andy, 2016. "An analytical approach for fantasy football draft and lineup management," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 12(1), pages 17-30, March.
    3. Kubatko Justin & Oliver Dean & Pelton Kevin & Rosenbaum Dan T, 2007. "A Starting Point for Analyzing Basketball Statistics," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 3(3), pages 1-24, July.
    4. Albert James, 2006. "Pitching Statistics, Talent and Luck, and the Best Strikeout Seasons of All-Time," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 2(1), pages 1-32, January.
    5. Piette James & Jensen Shane T., 2012. "Estimating Fielding Ability in Baseball Players Over Time," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 8(3), pages 1-36, October.
    6. Gramacy Robert B. & Jensen Shane T. & Taddy Matt, 2013. "Estimating player contribution in hockey with regularized logistic regression," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 9(1), pages 97-111, March.
    7. Goldner Keith, 2012. "A Markov Model of Football: Using Stochastic Processes to Model a Football Drive," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 8(1), pages 1-18, March.
    8. Deshpande Sameer K. & Jensen Shane T., 2016. "Estimating an NBA player’s impact on his team’s chances of winning," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 12(2), pages 51-72, June.
    9. Lock Dennis & Nettleton Dan, 2014. "Using random forests to estimate win probability before each play of an NFL game," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 10(2), pages 197-205, June.
    10. Jensen Jonathan A. & Turner Brian A., 2014. "What if statisticians ran college football? A re-conceptualization of the football bowl subdivision," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 10(1), pages 37-48, January.
    11. Mulholland Jason & Jensen Shane T., 2014. "Predicting the draft and career success of tight ends in the National Football League," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 10(4), pages 381-396, December.
    12. Snyder Kevin & Lopez Michael, 2015. "Consistency, accuracy, and fairness: a study of discretionary penalties in the NFL," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 11(4), pages 219-230, December.
    13. Pasteur R. Drew & Cunningham-Rhoads Kyle, 2014. "An expectation-based metric for NFL field goal kickers," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 10(1), pages 49-66, January.
    14. Balreira Eduardo Cabral & Miceli Brian K. & Tegtmeyer Thomas, 2014. "An Oracle method to predict NFL games," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 10(2), pages 183-196, June.
    15. Alamar Benjamin C, 2010. "Measuring Risk in NFL Playcalling," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 6(2), pages 1-9, April.
    16. David Romer, 2006. "Do Firms Maximize? Evidence from Professional Football," Journal of Political Economy, University of Chicago Press, vol. 114(2), pages 340-365, April.
    17. Baumer Benjamin S. & Jensen Shane T. & Matthews Gregory J., 2015. "openWAR: An open source system for evaluating overall player performance in major league baseball," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 11(2), pages 69-84, June.
    18. Franks Alexander M. & D’Amour Alexander & Cervone Daniel & Bornn Luke, 2016. "Meta-analytics: tools for understanding the statistical properties of sports metrics," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 12(4), pages 151-165, December.
    19. Grimshaw Scott D. & Burwell Scott J., 2014. "Choosing the most popular NFL games in a local TV market," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 10(3), pages 329-343, September.
    20. Cafarelli Ryan & Rigdon Christopher J. & Rigdon Steven E., 2012. "Models for Third Down Conversion in the National Football League," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 8(3), pages 1-26, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. S. E. Hill, 2022. "In-game win probability models for Canadian football," Journal of Business Analytics, Taylor & Francis Journals, vol. 5(2), pages 164-178, July.
    2. Mallepalle Sarah & Yurko Ronald & Pelechrinis Konstantinos & Ventura Samuel L., 2020. "Extracting NFL tracking data from images to evaluate quarterbacks and pass defenses," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 16(2), pages 95-120, June.
    3. Yurko Ronald & Matano Francesca & Richardson Lee F. & Granered Nicholas & Pospisil Taylor & Pelechrinis Konstantinos & Ventura Samuel L., 2020. "Going deep: models for continuous-time within-play valuation of game outcomes in American football with tracking data," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 16(2), pages 163-182, June.
    4. Ventura Samuel L., 2020. "What will we unlearn next? The implications of Lopez (2020)," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 16(2), pages 81-83, June.
    5. Sabin R. Paul, 2021. "Estimating player value in American football using plus–minus models," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 17(4), pages 313-364, December.
    6. Timothy C. Y. Chan & Craig Fernandes & Martin L. Puterman, 2021. "Points Gained in Football: Using Markov Process-Based Value Functions to Assess Team Performance," Operations Research, INFORMS, vol. 69(3), pages 877-894, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yurko Ronald & Ventura Samuel & Horowitz Maksim, 2019. "nflWAR: a reproducible method for offensive player evaluation in football," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 15(3), pages 163-183, September.
    2. Sabin R. Paul, 2021. "Estimating player value in American football using plus–minus models," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 17(4), pages 313-364, December.
    3. Santos-Fernandez Edgar & Wu Paul & Mengersen Kerrie L., 2019. "Bayesian statistics meets sports: a comprehensive review," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 15(4), pages 289-312, December.
    4. Emara, Noha & Owens, David & Smith, John & Wilmer, Lisa, 2017. "Serial correlation in National Football League play calling and its effects on outcomes," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 69(C), pages 125-132.
    5. Brander James A. & Egan Edward J. & Yeung Louisa, 2014. "Estimating the effects of age on NHL player performance," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 10(2), pages 241-259, June.
    6. Michael William Gmeiner, 2019. "History-Dependent Mixed Strategies: Evidence From Major League Baseball," Journal of Sports Economics, , vol. 20(3), pages 371-398, April.
    7. Mallepalle Sarah & Yurko Ronald & Pelechrinis Konstantinos & Ventura Samuel L., 2020. "Extracting NFL tracking data from images to evaluate quarterbacks and pass defenses," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 16(2), pages 95-120, June.
    8. Jared Quenzel & Paul Shea, 2016. "Predicting the Winner of Tied National Football League Games," Journal of Sports Economics, , vol. 17(7), pages 661-671, October.
    9. Ehrlich Justin & Sanders Shane & Boudreaux Christopher J., 2019. "The relative wages of offense and defense in the NBA: a setting for win-maximization arbitrage?," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 15(3), pages 213-224, September.
    10. Phillips Andrew J. K., 2014. "Uncovering Formula One driver performances from 1950 to 2013 by adjusting for team and competition effects," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 10(2), pages 261-278, June.
    11. Urschel John D & Zhuang Jun, 2011. "Are NFL Coaches Risk and Loss Averse? Evidence from Their Use of Kickoff Strategies," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 7(3), pages 1-17, July.
    12. Vock David Michael & Vock Laura Frances Boehm, 2018. "Estimating the effect of plate discipline using a causal inference framework: an application of the G-computation algorithm," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 14(2), pages 37-56, June.
    13. Joseph Price & Justin Wolfers, 2010. "Racial Discrimination Among NBA Referees," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1859-1887.
    14. Fort, Rodney & Maxcy, Joel & Diehl, Mark, 2016. "Uncertainty by regulation: Rottenberg׳s invariance principle," Research in Economics, Elsevier, vol. 70(3), pages 454-467.
    15. Gabel Alan & Redner Sidney, 2012. "Random Walk Picture of Basketball Scoring," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 8(1), pages 1-20, March.
    16. Di Domizio Marco, 2008. "Win the best, win the largest or win the richest. Some empirical evidence from Italian championships," wp.comunite 0047, Department of Communication, University of Teramo.
    17. Gil Aharoni & Oded H. Sarig, 2012. "Hot hands and equilibrium," Applied Economics, Taylor & Francis Journals, vol. 44(18), pages 2309-2320, June.
    18. Macdonald Brian, 2012. "Adjusted Plus-Minus for NHL Players using Ridge Regression with Goals, Shots, Fenwick, and Corsi," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 8(3), pages 1-24, October.
    19. Vojtěch Kotrba, 2020. "Heuristics in fantasy sports: is it profitable to strategize based on favourite of the match?," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 19(1), pages 195-206, June.
    20. Michele Fioretti, 2022. "Caring or Pretending to Care? Social Impact, Firms' Objectives, and Welfare (former title: Social Responsibility and Firm's Objectives)," SciencePo Working papers hal-03393065, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:jqsprt:v:15:y:2019:i:3:p:163-183:n:1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.