IDEAS home Printed from https://ideas.repec.org/a/bla/jorssc/v71y2022i5p1427-1450.html
   My bibliography  Save this article

Modelling time‐varying rankings with autoregressive and score‐driven dynamics

Author

Listed:
  • Vladimír Holý
  • Jan Zouhar

Abstract

We develop a new statistical model to analyse time‐varying ranking data. The model can be used with a large number of ranked items, accommodates exogenous time‐varying covariates and partial rankings, and is estimated via the maximum likelihood in a straightforward manner. Rankings are modelled using the Plackett–Luce distribution with time‐varying worth parameters that follow a mean‐reverting time series process. To capture the dependence of the worth parameters on past rankings, we utilise the conditional score in the fashion of the generalised autoregressive score models. Simulation experiments show that the small‐sample properties of the maximum‐likelihood estimator improve rapidly with the length of the time series and suggest that statistical inference relying on conventional Hessian‐based standard errors is usable even for medium‐sized samples. In an empirical study, we apply the model to the results of the Ice Hockey World Championships. We also discuss applications to rankings based on underlying indices, repeated surveys and non‐parametric efficiency analysis.

Suggested Citation

  • Vladimír Holý & Jan Zouhar, 2022. "Modelling time‐varying rankings with autoregressive and score‐driven dynamics," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1427-1450, November.
  • Handle: RePEc:bla:jorssc:v:71:y:2022:i:5:p:1427-1450
    DOI: 10.1111/rssc.12584
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssc.12584
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssc.12584?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    2. F Blasques & P Gorgi & S Koopman & O Wintenberger, 2016. "Feasible Invertibility Conditions for Maximum Likelihood Estimation for Observation-Driven Models," Papers 1610.02863, arXiv.org.
    3. Heather L. Turner & Jacob Etten & David Firth & Ioannis Kosmidis, 2020. "Modelling rankings in R: the PlackettLuce package," Computational Statistics, Springer, vol. 35(3), pages 1027-1057, September.
    4. Cristiano Varin & Manuela Cattelan & David Firth, 2016. "Statistical modelling of citation exchange between statistics journals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(1), pages 1-63, January.
    5. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min & Lin, Bruce J.Y., 2013. "A survey of DEA applications," Omega, Elsevier, vol. 41(5), pages 893-902.
    6. Richard A. Davis, 2003. "Observation-driven models for Poisson counts," Biometrika, Biometrika Trust, vol. 90(4), pages 777-790, December.
    7. Fiorentini, Gabriele & Calzolari, Giorgio & Panattoni, Lorenzo, 1996. "Analytic Derivatives and the Computation of GARCH Estimates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(4), pages 399-417, July-Aug..
    8. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    9. George Leckie & Harvey Goldstein, 2009. "The limitations of using school league tables to inform school choice," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(4), pages 835-851, October.
    10. Koopman, Siem Jan & Lit, Rutger, 2019. "Forecasting football match results in national league competitions using score-driven time series models," International Journal of Forecasting, Elsevier, vol. 35(2), pages 797-809.
    11. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    12. Robert F. Engle & Jeffrey R. Russell, 1998. "Autoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction Data," Econometrica, Econometric Society, vol. 66(5), pages 1127-1162, September.
    13. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    14. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    15. R. L. Plackett, 1975. "The Analysis of Permutations," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 24(2), pages 193-202, June.
    16. Bollerslev, Tim, 1987. "A Conditionally Heteroskedastic Time Series Model for Speculative Prices and Rates of Return," The Review of Economics and Statistics, MIT Press, vol. 69(3), pages 542-547, August.
    17. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    18. P. Gorgi & S. J. Koopman & R. Lit, 2019. "The analysis and forecasting of tennis matches by using a high dimensional dynamic model," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 182(4), pages 1393-1409, October.
    19. Rose D. Baker & Ian G. McHale, 2015. "Deterministic Evolution of Strength in Multiple Comparisons Models: Who is the Greatest Golfer?," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(1), pages 180-196, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Holý, Vladimír, 2024. "Ranking-based second stage in data envelopment analysis: An application to research efficiency in higher education," Operations Research Perspectives, Elsevier, vol. 12(C).
    2. Drew Creal & Siem Jan Koopman & André Lucas, 2008. "A General Framework for Observation Driven Time-Varying Parameter Models," Tinbergen Institute Discussion Papers 08-108/4, Tinbergen Institute.
    3. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    4. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107034723, September.
    5. Francisco Blasques & Paolo Gorgi & Siem Jan Koopman & Olivier Wintenberger, 2016. "Feasible Invertibility Conditions and Maximum Likelihood Estimation for Observation-Driven Models," Tinbergen Institute Discussion Papers 16-082/III, Tinbergen Institute.
    6. Vêlayoudom Marimoutou & Manel Soury, 2015. "Energy Markets and CO2 Emissions: Analysis by Stochastic Copula Autoregressive Model," AMSE Working Papers 1520, Aix-Marseille School of Economics, France.
    7. Neves, César & Fernandes, Cristiano & Hoeltgebaum, Henrique, 2017. "Five different distributions for the Lee–Carter model of mortality forecasting: A comparison using GAS models," Insurance: Mathematics and Economics, Elsevier, vol. 75(C), pages 48-57.
    8. F Blasques & P Gorgi & S Koopman & O Wintenberger, 2016. "Feasible Invertibility Conditions for Maximum Likelihood Estimation for Observation-Driven Models," Papers 1610.02863, arXiv.org.
    9. De Lira Salvatierra, Irving & Patton, Andrew J., 2015. "Dynamic copula models and high frequency data," Journal of Empirical Finance, Elsevier, vol. 30(C), pages 120-135.
    10. Francisco Blasques & Siem Jan Koopman & André Lucas, 2014. "Maximum Likelihood Estimation for correctly Specified Generalized Autoregressive Score Models: Feedback Effects, Contraction Conditions and Asymptotic Properties," Tinbergen Institute Discussion Papers 14-074/III, Tinbergen Institute.
    11. Francisco Blasques & Siem Jan Koopman & André Lucas, 2014. "Information Theoretic Optimality of Observation Driven Time Series Models," Tinbergen Institute Discussion Papers 14-046/III, Tinbergen Institute.
    12. Drew Creal & Siem Jan Koopman & André Lucas, 2011. "A Dynamic Multivariate Heavy-Tailed Model for Time-Varying Volatilities and Correlations," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(4), pages 552-563, October.
    13. Tingguo Zheng & Han Xiao & Rong Chen, 2022. "Generalized autoregressive moving average models with GARCH errors," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(1), pages 125-146, January.
    14. Blasques, F. & Gorgi, P. & Koopman, S.J., 2021. "Missing observations in observation-driven time series models," Journal of Econometrics, Elsevier, vol. 221(2), pages 542-568.
    15. F Blasques & P Gorgi & S J Koopman & O Wintenberger, 2016. "Feasible Invertibility Conditions for Maximum Likelihood Estimation for Observation-Driven Models ," Working Papers hal-01377971, HAL.
    16. Vêlayoudom Marimoutou & Manel Soury, 2015. "Energy Markets and CO2 Emissions: Analysis by Stochastic Copula Autoregressive Model," Working Papers halshs-01148746, HAL.
    17. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    18. Marimoutou, Vêlayoudom & Soury, Manel, 2015. "Energy markets and CO2 emissions: Analysis by stochastic copula autoregressive model," Energy, Elsevier, vol. 88(C), pages 417-429.
    19. Tingguo Zheng & Han Xiao & Rong Chen, 2021. "Generalized Autoregressive Moving Average Models with GARCH Errors," Papers 2105.05532, arXiv.org.
    20. Blasques, Francisco & Koopman, Siem Jan & Łasak, Katarzyna & Lucas, André, 2016. "In-sample confidence bands and out-of-sample forecast bands for time-varying parameters in observation-driven models," International Journal of Forecasting, Elsevier, vol. 32(3), pages 875-887.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssc:v:71:y:2022:i:5:p:1427-1450. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.