IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1506.07212.html
   My bibliography  Save this paper

Elicitation Complexity of Statistical Properties

Author

Listed:
  • Rafael Frongillo
  • Ian A. Kash

Abstract

A property, or statistical functional, is said to be elicitable if it minimizes expected loss for some loss function. The study of which properties are elicitable sheds light on the capabilities and limitations of point estimation and empirical risk minimization. While recent work asks which properties are elicitable, we instead advocate for a more nuanced question: how many dimensions are required to indirectly elicit a given property? This number is called the elicitation complexity of the property. We lay the foundation for a general theory of elicitation complexity, including several basic results about how elicitation complexity behaves, and the complexity of standard properties of interest. Building on this foundation, our main result gives tight complexity bounds for the broad class of Bayes risks. We apply these results to several properties of interest, including variance, entropy, norms, and several classes of financial risk measures. We conclude with discussion and open directions.

Suggested Citation

  • Rafael Frongillo & Ian A. Kash, 2015. "Elicitation Complexity of Statistical Properties," Papers 1506.07212, arXiv.org, revised Aug 2020.
    • Handle: RePEc:arx:papers:1506.07212
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1506.07212
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Suzanne Emmer & Marie Kratz & Dirk Tasche, 2013. "What Is the Best Risk Measure in Practice? A Comparison of Standard Measures," Working Papers hal-00921283, HAL.
    2. Susanne Emmer & Marie Kratz & Dirk Tasche, 2013. "What is the best risk measure in practice? A comparison of standard measures," Papers 1312.1645, arXiv.org, revised Apr 2015.
    3. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    4. Johanna F. Ziegel, 2013. "Coherence and elicitability," Papers 1303.1690, arXiv.org, revised Mar 2014.
    5. Wang, Ruodu & Ziegel, Johanna F., 2015. "Elicitable distortion risk measures: A concise proof," Statistics & Probability Letters, Elsevier, vol. 100(C), pages 172-175.
    6. repec:hal:journl:hal-00921283 is not listed on IDEAS
    7. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    8. Hans Föllmer & Stefan Weber, 2015. "The Axiomatic Approach to Risk Measures for Capital Determination," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 301-337, December.
    9. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    10. Tobias Fissler & Johanna F. Ziegel, 2015. "Higher order elicitability and Osband's principle," Papers 1503.08123, arXiv.org, revised Sep 2015.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rafael Frongillo, 2022. "Quantum Information Elicitation," Papers 2203.07469, arXiv.org.
    2. Tobias Fissler & Yannick Hoga, 2021. "Backtesting Systemic Risk Forecasts using Multi-Objective Elicitability," Papers 2104.10673, arXiv.org, revised Feb 2022.
    3. Christis Katsouris, 2021. "Optimal Portfolio Choice and Stock Centrality for Tail Risk Events," Papers 2112.12031, arXiv.org.
    4. Fissler Tobias & Ziegel Johanna F., 2021. "On the elicitability of range value at risk," Statistics & Risk Modeling, De Gruyter, vol. 38(1-2), pages 25-46, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Véronique Maume-Deschamps & Didier Rullière & Khalil Said, 2017. "Multivariate Extensions Of Expectiles Risk Measures," Working Papers hal-01367277, HAL.
    2. Maume-Deschamps Véronique & Rullière Didier & Said Khalil, 2017. "Multivariate extensions of expectiles risk measures," Dependence Modeling, De Gruyter, vol. 5(1), pages 20-44, January.
    3. Werner Ehm & Tilmann Gneiting & Alexander Jordan & Fabian Krüger, 2016. "Of quantiles and expectiles: consistent scoring functions, Choquet representations and forecast rankings," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(3), pages 505-562, June.
    4. Tobias Fissler & Fangda Liu & Ruodu Wang & Linxiao Wei, 2024. "Elicitability and identifiability of tail risk measures," Papers 2404.14136, arXiv.org, revised Jun 2024.
    5. Tobias Fissler & Johanna F. Ziegel, 2015. "Higher order elicitability and Osband's principle," Papers 1503.08123, arXiv.org, revised Sep 2015.
    6. Fissler Tobias & Ziegel Johanna F., 2021. "On the elicitability of range value at risk," Statistics & Risk Modeling, De Gruyter, vol. 38(1-2), pages 25-46, January.
    7. Samuel Drapeau & Mekonnen Tadese, 2019. "Dual Representation of Expectile based Expected Shortfall and Its Properties," Papers 1911.03245, arXiv.org.
    8. Natalia Nolde & Johanna F. Ziegel, 2016. "Elicitability and backtesting: Perspectives for banking regulation," Papers 1608.05498, arXiv.org, revised Feb 2017.
    9. Ruodu Wang & Johanna F. Ziegel, 2014. "Distortion Risk Measures and Elicitability," Papers 1405.3769, arXiv.org, revised May 2014.
    10. Samuel Drapeau & Mekonnen Tadese, 2019. "Relative Bound and Asymptotic Comparison of Expectile with Respect to Expected Shortfall," Papers 1906.09729, arXiv.org, revised Jun 2020.
    11. Matthias Fischer & Thorsten Moser & Marius Pfeuffer, 2018. "A Discussion on Recent Risk Measures with Application to Credit Risk: Calculating Risk Contributions and Identifying Risk Concentrations," Risks, MDPI, vol. 6(4), pages 1-28, December.
    12. Said Khalil, 2022. "Expectile-based capital allocation," Working Papers hal-03816525, HAL.
    13. Dingshi Tian & Zongwu Cai & Ying Fang, 2018. "Econometric Modeling of Risk Measures: A Selective Review of the Recent Literature," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 201807, University of Kansas, Department of Economics, revised Oct 2018.
    14. Steven Kou & Xianhua Peng, 2016. "On the Measurement of Economic Tail Risk," Operations Research, INFORMS, vol. 64(5), pages 1056-1072, October.
    15. Bellini, Fabio & Klar, Bernhard & Müller, Alfred & Rosazza Gianin, Emanuela, 2014. "Generalized quantiles as risk measures," Insurance: Mathematics and Economics, Elsevier, vol. 54(C), pages 41-48.
    16. Ruodu Wang & Yunran Wei, 2020. "Risk functionals with convex level sets," Mathematical Finance, Wiley Blackwell, vol. 30(4), pages 1337-1367, October.
    17. Johanna F. Ziegel, 2013. "Coherence and elicitability," Papers 1303.1690, arXiv.org, revised Mar 2014.
    18. Ruodu Wang & Ričardas Zitikis, 2021. "An Axiomatic Foundation for the Expected Shortfall," Management Science, INFORMS, vol. 67(3), pages 1413-1429, March.
    19. Sander Barendse, 2017. "Interquantile Expectation Regression," Tinbergen Institute Discussion Papers 17-034/III, Tinbergen Institute.
    20. Edgars Jakobsons & Steven Vanduffel, 2015. "Dependence Uncertainty Bounds for the Expectile of a Portfolio," Risks, MDPI, vol. 3(4), pages 1-25, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1506.07212. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.