IDEAS home Printed from https://ideas.repec.org/a/spr/astaws/v18y2024i2d10.1007_s11943-024-00344-2.html
   My bibliography  Save this article

Connecting algorithmic fairness to quality dimensions in machine learning in official statistics and survey production

Author

Listed:
  • Patrick Oliver Schenk

    (LMU Munich)

  • Christoph Kern

    (LMU Munich
    Munich Center for Machine Learning (MCML))

Abstract

National Statistical Organizations (NSOs) increasingly draw on Machine Learning (ML) to improve the timeliness and cost-effectiveness of their products. When introducing ML solutions, NSOs must ensure that high standards with respect to robustness, reproducibility, and accuracy are upheld as codified, e.g., in the Quality Framework for Statistical Algorithms (QF4SA; Yung et al. 2022, Statistical Journal of the IAOS). At the same time, a growing body of research focuses on fairness as a pre-condition of a safe deployment of ML to prevent disparate social impacts in practice. However, fairness has not yet been explicitly discussed as a quality aspect in the context of the application of ML at NSOs. We employ the QF4SA quality framework and present a mapping of its quality dimensions to algorithmic fairness. We thereby extend the QF4SA framework in several ways: First, we investigate the interaction of fairness with each of these quality dimensions. Second, we argue for fairness as its own, additional quality dimension, beyond what is contained in the QF4SA so far. Third, we emphasize and explicitly address data, both on its own and its interaction with applied methodology. In parallel with empirical illustrations, we show how our mapping can contribute to methodology in the domains of official statistics, algorithmic fairness, and trustworthy machine learning. Little to no prior knowledge of ML, fairness, and quality dimensions in official statistics is required as we provide introductions to these subjects. These introductions are also targeted to the discussion of quality dimensions and fairness.

Suggested Citation

  • Patrick Oliver Schenk & Christoph Kern, 2024. "Connecting algorithmic fairness to quality dimensions in machine learning in official statistics and survey production," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 18(2), pages 131-184, June.
  • Handle: RePEc:spr:astaws:v:18:y:2024:i:2:d:10.1007_s11943-024-00344-2
    DOI: 10.1007/s11943-024-00344-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11943-024-00344-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11943-024-00344-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mick P. Couper & Frauke Kreuter, 2013. "Using paradata to explore item level response times in surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(1), pages 271-286, January.
    2. Hornik, Kurt, 2005. "A CLUE for CLUster Ensembles," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 14(i12).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiayun Jin & Caroline Vandenplas & Geert Loosveldt, 2019. "The Evaluation of Statistical Process Control Methods to Monitor Interview Duration During Survey Data Collection," SAGE Open, , vol. 9(2), pages 21582440198, June.
    2. Wu, Han-Ming, 2011. "On biological validity indices for soft clustering algorithms for gene expression data," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1969-1979, May.
    3. Hornik, Kurt & Grün, Bettina, 2014. "movMF: An R Package for Fitting Mixtures of von Mises-Fisher Distributions," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 58(i10).
    4. Jochen Mayerl & Thorsten Faas, 2018. "Campaign dynamics of cognitive accessibility of political judgments: measuring the impact of campaigns and campaign events using response latencies in two German rolling cross section studies," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1575-1592, July.
    5. Yan Ting & Williams Douglas, 2022. "Response Burden – Review and Conceptual Framework," Journal of Official Statistics, Sciendo, vol. 38(4), pages 939-961, December.
    6. Luis Lorenzo & Javier Arroyo, 2022. "Analysis of the cryptocurrency market using different prototype-based clustering techniques," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-46, December.
    7. Boztug, Yasemin & Reutterer, Thomas, 2008. "A combined approach for segment-specific market basket analysis," European Journal of Operational Research, Elsevier, vol. 187(1), pages 294-312, May.
    8. Fionn Murtagh, 2009. "The Remarkable Simplicity of Very High Dimensional Data: Application of Model-Based Clustering," Journal of Classification, Springer;The Classification Society, vol. 26(3), pages 249-277, December.
    9. Pełka Marcin, 2018. "Analysis of Innovations in the European Union Via Ensemble Symbolic Density Clustering," Econometrics. Advances in Applied Data Analysis, Sciendo, vol. 22(3), pages 84-98, September.
    10. Fišar, Miloš & Greiner, Ben & Huber, Christoph & Katok, Elena & Ozkes, Ali & Management Science Reproducibility Collaboration, 2023. "Reproducibility in Management Science," Department for Strategy and Innovation Working Paper Series 03/2023, WU Vienna University of Economics and Business.
    11. Pełka Marcin, 2019. "Analysis of Happiness in EU Countries Using the Multi-Model Classification based on Models of Symbolic Data," Econometrics. Advances in Applied Data Analysis, Sciendo, vol. 23(3), pages 15-25, September.
    12. Maleva, Tatyana Mikhailovna (Малева, Татьяна Михайловна) & Avraamova, Elena (Авраамова, Елена) & Kirillova, M. K. (Кириллова, М. К.) & Burdyak, Alexandra (Бурдяк, Александра) & Tyndik, Alla (Тындик, А, 2014. "Sociological Monitoring Survey of Wages, Income, Poverty and Social Inequality [Социологическое Мониторинговое Обследование Заработных Плат, Доходов, Бедности И Социального Неравенства]," Published Papers om27, Russian Presidential Academy of National Economy and Public Administration.
    13. Axel Strauß & François Guilhaumon & Roger Daniel Randrianiaina & Katharina C Wollenberg Valero & Miguel Vences & Julian Glos, 2016. "Opposing Patterns of Seasonal Change in Functional and Phylogenetic Diversity of Tadpole Assemblages," PLOS ONE, Public Library of Science, vol. 11(3), pages 1-18, March.
    14. Juan José Fernández-Durán & María Mercedes Gregorio-Domínguez, 2021. "Consumer Segmentation Based on Use Patterns," Journal of Classification, Springer;The Classification Society, vol. 38(1), pages 72-88, April.
    15. Raphael Studer & Rainer Winkelmann, 2014. "Reported Happiness, Fast and Slow," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(3), pages 1055-1067, July.
    16. repec:jss:jstsof:25:i05 is not listed on IDEAS
    17. Pełka Marcin, 2019. "Assessment of the Development of the European Oecd Countries with the Application of Linear Ordering and Ensemble Clustering of Symbolic Data," Folia Oeconomica Stetinensia, Sciendo, vol. 19(2), pages 117-133, December.
    18. Carstensen Johann & Lang Sebastian & Cordua Fine, 2022. "The Effects of Response Burden – Collecting Life History Data in a Self-Administered Mixed-Device Survey," Journal of Official Statistics, Sciendo, vol. 38(4), pages 1069-1095, December.
    19. repec:hum:wpaper:sfb649dp2006-006 is not listed on IDEAS
    20. Hahsler, Michael & Bolaños, Matthew & Forrest, John, 2017. "Introduction to stream: An Extensible Framework for Data Stream Clustering Research with R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i14).
    21. Boztuğ, Yasemin & Reutterer, Thomas, 2006. "A combined approach for segment-specific analysis of market basket data," SFB 649 Discussion Papers 2006-006, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    22. Marcin Pełka, 2012. "Ensemble approach for clustering of interval-valued symbolic data," Statistics in Transition new series, Główny Urząd Statystyczny (Polska), vol. 13(2), pages 335-342, June.

    More about this item

    Keywords

    Algorithmic Fairness; Quality Dimensions; Machine Learning; Official Statistics; Trustworthy Machine Learning;
    All these keywords.

    JEL classification:

    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Y80 - Miscellaneous Categories - - Related Disciplines - - - Related Disciplines

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:astaws:v:18:y:2024:i:2:d:10.1007_s11943-024-00344-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.