IDEAS home Printed from https://ideas.repec.org/a/vrs/offsta/v31y2015i3p489-506n9.html
   My bibliography  Save this article

Sensitivity of Mixed-Source Statistics to Classification Errors

Author

Listed:
  • Burger Joep

    (Statistics Netherlands, Department of Process Development and Methodology, CBS-weg 11, P.O. Box 4481, 6401 CZ Heerlen, The Netherlands)

  • Delden Arnout van

    (Statistics Netherlands, Department of Process Development and Methodology, Henri Faasdreef 312, P.O. Box 24500, 2490 HA The Hague, The Netherlands)

  • Scholtus Sander

    (Statistics Netherlands, Department of Process Development and Methodology, Henri Faasdreef 312, P.O. Box 24500, 2490 HA The Hague, The Netherlands)

Abstract

For policymakers and other users of official statistics, it is crucial to distinguish real differences underlying statistical outcomes from noise caused by various error sources in the statistical process. This has become more difficult as official statistics are increasingly based upon a mix of sources that typically do not involve probability sampling. In this article, we apply a resampling method to assess the sensitivity of mixed-source statistics to sourcespecific classification errors. Classification errors can be seen as coverage errors within a stratum. The method can be used to compare relative accuracies between strata and releases, it can assist in deciding how to optimally allocate resources in the statistical process, and it can be applied in evaluating potential estimators. A case study on short-term business statistics shows that bias occurs especially for those strata that deviate strongly from the mean value in other strata. It also suggests that shifting classification resources from small and mediumsized enterprises to large enterprises has virtually no net effect on accuracy, because the gain in precision is offset by the creation of bias. The resampling method can be extended to include other types of nonsampling error.

Suggested Citation

  • Burger Joep & Delden Arnout van & Scholtus Sander, 2015. "Sensitivity of Mixed-Source Statistics to Classification Errors," Journal of Official Statistics, Sciendo, vol. 31(3), pages 489-506, September.
    • Handle: RePEc:vrs:offsta:v:31:y:2015:i:3:p:489-506:n:9
    DOI: 10.1515/jos-2015-0029
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jos-2015-0029
    Download Restriction: no
    File URL: https://libkey.io/10.1515/jos-2015-0029?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Daniel de Munnik & Mark Illing & David Dupuis, 2013. "Assessing the accuracy of non-random business conditions surveys: a novel approach," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(2), pages 371-388, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Amirault & Paul Fenton & Thérèse Laflèche, 2013. "Asking About Wages: Results from the Bank of Canada’s Wage Setting Survey of Canadian Companies," Discussion Papers 13-1, Bank of Canada.
    2. Sarah Miller & David Amirault & Laurent Martin, 2017. "What’s Up with Unit Non-Response in the Bank of Canada’s Business Outlook Survey? The Effect of Staff Tenure," Discussion Papers 17-11, Bank of Canada.
    3. Matthieu Verstraete & Lena Suchanek, 2017. "Understanding Monetary Policy and its Effects: Evidence from Canadian Firms Using the Business Outlook Survey," Staff Working Papers 17-24, Bank of Canada.
    4. David Amirault & Naveen Rai & Laurent Martin, 2020. "A Reference Guide for the Business Outlook Survey," Discussion Papers 2020-15, Bank of Canada.
    5. Angelika Welte, 2017. "The Bank of Canada 2015 Retailer Survey on the Cost of Payment Methods: Sampling," Technical Reports 108, Bank of Canada.
    6. Patrick Sturgis & Jouni Kuha & Nick Baker & Mario Callegaro & Stephen Fisher & Jane Green & Will Jennings & Benjamin E. Lauderdale & Patten Smith, 2018. "An assessment of the causes of the errors in the 2015 UK general election opinion polls," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(3), pages 757-781, June.
    7. Simon Richards & Matthieu Verstraete, 2016. "Understanding Firms' Inflation Expectations Using the Bank of Canada's Business Outlook Survey," Staff Working Papers 16-7, Bank of Canada.
    8. Simon Richards & Matthieu Verstraete, 2016. "Understanding Firms' Inflation Expectations Using the Bank of Canada's Business Outlook Survey," CESifo Working Paper Series 6090, CESifo.
    9. Matthieu Verstraete & Lena Suchanek, 2018. "Understanding Monetary Policy and its Effects: Evidence from Canadian Firms Using the Business Outlook Survey," CESifo Working Paper Series 7221, CESifo.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:offsta:v:31:y:2015:i:3:p:489-506:n:9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.