IDEAS home Printed from https://ideas.repec.org/p/boj/bojwps/10-e-8.html
   My bibliography  Save this paper

Treatment of Outliers in Business Surveys: The Case of Short-term Economic Survey of Enterprises in Japan (Tankan)

Author

Listed:
  • Atsushi Ishikawa

    (Bank of Japan)

  • Shunsuke Endo

    (Bank of Japan)

  • Tetsuya Shiratori

    (Bank of Japan)

Abstract

This paper discusses the appropriate treatment of outliers in Tankan. Under the current population estimate method, if one of the data which greatly diverges from the rest of the data (the so-called "outlier") does not represent the population, the estimates could also greatly diverge from the real value for the population. Since the real picture of the population when the outlier occurred is unknown, it is difficult to choose the optimum method through empirical analyses. Considering 1) the accuracy of Tankan, 2) the maintenance of its "easy to understand" quality, and 3) the reduction of its work load, we assume that outliers in Tankan are those which have extremely large impact on the rate of change from the previous year or the rate of revision from the previous survey of the estimated values for the population. The method of detecting and treating outliers is suitable for the characteristics of Tankan through empirical analyses of actual Tankan data. Specifically, detection method is based on the adjusted "range edit" method, which uses 1 percentile and 99 percentile, so that it can be applied to non-parametric data, for which the incidence of "0" (zero) is very high. The outliers thus detected are regarded as missing values and should be augmented by applying the missing value imputation, which is already being used for Tankan.

Suggested Citation

  • Atsushi Ishikawa & Shunsuke Endo & Tetsuya Shiratori, 2010. "Treatment of Outliers in Business Surveys: The Case of Short-term Economic Survey of Enterprises in Japan (Tankan)," Bank of Japan Working Paper Series 10-E-8, Bank of Japan.
    • Handle: RePEc:boj:bojwps:10-e-8
    as

    Download full text from publisher

    File URL: http://www.boj.or.jp/en/research/wps_rev/wps_2010/data/wp10e08.pdf
    Download Restriction: no
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Research and Statistics Department, 2016. "Revision of the Sample Design of the Tankan Using the Economic Census of Japan," Bank of Japan Research Papers 16-09-23, Bank of Japan.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:boj:bojwps:10-e-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bank of Japan (email available below). General contact details of provider: https://edirc.repec.org/data/bojgvjp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.