IDEAS home Printed from https://ideas.repec.org/a/aea/jeclit/v53y2015i3p631-53.html
   My bibliography  Save this article

Communicating Uncertainty in Official Economic Statistics: An Appraisal Fifty Years after Morgenstern

Author

Listed:
  • Charles F. Manski

Abstract

Federal statistical agencies in the United States and analogous agencies elsewhere commonly report official economic statistics as point estimates, without accompanying measures of error. Users of the statistics may incorrectly view them as error free or may incorrectly conjecture error magnitudes. This paper discusses strategies to mitigate misinterpretation of official statistics by communicating uncertainty to the public. Sampling error can be measured using established statistical principles. The challenge is to satisfactorily measure the various forms of nonsampling error. I find it useful to distinguish transitory statistical uncertainty, permanent statistical uncertainty, and conceptual uncertainty. I illustrate how each arises as the Bureau of Economic Analysis periodically revises GDP estimates, the Census Bureau generates household income statistics from surveys with nonresponse, and the Bureau of Labor Statistics seasonally adjusts employment statistics. I anchor my discussion of communication of uncertainty in the contribution of Oskar Morgenstern (1963a), who argued forcefully for agency publication of error estimates for official economic statistics. (JEL B22, C82, E23)

Suggested Citation

  • Charles F. Manski, 2015. "Communicating Uncertainty in Official Economic Statistics: An Appraisal Fifty Years after Morgenstern," Journal of Economic Literature, American Economic Association, vol. 53(3), pages 631-653, September.
    • Handle: RePEc:aea:jeclit:v:53:y:2015:i:3:p:631-53
    Note: DOI: 10.1257/jel.53.3.631
    as

    Download full text from publisher

    File URL: http://www.aeaweb.org/articles.php?doi=10.1257/jel.53.3.631
    Download Restriction: no
    File URL: https://www.aeaweb.org/jel/ds/5303/jel.53.3.631_ds.zip
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.
    ---><---

    References listed on IDEAS

    as
    1. Lillard, Lee & Smith, James P & Welch, Finis, 1986. "What Do We Really Know about Wages? The Importance of Nonreporting and Census Imputation," Journal of Political Economy, University of Chicago Press, vol. 94(3), pages 489-506, June.
    2. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444606, November.
    3. Richard Blundell & Amanda Gosling & Hidehiko Ichimura & Costas Meghir, 2007. "Changes in the Distribution of Male and Female Wages Accounting for Employment Composition Using Bounds," Econometrica, Econometric Society, vol. 75(2), pages 323-363, March.
    4. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    5. Marcel Boumans, 2012. "Observations in a Hostile Environment: Morgenstern on the Accuracy of Economic Observations," History of Political Economy, Duke University Press, vol. 44(5), pages 114-136, Supplemen.
    6. Horowitz, Joel L. & Manski, Charles F., 1998. "Censoring of outcomes and regressors due to survey nonresponse: Identification and estimation using weights and imputations," Journal of Econometrics, Elsevier, vol. 84(1), pages 37-58, May.
    7. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444590, November.
    8. Charles F. Manski, 1989. "Anatomy of the Selection Problem," Journal of Human Resources, University of Wisconsin Press, vol. 24(3), pages 343-360.
    9. Charles F. Manski, 2011. "Policy Analysis with Incredible Certitude," Economic Journal, Royal Economic Society, vol. 121(554), pages 261-289, August.
    10. Manski, Charles F., 2013. "Public Policy in an Uncertain World: Analysis and Decisions," Economics Books, Harvard University Press, number 9780674066892, Spring.
    11. J. Steven Landefeld & Eugene P. Seskin & Barbara M. Fraumeni, 2008. "Taking the Pulse of the Economy: Measuring GDP," Journal of Economic Perspectives, American Economic Association, vol. 22(2), pages 193-216, Spring.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Charles F. Manski, 2014. "Communicating Uncertainty in Official Economic Statistics," NBER Working Papers 20098, National Bureau of Economic Research, Inc.
    2. Manski, Charles F., 2016. "Credible interval estimates for official statistics with survey nonresponse," Journal of Econometrics, Elsevier, vol. 191(2), pages 293-301.
    3. Christelis, Dimitris & Messina, Julián, 2019. "Partial Identification of Population Average and Quantile Treatment Effects in Observational Data under Sample Selection," IDB Publications (Working Papers) 9520, Inter-American Development Bank.
    4. Kate Ho & Adam M. Rosen, 2015. "Partial Identification in Applied Research: Benefits and Challenges," NBER Working Papers 21641, National Bureau of Economic Research, Inc.
    5. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen, 2013. "Intersection Bounds: Estimation and Inference," Econometrica, Econometric Society, vol. 81(2), pages 667-737, March.
    6. Michael Lechner & Blaise Melly, 2010. "Partial Idendification of Wage Effects of Training Programs," Working Papers 2010-8, Brown University, Department of Economics.
    7. Martin Huber & Giovanni Mellace, 2015. "Sharp Bounds on Causal Effects under Sample Selection," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(1), pages 129-151, February.
    8. German Blanco & Carlos A. Flores & Alfonso Flores-Lagunes, 2013. "Bounds on Average and Quantile Treatment Effects of Job Corps Training on Wages," Journal of Human Resources, University of Wisconsin Press, vol. 48(3), pages 659-701.
    9. Claudia Olivetti & Barbara Petrongolo, 2008. "Unequal Pay or Unequal Employment? A Cross-Country Analysis of Gender Gaps," Journal of Labor Economics, University of Chicago Press, vol. 26(4), pages 621-654, October.
    10. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Nicoletti, Cheti & Peracchi, Franco & Foliano, Francesca, 2011. "Estimating Income Poverty in the Presence of Missing Data and Measurement Error," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 61-72.
    12. Aizawa, T.;, 2019. "Reviewing the Existing Evidence of the Conditional Cash Transfer in India through the Partial Identification Approach," Health, Econometrics and Data Group (HEDG) Working Papers 19/24, HEDG, c/o Department of Economics, University of York.
    13. Donald W. K. Andrews & Xiaoxia Shi, 2013. "Inference Based on Conditional Moment Inequalities," Econometrica, Econometric Society, vol. 81(2), pages 609-666, March.
    14. Bruno Arpino & Elisabetta De Cao & Franco Peracchi, 2011. "Using panel data to partially identify HIV prevalence When HIV status is not missing at random," Working Papers 048, "Carlo F. Dondena" Centre for Research on Social Dynamics (DONDENA), Università Commerciale Luigi Bocconi.
    15. Michael Lechner & Blaise Melly, 2007. "Earnings Effects of Training Programs," University of St. Gallen Department of Economics working paper series 2007 2007-28, Department of Economics, University of St. Gallen.
    16. Victor Chernozhukov & Ivan Fernandez-Val & Siyi Luo, 2018. "Distribution regression with sample selection, with an application to wage decompositions in the UK," CeMMAP working papers CWP68/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    17. Vazquez-Alvarez, R. & Melenberg, B. & van Soest, A.H.O., 2001. "Nonparametric Bounds in the Presence of Item Nonresponse, Unfolding Brackets and Anchoring," Discussion Paper 2001-67, Tilburg University, Center for Economic Research.
    18. Francine D. Blau & Lawrence M. Kahn & Nikolai Boboshko & Matthew Comey, 2024. "The Impact of Selection into the Labor Force on the Gender Wage Gap," Journal of Labor Economics, University of Chicago Press, vol. 42(4), pages 1093-1133.
    19. Charles F. Manski, 2003. "Identification Problems in the Social Sciences and Everyday Life," Southern Economic Journal, John Wiley & Sons, vol. 70(1), pages 11-21, July.
    20. Martin Huber & Giovanni Mellace, 2010. "Sharp IV bounds on average treatment effects under endogeneity and noncompliance," University of St. Gallen Department of Economics working paper series 2010 2010-31, Department of Economics, University of St. Gallen.

    More about this item

    JEL classification:

    • B22 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - Macroeconomics
    • C82 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data; Data Access
    • E23 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Production

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:jeclit:v:53:y:2015:i:3:p:631-53. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.