IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v185y2022i4p1882-1902.html
   My bibliography  Save this article

Adjusting misclassification using a second classifier with an external validation sample

Author

Listed:
  • Jonas F. Schenkel
  • Li‐Chun Zhang

Abstract

Administrative data may suffer from delays or mistakes in reporting. To adjust for the resulting measurement errors, it is often necessary to combine data from related sources, such as sample survey, administrative or ‘big’ data. However, the additional measure variable usually has a different definition and errors of its own, and the available joint data set may not have a completely known sampling distribution. We develop a modelling approach which capitalizes on one's knowledge and experience with the data source where they exist, and apply it to register‐ and survey‐based Employed status. Comparisons are made to adjustments by hidden Markov models. Our approach is applicable to similar situations involving big data sources.

Suggested Citation

  • Jonas F. Schenkel & Li‐Chun Zhang, 2022. "Adjusting misclassification using a second classifier with an external validation sample," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(4), pages 1882-1902, October.
    • Handle: RePEc:bla:jorssa:v:185:y:2022:i:4:p:1882-1902
    DOI: 10.1111/rssa.12845
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12845
    Download Restriction: no
    File URL: https://libkey.io/10.1111/rssa.12845?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David J. Hand, 2018. "Statistical challenges of administrative and transaction data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(3), pages 555-605, June.
    2. Poterba, James M & Summers, Lawrence H, 1986. "Reporting Errors and Labor Market Dynamics," Econometrica, Econometric Society, vol. 54(6), pages 1319-1338, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Elsby, Michael W.L. & Hobijn, Bart & Şahin, Ayşegül, 2015. "On the importance of the participation margin for labor market fluctuations," Journal of Monetary Economics, Elsevier, vol. 72(C), pages 64-82.
    2. Laisney, François & Pohlmeier, Winfried & Staat, Matthias, 1991. "Estimation of labour supply functions using panel data: a survey," ZEW Discussion Papers 91-05, ZEW - Leibniz Centre for European Economic Research.
    3. Borowczyk-Martins, Daniel & Lalé, Etienne, 2020. "The ins and outs of involuntary part-time employment," Labour Economics, Elsevier, vol. 67(C).
    4. Daron Acemoglu & Joshua D. Angrist, 2001. "Consequences of Employment Protection? The Case of the Americans with Disabilities Act," Journal of Political Economy, University of Chicago Press, vol. 109(5), pages 915-957, October.
    5. Tor Helge Holmås, 2002. "Keeping nurses at work: a duration analysis," Health Economics, John Wiley & Sons, Ltd., vol. 11(6), pages 493-503, September.
    6. Robert E. Hall & Sam Schulhofer-Wohl, 2018. "Measuring Job-Finding Rates and Matching Efficiency with Heterogeneous Job-Seekers," American Economic Journal: Macroeconomics, American Economic Association, vol. 10(1), pages 1-32, January.
    7. François Langot & Shaimaa Yassin, 2015. "Reforming Employment Protection in Egypt: An Evaluation Based on Transition Models with Measurement Errors," Working Papers 918, Economic Research Forum, revised Jun 2015.
    8. Maximiliano Dvorkin, 2021. "International trade and labor reallocation: misclassification errors, mobility, and switching costs," Working Papers 2021-014, Federal Reserve Bank of St. Louis, revised Jun 2024.
    9. Stefania Albanesi & Aysegul Sahin, 2018. "The Gender Unemployment Gap," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 30, pages 47-67, October.
    10. Yashiv, Eran, 2007. "Labor search and matching in macroeconomics," European Economic Review, Elsevier, vol. 51(8), pages 1859-1895, November.
    11. Peter G. M. van der Heijden & Maarten Cruyff & Paul A. Smith & Christine Bycroft & Patrick Graham & Nathaniel Matheson‐Dunning, 2022. "Multiple system estimation using covariates having missing values and measurement error: Estimating the size of the Māori population in New Zealand," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(1), pages 156-177, January.
    12. Philip Jung & Moritz Kuhn, 2019. "Earnings Losses and Labor Mobility Over the Life Cycle," Journal of the European Economic Association, European Economic Association, vol. 17(3), pages 678-724.
    13. de Nicola, Francesca & Giné, Xavier, 2014. "How accurate are recall data? Evidence from coastal India," Journal of Development Economics, Elsevier, vol. 106(C), pages 52-65.
    14. Das, Tirthatanmoy & Polachek, Solomon W., 2017. "Estimating labor force joiners and leavers using a heterogeneity augmented two-tier stochastic frontier," Journal of Econometrics, Elsevier, vol. 199(2), pages 156-172.
    15. Miyamoto, Hiroaki, 2011. "Cyclical behavior of unemployment and job vacancies in Japan," Japan and the World Economy, Elsevier, vol. 23(3), pages 214-225.
    16. Michael D. Hurd & Daniel McFadden & Harish Chand & Li Gan & Angela Menill & Michael Roberts, 1998. "Consumption and Savings Balances of the Elderly: Experimental Evidence on Survey Response Bias," NBER Chapters, in: Frontiers in the Economics of Aging, pages 353-392, National Bureau of Economic Research, Inc.
    17. Bruce Fallick & Charles A. Fleischman, 2001. "The importance of employer-to-employer flows in the U.S. labor market," Finance and Economics Discussion Series 2001-18, Board of Governors of the Federal Reserve System (U.S.).
    18. Niklas Engbom, 2019. "Application Cycles," 2019 Meeting Papers 1170, Society for Economic Dynamics.
    19. Stéfan Lollivier, 1994. "L'évolution du marché du travail dans les années quatre-vingt," Revue Économique, Programme National Persée, vol. 45(3), pages 429-441.
    20. Mezza, Alvaro & Buchinsky, Moshe, 2021. "Illegal drugs, education, and labor market outcomes," Journal of Econometrics, Elsevier, vol. 223(2), pages 454-484.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:185:y:2022:i:4:p:1882-1902. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.