IDEAS home Printed from https://ideas.repec.org/h/nbr/nberch/14277.html
   My bibliography  Save this book chapter

Transforming Naturally Occurring Text Data into Economic Statistics: The Case of Online Job Vacancy Postings

In: Big Data for Twenty-First-Century Economic Statistics

Author

Listed:
  • Arthur Turrell
  • Bradley Speigner
  • Jyldyz Djumalieva
  • David Copple
  • James Thurgood

Abstract

Using a dataset of 15 million UK job adverts from a recruitment website, we construct new economic statistics measuring labour market demand. These data are ‘naturally occurring’, having originally been posted online by firms. They offer information on two dimensions of vacancies—region and occupation—that firm-based surveys do not usually, and cannot easily, collect. These data do not come with official classification labels so we develop an algorithm which maps the free form text of job descriptions into standard occupational classification codes. The created vacancy statistics give a plausible, granular picture of UK labour demand and permit the analysis of Beveridge curves and mismatch unemployment at the occupational level.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Arthur Turrell & Bradley Speigner & Jyldyz Djumalieva & David Copple & James Thurgood, 2019. "Transforming Naturally Occurring Text Data into Economic Statistics: The Case of Online Job Vacancy Postings," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 173-207, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberch:14277
    as

    Download full text from publisher

    File URL: http://www.nber.org/chapters/c14277.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Marinescu, Ioana, 2017. "The general equilibrium impacts of unemployment insurance: Evidence from a large online job board," Journal of Public Economics, Elsevier, vol. 150(C), pages 14-29.
    2. Ay?egül ?ahin & Joseph Song & Giorgio Topa & Giovanni L. Violante, 2014. "Mismatch Unemployment," American Economic Review, American Economic Association, vol. 104(11), pages 3529-3564, November.
    3. Azar, José & Marinescu, Ioana & Steinbaum, Marshall & Taska, Bledi, 2020. "Concentration in US labor markets: Evidence from online vacancy data," Labour Economics, Elsevier, vol. 66(C).
    4. Alan Manning & Barbara Petrongolo, 2017. "How Local Are Labor Markets? Evidence from a Spatial Job Search Model," American Economic Review, American Economic Association, vol. 107(10), pages 2877-2907, October.
    5. Brad Hershbein & Lisa B. Kahn, 2018. "Do Recessions Accelerate Routine-Biased Technological Change? Evidence from Vacancy Postings," American Economic Review, American Economic Association, vol. 108(7), pages 1737-1772, July.
    6. Tomaz Cajner & David Ratner, 2016. "A Cautionary Note on the Help Wanted Online Data," FEDS Notes 2016-06-23, Board of Governors of the Federal Reserve System (U.S.).
    7. Ioana Marinescu & Ronald Wolthoff, 2020. "Opening the Black Box of the Matching Function: The Power of Words," Journal of Labor Economics, University of Chicago Press, vol. 38(2), pages 535-568.
    8. Patterson, Christina & Şahin, Ayşegül & Topa, Giorgio & Violante, Giovanni L., 2016. "Working hard in the wrong place: A mismatch-based explanation to the UK productivity puzzle," European Economic Review, Elsevier, vol. 84(C), pages 42-56.
    9. David Deming & Lisa B. Kahn, 2018. "Skill Requirements across Firms and Labor Markets: Evidence from Job Postings for Professionals," Journal of Labor Economics, University of Chicago Press, vol. 36(S1), pages 337-369.
    10. Tara Sinclair & Mariano Mamertino, 2016. "Online Job Search and Migration Intentions Across EU Member States," Working Papers 2016-5, The George Washington University, Institute for International Economic Policy.
    11. Michele Belloni & Agar Brugiavini & Elena Maschi & Kea Tijdens, 2014. "Measurement error in occupational coding:an analysis on SHARE data," Working Papers 2014: 24, Department of Economics, University of Venice "Ca' Foscari".
    12. Mellow, Wesley & Sider, Hal, 1983. "Accuracy of Response in Labor Market Surveys: Evidence and Implications," Journal of Labor Economics, University of Chicago Press, vol. 1(4), pages 331-344, October.
    13. Abraham, Katharine G, 1983. "Structural-Frictional vs. Deficient Demand Unemployment: Some New Evidence," American Economic Review, American Economic Association, vol. 73(4), pages 708-724, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maciej Berk{e}sewicz & Herman Cherniaiev & Robert Pater, 2021. "Estimating the number of entities with vacancies using administrative and online data," Papers 2106.03263, arXiv.org.
    2. Vydra Simon & Kantorowicz Jaroslaw, 2021. "Tracing Policy-relevant Information in Social Media: The Case of Twitter before and during the COVID-19 Crisis," Statistics, Politics and Policy, De Gruyter, vol. 12(1), pages 87-127, June.
    3. Faryna, Oleksandr & Pham, Tho & Talavera, Oleksandr & Tsapin, Andriy, 2022. "Wage and unemployment: Evidence from online job vacancy data," Journal of Comparative Economics, Elsevier, vol. 50(1), pages 52-70.
    4. Stef Garasto & Jyldyz Djumalieva & Karlis Kanders & Rachel Wilcock & Cath Sleeman, 2021. "Developing experimental estimates of regional skill demand," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2021-02, Economic Statistics Centre of Excellence (ESCoE).
    5. Kakuho Furukawa & Yoshihiko Hogen & Yosuke Kido, "undated". "Labor Market of Regular Workers in Japan: A Perspective from Job Advertisement Data," Bank of Japan Working Paper Series 23-E-7, Bank of Japan.
    6. Faryna, Oleksandr & Pham, Tho & Talavera, Oleksandr & Tsapin, Andriy, 2020. "Wage Setting and Unemployment: Evidence from Online Job Vacancy Data," GLO Discussion Paper Series 503, Global Labor Organization (GLO).
    7. Mary A. Burke & Alicia Sasser Modestino & Shahriar Sadighi & Rachel B. Sederberg & Bledi Taska, 2019. "No Longer Qualified? Changes in the Supply and Demand for Skills within Occupations," Working Papers 20-3, Federal Reserve Bank of Boston.
    8. Turrell, Arthur & Speigner, Bradley & Copple, David & Djumalieva, Jyldyz & Thurgood, James, 2021. "Is the UK’s productivity puzzle mostly driven by occupational mismatch? An analysis using big data on job vacancies," Labour Economics, Elsevier, vol. 71(C).
    9. He, Chuan & Mau, Karsten & Xu, Mingzhi, 2021. "Trade Shocks and Firms Hiring Decisions: Evidence from Vacancy Postings of Chinese Firms in the Trade War," Labour Economics, Elsevier, vol. 71(C).
    10. Bellatin, Alejandra & Galassi, Gabriela, 2022. "What COVID-19 May Leave Behind: Technology-Related Job Postings in Canada," IZA Discussion Papers 15209, Institute of Labor Economics (IZA).
    11. He, Chuan & Mau, Karsten & Xu, Mingzhi, 2021. "Trade Shocks and Firms Hiring Decisions:," Research Memorandum 001, Maastricht University, Graduate School of Business and Economics (GSBE).
    12. Caglayan, Mustafa & Talavera, Oleksandr & Xiong, Lin, 2022. "Female small business owners in China: Discouraged, not discriminated," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 80(C).
    13. Vacha, Stepan, 2021. "Labour demand in the UK during the COVID-19 pandemic : evidence from online job postings," Warwick-Monash Economics Student Papers 13, Warwick Monash Economics Student Papers.
    14. Pietro Giorgio Lovaglio, 2022. "Do job vacancies variations anticipate employment variations by sector? Some preliminary evidence from Italy," LABOUR, CEIS, vol. 36(1), pages 71-93, March.
    15. David Evans & Claire Mason & Haohui Chen & Andrew Reeson, 2024. "Accelerated demand for interpersonal skills in the Australian post-pandemic labour market," Nature Human Behaviour, Nature, vol. 8(1), pages 32-42, January.
    16. Joel Alcedo & Alberto Cavallo & Bricklin Dwyer & Prachi Mishra & Antonio Spilimbergo, 2022. "Back to Trend: COVID Effects on E-commerce in 47 Countries," NBER Working Papers 29729, National Bureau of Economic Research, Inc.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Turrell, Arthur & Thurgood, James & Djumalieva, Jyldyz & Copple, David & Speigner, Bradley, 2018. "Using online job vacancies to understand the UK labour market from the bottom-up," Bank of England working papers 742, Bank of England.
    2. He, Chuan & Mau, Karsten & Xu, Mingzhi, 2021. "Trade Shocks and Firms Hiring Decisions: Evidence from Vacancy Postings of Chinese Firms in the Trade War," Labour Economics, Elsevier, vol. 71(C).
    3. Abi Adams-Prassl & Tom Waters & Maria Balgova & Matthias Qian, 2023. "Firm concentration & job design: the case of schedule flexible work arrangements," IFS Working Papers W23/14, Institute for Fiscal Studies.
    4. Azar, José & Alekseeva, Liudmila & Gine, Mireia & Samila, Sampsa & Taska, Bledi, 2020. "The Demand for AI Skills in the Labor Market," CEPR Discussion Papers 14320, C.E.P.R. Discussion Papers.
    5. Andreas I Mueller & Damian Osterwalder & Josef Zweimüller & Andreas Kettemann, 2024. "Vacancy Durations and Entry Wages: Evidence from Linked Vacancy–Employer–Employee Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(3), pages 1807-1841.
    6. Ziqiao Ao & Gergely Horvath & Chunyuan Sheng & Yifan Song & Yutong Sun, 2022. "Skill requirements in job advertisements: A comparison of skill-categorization methods based on explanatory power in wage regressions," Papers 2207.12834, arXiv.org.
    7. He, Chuan & Mau, Karsten & Xu, Mingzhi, 2021. "Trade Shocks and Firms Hiring Decisions:," Research Memorandum 001, Maastricht University, Graduate School of Business and Economics (GSBE).
    8. Azar, José & Marinescu, Ioana & Steinbaum, Marshall & Taska, Bledi, 2020. "Concentration in US labor markets: Evidence from online vacancy data," Labour Economics, Elsevier, vol. 66(C).
    9. Marcus Dillender, 2019. "Computerization of White Collar Jobs," Upjohn Working Papers 19-310, W.E. Upjohn Institute for Employment Research.
    10. Pater, Robert & Szkola, Jaroslaw & Kozak, Marcin, 2019. "A method for measuring detailed demand for workers' competences," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 13, pages 1-30.
    11. Arendt, Lukasz & Gałecka-Burdziak, Ewa & Núñez, Fernando & Pater, Robert & Usabiaga, Carlos, 2023. "Skills requirements across task-content groups in Poland: What online job offers tell us," Technological Forecasting and Social Change, Elsevier, vol. 187(C).
    12. José Azar & Emiliano Huet & Ioana Marinescu & Bledi Taska & Till von, 2024. "Minimum Wage Employment Effects and Labour Market Concentration," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(4), pages 1843-1883.
    13. Maciej Berk{e}sewicz & Herman Cherniaiev & Robert Pater, 2021. "Estimating the number of entities with vacancies using administrative and online data," Papers 2106.03263, arXiv.org.
    14. David Deming & Lisa B. Kahn, 2018. "Skill Requirements across Firms and Labor Markets: Evidence from Job Postings for Professionals," Journal of Labor Economics, University of Chicago Press, vol. 36(S1), pages 337-369.
    15. Morgan Raux, 2019. "Looking for the "Best and Brightest": Hiring difficulties and high-skilled foreign workers," Working Papers halshs-02364921, HAL.
    16. Mirjam Bächli & Hélène Benghalem & Doriana Tinello & Damaris Aschwanden & Sascha Zuber & Matthias Kliegel & Michele Pellizzari & Rafael Lalive, 2024. "Ranking occupations by their proximity to workers’ profiles," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 160(1), pages 1-17, December.
    17. Brancatelli,Calogero & Marguerie,Alicia Charlene & Koettl-Brodmann,Stefanie, 2020. "Job Creation and Demand for Skills in Kosovo : What Can We Learn from Job Portal Data?," Policy Research Working Paper Series 9266, The World Bank.
    18. Alejandra Bellatin & Gabriela Galassi, 2022. "What COVID-19 May Leave Behind: Technology-Related Job Postings in Canada," Staff Working Papers 22-17, Bank of Canada.
    19. Bloom, Nicholas & Davis, Steven J. & Hansen, Stephen & Lambert, Peter John & Sadun, Raffaella & Taska, Bledi, 2023. "Remote work across jobs, companies and space," LSE Research Online Documents on Economics 121302, London School of Economics and Political Science, LSE Library.
    20. Adams-Prassl, Abi & Balgova, Maria & Qian, Matthias, 2020. "Flexible Work Arrangements in Low Wage Jobs: Evidence from Job Vacancy Data," IZA Discussion Papers 13691, Institute of Labor Economics (IZA).

    More about this item

    JEL classification:

    • E24 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Employment; Unemployment; Wages; Intergenerational Income Distribution; Aggregate Human Capital; Aggregate Labor Productivity
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • J63 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Turnover; Vacancies; Layoffs

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberch:14277. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.