IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v55y2021i3d10.1007_s11135-020-01031-4.html
   My bibliography  Save this article

ICT skills measurement in social surveys: Can we trust self-reports?

Author

Listed:
  • Marta Palczyńska

    (SGH Warsaw School of Economics
    Institute for Structural Research)

  • Maja Rynko

    (SGH Warsaw School of Economics)

Abstract

Self-reports are the most common way of measuring information and communications technology (ICT) skills in social surveys. Studies comparing self-reported computer skills with objective assessments have found evidence of significant overreporting of skills, but were conducted only among non-representative groups of individuals. This paper fills an important gap by analysing the degree to which ICT skills are overreported in the working-age population of Poland, and the potential causes of this behaviour. We compare answers to Eurostat questions on ICT usage with direct assessments of the corresponding tasks. The results suggest that those individuals who are most likely to possess ICT skills are also most likely to overreport having these skills. The propensity to overreport decreases with age and increases with years of education and numeracy level; women are less likely than men to overestimate their skills. The positive relationship between the probability of a group to overreport their own skills and their expected levels of skills suggests that social desirability bias may explain this phenomenon.

Suggested Citation

  • Marta Palczyńska & Maja Rynko, 2021. "ICT skills measurement in social surveys: Can we trust self-reports?," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(3), pages 917-943, June.
    • Handle: RePEc:spr:qualqt:v:55:y:2021:i:3:d:10.1007_s11135-020-01031-4
    DOI: 10.1007/s11135-020-01031-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-020-01031-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-020-01031-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Patricia Mccourt Larres & Joan Ballantine & Mark Whittington, 2003. "Evaluating the validity of self-assessment: measuring computer literacy among entry-level undergraduates within accounting degree programmes at two UK universities," Accounting Education, Taylor & Francis Journals, vol. 12(2), pages 97-112.
    2. Borghans, Lex & ter Weel, Bas, 2004. "Are computer skills the new basic skills? The returns to computer, writing and math skills in Britain," Labour Economics, Elsevier, vol. 11(1), pages 85-98, February.
    3. Ehrlinger, Joyce & Johnson, Kerri & Banner, Matthew & Dunning, David & Kruger, Justin, 2008. "Why the unskilled are unaware: Further explorations of (absent) self-insight among the incompetent," Organizational Behavior and Human Decision Processes, Elsevier, vol. 105(1), pages 98-121, January.
    4. repec:pri:cpanda:wp17%20-%20dimaggio,%20hargittai,%20neuman,%20robinson is not listed on IDEAS
    5. Johnston, David W. & Propper, Carol & Shields, Michael A., 2009. "Comparing subjective and objective measures of health: Evidence from hypertension for the income/health gradient," Journal of Health Economics, Elsevier, vol. 28(3), pages 540-552, May.
    6. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    7. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375, March.
    8. Falck, Oliver & Heimisch-Roecker, Alexandra & Wiederhold, Simon, 2021. "Returns to ICT skills," Research Policy, Elsevier, vol. 50(7).
    9. Philip Brenner & John DeLamater, 2014. "Social Desirability Bias in Self-reports of Physical Activity: Is an Exercise Identity the Culprit?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(2), pages 489-504, June.
    10. Alan B. Krueger, 1993. "How Computers Have Changed the Wage Structure: Evidence from Microdata, 1984–1989," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(1), pages 33-60.
    11. Eszter Hargittai & Steven Shafer, 2006. "Differences in Actual and Perceived Online Skills: The Role of Gender," Social Science Quarterly, Southwestern Social Science Association, vol. 87(2), pages 432-448, June.
    12. Paul DiMaggio & Eszter Hargittai & W. Russell Neuman & John P. Robinson, 2001. "Social Implications of the Internet," Working Papers 159, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Arts and Cultural Policy Studies..
    13. John E. DiNardo & Jörn-Steffen Pischke, 1997. "The Returns to Computer Use Revisited: Have Pencils Changed the Wage Structure Too?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(1), pages 291-303.
    14. Jens Bonke, 2005. "Paid Work and Unpaid Work: Diary Information Versus Questionnaire Information," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 70(3), pages 349-368, February.
    15. Man Kan, 2008. "Measuring Housework Participation: The Gap between “Stylised” Questionnaire Estimates and Diary-based Estimates," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 86(3), pages 381-400, May.
    16. Paul DiMaggio & Eszter Hargittai & W. Russell Neuman & John P. Robinson, 2001. "Social Implications of the Internet," Working Papers 159, Princeton University, School of Public and International Affairs, Center for Arts and Cultural Policy Studies..
    17. repec:mpr:mprres:7480 is not listed on IDEAS
    18. Robert Cialdini, 2007. "Descriptive Social Norms as Underappreciated Sources of Social Control," Psychometrika, Springer;The Psychometric Society, vol. 72(2), pages 263-268, June.
    19. Iiris Niemi, 1993. "Systematic error in behavioural measurement: Comparing results from interview and time budget studies," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 30(2), pages 229-244, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paola Gritti & Riccardo Leoni, 2013. "The impact on wages of generic competencies, psychological capital, new work practices and digital technologies," Working Papers (2013-) 1301, University of Bergamo, Department of Management, Economics and Quantitative Methods.
    2. Riccardo Leoni & Paola Gritti, 2017. "Institutional Wage Setting, Distinctive Competencies and Wage Premia," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 3(1), pages 71-111, March.
    3. Gimenez-Nadal, J. Ignacio & Molina, Jose Alberto, 2015. "Health status and the allocation of time: Cross-country evidence from Europe," Economic Modelling, Elsevier, vol. 46(C), pages 188-203.
    4. Fairlie, Robert W. & Bahr, Peter Riley, 2018. "The effects of computers and acquired skills on earnings, employment and college enrollment: Evidence from a field experiment and California UI earnings records," Economics of Education Review, Elsevier, vol. 63(C), pages 51-63.
    5. Peter Dolton & Panu Pelkonen, 2008. "The Wage Effects of Computer Use: Evidence from WERS 2004," British Journal of Industrial Relations, London School of Economics, vol. 46(4), pages 587-630, December.
    6. David Johnston & Carol Propper & Stephen Pudney & Michael Shields, 2014. "Child Mental Health And Educational Attainment: Multiple Observers And The Measurement Error Problem," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(6), pages 880-900, September.
    7. Beland, Louis-Philippe & Murphy, Richard, 2016. "Ill Communication: Technology, distraction & student performance," Labour Economics, Elsevier, vol. 41(C), pages 61-76.
    8. Borghans, Lex & ter Weel, Bas, 2004. "What happens when agent T gets a computer?: The labor market impact of cost efficient computer adoption," Journal of Economic Behavior & Organization, Elsevier, vol. 54(2), pages 137-151, June.
    9. Falck, Oliver & Heimisch-Roecker, Alexandra & Wiederhold, Simon, 2021. "Returns to ICT skills," Research Policy, Elsevier, vol. 50(7).
    10. Ganna Vakhitova & Christopher R. Bollinger, 2011. "Labor Market Return to Computer Skills: Using Microsoft Certification to Measure Computer Skills," Discussion Papers 46, Kyiv School of Economics.
    11. Borghans, Lex & ter Weel, Bas, 2007. "The diffusion of computers and the distribution of wages," European Economic Review, Elsevier, vol. 51(3), pages 715-748, April.
    12. Fatehkia, Masoomali & Kashyap, Ridhi & Weber, Ingmar, 2018. "Using Facebook Ad Data to Track the Global Digital Gender Gap," SocArXiv rkvb3, Center for Open Science.
    13. Todd M. Gabe, 2009. "Knowledge And Earnings," Journal of Regional Science, Wiley Blackwell, vol. 49(3), pages 439-457, August.
    14. Fabienne Kiener & Ann-Sophie Gnehm & Simon Clematide & Uschi Backes-Gellner, 2019. "IT skills in vocational training curricula and labour market outcomes," Economics of Education Working Paper Series 0159, University of Zurich, Department of Business Administration (IBW), revised Sep 2022.
    15. Ng, Ying Chu, 2006. "Levels of computer self-efficacy, computer use and earnings in China," Economics Letters, Elsevier, vol. 90(3), pages 427-432, March.
    16. Xinxin Ma, 2022. "Internet use and gender wage gap: evidence from China," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 56(1), pages 1-17, December.
    17. Fatehkia, Masoomali & Kashyap, Ridhi & Weber, Ingmar, 2018. "Using Facebook ad data to track the global digital gender gap," World Development, Elsevier, vol. 107(C), pages 189-209.
    18. Xinxin Ma, 2023. "Internet Use and Risky Financial Market Participation: Evidence from China," International Journal of Economics and Finance, Canadian Center of Science and Education, vol. 15(2), pages 1-1, February.
    19. Carlos Medina & Christian Posso, 2010. "Technical Change and Polarization of the Labor Market: Evidence for Brazil, Colombia and Mexico," Borradores de Economia 614, Banco de la Republica de Colombia.
    20. Leora Friedberg, 2003. "The Impact of Technological Change on Older Workers: Evidence from Data on Computer Use," ILR Review, Cornell University, ILR School, vol. 56(3), pages 511-529, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:55:y:2021:i:3:d:10.1007_s11135-020-01031-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.