IDEAS home Printed from https://ideas.repec.org/a/aea/aecrev/v109y2019i11p3713-44.html
   My bibliography  Save this article

Incentivized Resume Rating: Eliciting Employer Preferences without Deception

Author

Listed:
  • Judd B. Kessler
  • Corinne Low
  • Colin D. Sullivan

Abstract

We introduce a new experimental paradigm to evaluate employer preferences, called incentivized resume rating (IRR). Employers evaluate resumes they know to be hypothetical in order to be matched with real job seekers, preserving incentives while avoiding the deception necessary in audit studies. We deploy IRR with employers recruiting college seniors from a prestigious school, randomizing human capital characteristics and demographics of hypothetical candidates. We measure both employer preferences for candidates and employer beliefs about the likelihood that candidates will accept job offers, avoiding a typical confound in audit studies. We discuss the costs, benefits, and future applications of this new methodology.

Suggested Citation

  • Judd B. Kessler & Corinne Low & Colin D. Sullivan, 2019. "Incentivized Resume Rating: Eliciting Employer Preferences without Deception," American Economic Review, American Economic Association, vol. 109(11), pages 3713-3744, November.
  • Handle: RePEc:aea:aecrev:v:109:y:2019:i:11:p:3713-44
    Note: DOI: 10.1257/aer.20181714
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/doi/10.1257/aer.20181714
    Download Restriction: no

    File URL: https://www.aeaweb.org/doi/10.1257/aer.20181714.data
    Download Restriction: no

    File URL: https://www.aeaweb.org/doi/10.1257/aer.20181714.appx
    Download Restriction: no

    File URL: https://www.aeaweb.org/doi/10.1257/aer.20181714.ds
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jonathan de Quidt & Johannes Haushofer & Christopher Roth, 2018. "Measuring and Bounding Experimenter Demand," American Economic Review, American Economic Association, vol. 108(11), pages 3266-3302, November.
    2. David Neumark & Ian Burn & Patrick Button, 2019. "Is It Harder for Older Workers to Find Jobs? New and Improved Evidence from a Field Experiment," Journal of Political Economy, University of Chicago Press, vol. 127(2), pages 922-970.
    3. Rajeev Darolia & Cory Koedel & Paco Martorell & Katie Wilson & Francisco Perez‐Arce, 2015. "Do Employers Prefer Workers Who Attend For‐Profit Colleges? Evidence from a Field Experiment," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(4), pages 881-903, September.
    4. Kevin Lang & Jee-Yeon K. Lehmann, 2012. "Racial Discrimination in the Labor Market: Theory and Empirics," Journal of Economic Literature, American Economic Association, vol. 50(4), pages 959-1006, December.
    5. Lars J. Kirkeboen & Edwin Leuven & Magne Mogstad, 2016. "Editor's Choice Field of Study, Earnings, and Self-Selection," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1057-1111.
    6. Riach Peter A & Rich Judith, 2006. "An Experimental Investigation of Sexual Discrimination in Hiring in the English Labor Market," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-22, January.
    7. Kory Kroft & Fabian Lange & Matthew J. Notowidigdo, 2013. "Duration Dependence and Labor Market Conditions: Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(3), pages 1123-1167.
    8. Scott E. Carrell & Marianne E. Page & James E. West, 2010. "Sex and Science: How Professor Gender Perpetuates the Gender Gap," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(3), pages 1101-1144.
    9. David H. Autor & Susan N. Houseman, 2010. "Do Temporary-Help Jobs Improve Labor Market Outcomes for Low-Skilled Workers? Evidence from "Work First"," American Economic Journal: Applied Economics, American Economic Association, vol. 2(3), pages 96-128, July.
    10. James J. Heckman, 1998. "Detecting Discrimination," Journal of Economic Perspectives, American Economic Association, vol. 12(2), pages 101-116, Spring.
    11. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    12. Hanson, Andrew & Hawley, Zackary, 2011. "Do landlords discriminate in the rental housing market? Evidence from an internet field experiment in US cities," Journal of Urban Economics, Elsevier, vol. 70(2-3), pages 99-114, September.
    13. Andreas Ortmann & Ralph Hertwig, 2002. "The Costs of Deception: Evidence from Psychology," Experimental Economics, Springer;Economic Science Association, vol. 5(2), pages 111-131, October.
    14. David Neumark, 2012. "Detecting Discrimination in Audit and Correspondence Studies," Journal of Human Resources, University of Wisconsin Press, vol. 47(4), pages 1128-1157.
    15. Henry S. Farber & Chris M. Herbst & Dan Silverman & Till von Wachter, 2018. "Whom Do Employers Want? The Role of Recent Employment and Unemployment Status and Age," Working Papers 619, Princeton University, Department of Economics, Industrial Relations Section..
    16. Daniel M. Butler & David E. Broockman, 2011. "Do Politicians Racially Discriminate Against Constituents? A Field Experiment on State Legislators," American Journal of Political Science, John Wiley & Sons, vol. 55(3), pages 463-477, July.
    17. Asaf Zussman, 2013. "Ethnic Discrimination: Lessons from the Israeli Online Market for Used Cars," Economic Journal, Royal Economic Society, vol. 123(11), pages 433-468, November.
    18. Gaddis, S. Michael, 2015. "Discrimination in the Credential Society: An Audit Study of Race and College Selectivity in the Labor Market," SocArXiv 6qjue, Center for Open Science.
    19. Altonji, Joseph G. & Blank, Rebecca M., 1999. "Race and gender in the labor market," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 48, pages 3143-3259, Elsevier.
    20. David J. Deming & Noam Yuchtman & Amira Abulafi & Claudia Goldin & Lawrence F. Katz, 2016. "The Value of Postsecondary Credentials in the Labor Market: An Experimental Study," American Economic Review, American Economic Association, vol. 106(3), pages 778-806, March.
    21. repec:eee:labchp:v:3:y:1999:i:pc:p:3143-3259 is not listed on IDEAS
    22. J. Aislinn Bohren & Alex Imas & Michael Rosenberg, 2019. "The Dynamics of Discrimination: Theory and Evidence," American Economic Review, American Economic Association, vol. 109(10), pages 3395-3436, October.
    23. Stefan Eriksson & Dan-Olof Rooth, 2014. "Do Employers Use Unemployment as a Sorting Criterion When Hiring? Evidence from a Field Experiment," American Economic Review, American Economic Association, vol. 104(3), pages 1014-1039, March.
    24. John M. Nunley & Adam Pugh & Nicholas Romero & Richard Alan Seals, Jr., 2014. "Unemployment, Underemployment, and Employment Opportunities: Results from a Correspondence Audit of the Labor Market for College Graduates," Auburn Economics Working Paper Series auwp2014-04, Department of Economics, Auburn University.
    25. Vojtěch Bartoš & Michal Bauer & Julie Chytilová & Filip Matějka, 2016. "Attention Discrimination: Theory and Field Experiments with Monitoring Information Acquisition," American Economic Review, American Economic Association, vol. 106(6), pages 1437-1475, June.
    26. Henry S. Farber & Chris M. Herbst & Dan Silverman & Till von Wachter, 2018. "Whom Do Employers Want? The Role of Recent Employment and Unemployment Status and Age," NBER Working Papers 24605, National Bureau of Economic Research, Inc.
    27. Claudia Goldin, 2014. "A Grand Gender Convergence: Its Last Chapter," American Economic Review, American Economic Association, vol. 104(4), pages 1091-1119, April.
    28. John M. Nunley & Adam Pugh & Nicholas Romero & R. Alan Seals, 2017. "The Effects of Unemployment and Underemployment on Employment Opportunities," ILR Review, Cornell University, ILR School, vol. 70(3), pages 642-669, May.
    29. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    30. William Greene, 2004. "The behaviour of the maximum likelihood estimator of limited dependent variable models in the presence of fixed effects," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 98-119, June.
    31. Marianne Bertrand & Dolly Chugh & Sendhil Mullainathan, 2005. "Implicit Discrimination," American Economic Review, American Economic Association, vol. 95(2), pages 94-98, May.
    32. Michael Ewens & Bryan Tomlin & Liang Choon Wang, 2014. "Statistical Discrimination or Prejudice? A Large Sample Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 96(1), pages 119-134, March.
    33. Amanda Pallais, 2014. "Inefficient Hiring in Entry-Level Labor Markets," American Economic Review, American Economic Association, vol. 104(11), pages 3565-3599, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gaddis, S. Michael, 2018. "An Introduction to Audit Studies in the Social Sciences," SocArXiv e5hfc, Center for Open Science.
    2. David Neumark, 2018. "Experimental Research on Labor Market Discrimination," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 799-866, September.
    3. Button, Patrick & Walker, Brigham, 2020. "Employment discrimination against Indigenous Peoples in the United States: Evidence from a field experiment," Labour Economics, Elsevier, vol. 65(C).
    4. Chowdhury, Shyamal & Ooi, Evarn & Slonim, Robert, 2020. "Racial Discrimination and White First Name Adoption: Evidence from a Correspondence Study in the Australian Labour Market," IZA Discussion Papers 13208, Institute of Labor Economics (IZA).
    5. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    6. Carlsson, Magnus & Eriksson, Stefan, 2019. "Age discrimination in hiring decisions: Evidence from a field experiment in the labor market," Labour Economics, Elsevier, vol. 59(C), pages 173-183.
    7. Gagnon, Nickolas & Bosmans, Kristof & Riedl, Arno, 2020. "The Effect of Unfair Chances and Gender Discrimination on Labor Supply," Research Memorandum 005, Maastricht University, Graduate School of Business and Economics (GSBE).
    8. Hinrichs, Peter, 2021. "What kind of teachers are schools looking for? Evidence from a randomized field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 395-411.
    9. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    10. Joanna N. Lahey & Douglas R. Oxley, 2021. "Discrimination at the Intersection of Age, Race, and Gender: Evidence from an Eye‐Tracking Experiment," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(4), pages 1083-1119, September.
    11. Rich, Judy, 2014. "What Do Field Experiments of Discrimination in Markets Tell Us? A Meta Analysis of Studies Conducted since 2000," IZA Discussion Papers 8584, Institute of Labor Economics (IZA).
    12. Soumitra Shukla, 2021. "Between College and That First Job: Designing and Evaluating Policies for Hiring Diversity," International Finance Discussion Papers 1331, Board of Governors of the Federal Reserve System (U.S.).
    13. Ewens, Michael, 2022. "Race and Gender in Entrepreneurial Finance," SocArXiv djf8z, Center for Open Science.
    14. Ye Zhang, 2020. "Discrimination in the Venture Capital Industry: Evidence from Field Experiments," Papers 2010.16084, arXiv.org, revised Aug 2022.
    15. Baert, Stijn, 2017. "Hiring Discrimination: An Overview of (Almost) All Correspondence Experiments Since 2005," GLO Discussion Paper Series 61, Global Labor Organization (GLO).
    16. Stefan Eriksson & Per Johansson & Sophie Langenskiöld, 2017. "What is the right profile for getting a job? A stated choice experiment of the recruitment process," Empirical Economics, Springer, vol. 53(2), pages 803-826, September.
    17. Adermon, Adrian & Hensvik, Lena, 2022. "Gig-jobs: Stepping stones or dead ends?," Labour Economics, Elsevier, vol. 76(C).
    18. Nikoloz Kudashvili & Philipp Lergetporer, 2019. "Do Minorities Misrepresent Their Ethnicity to Avoid Discrimination?," CESifo Working Paper Series 7861, CESifo.
    19. Melo, Vitor & Rocha, Hugo Vaca Pereira & Sigaud, Liam & Warren, Patrick L. & Gaddis, S. Michael, 2024. "Understanding Discrimination in College Admissions: A Field Experiment," SocArXiv 5ctms, Center for Open Science.
    20. Valfort, Marie-Anne, 2020. "Anti-Muslim discrimination in France: Evidence from a field experiment," World Development, Elsevier, vol. 135(C).

    More about this item

    JEL classification:

    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • I26 - Health, Education, and Welfare - - Education - - - Returns to Education
    • J23 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Demand
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • M51 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Firm Employment Decisions; Promotions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:aecrev:v:109:y:2019:i:11:p:3713-44. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.