IDEAS home Printed from https://ideas.repec.org/p/rco/dpaper/497.html
   My bibliography  Save this paper

Interview Sequences and the Formation of Subjective Assessments

Author

Listed:
  • Jonas Radbruch

    (HU Berlin)

  • Amelie Schiprowski

    (University of Bonn)

Abstract

Interviewing is a decisive stage of most processes that match candidates to firms and organizations. This paper studies how and why a candidate’s interview outcome depends on the other candidates interviewed by the same evaluator. We use large-scale data from high-stakes admission and hiring processes, where candidates are quasi-randomly assigned to evaluators and time slots. We find that the individual assessment decreases as the quality of other candidates assigned to the same evaluator increases. The influence of the previous candidate stands out, leading to a negative autocorrelation in evaluators’ votes of up to 40% and distorting final admission and hiring decisions. Our findings are in line with a contrast effect model where evaluators form a benchmark through associative recall. We assess potential changes in the design of interview processes to mitigate contrasting against the previous candidate.

Suggested Citation

  • Jonas Radbruch & Amelie Schiprowski, 2024. "Interview Sequences and the Formation of Subjective Assessments," Rationality and Competition Discussion Paper Series 497, CRC TRR 190 Rationality and Competition.
  • Handle: RePEc:rco:dpaper:497
    as

    Download full text from publisher

    File URL: https://rationality-and-competition.de/wp-content/uploads/discussion_paper/497.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Mitchell Hoffman & Lisa B Kahn & Danielle Li, 2018. "Discretion in Hiring," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 765-800.
    2. Manudeep Bhuller & Gordon B. Dahl & Katrine V. Løken & Magne Mogstad, 2020. "Incarceration, Recidivism, and Employment," Journal of Political Economy, University of Chicago Press, vol. 128(4), pages 1269-1324.
    3. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    4. Altonji, Joseph G & Segal, Lewis M, 1996. "Small-Sample Bias in GMM Estimation of Covariance Structures," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 353-366, July.
    5. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    6. Victor A. Ginsburgh & Jan C. van Ours, 2003. "Expert Opinion and Compensation: Evidence from a Musical Competition," American Economic Review, American Economic Association, vol. 93(1), pages 289-296, March.
    7. Charles T. Clotfelter & Philip J. Cook, 1993. "Notes: The "Gambler's Fallacy" in Lottery Play," Management Science, INFORMS, vol. 39(12), pages 1521-1525, December.
    8. Uri Simonsohn, 2006. "New Yorkers Commute More Everywhere: Contrast Effects in the Field," The Review of Economics and Statistics, MIT Press, vol. 88(1), pages 1-9, February.
    9. B. Douglas Bernheim & Antonio Rangel, 2004. "Addiction and Cue-Triggered Decision Processes," American Economic Review, American Economic Association, vol. 94(5), pages 1558-1590, December.
    10. Matthew Rabin, 2002. "Inference by Believers in the Law of Small Numbers," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 775-816.
    11. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2020. "Memory, Attention, and Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1399-1442.
    12. Stefano Della & Jörg Heining & Johannes F Schmieder & Simon Trenkle, 2023. "Evidence on Job Search Models from a Survey of Unemployed Workers in Germany," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(2), pages 1181-1232.
    13. Chen, Daniel L. & Moskowitz, Tobias J. & Shue, Kelly, 2016. "Decision-Making Under the Gambler’s Fallacy: Evidence From Asylum Courts, Loan Officers, and Baseball Umpires," IAST Working Papers 16-43, Institute for Advanced Study in Toulouse (IAST).
    14. Koen Jochmans, 2023. "Testing random assignment to peer groups," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 321-333, April.
    15. David Laibson, 2001. "A Cue-Theory of Consumption," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(1), pages 81-119.
    16. Jonathan Guryan & Kory Kroft & Matthew J. Notowidigdo, 2009. "Peer Effects in the Workplace: Evidence from Random Groupings in Professional Golf Tournaments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 34-68, October.
    17. Nicola Gennaioli & Andrei Shleifer, 2010. "What Comes to Mind," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1399-1433.
    18. Benjamin Enke & Frederik Schwerter & Florian Zimmermann, 2019. "Associative Memory and Belief Formation," CESifo Working Paper Series 7916, CESifo.
    19. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    20. Oyer, Paul & Schaefer, Scott, 2011. "Personnel Economics: Hiring and Incentives," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 20, pages 1769-1823, Elsevier.
    21. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    22. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2019. "Memory and Reference Prices: An Application to Rental Choice," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 572-576, May.
    23. Kory Kroft & Fabian Lange & Matthew J. Notowidigdo, 2013. "Duration Dependence and Labor Market Conditions: Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(3), pages 1123-1167.
    24. Hassan Afrouzi & Spencer Y Kwon & Augustin Landier & Yueran Ma & David Thesmar, 2023. "Overreaction in Expectations: Evidence and Theory," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(3), pages 1713-1764.
    25. Neil Thakral & Linh T. Tô, 2021. "Daily Labor Supply and Adaptive Reference Points," American Economic Review, American Economic Association, vol. 111(8), pages 2417-2443, August.
    26. Ricardo Estrada, 2019. "Rules versus Discretion in Public Service: Teacher Hiring in Mexico," Journal of Labor Economics, University of Chicago Press, vol. 37(2), pages 545-579.
    27. Stefano Della & Jörg Heining & Johannes F Schmieder & Simon Trenkle, 2022. "Evidence on Job Search Models from a Survey of Unemployed Workers in Germany [Reference-Dependent Preferences: Evidence from Marathon Runners]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(2), pages 1181-1232.
    28. John J. Horton, 2017. "The Effects of Algorithmic Labor Market Recommendations: Evidence from a Field Experiment," Journal of Labor Economics, University of Chicago Press, vol. 35(2), pages 345-385.
    29. Danielle Li, 2017. "Expertise versus Bias in Evaluation: Evidence from the NIH," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 60-92, April.
    30. Samuel M. Hartzmark & Kelly Shue, 2018. "A Tough Act to Follow: Contrast Effects in Financial Markets," Journal of Finance, American Finance Association, vol. 73(4), pages 1567-1613, August.
    31. Uri Simonsohn & George Loewenstein, 2006. "Mistake #37: The Effect of Previously Encountered Prices on Current Housing Demand," Economic Journal, Royal Economic Society, vol. 116(508), pages 175-199, January.
    32. Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-1426, November.
    33. Danielle Li & Lindsey R. Raymond & Peter Bergman, 2020. "Hiring as Exploration," NBER Working Papers 27736, National Bureau of Economic Research, Inc.
    34. David H. Autor & David Scarborough, 2008. "Does Job Testing Harm Minority Workers? Evidence from Retail Establishments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(1), pages 219-277.
    35. Sendhil Mullainathan, 2002. "A Memory-Based Model of Bounded Rationality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 735-774.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anna Bindler & Randi Hjalmarsson, 2019. "Path Dependency in Jury Decision Making," Journal of the European Economic Association, European Economic Association, vol. 17(6), pages 1971-2017.
    2. Daniel J. Benjamin, 2018. "Errors in Probabilistic Reasoning and Judgment Biases," NBER Working Papers 25200, National Bureau of Economic Research, Inc.
    3. Samuel M. Hartzmark & Kelly Shue, 2017. "A Tough Act to Follow: Contrast Effects In Financial Markets," NBER Working Papers 23883, National Bureau of Economic Research, Inc.
    4. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2020. "Memory, Attention, and Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1399-1442.
    5. Diana Moreira & Santiago Pérez, 2022. "Who Benefits from Meritocracy?," NBER Working Papers 30113, National Bureau of Economic Research, Inc.
    6. Abebe, Girum & Caria, Stefano & Fafchamps, Marcel & Falco, Paolo & Franklin, Simon & Quinn, Simon & Shilpi, Forhad, 2017. "Matching firms and workers in a field experiment in Ethiopia," LSE Research Online Documents on Economics 86572, London School of Economics and Political Science, LSE Library.
    7. Daniel Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision-Making under the Gambler's Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," NBER Working Papers 22026, National Bureau of Economic Research, Inc.
    8. Hagenbach, Jeanne & Koessler, Frédéric, 2022. "Selective memory of a psychological agent," European Economic Review, Elsevier, vol. 142(C).
    9. Gagnon-Bartsch, Tristan & Bushong, Benjamin, 2022. "Learning with misattribution of reference dependence," Journal of Economic Theory, Elsevier, vol. 203(C).
    10. Doidge, Mary & Feng, Hongli & Hennessy, David A., 2017. "A test of the gambler’s and hot hand fallacies in farmers’ weather and market predictions," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258457, Agricultural and Applied Economics Association.
    11. Brändle, Tobias & Grunau, Philipp & Haylock, Michael & Kampkötter, Patrick, 2020. "Recruitment strategies and match quality - New evidence from representative linked employer-employee data," University of Tübingen Working Papers in Business and Economics 134, University of Tuebingen, Faculty of Economics and Social Sciences, School of Business and Economics.
    12. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    13. Benjamin Enke & Frederik Schwerter & Florian Zimmermann, 2019. "Associative Memory and Belief Formation," CESifo Working Paper Series 7916, CESifo.
    14. Angelico, Cristina, 2024. "The green transition and firms' expectations on future prices: Survey evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 221(C), pages 519-543.
    15. Markus M. Möbius & Muriel Niederle & Paul Niehaus & Tanya S. Rosenblat, 2022. "Managing Self-Confidence: Theory and Experimental Evidence," Management Science, INFORMS, vol. 68(11), pages 7793-7817, November.
    16. Moshe A. Barach & John Horton, 2017. "How Do Employers Use Compensation History?: Evidence from a Field Experiment," CESifo Working Paper Series 6559, CESifo.
    17. Abel, Martin & Burger, Rulof, 2023. "Unpacking Name-Based Race Discrimination," IZA Discussion Papers 16254, Institute of Labor Economics (IZA).
    18. Alejandro Núnez Arroyo, 2018. "Information seeking with selective memory," Documentos CEDE 17131, Universidad de los Andes, Facultad de Economía, CEDE.
    19. Payzan-LeNestour, Elise & Pradier, Lionnel & Putniņš, Tālis J., 2023. "Biased risk perceptions: Evidence from the laboratory and financial markets," Journal of Banking & Finance, Elsevier, vol. 154(C).
    20. Jens Ludwig & Sendhil Mullainathan, 2021. "Fragile Algorithms and Fallible Decision-Makers: Lessons from the Justice System," Journal of Economic Perspectives, American Economic Association, vol. 35(4), pages 71-96, Fall.

    More about this item

    Keywords

    hiring; interviewing; contrast effect; memory;
    All these keywords.

    JEL classification:

    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • J20 - Labor and Demographic Economics - - Demand and Supply of Labor - - - General
    • M51 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Firm Employment Decisions; Promotions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rco:dpaper:497. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Viviana Lalli (email available below). General contact details of provider: https://rationality-and-competition.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.