IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2502.08501.html
   My bibliography  Save this paper

Better Together? A Field Experiment on Human-Algorithm Interaction in Child Protection

Author

Listed:
  • Marie-Pascale Grimon
  • Christopher Mills

Abstract

Algorithm tools have the potential to improve public service efficiency, but our understanding of how experts use algorithms is limited, and concerns about resulting bias are widespread. We randomize access to algorithm support for workers allocating Child Protective Services (CPS) investigations. Access to the algorithm reduced maltreatment-related hospitalizations, especially for disadvantaged groups, while reducing CPS surveillance of Black children. Child injuries fell by 29 percent. Workers improved their scrutiny of complementary information emphasized by the algorithm, and targeted investigations to children at greater risk of harm irrespective of algorithm-predicted risk. Algorithm-only counterfactuals confirm human-algorithm complementarity for both efficiency and equity.

Suggested Citation

  • Marie-Pascale Grimon & Christopher Mills, 2025. "Better Together? A Field Experiment on Human-Algorithm Interaction in Child Protection," Papers 2502.08501, arXiv.org.
    • Handle: RePEc:arx:papers:2502.08501
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2502.08501
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Danielle Li & Lindsey Raymond, 2023. "Generative AI at Work," Papers 2304.11771, arXiv.org, revised Nov 2024.
    2. Karel H. van Donselaar & Vishal Gaur & Tom van Woensel & Rob A. C. M. Broekmeulen & Jan C. Fransoo, 2010. "Ordering Behavior in Retail Stores and Implications for Automated Replenishment," Management Science, INFORMS, vol. 56(5), pages 766-784, May.
    3. Doyle, Joseph J., 2013. "Causal effects of foster care: An instrumental-variables approach," Children and Youth Services Review, Elsevier, vol. 35(7), pages 1143-1151.
    4. David Almog & Romain Gauriot & Lionel Page & Daniel Martin, 2024. "AI Oversight and Human Mistakes: Evidence from Centre Court," Papers 2401.16754, arXiv.org, revised Feb 2025.
    5. Monica P Bhatt & Sara B Heller & Max Kapustin & Marianne Bertrand & Christopher Blattman, 2024. "Predicting and Preventing Gun Violence: An Experimental Evaluation of READI Chicago," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(1), pages 1-56.
    6. E. Jason Baron & Max Gross, 2022. "Is There a Foster Care-To-Prison Pipeline? Evidence from Quasi-Randomly Assigned Investigators," NBER Working Papers 29922, National Bureau of Economic Research, Inc.
    7. John A. List, 2020. "Non est Disputandum de Generalizability? A Glimpse into The External Validity Trial," NBER Working Papers 27535, National Bureau of Economic Research, Inc.
    8. Jens Ludwig & Sendhil Mullainathan, 2021. "Fragile Algorithms and Fallible Decision-Makers: Lessons from the Justice System," Journal of Economic Perspectives, American Economic Association, vol. 35(4), pages 71-96, Fall.
    9. Maria D. Fitzpatrick & Katharine Sadowski & Christopher Wildeman, 2022. "Does Access to an Algorithmic Decision-Making Tool Change Child Protective Service Caseworkers’ Investigation Decisions?," NBER Chapters, in: Economics of Artificial Intelligence, National Bureau of Economic Research, Inc.
    10. Prithwiraj Choudhury & Evan Starr & Rajshree Agarwal, 2020. "Machine learning and human capital complementarities: Experimental evidence on bias mitigation," Strategic Management Journal, Wiley Blackwell, vol. 41(8), pages 1381-1411, August.
    11. Sean Cao & Wei Jiang & Junbo L. Wang & Baozhong Yang, 2021. "From Man vs. Machine to Man + Machine: The Art and AI of Stock Analyses," NBER Working Papers 28800, National Bureau of Economic Research, Inc.
    12. Eli Ben-Michael & D. James Greiner & Melody Huang & Kosuke Imai & Zhichao Jiang & Sooahn Shin, 2024. "Does AI help humans make better decisions? A statistical evaluation framework for experimental and observational studies," Papers 2403.12108, arXiv.org, revised Oct 2024.
    13. Sendhil Mullainathan & Ziad Obermeyer, 2022. "Diagnosing Physician Error: A Machine Learning Approach to Low-Value Health Care [“The Determinants of Productivity in Medical Testing: Intensity and Allocation of Care,”]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(2), pages 679-727.
    14. David Arnold & Will S. Dobbie & Peter Hull, 2024. "Building Non-Discriminatory Algorithms in Selected Data," NBER Working Papers 32403, National Bureau of Economic Research, Inc.
    15. Nikhil Agarwal & Alex Moehring & Pranav Rajpurkar & Tobias Salz, 2023. "Combining Human Expertise with Artificial Intelligence: Experimental Evidence from Radiology," NBER Working Papers 31422, National Bureau of Economic Research, Inc.
    16. Jillian Grennan & Roni Michaely, 2020. "Artificial Intelligence and High-Skilled Work: Evidence from Analysts," Swiss Finance Institute Research Paper Series 20-84, Swiss Finance Institute.
    17. Ziyi Wang & Lijia Wei & Lian Xue, 2024. "Overcoming Medical Overuse with AI Assistance: An Experimental Investigation," Papers 2405.10539, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grimon, Marie-Pascale & Mills, Christopher, 2025. "Better Together? A Field Experiment on Human-Algorithm Interaction in Child Protection," SOFI Working Papers in Labour Economics 2/2025, Stockholm University, Swedish Institute for Social Research.
    2. Eric Chyn & Brigham Frandsen & Emily C. Leslie, 2024. "Examiner and Judge Designs in Economics: A Practitioner's Guide," NBER Working Papers 32348, National Bureau of Economic Research, Inc.
    3. Michael Allan Ribers & Hannes Ullrich, 2023. "Machine learning and physician prescribing: a path to reduced antibiotic use," Berlin School of Economics Discussion Papers 0019, Berlin School of Economics.
    4. Michael Allan Ribers & Hannes Ullrich, 2024. "Complementarities between algorithmic and human decision-making: The case of antibiotic prescribing," Quantitative Marketing and Economics (QME), Springer, vol. 22(4), pages 445-483, December.
    5. Marco Castillo & Sera Linardi & Ragan Petrie, 2024. "Recidivism and Barriers to Reintegration: A Field Experiment Encouraging Use of Reentry Support," CESifo Working Paper Series 11554, CESifo.
    6. Hyunjin Kim & Edward L. Glaeser & Andrew Hillis & Scott Duke Kominers & Michael Luca, 2024. "Decision authority and the returns to algorithms," Strategic Management Journal, Wiley Blackwell, vol. 45(4), pages 619-648, April.
    7. Johannes W. Ligtenberg & Tiemen Woutersen, 2024. "Multidimensional clustering in judge designs," Papers 2406.09473, arXiv.org.
    8. Mahdi Ahmadi & Neda Khosh Kheslat & Adebola Akintomide, 2024. "Generative AI Impact on Labor Market: Analyzing ChatGPT's Demand in Job Advertisements," Papers 2412.07042, arXiv.org.
    9. Alex Albright, 2024. "The Hidden Effects of Algorithmic Recommendations," Opportunity and Inclusive Growth Institute Working Papers 104, Federal Reserve Bank of Minneapolis.
    10. S. Mills & S. Costa & C. R. Sunstein, 2023. "AI, Behavioural Science, and Consumer Welfare," Journal of Consumer Policy, Springer, vol. 46(3), pages 387-400, September.
    11. Hannes Ullrich & Michael Allan Ribers, 2023. "Machine predictions and human decisions with variation in payoffs and skill: the case of antibiotic prescribing," Berlin School of Economics Discussion Papers 0027, Berlin School of Economics.
    12. Lea Cassar & Mira Fischer & Vanessa Valero, 2022. "Keep Calm and Carry On: Immediate-vs. Six-Month Effects of Mindfulness Training on Academic Performance," CESifo Working Paper Series 10099, CESifo.
    13. Kazi Iqbal & Asad Islam & John List & Vy Nguyen, 2021. "Myopic Loss Aversion and Investment Decisions: From the Laboratory to the Field," Framed Field Experiments 000730, The Field Experiments Website.
    14. Nathan Craig & Nicole DeHoratius & Ananth Raman, 2016. "The Impact of Supplier Inventory Service Level on Retailer Demand," Manufacturing & Service Operations Management, INFORMS, vol. 18(4), pages 461-474, October.
    15. A‐Sung Hong, 2024. "Beyond the finish line: How losing in patent race drives post‐race innovation," Strategic Management Journal, Wiley Blackwell, vol. 45(5), pages 968-993, May.
    16. John A. List, 2024. "Optimally generate policy-based evidence before scaling," Nature, Nature, vol. 626(7999), pages 491-499, February.
    17. Olkhov, Victor, 2014. "Expressions of market-based correlations between prices and returns of two assets," MPRA Paper 123009, University Library of Munich, Germany.
    18. Siliang Tong & Nan Jia & Xueming Luo & Zheng Fang, 2021. "The Janus face of artificial intelligence feedback: Deployment versus disclosure effects on employee performance," Strategic Management Journal, Wiley Blackwell, vol. 42(9), pages 1600-1631, September.
    19. Christoph Riedl & Eric Bogert, 2024. "Effects of AI Feedback on Learning, the Skill Gap, and Intellectual Diversity," Papers 2409.18660, arXiv.org.
    20. Carvajal, Daniel & Franco, Catalina & Isaksson, Siri, 2024. "Will Artificial Intelligence Get in the Way of Achieving Gender Equality?," Discussion Paper Series in Economics 3/2024, Norwegian School of Economics, Department of Economics, revised 20 Mar 2025.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2502.08501. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.