IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i2p846-865.html
   My bibliography  Save this article

Predicting Human Discretion to Adjust Algorithmic Prescription: A Large-Scale Field Experiment in Warehouse Operations

Author

Listed:
  • Jiankun Sun

    (Imperial College Business School, Imperial College London, London SW7 2AZ, United Kingdom)

  • Dennis J. Zhang

    (Olin Business School, Washington University in St. Louis, St. Louis, Missouri 63130)

  • Haoyuan Hu

    (Cainiao, Alibaba Group, Hangzhou 311101, China)

  • Jan A. Van Mieghem

    (Kellogg School of Management, Northwestern University, Evanston, Illinois 60208)

Abstract

Conventional optimization algorithms that prescribe order packing instructions (which items to pack in which sequence in which box) focus on box volume utilization yet tend to overlook human behavioral deviations. We observe that packing workers at the warehouses of the Alibaba Group deviate from algorithmic prescriptions for 5.8% of packages, and these deviations increase packing time and reduce operational efficiency. We posit two mechanisms and demonstrate that they result in two types of deviations: (1) information deviations stem from workers having more information and in turn better solutions than the algorithm; and (2) complexity deviations result from workers’ aversion, inability, or discretion to precisely implement algorithmic prescriptions. We propose a new “human-centric bin packing algorithm” that anticipates and incorporates human deviations to reduce deviations and improve performance. It predicts when workers are more likely to switch to larger boxes using machine learning techniques and then proactively adjusts the algorithmic prescriptions of those “targeted packages.” We conducted a large-scale randomized field experiment with the Alibaba Group. Orders were randomly assigned to either the new algorithm (treatment group) or Alibaba’s original algorithm (control group). Our field experiment results show that our new algorithm lowers the rate of switching to larger boxes from 29.5% to 23.8% for targeted packages and reduces the average packing time of targeted packages by 4.5%. This idea of incorporating human deviations to improve optimization algorithms could also be generalized to other processes in logistics and operations.

Suggested Citation

  • Jiankun Sun & Dennis J. Zhang & Haoyuan Hu & Jan A. Van Mieghem, 2022. "Predicting Human Discretion to Adjust Algorithmic Prescription: A Large-Scale Field Experiment in Warehouse Operations," Management Science, INFORMS, vol. 68(2), pages 846-865, February.
  • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:2:p:846-865
    DOI: 10.1287/mnsc.2021.3990
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2021.3990
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2021.3990?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Karel H. van Donselaar & Vishal Gaur & Tom van Woensel & Rob A. C. M. Broekmeulen & Jan C. Fransoo, 2010. "Ordering Behavior in Retail Stores and Implications for Automated Replenishment," Management Science, INFORMS, vol. 56(5), pages 766-784, May.
    2. Nathan Charles Craig & Nicole DeHoratius & Ananth Raman, 2010. "The Impact of Supplier Inventory Service Level on Retailer Demand," Harvard Business School Working Papers 11-034, Harvard Business School, revised Jan 2016.
    3. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    4. Sheng Liu & Long He & Zuo-Jun Max Shen, 2021. "On-Time Last-Mile Delivery: Order Assignment with Travel-Time Predictors," Management Science, INFORMS, vol. 67(7), pages 4095-4119, July.
    5. Chen, C. S. & Lee, S. M. & Shen, Q. S., 1995. "An analytical model for the container loading problem," European Journal of Operational Research, Elsevier, vol. 80(1), pages 68-76, January.
    6. Silvano Martello & David Pisinger & Daniele Vigo, 2000. "The Three-Dimensional Bin Packing Problem," Operations Research, INFORMS, vol. 48(2), pages 256-267, April.
    7. Nathan Craig & Nicole DeHoratius & Ananth Raman, 2016. "The Impact of Supplier Inventory Service Level on Retailer Demand," Manufacturing & Service Operations Management, INFORMS, vol. 18(4), pages 461-474, October.
    8. Ruomeng Cui & Gad Allon & Achal Bassamboo & Jan A. Van Mieghem, 2015. "Information Sharing in Supply Chains: An Empirical and Theoretical Valuation," Management Science, INFORMS, vol. 61(11), pages 2803-2824, November.
    9. Mirko Kremer & Brent Moritz & Enno Siemsen, 2011. "Demand Forecasting Behavior: System Neglect and Change Detection," Management Science, INFORMS, vol. 57(10), pages 1827-1843, October.
    10. Maria R. Ibanez & Jonathan R. Clark & Robert S. Huckman & Bradley R. Staats, 2018. "Discretionary Task Ordering: Queue Management in Radiological Services," Management Science, INFORMS, vol. 64(9), pages 4389-4407, September.
    11. Tom Fangyun Tan & Serguei Netessine, 2014. "When Does the Devil Make Work? An Empirical Study of the Impact of Workload on Worker Productivity," Management Science, INFORMS, vol. 60(6), pages 1574-1593, June.
    12. Maurice E. Schweitzer & Gérard P. Cachon, 2000. "Decision Bias in the Newsvendor Problem with a Known Demand Distribution: Experimental Evidence," Management Science, INFORMS, vol. 46(3), pages 404-420, March.
    13. Andrew M. Davis & Elena Katok & Natalia Santamaría, 2014. "Push, Pull, or Both? A Behavioral Study of How the Allocation of Inventory Risk Affects Channel Efficiency," Management Science, INFORMS, vol. 60(11), pages 2666-2683, November.
    14. Song-Hee Kim & Carri W. Chan & Marcelo Olivares & Gabriel Escobar, 2015. "ICU Admission Control: An Empirical Study of Capacity Allocation and Its Implication for Patient Outcomes," Management Science, INFORMS, vol. 61(1), pages 19-38, January.
    15. Gregory S. Taylor & Yupo Chan & Ghulam Rasool, 2017. "A three-dimensional bin-packing model: exact multicriteria solution and computational complexity," Annals of Operations Research, Springer, vol. 251(1), pages 397-427, April.
    16. Bradley R. Staats & Hengchen Dai & David Hofmann & Katherine L. Milkman, 2017. "Motivating Process Compliance Through Individual Electronic Monitoring: An Empirical Examination of Hand Hygiene in Healthcare," Management Science, INFORMS, vol. 63(5), pages 1563-1585, May.
    17. John Boudreau & Wallace Hopp & John O. McClain & L. Joseph Thomas, 2003. "On the Interface Between Operations and Human Resources Management," Manufacturing & Service Operations Management, INFORMS, vol. 5(3), pages 179-202, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. S. Alex Yang & Angela Huyue Zhang, 2024. "Generative AI and Copyright: A Dynamic Perspective," Papers 2402.17801, arXiv.org.
    2. Dreyfuss, Bnaya & Heffetz, Ori & Hoffman, Guy & Ishai, Guy & Kshirsagar, Alap, 2024. "Additive vs. subtractive earning in shared human-robot work environments," Journal of Economic Behavior & Organization, Elsevier, vol. 217(C), pages 692-704.
    3. Angelopoulos, Spyros & Bendoly, Elliot & Fransoo, Jan C. & Hoberg, Kai & Ou, Carol & Tenhiälä, Antti, 2023. "Digital transformation in operations management: Fundamental change through agency reversal," Other publications TiSEM 373742f5-0b87-4276-9ed6-8, Tilburg University, School of Economics and Management.
    4. Ivanov, Dmitry, 2023. "Intelligent digital twin (iDT) for supply chain stress-testing, resilience, and viability," International Journal of Production Economics, Elsevier, vol. 263(C).
    5. Felipe A. Csaszar & Harsh Ketkar & Hyunjin Kim, 2024. "Artificial Intelligence and Strategic Decision-Making: Evidence from Entrepreneurs and Investors," Papers 2408.08811, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maria R. Ibanez & Jonathan R. Clark & Robert S. Huckman & Bradley R. Staats, 2018. "Discretionary Task Ordering: Queue Management in Radiological Services," Management Science, INFORMS, vol. 64(9), pages 4389-4407, September.
    2. Diwas S. KC & Bradley R. Staats & Maryam Kouchaki & Francesca Gino, 2020. "Task Selection and Workload: A Focus on Completing Easy Tasks Hurts Performance," Management Science, INFORMS, vol. 66(10), pages 4397-4416, October.
    3. Tom F. Tan & Bradley R. Staats, 2020. "Behavioral Drivers of Routing Decisions: Evidence from Restaurant Table Assignment," Production and Operations Management, Production and Operations Management Society, vol. 29(4), pages 1050-1070, April.
    4. Bradley R. Staats & Diwas S. KC & Francesca Gino, 2018. "Maintaining Beliefs in the Face of Negative News: The Moderating Role of Experience," Management Science, INFORMS, vol. 64(2), pages 804-824, February.
    5. Mirko Kremer & Francis de Véricourt, 2022. "Mismanaging diagnostic accuracy under congestion," ESMT Research Working Papers ESMT-22-01, ESMT European School of Management and Technology.
    6. Christian Terwiesch & Marcelo Olivares & Bradley R. Staats & Vishal Gaur, 2020. "OM Forum—A Review of Empirical Operations Management over the Last Two Decades," Manufacturing & Service Operations Management, INFORMS, vol. 22(4), pages 656-668, July.
    7. Song-Hee Kim & Jordan Tong & Carol Peden, 2020. "Admission Control Biases in Hospital Unit Capacity Management: How Occupancy Information Hurdles and Decision Noise Impact Utilization," Management Science, INFORMS, vol. 66(11), pages 5151-5170, November.
    8. Robert J. Niewoehner & Bradley R. Staats, 2022. "Focusing Provider Attention: An Empirical Examination of Incentives and Feedback in Flu Vaccinations," Management Science, INFORMS, vol. 68(5), pages 3680-3702, May.
    9. Meng Li & Tao Li, 2022. "AI Automation and Retailer Regret in Supply Chains," Production and Operations Management, Production and Operations Management Society, vol. 31(1), pages 83-97, January.
    10. Anna‐Lena Sachs & Michael Becker‐Peth & Stefan Minner & Ulrich W. Thonemann, 2022. "Empirical newsvendor biases: Are target service levels achieved effectively and efficiently?," Production and Operations Management, Production and Operations Management Society, vol. 31(4), pages 1839-1855, April.
    11. Pol Boada-Collado & Victor Martínez-de-Albéniz, 2020. "Estimating and Optimizing the Impact of Inventory on Consumer Choices in a Fashion Retail Setting," Manufacturing & Service Operations Management, INFORMS, vol. 22(3), pages 582-597, May.
    12. Yun Shin Lee & Enno Siemsen, 2017. "Task Decomposition and Newsvendor Decision Making," Management Science, INFORMS, vol. 63(10), pages 3226-3245, October.
    13. Andrew M. Davis & Rihuan Huang & Douglas J. Thomas, 2022. "Retailer Inventory Sharing in Two-Tier Supply Chains: An Experimental Investigation," Management Science, INFORMS, vol. 68(12), pages 8773-8790, December.
    14. Samuel N. Kirshner & Brent B. Moritz, 2023. "For the future and from afar: Psychological distance and inventory decision‐making," Production and Operations Management, Production and Operations Management Society, vol. 32(1), pages 170-188, January.
    15. Robert J. Batt & Santiago Gallino, 2019. "Finding a Needle in a Haystack: The Effects of Searching and Learning on Pick-Worker Performance," Management Science, INFORMS, vol. 67(6), pages 2624-2645, June.
    16. Saravanan Kesavan & Tarun Kushwaha, 2020. "Field Experiment on the Profit Implications of Merchants’ Discretionary Power to Override Data-Driven Decision-Making Tools," Management Science, INFORMS, vol. 66(11), pages 5182-5190, November.
    17. Ruomeng Cui & Dennis J. Zhang & Achal Bassamboo, 2019. "Learning from Inventory Availability Information: Evidence from Field Experiments on Amazon," Management Science, INFORMS, vol. 65(3), pages 1216-1235, March.
    18. Bryce McLaughlin & Jann Spiess, 2022. "Algorithmic Assistance with Recommendation-Dependent Preferences," Papers 2208.07626, arXiv.org, revised Jan 2024.
    19. Maria R. Ibanez & Michael W. Toffel, 2020. "How Scheduling Can Bias Quality Assessment: Evidence from Food-Safety Inspections," Management Science, INFORMS, vol. 66(6), pages 2396-2416, June.
    20. Bortfeldt, Andreas & Wäscher, Gerhard, 2013. "Constraints in container loading – A state-of-the-art review," European Journal of Operational Research, Elsevier, vol. 229(1), pages 1-20.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:2:p:846-865. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.