IDEAS home Printed from https://ideas.repec.org/a/inm/orinte/v40y2010i5p342-352.html
   My bibliography  Save this article

Approximate Dynamic Programming Captures Fleet Operations for Schneider National

Author

Listed:
  • Hugo P. Simão

    (Princeton University, Princeton, New Jersey 08544)

  • Abraham George

    (Princeton University, Princeton, New Jersey 08544)

  • Warren B. Powell

    (Princeton University, Princeton, New Jersey 08544)

  • Ted Gifford

    (Schneider National, Green Bay, Wisconsin 54306)

  • John Nienow

    (Schneider National, Green Bay, Wisconsin 54306)

  • Jeff Day

    (Schneider National, Green Bay, Wisconsin 54306)

Abstract

Schneider National needed a simulation model that would capture the dynamics of its fleet of over 6,000 long-haul drivers to determine where the company should hire new drivers, estimate the impact of changes in work rules, find the best way to manage Canadian drivers, and experiment with new ways to get drivers home. It needed a model that could perform as well as its experienced team of dispatchers and fleet managers. In developing our model, we had to simulate drivers and loads at a high level of detail, capturing both complex dynamics and multiple forms of uncertainty. We used approximate dynamic programming to produce realistic, high-quality decisions that capture the ability of dispatchers to anticipate the future impact of decisions. The resulting model closely calibrated against Schneider's historical performance, giving the company the confidence to base major policy decisions on studies performed using the model. These policy decisions helped Schneider to avoid costs of $30 million by identifying problems with a new driver-management policy, achieve annual savings of $5 million by identifying the best driver domiciles, reduce the number of late deliveries by more than 50 percent by analyzing service commitment policies, and save $3.8 million annually by reducing training expenses for new border-crossing regulations.

Suggested Citation

  • Hugo P. Simão & Abraham George & Warren B. Powell & Ted Gifford & John Nienow & Jeff Day, 2010. "Approximate Dynamic Programming Captures Fleet Operations for Schneider National," Interfaces, INFORMS, vol. 40(5), pages 342-352, October.
  • Handle: RePEc:inm:orinte:v:40:y:2010:i:5:p:342-352
    DOI: 10.1287/inte.1100.0510
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/inte.1100.0510
    Download Restriction: no

    File URL: https://libkey.io/10.1287/inte.1100.0510?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gregory A. Godfrey & Warren B. Powell, 2002. "An Adaptive Dynamic Programming Algorithm for Dynamic Fleet Management, I: Single Period Travel Times," Transportation Science, INFORMS, vol. 36(1), pages 21-39, February.
    2. Hugo P. Simão & Jeff Day & Abraham P. George & Ted Gifford & John Nienow & Warren B. Powell, 2009. "An Approximate Dynamic Programming Algorithm for Large-Scale Fleet Management: A Case Application," Transportation Science, INFORMS, vol. 43(2), pages 178-197, May.
    3. Marar, Arun & Powell, Warren B., 2009. "Capturing incomplete information in resource allocation problems through numerical patterns," European Journal of Operational Research, Elsevier, vol. 197(1), pages 50-58, August.
    4. Huseyin Topaloglu & Warren B. Powell, 2006. "Dynamic-Programming Approximations for Stochastic Time-Staged Integer Multicommodity-Flow Problems," INFORMS Journal on Computing, INFORMS, vol. 18(1), pages 31-42, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michael F. Gorman & John-Paul Clarke & René Koster & Michael Hewitt & Debjit Roy & Mei Zhang, 2023. "Emerging practices and research issues for big data analytics in freight transportation," Maritime Economics & Logistics, Palgrave Macmillan;International Association of Maritime Economists (IAME), vol. 25(1), pages 28-60, March.
    2. Rempel, M. & Cai, J., 2021. "A review of approximate dynamic programming applications within military operations research," Operations Research Perspectives, Elsevier, vol. 8(C).
    3. Ilya O. Ryzhov & Martijn R. K. Mes & Warren B. Powell & Gerald van den Berg, 2019. "Bayesian Exploration for Approximate Dynamic Programming," Operations Research, INFORMS, vol. 67(1), pages 198-214, January.
    4. Gu, Liyi & Ryzhov, Ilya O. & Eftekhar, Mahyar, 2021. "The facts on the ground: Evaluating humanitarian fleet management policies using simulation," European Journal of Operational Research, Elsevier, vol. 293(2), pages 681-702.
    5. Mercedes Esteban-Bravo & Jose M. Vidal-Sanz & Gökhan Yildirim, 2014. "Valuing Customer Portfolios with Endogenous Mass and Direct Marketing Interventions Using a Stochastic Dynamic Programming Decomposition," Marketing Science, INFORMS, vol. 33(5), pages 621-640, September.
    6. Song, Haiqing & Cheung, Raymond K. & Wang, Haiyan, 2014. "An arc-exchange decomposition method for multistage dynamic networks with random arc capacities," European Journal of Operational Research, Elsevier, vol. 233(3), pages 474-487.
    7. Michael F. Gorman & John-Paul Clarke & Amir Hossein Gharehgozli & Michael Hewitt & René de Koster & Debjit Roy, 2014. "State of the Practice: A Review of the Application of OR/MS in Freight Transportation," Interfaces, INFORMS, vol. 44(6), pages 535-554, December.
    8. Ye Chen & Ilya O. Ryzhov, 2020. "Technical Note—Consistency Analysis of Sequential Learning Under Approximate Bayesian Inference," Operations Research, INFORMS, vol. 68(1), pages 295-307, January.
    9. Phares, Jonathan & Miller, Jason W. & Burks, Stephen V., 2023. "State-Level Trucking Employment and the COVID-19 Pandemic in the U.S: Understanding Heterogenous Declines and Rebounds," IZA Discussion Papers 16265, Institute of Labor Economics (IZA).
    10. Michael F. Gorman, 2016. "From Magnum Opus to Mea Culpa: A Cautionary Tale of Lessons Learned from a Failed Decision Support System," Interfaces, INFORMS, vol. 46(2), pages 183-195, April.
    11. Warren B. Powell, 2016. "Perspectives of approximate dynamic programming," Annals of Operations Research, Springer, vol. 241(1), pages 319-356, June.
    12. Geursen, Izaak L. & Santos, Bruno F. & Yorke-Smith, Neil, 2023. "Fleet planning under demand and fuel price uncertainty using actor–critic reinforcement learning," Journal of Air Transport Management, Elsevier, vol. 109(C).
    13. Antoine Sauré & Jonathan Patrick & Martin L. Puterman, 2015. "Simulation-Based Approximate Policy Iteration with Generalized Logistic Functions," INFORMS Journal on Computing, INFORMS, vol. 27(3), pages 579-595, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Al-Kanj, Lina & Nascimento, Juliana & Powell, Warren B., 2020. "Approximate dynamic programming for planning a ride-hailing system using autonomous fleets of electric vehicles," European Journal of Operational Research, Elsevier, vol. 284(3), pages 1088-1106.
    2. Ulmer, Marlin W. & Thomas, Barrett W., 2020. "Meso-parametric value function approximation for dynamic customer acceptances in delivery routing," European Journal of Operational Research, Elsevier, vol. 285(1), pages 183-195.
    3. Warren B. Powell, 2016. "Perspectives of approximate dynamic programming," Annals of Operations Research, Springer, vol. 241(1), pages 319-356, June.
    4. Warren B. Powell & Abraham George & Hugo Simão & Warren Scott & Alan Lamont & Jeffrey Stewart, 2012. "SMART: A Stochastic Multiscale Model for the Analysis of Energy Resources, Technology, and Policy," INFORMS Journal on Computing, INFORMS, vol. 24(4), pages 665-682, November.
    5. Li, Haitao & Womer, Norman K., 2015. "Solving stochastic resource-constrained project scheduling problems by closed-loop approximate dynamic programming," European Journal of Operational Research, Elsevier, vol. 246(1), pages 20-33.
    6. Luke Schenk & Diego Klabjan, 2008. "Intramarket Optimization for Express Package Carriers," Transportation Science, INFORMS, vol. 42(4), pages 530-545, November.
    7. George, David K. & Xia, Cathy H., 2011. "Fleet-sizing and service availability for a vehicle rental system via closed queueing networks," European Journal of Operational Research, Elsevier, vol. 211(1), pages 198-207, May.
    8. Zolfagharinia, Hossein & Haughton, Michael, 2016. "Effective truckload dispatch decision methods with incomplete advance load information," European Journal of Operational Research, Elsevier, vol. 252(1), pages 103-121.
    9. Baris Yildiz & Martin Savelsbergh, 2019. "Provably High-Quality Solutions for the Meal Delivery Routing Problem," Transportation Science, INFORMS, vol. 53(5), pages 1372-1388, September.
    10. Zolfagharinia, Hossein & Haughton, Michael, 2014. "The benefit of advance load information for truckload carriers," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 70(C), pages 34-54.
    11. Schmid, Verena, 2012. "Solving the dynamic ambulance relocation and dispatching problem using approximate dynamic programming," European Journal of Operational Research, Elsevier, vol. 219(3), pages 611-621.
    12. Belgacem Bouzaiene-Ayari & Clark Cheng & Sourav Das & Ricardo Fiorillo & Warren B. Powell, 2016. "From Single Commodity to Multiattribute Models for Locomotive Optimization: A Comparison of Optimal Integer Programming and Approximate Dynamic Programming," Transportation Science, INFORMS, vol. 50(2), pages 366-389, May.
    13. Pillac, Victor & Gendreau, Michel & Guéret, Christelle & Medaglia, Andrés L., 2013. "A review of dynamic vehicle routing problems," European Journal of Operational Research, Elsevier, vol. 225(1), pages 1-11.
    14. Powell, Warren B., 2019. "A unified framework for stochastic optimization," European Journal of Operational Research, Elsevier, vol. 275(3), pages 795-821.
    15. G J King & H Topaloglu, 2007. "Incorporating the pricing decisions into the dynamic fleet management problem," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(8), pages 1065-1074, August.
    16. Adler, Jonathan D. & Mirchandani, Pitu B., 2014. "Online routing and battery reservations for electric vehicles with swappable batteries," Transportation Research Part B: Methodological, Elsevier, vol. 70(C), pages 285-302.
    17. Dimitri J. Papageorgiou & Myun-Seok Cheon & George Nemhauser & Joel Sokol, 2015. "Approximate Dynamic Programming for a Class of Long-Horizon Maritime Inventory Routing Problems," Transportation Science, INFORMS, vol. 49(4), pages 870-885, November.
    18. Zolfagharinia, Hossein & Haughton, Michael, 2018. "The importance of considering non-linear layover and delay costs for local truckers," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 109(C), pages 331-355.
    19. Prochazka, Vit & Adland, Roar & Wallace, Stein W., 2019. "The value of foresight in the drybulk freight market," Transportation Research Part A: Policy and Practice, Elsevier, vol. 129(C), pages 232-245.
    20. Felix Papier & Ulrich W. Thonemann, 2008. "Queuing Models for Sizing and Structuring Rental Fleets," Transportation Science, INFORMS, vol. 42(3), pages 302-317, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orinte:v:40:y:2010:i:5:p:342-352. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.