IDEAS home Printed from https://ideas.repec.org/a/eee/transe/v125y2019icp74-96.html
   My bibliography  Save this article

Modeling city logistics using adaptive dynamic programming based multi-agent simulation

Author

Listed:
  • Firdausiyah, N.
  • Taniguchi, E.
  • Qureshi, A.G.

Abstract

The effects of city logistics solutions are uncertain due to fluctuating demand, parking issues and multiple agents within the system. This research modelled the behavior of freight carriers and an Urban Consolidation Center (UCC) operator using Multi-Agent Simulation-Adaptive Dynamic Programming based Reinforcement Learning (MAS-ADP based RL) to evaluate a Joint Delivery Systems in an uncertain environment. The MAS-ADP based RL is superior to MAS-Q-learning in replicating the potential actions of the agents under uncertain environment by adapting to the changing environment properly into accurate decisions thus increasing the accuracy of agent’s decision making and eventually reducing environmental emissions as well.

Suggested Citation

  • Firdausiyah, N. & Taniguchi, E. & Qureshi, A.G., 2019. "Modeling city logistics using adaptive dynamic programming based multi-agent simulation," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 125(C), pages 74-96.
    • Handle: RePEc:eee:transe:v:125:y:2019:i:c:p:74-96
    DOI: 10.1016/j.tre.2019.02.011
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1366554518309049
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.tre.2019.02.011?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ali Gul Qureshi & Eiichi Taniguchi & Russell G. Thompson & Joel S.E. Teo, 2014. "Application of exact route optimization for the evaluation of a city logistics truck ban scheme," International Journal of Urban Sciences, Taylor & Francis Journals, vol. 18(2), pages 117-132, July.
    2. J.S.E. Teo & E. Taniguchi & A.G. Qureshi, 2014. "Multi-agent systems modelling approach to evaluate urban motorways for city logistics," International Journal of Urban Sciences, Taylor & Francis Journals, vol. 18(2), pages 154-165, July.
    3. Roorda, Matthew J. & Cavalcante, Rinaldo & McCabe, Stephanie & Kwan, Helen, 2010. "A conceptual framework for agent-based modelling of logistics services," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 46(1), pages 18-31, January.
    4. Nilesh Anand & Ron van Duin & Lori Tavasszy, 2014. "Ontology-based multi-agent system for urban freight transportation," International Journal of Urban Sciences, Taylor & Francis Journals, vol. 18(2), pages 133-153, July.
    5. Warren B. Powell & Joel A. Shapiro & Hugo P. Simão, 2002. "An Adaptive Dynamic Programming Algorithm for the Heterogeneous Resource Allocation Problem," Transportation Science, INFORMS, vol. 36(2), pages 231-249, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Sijing & He, Nannan & Cao, Xindan & Li, Guoqi & Jian, Ming, 2022. "Logistics cluster and its future development: A comprehensive research review," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 168(C).
    2. Gómez-Marín, Cristian Giovanny & Comi, Antonio & Serna-Urán, Conrado Augusto & Zapata-Cortés, Julián Andrés, 2024. "Fostering collaboration and coordination in urban delivery: a multi-agent microsimulation model," Research in Transportation Economics, Elsevier, vol. 103(C).
    3. Alves, Roberta & Pereira, Cecília Aparecida & Lima, Renato da Silva, 2023. "Operational cost analysis for e-commerce deliveries using agent-based modeling and simulation," Research in Transportation Economics, Elsevier, vol. 101(C).
    4. Kong, Xiang T.R. & Kang, Kai & Zhong, Ray Y. & Luo, Hao & Xu, Su Xiu, 2021. "Cyber physical system-enabled on-demand logistics trading," International Journal of Production Economics, Elsevier, vol. 233(C).
    5. Jamal Alnsour & Abdullah Radwan Arabeyyat & Khalil Al-Hyari & Sakher A. I. Al-Bazaiah & Reeman Aldweik, 2023. "Enhancing City Logistics for Sustainable Development in Jordan: A Survey-Based Study," Logistics, MDPI, vol. 8(1), pages 1-14, December.
    6. Amaya, Johanna & Delgado-Lindeman, Maira & Arellana, Julian & Allen, Jaime, 2021. "Urban freight logistics: What do citizens perceive?," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 152(C).
    7. Regal, Andrés & Gonzalez-Feliu, Jesús & Rodriguez, Michelle, 2023. "A spatio-functional logistics profile clustering analysis method for metropolitan areas," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 179(C).
    8. Rémy Dupas & Eiichi Taniguchi & Jean-Christophe Deschamps & Ali G. Qureshi, 2020. "A Multi-commodity Network Flow Model for Sustainable Performance Evaluation in City Logistics: Application to the Distribution of Multi-tenant Buildings in Tokyo," Sustainability, MDPI, vol. 12(6), pages 1-18, March.
    9. Li, Feng & Du, Timon C. & Wei, Ying, 2020. "Enhancing supply chain decisions with consumers’ behavioral factors: An illustration of decoy effect," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 144(C).
    10. Justyna Winkowska & Danuta Szpilko, 2020. "Methodology for Integration of Smart City Dimensions in the Socialised Process of Creating City Development," European Research Studies Journal, European Research Studies Journal, vol. 0(3), pages 524-547.
    11. Krystian Pietrzak & Oliwia Pietrzak & Andrzej Montwiłł, 2021. "Effects of Incorporating Rail Transport into a Zero-Emission Urban Deliveries System: Application of Light Freight Railway (LFR) Electric Trains," Energies, MDPI, vol. 14(20), pages 1-24, October.
    12. Yan, Yimo & Chow, Andy H.F. & Ho, Chin Pang & Kuo, Yong-Hong & Wu, Qihao & Ying, Chengshuo, 2022. "Reinforcement learning for logistics and supply chain management: Methodologies, state of the art, and future opportunities," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 162(C).
    13. Na Zhang & Xiangxiang Zhang & Yingjie Yang, 2019. "The Behavior Mechanism of the Urban Joint Distribution Alliance under Government Supervision from the Perspective of Sustainable Development," Sustainability, MDPI, vol. 11(22), pages 1-20, November.
    14. Utomo, D.S. & Gripton, A. & Greening, P., 2021. "Analysing charging strategies for electric LGV in grocery delivery operation using agent-based modelling: An initial case study in the United Kingdom," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 148(C).
    15. Xin Yao & Yuanyuan Cheng & Li Zhou & Malin Song, 2022. "Green efficiency performance analysis of the logistics industry in China: based on a kind of machine learning methods," Annals of Operations Research, Springer, vol. 308(1), pages 727-752, January.
    16. Sergio Maria Patella & Gianluca Grazieschi & Valerio Gatta & Edoardo Marcucci & Stefano Carrese, 2020. "The Adoption of Green Vehicles in Last Mile Logistics: A Systematic Review," Sustainability, MDPI, vol. 13(1), pages 1-29, December.
    17. Comi, Antonio, 2020. "A modelling framework to forecast urban goods flows," Research in Transportation Economics, Elsevier, vol. 80(C).
    18. Shuangyan Li & Yijing Liang & Zhenjie Wang & Dezhi Zhang, 2021. "An Optimization Model of a Sustainable City Logistics Network Design Based on Goal Programming," Sustainability, MDPI, vol. 13(13), pages 1-20, July.
    19. Sayarshad, Hamid R. & Sattar, Shahram & Oliver Gao, H., 2020. "A scalable non-myopic atomic game for a smart parking mechanism," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 140(C).
    20. Bahareh Mansouri & Subhasmita Sahu & M. Ali Ülkü, 2023. "Toward Greening City Logistics: A Systematic Review on Corporate Governance and Social Responsibility in Managing Urban Distribution Centers," Logistics, MDPI, vol. 7(1), pages 1-20, March.
    21. Kim, Nayeon & Montreuil, Benoit & Klibi, Walid & Kholgade, Nitish, 2021. "Hyperconnected urban fulfillment and delivery," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 145(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wooseok Do & Hyeongjun Park & Koohong Chung & Dongjoo Park, 2019. "An Effects Analysis of Logistics Collaboration: The Case of Pharmaceutical Supplies in Seoul," Sustainability, MDPI, vol. 11(8), pages 1-16, April.
    2. Nilesh Anand & Ron van Duin & Hans Quak & Lori Tavasszy, 2015. "Relevance of City Logistics Modelling Efforts: A Review," Transport Reviews, Taylor & Francis Journals, vol. 35(6), pages 701-719, November.
    3. Sakai, Takanori & Romano Alho, André & Bhavathrathan, B.K. & Chiara, Giacomo Dalla & Gopalakrishnan, Raja & Jing, Peiyu & Hyodo, Tetsuro & Cheah, Lynette & Ben-Akiva, Moshe, 2020. "SimMobility Freight: An agent-based urban freight simulator for evaluating logistics solutions," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 141(C).
    4. Tavasszy, Lóránt A., 2020. "Predicting the effects of logistics innovations on freight systems: Directions for research," Transport Policy, Elsevier, vol. 86(C), pages 1-6.
    5. Alena Brettmo & Jon Williamsson, 2020. "The Role of ‘Influencers’ as Drivers of a More Sustainable Urban Freight Sector," Sustainability, MDPI, vol. 12(7), pages 1-17, April.
    6. Theodore Tsekeris & Klimis Vogiatzoglou, 2011. "Spatial agent-based modeling of household and firm location with endogenous transport costs," Netnomics, Springer, vol. 12(2), pages 77-98, July.
    7. Marta Kadłubek & Eleftherios Thalassinos & Joanna Domagała & Sandra Grabowska & Sebastian Saniuk, 2022. "Intelligent Transportation System Applications and Logistics Resources for Logistics Customer Service in Road Freight Transport Enterprises," Energies, MDPI, vol. 15(13), pages 1-27, June.
    8. Daniel Kaszubowski, 2019. "A Method for the Evaluation of Urban Freight Transport Models as a Tool for Improving the Delivery of Sustainable Urban Transport Policy," Sustainability, MDPI, vol. 11(6), pages 1-23, March.
    9. Roberta Alves & Renato da Silva Lima & David Custódio de Sena & Alexandre Ferreira de Pinho & José Holguín-Veras, 2019. "Agent-Based Simulation Model for Evaluating Urban Freight Policy to E-Commerce," Sustainability, MDPI, vol. 11(15), pages 1-19, July.
    10. Gülpınar, Nalan & Çanakoğlu, Ethem & Branke, Juergen, 2018. "Heuristics for the stochastic dynamic task-resource allocation problem with retry opportunities," European Journal of Operational Research, Elsevier, vol. 266(1), pages 291-303.
    11. Anand, Nilesh & van Duin, Ron & Tavasszy, Lorant, 2021. "Carbon credits and urban freight consolidation: An experiment using agent based simulation," Research in Transportation Economics, Elsevier, vol. 85(C).
    12. Mesa-Arango, Rodrigo & Ukkusuri, Satish V., 2014. "Attributes driving the selection of trucking services and the quantification of the shipper’s willingness to pay," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 71(C), pages 142-158.
    13. Thi Yen Pham & Ki Young Kim & Gi-Tae YEO, 2018. "The Panama Canal Expansion and Its Impact on East–West Liner Shipping Route Selection," Sustainability, MDPI, vol. 10(12), pages 1-16, November.
    14. Sharman, Bryce W. & Roorda, Matthew J., 2013. "Multilevel modelling of commercial vehicle inter-arrival duration using GPS data," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 56(C), pages 94-107.
    15. Gerard Jong & Inge Vierth & Lori Tavasszy & Moshe Ben-Akiva, 2013. "Recent developments in national and international freight transport models within Europe," Transportation, Springer, vol. 40(2), pages 347-371, February.
    16. Reiffer, Anna S. & Kübler, Jelle & Kagerbauer, Martin & Vortisch, Peter, 2023. "Agent-based model of last-mile parcel deliveries and travel demand incorporating online shopping behavior," Research in Transportation Economics, Elsevier, vol. 102(C).
    17. Thoen, Sebastiaan & Tavasszy, Lóránt & de Bok, Michiel & Correia, Goncalo & van Duin, Ron, 2020. "Descriptive modeling of freight tour formation: A shipment-based approach," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 140(C).
    18. Belgacem Bouzaiene-Ayari & Clark Cheng & Sourav Das & Ricardo Fiorillo & Warren B. Powell, 2016. "From Single Commodity to Multiattribute Models for Locomotive Optimization: A Comparison of Optimal Integer Programming and Approximate Dynamic Programming," Transportation Science, INFORMS, vol. 50(2), pages 366-389, May.
    19. Giulio Mangano & Giovanni Zenezini & Anna Corinna Cagliano, 2021. "Value Proposition for Sustainable Last-Mile Delivery. A Retailer Perspective," Sustainability, MDPI, vol. 13(7), pages 1-15, March.
    20. Pillac, Victor & Gendreau, Michel & Guéret, Christelle & Medaglia, Andrés L., 2013. "A review of dynamic vehicle routing problems," European Journal of Operational Research, Elsevier, vol. 225(1), pages 1-11.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transe:v:125:y:2019:i:c:p:74-96. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600244/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.