IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i17p3782-d1231981.html
   My bibliography  Save this article

Data Transformation in the Predict-Then-Optimize Framework: Enhancing Decision Making under Uncertainty

Author

Listed:
  • Xuecheng Tian

    (Department of Logistics and Maritime Studies, The Hong Kong Polytechnic University, Hung Hom, Hong Kong)

  • Yanxia Guan

    (Department of Logistics and Maritime Studies, The Hong Kong Polytechnic University, Hung Hom, Hong Kong)

  • Shuaian Wang

    (Department of Logistics and Maritime Studies, The Hong Kong Polytechnic University, Hung Hom, Hong Kong)

Abstract

Decision making under uncertainty is pivotal in real-world scenarios, such as selecting the shortest transportation route amidst variable traffic conditions or choosing the best investment portfolio during market fluctuations. In today’s big data age, while the predict-then-optimize framework has become a standard method for tackling uncertain optimization challenges using machine learning tools, many prediction models overlook data intricacies such as outliers and heteroskedasticity. These oversights can degrade decision-making quality. To enhance predictive accuracy and consequent decision-making quality, we introduce a data transformation technique into the predict-then-optimize framework. Our approach transforms target values in linear regression, decision tree, and random forest models using a power function, aiming to boost their predictive prowess and, in turn, drive better decisions. Empirical validation on several datasets reveals marked improvements in decision tree and random forest models. In contrast, the benefits of linear regression are nuanced. Thus, while data transformation can bolster the predict-then-optimize framework, its efficacy is model-dependent. This research underscores the potential of tailoring transformation techniques for specific models to foster reliable and robust decision-making under uncertainty.

Suggested Citation

  • Xuecheng Tian & Yanxia Guan & Shuaian Wang, 2023. "Data Transformation in the Predict-Then-Optimize Framework: Enhancing Decision Making under Uncertainty," Mathematics, MDPI, vol. 11(17), pages 1-12, September.
  • Handle: RePEc:gam:jmathe:v:11:y:2023:i:17:p:3782-:d:1231981
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/17/3782/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/11/17/3782/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bérubé, Jean-François & Gendreau, Michel & Potvin, Jean-Yves, 2009. "An exact [epsilon]-constraint method for bi-objective combinatorial optimization problems: Application to the Traveling Salesman Problem with Profits," European Journal of Operational Research, Elsevier, vol. 194(1), pages 39-50, April.
    2. Nhi N.Y.Vo & Xue-Zhong He & Shaowu Liu & Guandong Xu, 2019. "Deep Learning for Decision Making and the Optimization of Socially Responsible Investments and Portfolio," Published Paper Series 2019-3, Finance Discipline Group, UTS Business School, University of Technology, Sydney.
    3. Wang, Shuaian & Yan, Ran & Qu, Xiaobo, 2019. "Development of a non-parametric classifier: Effective identification, algorithm, and applications in port state control for maritime transportation," Transportation Research Part B: Methodological, Elsevier, vol. 128(C), pages 129-157.
    4. Basso, Rafael & Kulcsár, Balázs & Sanchez-Diaz, Ivan, 2021. "Electric vehicle routing problem with machine learning for energy prediction," Transportation Research Part B: Methodological, Elsevier, vol. 145(C), pages 24-55.
    5. Herbert A. Simon & George B. Dantzig & Robin Hogarth & Charles R. Plott & Howard Raiffa & Thomas C. Schelling & Kenneth A. Shepsle & Richard Thaler & Amos Tversky & Sidney Winter, 1987. "Decision Making and Problem Solving," Interfaces, INFORMS, vol. 17(5), pages 11-31, October.
    6. Yan, Ran & Wang, Shuaian & Fagerholt, Kjetil, 2020. "A semi-“smart predict then optimize” (semi-SPO) method for efficient ship inspection," Transportation Research Part B: Methodological, Elsevier, vol. 142(C), pages 100-125.
    7. Yang, Zhisen & Yang, Zaili & Yin, Jingbo, 2018. "Realising advanced risk-based port state control inspection using data-driven Bayesian networks," Transportation Research Part A: Policy and Practice, Elsevier, vol. 110(C), pages 38-56.
    8. Wang, Yong & Peng, Shouguo & Zhou, Xuesong & Mahmoudi, Monirehalsadat & Zhen, Lu, 2020. "Green logistics location-routing problem with eco-packages," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 143(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang, Zhisen & Wan, Chengpeng & Yu, Qing & Yin, Jingbo & Yang, Zaili, 2023. "A machine learning-based Bayesian model for predicting the duration of ship detention in PSC inspection," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 180(C).
    2. Xuecheng Tian & Yanxia Guan & Shuaian Wang, 2023. "A Decision-Focused Learning Framework for Vessel Selection Problem," Mathematics, MDPI, vol. 11(16), pages 1-13, August.
    3. Tian, Xuecheng & Yan, Ran & Liu, Yannick & Wang, Shuaian, 2023. "A smart predict-then-optimize method for targeted and cost-effective maritime transportation," Transportation Research Part B: Methodological, Elsevier, vol. 172(C), pages 32-52.
    4. Yan, Ran & Wang, Shuaian & Fagerholt, Kjetil, 2020. "A semi-“smart predict then optimize” (semi-SPO) method for efficient ship inspection," Transportation Research Part B: Methodological, Elsevier, vol. 142(C), pages 100-125.
    5. Xiao, Yi & Qi, Guanqiu & Jin, Mengjie & Yuen, Kum Fai & Chen, Zhuo & Li, Kevin X., 2021. "Efficiency of Port State Control inspection regimes: A comparative study," Transport Policy, Elsevier, vol. 106(C), pages 165-172.
    6. Fan, Lixian & Zhang, Meng & Yin, Jingbo & Zhang, Jinfen, 2022. "Impacts of dynamic inspection records on port state control efficiency using Bayesian network analysis," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    7. Yang, Zhisen & Yu, Qing & Yang, Zaili & Wan, Chengpeng, 2024. "A data-driven Bayesian model for evaluating the duration of detention of ships in PSC inspections," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 181(C).
    8. Yan, Ran & Wang, Shuaian & Cao, Jiannong & Sun, Defeng, 2021. "Shipping Domain Knowledge Informed Prediction and Optimization in Port State Control," Transportation Research Part B: Methodological, Elsevier, vol. 149(C), pages 52-78.
    9. Yang, Zhisen & Wan, Chengpeng & Yang, Zaili & Yu, Qing, 2021. "Using Bayesian network-based TOPSIS to aid dynamic port state control detention risk control decision," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    10. Liu, Kezhong & Yu, Qing & Yang, Zhisen & Wan, Chengpeng & Yang, Zaili, 2022. "BN-based port state control inspection for Paris MoU: New risk factors and probability training using big data," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    11. Yan, Ran & Liu, Yan & Wang, Shuaian, 2024. "A data-driven optimization approach to improving maritime transport efficiency," Transportation Research Part B: Methodological, Elsevier, vol. 180(C).
    12. Yan, Ran & Wang, Shuaian & Zhen, Lu, 2023. "An extended smart “predict, and optimize” (SPO) framework based on similar sets for ship inspection planning," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 173(C).
    13. Wang, Yuhong & Zhang, Fan & Yang, Zhisen & Yang, Zaili, 2021. "Incorporation of deficiency data into the analysis of the dependency and interdependency among the risk factors influencing port state control inspection," Reliability Engineering and System Safety, Elsevier, vol. 206(C).
    14. Xuecheng Tian & Shuaian Wang, 2022. "Cost-Sensitive Laplacian Logistic Regression for Ship Detention Prediction," Mathematics, MDPI, vol. 11(1), pages 1-15, December.
    15. Wu, Bing & Tang, Yuheng & Yan, Xinping & Guedes Soares, Carlos, 2021. "Bayesian Network modelling for safety management of electric vehicles transported in RoPax ships," Reliability Engineering and System Safety, Elsevier, vol. 209(C).
    16. Yu, Qing & Teixeira, Ângelo Palos & Liu, Kezhong & Rong, Hao & Guedes Soares, Carlos, 2021. "An integrated dynamic ship risk model based on Bayesian Networks and Evidential Reasoning," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    17. Zhu, Jiang-Hong & Yang, Qiang & Jiang, Jun, 2023. "Identifying crucial deficiency categories influencing ship detention: A method of combining cloud model and prospect theory," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    18. Dang, Duc-Cuong & Guibadj, Rym Nesrine & Moukrim, Aziz, 2013. "An effective PSO-inspired algorithm for the team orienteering problem," European Journal of Operational Research, Elsevier, vol. 229(2), pages 332-344.
    19. Ziegler Haselein, Bruno & da Silva, Jonny Carlos & Hooey, Becky L., 2024. "Multiple machine learning modeling on near mid-air collisions: An approach towards probabilistic reasoning," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    20. Tang, Lianhua & Li, Yantong & Bai, Danyu & Liu, Tao & Coelho, Leandro C., 2022. "Bi-objective optimization for a multi-period COVID-19 vaccination planning problem," Omega, Elsevier, vol. 110(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:17:p:3782-:d:1231981. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.