IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v565y2021ics0378437120308724.html
   My bibliography  Save this article

Traffic flow prediction by an ensemble framework with data denoising and deep learning model

Author

Listed:
  • Chen, Xinqiang
  • Chen, Huixing
  • Yang, Yongsheng
  • Wu, Huafeng
  • Zhang, Wenhui
  • Zhao, Jiansen
  • Xiong, Yong

Abstract

Accurate traffic flow data is important for traffic flow state estimation, real-time traffic management and control, etc. Raw traffic flow data collected from inductive detectors may be contaminated by different noises (e.g., sharp data increase/decrease, trivial anomaly oscillations) under various unexpected interference (caused by roadway maintenance, loop detector damage, etc.). To address the issue, we introduced data denoising schemes (i.e., Empirical Mode Decomposition (EMD), Ensemble Empirical Mode Decomposition (EEMD) and Wavelet (WL)) to suppress the potential data outliers. After that, the Long Short-Term Memory (LSTM) neural network was introduced to fulfill the traffic flow prediction task. We have tested the proposed framework performance on three traffic flow datasets, which were downloaded from Caltrans Performance Measurement System (PeMS). The experimental results showed that the LSTM+EEMD scheme obtained higher accuracy considering that the average Root Mean Square Error (RMSE), Mean Absolute Error (MAE) and Mean Absolute Percentage Error (MAPE) are 0.79, 0.60 and 2.14.

Suggested Citation

  • Chen, Xinqiang & Chen, Huixing & Yang, Yongsheng & Wu, Huafeng & Zhang, Wenhui & Zhao, Jiansen & Xiong, Yong, 2021. "Traffic flow prediction by an ensemble framework with data denoising and deep learning model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 565(C).
    • Handle: RePEc:eee:phsmap:v:565:y:2021:i:c:s0378437120308724
    DOI: 10.1016/j.physa.2020.125574
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437120308724
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000
    File URL: https://libkey.io/10.1016/j.physa.2020.125574?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cai, Lingru & Zhang, Zhanchang & Yang, Junjie & Yu, Yidan & Zhou, Teng & Qin, Jing, 2019. "A noise-immune Kalman filter for short-term traffic flow forecasting," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 536(C).
    2. Tang, Jinjun & Chen, Xinqiang & Hu, Zheng & Zong, Fang & Han, Chunyang & Li, Leixiao, 2019. "Traffic flow prediction based on combination of support vector machine and data denoising schemes," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 534(C).
    3. Ma, Tao & Zhou, Zhou & Antoniou, Constantinos, 2018. "Dynamic factor model for network traffic state forecast," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 281-317.
    4. Tang, Jinjun & Hu, Jin & Hao, Wei & Chen, Xinqiang & Qi, Yong, 2020. "Markov Chains based route travel time estimation considering link spatio-temporal correlation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    5. Peng, Yanni & Xiang, Wanli, 2020. "Short-term traffic volume prediction using GA-BP based on wavelet denoising and phase space reconstruction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 549(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ma, Changxi & Zhao, Mingxi & Huang, Xiaoting & Zhao, Yongpeng, 2024. "Optimized deep extreme learning machine for traffic prediction and autonomous vehicle lane change decision-making," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 633(C).
    2. Cankun Wei & Meichen Fu & Li Wang & Hanbing Yang & Feng Tang & Yuqing Xiong, 2022. "The Research Development of Hedonic Price Model-Based Real Estate Appraisal in the Era of Big Data," Land, MDPI, vol. 11(3), pages 1-30, February.
    3. Ziwen Song & Feng Sun & Rongji Zhang & Yingcui Du & Guiliang Zhou, 2021. "An Improved Cellular Automaton Traffic Model Based on STCA Model Considering Variable Direction Lanes in I-VICS," Sustainability, MDPI, vol. 13(24), pages 1-17, December.
    4. Dong, Hanxuan & Ding, Fan & Tan, Huachun & Zhang, Hailong, 2022. "Laplacian integration of graph convolutional network with tensor completion for traffic prediction with missing data in inter-city highway network," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 586(C).
    5. Wu, Jiaxin & Zhou, Xubing & Peng, Yi & Zhao, Xiaojun, 2022. "Recurrence analysis of urban traffic congestion index on multi-scale," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 585(C).
    6. Wang, Kun & Xiong, Li & Xue, Rudan, 2024. "Real-time data stream learning for emergency decision-making under uncertainty," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 633(C).
    7. Zhang, Kunpeng & Feng, Xiaoliang & Jia, Ning & Zhao, Liang & He, Zhengbing, 2022. "TSR-GAN: Generative Adversarial Networks for Traffic State Reconstruction with Time Space Diagrams," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 591(C).
    8. Wang, Ke & Ma, Changxi & Qiao, Yihuan & Lu, Xijin & Hao, Weining & Dong, Sheng, 2021. "A hybrid deep learning model with 1DCNN-LSTM-Attention networks for short-term traffic flow prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 583(C).
    9. Liu, Yang & Song, Yaolun & Zhang, Yan & Liao, Zhifang, 2022. "WT-2DCNN: A convolutional neural network traffic flow prediction model based on wavelet reconstruction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 603(C).
    10. Chengmei Wang & Yuchuan Du, 2022. "ELM-Based Non-Singular Fast Terminal Sliding Mode Control Strategy for Vehicle Platoon," Sustainability, MDPI, vol. 14(7), pages 1-18, March.
    11. Salvatore Antonio Biancardo & Francesco Avella & Ernesto Di Lisa & Xinqiang Chen & Francesco Abbondati & Gianluca Dell’Acqua, 2021. "Multiobjective Railway Alignment Optimization Using Ballastless Track and Reduced Cross-Section in Tunnel," Sustainability, MDPI, vol. 13(19), pages 1-19, September.
    12. Li, Yisha & Chen, Guoxi & Zhang, Ya, 2023. "Cycle-based signal timing with traffic flow prediction for dynamic environment," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 623(C).
    13. Krešimir Kušić & Edouard Ivanjko & Filip Vrbanić & Martin Gregurić & Ivana Dusparic, 2021. "Spatial-Temporal Traffic Flow Control on Motorways Using Distributed Multi-Agent Reinforcement Learning," Mathematics, MDPI, vol. 9(23), pages 1-28, November.
    14. Shao, Feng & Shao, Hu & Wang, Dongle & Lam, William H.K. & Cao, Shuhan, 2023. "A generative model for vehicular travel time distribution prediction considering spatial and temporal correlations," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 621(C).
    15. Han, Yu & Zhang, Mingyu & Guo, Yanyong & Zhang, Le, 2022. "A streaming-data-driven method for freeway traffic state estimation using probe vehicle trajectory data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 606(C).
    16. Philip Cammin & Jingjing Yu & Stefan Voß, 2023. "Tiered prediction models for port vessel emissions inventories," Flexible Services and Manufacturing Journal, Springer, vol. 35(1), pages 142-169, March.
    17. Shao, Feng & Shao, Hu & Wang, Dongle & Lam, William H.K., 2024. "A multi-task spatio-temporal generative adversarial network for prediction of travel time reliability in peak hour periods," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 638(C).
    18. Hang Shen & Lin Li & Haihong Zhu & Yu Liu & Zhenwei Luo, 2021. "Exploring a Pricing Model for Urban Rental Houses from a Geographical Perspective," Land, MDPI, vol. 11(1), pages 1-28, December.
    19. Wang, Yun & Xu, Houhua & Song, Mengmeng & Zhang, Fan & Li, Yifen & Zhou, Shengchao & Zhang, Lingjun, 2023. "A convolutional Transformer-based truncated Gaussian density network with data denoising for wind speed forecasting," Applied Energy, Elsevier, vol. 333(C).
    20. Ma, Changxi & Zhao, Mingxi, 2023. "Spatio-temporal multi-graph convolutional network based on wavelet analysis for vehicle speed prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    21. Hu, Xu & Li, Dongshuang & Yu, Zhaoyuan & Yan, Zhenjun & Luo, Wen & Yuan, Linwang, 2022. "Quantum harmonic oscillator model for fine-grained expressway traffic volume simulation considering individual heterogeneity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 605(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Huang, Haichao & Chen, Jingya & Sun, Rui & Wang, Shuang, 2022. "Short-term traffic prediction based on time series decomposition," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 585(C).
    2. Liu, Yang & Song, Yaolun & Zhang, Yan & Liao, Zhifang, 2022. "WT-2DCNN: A convolutional neural network traffic flow prediction model based on wavelet reconstruction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 603(C).
    3. Ma, Changxi & Zhao, Mingxi & Huang, Xiaoting & Zhao, Yongpeng, 2024. "Optimized deep extreme learning machine for traffic prediction and autonomous vehicle lane change decision-making," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 633(C).
    4. Ma, Changxi & Zhao, Mingxi, 2023. "Spatio-temporal multi-graph convolutional network based on wavelet analysis for vehicle speed prediction," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    5. Junjie Fu & Xinqiang Chen & Shubo Wu & Chaojian Shi & Huafeng Wu & Jiansen Zhao & Pengwen Xiong, 2020. "Mining ship deficiency correlations from historical port state control (PSC) inspection data," PLOS ONE, Public Library of Science, vol. 15(2), pages 1-19, February.
    6. Qu, Zhijian & Xu, Juan & Wang, Zixiao & Chi, Rui & Liu, Hanxin, 2021. "Prediction of electricity generation from a combined cycle power plant based on a stacking ensemble and its hyperparameter optimization with a grid-search method," Energy, Elsevier, vol. 227(C).
    7. Shao, Feng & Shao, Hu & Wang, Dongle & Lam, William H.K., 2024. "A multi-task spatio-temporal generative adversarial network for prediction of travel time reliability in peak hour periods," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 638(C).
    8. Yan, Ying & Zhang, Ying & Yang, Xiangli & Hu, Jin & Tang, Jinjun & Guo, Zhongyin, 2020. "Crash prediction based on random effect negative binomial model considering data heterogeneity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 547(C).
    9. Büchel, Beda & Corman, Francesco, 2022. "Modeling conditional dependencies for bus travel time estimation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 592(C).
    10. Fei Wang & Yinxi Liang & Zhizhe Lin & Jinglin Zhou & Teng Zhou, 2024. "SSA-ELM: A Hybrid Learning Model for Short-Term Traffic Flow Forecasting," Mathematics, MDPI, vol. 12(12), pages 1-17, June.
    11. Shenghan Zhou & Chaofan Wei & Chaofei Song & Yu Fu & Rui Luo & Wenbing Chang & Linchao Yang, 2022. "A Hybrid Deep Learning Model for Short-Term Traffic Flow Pre-Diction Considering Spatiotemporal Features," Sustainability, MDPI, vol. 14(16), pages 1-14, August.
    12. Alisson Assis Cardoso & Flávio Henrique Teles Vieira, 2019. "Adaptive fuzzy flow rate control considering multifractal traffic modeling and 5G communications," PLOS ONE, Public Library of Science, vol. 14(11), pages 1-22, November.
    13. Fang, Weiwei & Zhuo, Wenhao & Yan, Jingwen & Song, Youyi & Jiang, Dazhi & Zhou, Teng, 2022. "Attention meets long short-term memory: A deep learning network for traffic flow forecasting," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 587(C).
    14. Du, Zhouyang & Tang, Jinjun & Qi, Yong & Wang, Yiwei & Han, Chunyang & Yang, Yifan, 2020. "Identifying critical nodes in metro network considering topological potential: A case study in Shenzhen city—China," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 539(C).
    15. Junzhuo Li & Wenyong Li & Guan Lian, 2022. "Optimal Aggregate Size of Traffic Sequence Data Based on Fuzzy Entropy and Mutual Information," Sustainability, MDPI, vol. 14(22), pages 1-17, November.
    16. A, Sheeba Angel & R, Jayaparvathy, 2024. "Modeling of emergency evacuation in high rise buildings considering congestion at stairs based on Markov chains," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 633(C).
    17. Zhang, Kunpeng & Feng, Xiaoliang & Jia, Ning & Zhao, Liang & He, Zhengbing, 2022. "TSR-GAN: Generative Adversarial Networks for Traffic State Reconstruction with Time Space Diagrams," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 591(C).
    18. Wu, Jiaxin & Zhou, Xubing & Peng, Yi & Zhao, Xiaojun, 2022. "Recurrence analysis of urban traffic congestion index on multi-scale," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 585(C).
    19. Ze Dong & Yipeng Zhou & Xiongguan Bao, 2024. "A Short-Term Vessel Traffic Flow Prediction Based on a DBO-LSTM Model," Sustainability, MDPI, vol. 16(13), pages 1-21, June.
    20. Xinqiang Chen & Jinquan Lu & Jiansen Zhao & Zhijian Qu & Yongsheng Yang & Jiangfeng Xian, 2020. "Traffic Flow Prediction at Varied Time Scales via Ensemble Empirical Mode Decomposition and Artificial Neural Network," Sustainability, MDPI, vol. 12(9), pages 1-17, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:565:y:2021:i:c:s0378437120308724. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.