IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i14p3102-d1193546.html
   My bibliography  Save this article

Enhanced Night-to-Day Image Conversion Using CycleGAN-Based Base-Detail Paired Training

Author

Listed:
  • Dong-Min Son

    (School of Electronic and Electrical Engineering, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu 41566, Republic of Korea)

  • Hyuk-Ju Kwon

    (School of Electronic and Electrical Engineering, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu 41566, Republic of Korea)

  • Sung-Hak Lee

    (School of Electronic and Electrical Engineering, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu 41566, Republic of Korea)

Abstract

Numerous studies are underway to enhance the identification of surroundings in nighttime environments. These studies explore methods such as utilizing infrared images to improve night image visibility or converting night images into day-like representations for enhanced visibility. This research presents a technique focused on converting the road conditions depicted in night images to resemble daytime scenes. To facilitate this, a paired dataset is created by augmenting limited day and night image data using CycleGAN. The model is trained using both original night images and single-scale luminance transform (SLAT) day images to enhance the level of detail in the converted daytime images. However, the generated daytime images may exhibit sharpness and noise issues. To address these concerns, an image processing approach, inspired by the Stevens effect and local blurring, which align with visual characteristics, is employed to reduce noise and enhance image details. Consequently, this study contributes to improving the visibility of night images by means of day image conversion and subsequent image processing. The proposed night-to-day image translation in this study has a processing time of 0.81 s, including image processing, which is less than one second. Therefore, it is considered valuable as a module for daytime image translation. Additionally, the image quality assessment metric, BRISQUE, yielded a score of 19.8, indicating better performance compared to conventional methods. The outcomes of this research hold potential applications in fields such as CCTV surveillance systems and self-driving cars.

Suggested Citation

  • Dong-Min Son & Hyuk-Ju Kwon & Sung-Hak Lee, 2023. "Enhanced Night-to-Day Image Conversion Using CycleGAN-Based Base-Detail Paired Training," Mathematics, MDPI, vol. 11(14), pages 1-22, July.
  • Handle: RePEc:gam:jmathe:v:11:y:2023:i:14:p:3102-:d:1193546
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/14/3102/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/11/14/3102/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jin, Sheng & Wang, Dian-Hai & Huang, Zhi-Yi & Tao, Peng-Fei, 2011. "Visual angle model for car-following theory," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(11), pages 1931-1940.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yu, Shaowei & Huang, Mengxing & Ren, Jia & Shi, Zhongke, 2016. "An improved car-following model considering velocity fluctuation of the immediately ahead car," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 449(C), pages 1-17.
    2. Jiang, Nan & Yu, Bin & Cao, Feng & Dang, Pengfei & Cui, Shaohua, 2021. "An extended visual angle car-following model considering the vehicle types in the adjacent lane," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 566(C).
    3. Jin, Sheng & Qu, Xiaobo & Zhou, Dan & Xu, Cheng & Ma, Dongfang & Wang, Dianhai, 2015. "Estimating cycleway capacity and bicycle equivalent unit for electric bicycles," Transportation Research Part A: Policy and Practice, Elsevier, vol. 77(C), pages 225-248.
    4. Ponnu, Balaji & Coifman, Benjamin, 2015. "Speed-spacing dependency on relative speed from the adjacent lane: New insights for car following models," Transportation Research Part B: Methodological, Elsevier, vol. 82(C), pages 74-90.
    5. Li, Xin & Li, Xingang & Xiao, Yao & Jia, Bin, 2016. "Modeling mechanical restriction differences between car and heavy truck in two-lane cellular automata traffic flow model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 451(C), pages 49-62.
    6. Zhang, Xiangzhou & Shi, Zhongke & Yang, Qiaoli & An, Xiaodong, 2024. "Impacts of visuo-spatial working memory on the dynamic performance and safety of car-following behavior," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 637(C).
    7. Yang, Da & Jin, Peter (Jing) & Pu, Yun & Ran, Bin, 2014. "Stability analysis of the mixed traffic flow of cars and trucks using heterogeneous optimal velocity car-following model," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 395(C), pages 371-383.
    8. Guan, Xueyi & Cheng, Rongjun & Ge, Hongxia, 2021. "Bifurcation control of optimal velocity model through anticipated effect and response time-delay feedback methods," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 574(C).
    9. Li, Xiangchen & Luo, Xia & He, Mengchen & Chen, Siwei, 2018. "An improved car-following model considering the influence of space gap to the response," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 509(C), pages 536-545.
    10. Zhang, Xiangzhou & Shi, Zhongke & Yu, Shaowei & Ma, Lijing, 2023. "A new car-following model considering driver’s desired visual angle on sharp curves," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 615(C).
    11. Maosheng Li & Jing Fan & Jaeyoung Lee, 2023. "Modeling Car-Following Behavior with Different Acceptable Safety Levels," Sustainability, MDPI, vol. 15(7), pages 1-23, April.
    12. Muhammad Tanveer & Faizan Ahmad Kashmiri & Hassan Naeem & Huimin Yan & Xin Qi & Syed Muzammil Abbas Rizvi & Tianshi Wang & Huapu Lu, 2020. "An Assessment of Age and Gender Characteristics of Mixed Traffic with Autonomous and Manual Vehicles: A Cellular Automata Approach," Sustainability, MDPI, vol. 12(7), pages 1-22, April.
    13. Zhang, Xiangzhou & Shi, Zhongke & Chen, Jianzhong & Ma, lijing, 2023. "A bi-directional visual angle car-following model considering collision sensitivity," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 609(C).
    14. Hongxia Ge & Siteng Li & Chunyue Yan, 2021. "An Extended Car-Following Model Based on Visual Angle and Electronic Throttle Effect," Mathematics, MDPI, vol. 9(22), pages 1-17, November.
    15. Liu, Lan & Zhu, Liling & Yang, Da, 2016. "Modeling and simulation of the car-truck heterogeneous traffic flow based on a nonlinear car-following model," Applied Mathematics and Computation, Elsevier, vol. 273(C), pages 706-717.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:14:p:3102-:d:1193546. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.