IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i18p13667-d1238815.html
   My bibliography  Save this article

DFA-SAT: Dynamic Feature Abstraction with Self-Attention-Based 3D Object Detection for Autonomous Driving

Author

Listed:
  • Husnain Mushtaq

    (School of Computer Science and Engineering, Central South University, Changsha 410083, China)

  • Xiaoheng Deng

    (School of Computer Science and Engineering, Central South University, Changsha 410083, China)

  • Mubashir Ali

    (School of Computer Science, University of Birmingham, Birmingham B15 2TT, UK)

  • Babur Hayat

    (Department of Computer Science, University of Chenab, Gujrat 50700, Pakistan)

  • Hafiz Husnain Raza Sherazi

    (School of Computing and Engineering, University of West London, London W5 5RF, UK)

Abstract

Autonomous vehicles (AVs) play a crucial role in enhancing urban mobility within the context of a smarter and more connected urban environment. Three-dimensional object detection in AVs is an essential task for comprehending the driving environment to contribute to their safe use in urban environments. Existing 3D LiDAR object detection systems lose many critical point features during the down-sampling process and neglect the crucial interactions between local features, providing insufficient semantic information and leading to subpar detection performance. We propose a dynamic feature abstraction with self-attention (DFA-SAT), which utilizes self-attention to learn semantic features with contextual information by incorporating neighboring data and focusing on vital geometric details. DFA-SAT comprises four modules: object-based down-sampling (OBDS), semantic and contextual feature extraction (SCFE), multi-level feature re-weighting (MLFR), and local and global features aggregation (LGFA). The OBDS module preserves the maximum number of semantic foreground points along with their spatial information. SCFE learns rich semantic and contextual information with respect to spatial dependencies, refining the point features. MLFR decodes all the point features using a channel-wise multi-layered transformer approach. LGFA combines local features with decoding weights for global features using matrix product keys and query embeddings to learn spatial information across each channel. Extensive experiments using the KITTI dataset demonstrate significant improvements over the mainstream methods SECOND and PointPillars, improving the mean average precision (AP) by 6.86% and 6.43%, respectively, on the KITTI test dataset. DFA-SAT yields better and more stable performance for medium and long distances with a limited impact on real-time performance and model parameters, ensuring a transformative shift akin to when automobiles replaced conventional transportation in cities.

Suggested Citation

  • Husnain Mushtaq & Xiaoheng Deng & Mubashir Ali & Babur Hayat & Hafiz Husnain Raza Sherazi, 2023. "DFA-SAT: Dynamic Feature Abstraction with Self-Attention-Based 3D Object Detection for Autonomous Driving," Sustainability, MDPI, vol. 15(18), pages 1-21, September.
    • Handle: RePEc:gam:jsusta:v:15:y:2023:i:18:p:13667-:d:1238815
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/18/13667/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/15/18/13667/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Auwal Alhassan Musa & Salim Idris Malami & Fayez Alanazi & Wassef Ounaies & Mohammed Alshammari & Sadi Ibrahim Haruna, 2023. "Sustainable Traffic Management for Smart Cities Using Internet-of-Things-Oriented Intelligent Transportation Systems (ITS): Challenges and Recommendations," Sustainability, MDPI, vol. 15(13), pages 1-15, June.
    2. Hyo-Keun Lee, 2022. "The Relationship between Innovative Technology and Driver’s Resistance and Acceptance Intention for Sustainable Use of Automobile Self-Driving System," Sustainability, MDPI, vol. 14(16), pages 1-16, August.
    3. Douglas Mitieka & Rose Luke & Hossana Twinomurinzi & Joash Mageto, 2023. "Smart Mobility in Urban Areas: A Bibliometric Review and Research Agenda," Sustainability, MDPI, vol. 15(8), pages 1-23, April.
    4. Haobo Shi & Dezao Hou & Xiyao Li, 2023. "Center-Aware 3D Object Detection with Attention Mechanism Based on Roadside LiDAR," Sustainability, MDPI, vol. 15(3), pages 1-19, February.
    5. Li-Ya Yao & Xin-Feng Xia & Li-Shan Sun, 2014. "Transfer Scheme Evaluation Model for a Transportation Hub based on Vectorial Angle Cosine," Sustainability, MDPI, vol. 6(7), pages 1-11, July.
    6. Minh Sang Pham Do & Ketoma Vix Kemanji & Man Dinh Vinh Nguyen & Tuan Anh Vu & Gerrit Meixner, 2023. "The Action Point Angle of Sight: A Traffic Generation Method for Driving Simulation, as a Small Step to Safe, Sustainable and Smart Cities," Sustainability, MDPI, vol. 15(12), pages 1-27, June.
    7. Fábio Duarte & Carlo Ratti, 2018. "The Impact of Autonomous Vehicles on Cities: A Review," Journal of Urban Technology, Taylor & Francis Journals, vol. 25(4), pages 3-18, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chenhao Zhu & Jonah Susskind & Mario Giampieri & Hazel Backus O’Neil & Alan M. Berger, 2023. "Optimizing Sustainable Suburban Expansion with Autonomous Mobility through a Parametric Design Framework," Land, MDPI, vol. 12(9), pages 1-31, September.
    2. Devon McAslan & Farah Najar Arevalo & David A. King & Thaddeus R. Miller, 2021. "Pilot project purgatory? Assessing automated vehicle pilot projects in U.S. cities," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-16, December.
    3. Liliana Andrei & Oana Luca & Florian Gaman, 2022. "Insights from User Preferences on Automated Vehicles: Influence of Socio-Demographic Factors on Value of Time in Romania Case," Sustainability, MDPI, vol. 14(17), pages 1-22, August.
    4. Asmussen, Katherine E. & Mondal, Aupal & Bhat, Chandra R., 2022. "Adoption of partially automated vehicle technology features and impacts on vehicle miles of travel (VMT)," Transportation Research Part A: Policy and Practice, Elsevier, vol. 158(C), pages 156-179.
    5. Hans Westerman & John Black, 2024. "Preparing for Fully Autonomous Vehicles in Australian Cities: Land-Use Planning—Adapting, Transforming, and Innovating," Sustainability, MDPI, vol. 16(13), pages 1-31, June.
    6. Tengilimoglu, Oguz & Carsten, Oliver & Wadud, Zia, 2023. "Implications of automated vehicles for physical road environment: A comprehensive review," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 169(C).
    7. Hazel Si Min Lim & Araz Taeihagh, 2019. "Algorithmic Decision-Making in AVs: Understanding Ethical and Technical Concerns for Smart Cities," Sustainability, MDPI, vol. 11(20), pages 1-28, October.
    8. Bing Xia & Jindong Wu & Jiaqi Wang & Yitao Fang & Haodi Shen & Jingli Shen, 2021. "Sustainable Renewal Methods of Urban Public Parking Spaces under the Scenario of Shared Autonomous Vehicles (SAV): A Review and a Proposal," Sustainability, MDPI, vol. 13(7), pages 1-21, March.
    9. Cheng, Shuo & Li, Liang & Chen, Xiang & Fang, Sheng-nan & Wang, Xiang-yu & Wu, Xiu-heng & Li, Wei-bing, 2020. "Longitudinal autonomous driving based on game theory for intelligent hybrid electric vehicles with connectivity," Applied Energy, Elsevier, vol. 268(C).
    10. Tscharaktschiew, Stefan & Reimann, Felix, 2023. "The economics of speed choice and control in the presence of driverless vehicle cruising and parking-as-a-substitute-for-cruising," Transportation Research Part B: Methodological, Elsevier, vol. 178(C).
    11. Bin-Nun, Amitai Y. & Binamira, Isabel, 2020. "A framework for the impact of highly automated vehicles with limited operational design domains," Transportation Research Part A: Policy and Practice, Elsevier, vol. 139(C), pages 174-188.
    12. Mordue, Greig & Yeung, Anders & Wu, Fan, 2020. "The looming challenges of regulating high level autonomous vehicles," Transportation Research Part A: Policy and Practice, Elsevier, vol. 132(C), pages 174-187.
    13. Peer, Stefanie & Müller, Johannes & Naqvi, Asjad & Straub, Markus, 2024. "Introducing shared, electric, autonomous vehicles (SAEVs) in sub-urban zones: Simulating the case of Vienna," Transport Policy, Elsevier, vol. 147(C), pages 232-243.
    14. Pettigrew, Simone & Booth, Leon & Farrar, Victoria & Brown, Julie & Karl, Charles & Godic, Branislava & Vidanaarachchi, Rajith & Thompson, Jason, 2024. "Public support for proposed government policies to optimise the social benefits of autonomous vehicles," Transport Policy, Elsevier, vol. 149(C), pages 264-270.
    15. Chowdhury, Tufayel & Vaughan, James & Roorda, Matthew J., 2024. "Modeling impacts of freight automated vehicles in the Greater Toronto and Hamilton Area," Transportation Research Part A: Policy and Practice, Elsevier, vol. 184(C).
    16. Sajjad Shafiei & Ziyuan Gu & Hanna Grzybowska & Chen Cai, 2023. "Impact of self-parking autonomous vehicles on urban traffic congestion," Transportation, Springer, vol. 50(1), pages 183-203, February.
    17. Mohamed Alawadhi & Jumah Almazrouie & Mohammed Kamil & Khalil Abdelrazek Khalil, 0. "Review and analysis of the importance of autonomous vehicles liability: a systematic literature review," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 0, pages 1-23.
    18. Agnieszka Dudziak & Monika Stoma & Andrzej Kuranc & Jacek Caban, 2021. "Assessment of Social Acceptance for Autonomous Vehicles in Southeastern Poland," Energies, MDPI, vol. 14(18), pages 1-16, September.
    19. Dahlen Silva & Dávid Földes & Csaba Csiszár, 2021. "Autonomous Vehicle Use and Urban Space Transformation: A Scenario Building and Analysing Method," Sustainability, MDPI, vol. 13(6), pages 1-22, March.
    20. Nahmias-Biran, Bat-hen & Oke, Jimi B. & Kumar, Nishant, 2021. "Who benefits from AVs? Equity implications of automated vehicles policies in full-scale prototype cities," Transportation Research Part A: Policy and Practice, Elsevier, vol. 154(C), pages 92-107.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:18:p:13667-:d:1238815. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.