IDEAS home Printed from https://ideas.repec.org/a/gam/jftint/v16y2024i12p480-d1550566.html
   My bibliography  Save this article

A Survey of Scenario Generation for Automated Vehicle Testing and Validation

Author

Listed:
  • Ziyu Wang

    (Department of Data Science and Artificial Intelligence, School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland 1010, New Zealand)

  • Jing Ma

    (Department of Data Science and Artificial Intelligence, School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland 1010, New Zealand)

  • Edmund M-K Lai

    (Department of Data Science and Artificial Intelligence, School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland 1010, New Zealand)

Abstract

This survey explores the evolution of test scenario generation for autonomous vehicles (AVs), distinguishing between non-adaptive and adaptive scenario approaches. Non-adaptive scenarios, where dynamic objects follow predetermined scripts, provide repeatable and reliable tests but fail to capture the complexity and unpredictability of real-world traffic interactions. In contrast, adaptive scenarios, which adapt in real time to environmental changes, offer a more realistic simulation of traffic conditions, enabling the assessment of an AV system’s adaptability, safety, and robustness. The shift from non-adaptive to adaptive scenarios is increasingly emphasized in AV research, to better evaluate system performance in complex environments. However, generating adaptive scenario is more complex and faces challenges. These include the limited diversity in behaviors, low model interpretability, and high resource requirements. Future research should focus on enhancing the efficiency of adaptive scenario generation and developing comprehensive evaluation metrics to improve the realism and effectiveness of AV testing.

Suggested Citation

  • Ziyu Wang & Jing Ma & Edmund M-K Lai, 2024. "A Survey of Scenario Generation for Automated Vehicle Testing and Validation," Future Internet, MDPI, vol. 16(12), pages 1-17, December.
  • Handle: RePEc:gam:jftint:v:16:y:2024:i:12:p:480-:d:1550566
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1999-5903/16/12/480/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1999-5903/16/12/480/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Vincent P. Crawford & Nagore Iriberri, 2007. "Level-k Auctions: Can a Nonequilibrium Model of Strategic Thinking Explain the Winner's Curse and Overbidding in Private-Value Auctions?," Econometrica, Econometric Society, vol. 75(6), pages 1721-1770, November.
    2. Peter W. Glynn & Donald L. Iglehart, 1989. "Importance Sampling for Stochastic Simulations," Management Science, INFORMS, vol. 35(11), pages 1367-1392, November.
    3. Shuo Feng & Xintao Yan & Haowei Sun & Yiheng Feng & Henry X. Liu, 2021. "Intelligent driving intelligence test for autonomous vehicles with naturalistic and adversarial environment," Nature Communications, Nature, vol. 12(1), pages 1-14, December.
    4. Kalra, Nidhi & Paddock, Susan M., 2016. "Driving to safety: How many miles of driving would it take to demonstrate autonomous vehicle reliability?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 94(C), pages 182-193.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Henry X. Liu & Shuo Feng, 2024. "Curse of rarity for autonomous vehicles," Nature Communications, Nature, vol. 15(1), pages 1-5, December.
    2. Wei, Cheng & Hui, Fei & Khattak, Asad J. & Zhao, Xiangmo & Jin, Shaojie, 2023. "Batch human-like trajectory generation for multi-motion-state NPC-vehicles in autonomous driving virtual simulation testing," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 616(C).
    3. Demin Nalic & Aleksa Pandurevic & Arno Eichberger & Martin Fellendorf & Branko Rogic, 2021. "Software Framework for Testing of Automated Driving Systems in the Traffic Environment of Vissim," Energies, MDPI, vol. 14(11), pages 1-9, May.
    4. Bosch-Domènech, Antoni & Vriend, Nicolaas J., 2013. "On the role of non-equilibrium focal points as coordination devices," Journal of Economic Behavior & Organization, Elsevier, vol. 94(C), pages 52-67.
    5. Gisèle Umbhauer, 2015. "Almost common value auctions and discontinuous equilibria," Post-Print hal-01735849, HAL.
    6. Scott Duke Kominers & Alexander Teytelboym & Vincent P Crawford, 2017. "An invitation to market design," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 33(4), pages 541-571.
    7. Philippe Jehiel & Jakub Steiner, 2020. "Selective Sampling with Information-Storage Constraints [On interim rationality, belief formation and learning in decision problems with bounded memory]," The Economic Journal, Royal Economic Society, vol. 130(630), pages 1753-1781.
    8. Nichole Szembrot, 2017. "Are voters cursed when politicians conceal policy preferences?," Public Choice, Springer, vol. 173(1), pages 25-41, October.
    9. Hitoshi Matsushima, 2017. "Framing Game Theory," CARF F-Series CARF-F-425, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    10. David J. Cooper & Hanming Fang, 2008. "Understanding Overbidding in Second Price Auctions: An Experimental Study," Economic Journal, Royal Economic Society, vol. 118(532), pages 1572-1595, October.
    11. Philippe Jehiel, 2022. "Analogy-Based Expectation Equilibrium and Related Concepts:Theory, Applications, and Beyond," Working Papers halshs-03735680, HAL.
    12. Vincent P. Crawford & Nagore Iriberri, 2004. "Fatal Attraction: Focality, Naivete, and Sophistication in Experimental Hide-and-Seek Games," Levine's Bibliography 122247000000000345, UCLA Department of Economics.
    13. Andrea Bertolini & Massimo Riccaboni, 2021. "Grounding the case for a European approach to the regulation of automated driving: the technology-selection effect of liability rules," European Journal of Law and Economics, Springer, vol. 51(2), pages 243-284, April.
    14. Helton, J.C. & Hansen, C.W. & Sallaberry, C.J., 2014. "Conceptual structure and computational organization of the 2008 performance assessment for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada," Reliability Engineering and System Safety, Elsevier, vol. 122(C), pages 223-248.
    15. Strzalecki, Tomasz, 2014. "Depth of reasoning and higher order beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 108(C), pages 108-122.
    16. Kerim Keskin, 2016. "Inverse S-shaped probability weighting functions in first-price sealed-bid auctions," Review of Economic Design, Springer;Society for Economic Design, vol. 20(1), pages 57-67, March.
    17. Quement, Mark T. Le & Marcin, Isabel, 2020. "Communication and voting in heterogeneous committees: An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 174(C), pages 449-468.
    18. Luca Corazzini & Stefano Galavotti & Rupert Sausgruber & Paola Valbonesi, 2017. "Allotment in first-price auctions: an experimental investigation," Experimental Economics, Springer;Economic Science Association, vol. 20(1), pages 70-99, March.
    19. Helland, Leif & Iachan, Felipe S. & Juelsrud, Ragnar E. & Nenov, Plamen T., 2021. "Information quality and regime change: Evidence from the lab," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 538-554.
    20. Willemien Kets, 2014. "Finite Depth of Reasoning and Equilibrium Play in Games with Incomplete Information," Discussion Papers 1569, Northwestern University, Center for Mathematical Studies in Economics and Management Science.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jftint:v:16:y:2024:i:12:p:480-:d:1550566. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.