IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i24p4030-d1549928.html
   My bibliography  Save this article

A Navigation Algorithm Based on the Reinforcement Learning Reward System and Optimised with Genetic Algorithm

Author

Listed:
  • Mireya Cabezas-Olivenza

    (Faculty of Engineering, Mondragon Unibertsitatea, 20500 Arrasate-Mondragon, Spain)

  • Ekaitz Zulueta

    (System Engineering and Automation Control Department, University of the Basque Country (UPV/EHU), Nieves Cano, 12, 01006 Vitoria-Gasteiz, Spain)

  • Iker Azurmendi-Marquinez

    (CS Centro Stirling S. Coop., Avda. Álava 3, 20550 Aretxabaleta, Spain)

  • Unai Fernandez-Gamiz

    (Department Energy Engineering, University of the Basque Country (UPV/EHU), Nieves Cano, 12, 01006 Vitoria-Gasteiz, Spain)

  • Danel Rico-Melgosa

    (System Engineering and Automation Control Department, University of the Basque Country (UPV/EHU), Nieves Cano, 12, 01006 Vitoria-Gasteiz, Spain)

Abstract

Regarding autonomous vehicle navigation, reinforcement learning is a technique that has demonstrated significant results. Nevertheless, it is a technique with a high number of parameters that need to be optimised without prior information, and correctly performing this is a complicated task. In this research study, a system based on the principles of reinforcement learning, specifically on the concept of rewards, is presented. A mathematical expression was proposed to control the vehicle’s direction based on its position, the obstacles in the environment and the destination. In this equation proposal, there was only one unknown parameter that regulated the degree of the action to be taken, and this was optimised through the genetic algorithm. In this way, a less computationally expensive navigation algorithm was presented, as it avoided the use of neural networks. The controller’s time to obtain the navigation instructions was around 6.201·10 −4 s. This algorithm is an efficient and accurate system which manages not to collide with obstacles and to reach the destination from any position. Moreover, in most cases, it has been found that the proposed navigations are also optimal.

Suggested Citation

  • Mireya Cabezas-Olivenza & Ekaitz Zulueta & Iker Azurmendi-Marquinez & Unai Fernandez-Gamiz & Danel Rico-Melgosa, 2024. "A Navigation Algorithm Based on the Reinforcement Learning Reward System and Optimised with Genetic Algorithm," Mathematics, MDPI, vol. 12(24), pages 1-26, December.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:24:p:4030-:d:1549928
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/24/4030/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/24/4030/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stafylopatis, A. & Blekas, K., 1998. "Autonomous vehicle navigation using evolutionary reinforcement learning," European Journal of Operational Research, Elsevier, vol. 108(2), pages 306-318, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Zhicong & Zheng, Li & Hou, Forest & Li, Na, 2011. "Semiconductor final test scheduling with Sarsa([lambda], k) algorithm," European Journal of Operational Research, Elsevier, vol. 215(2), pages 446-458, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:24:p:4030-:d:1549928. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.