IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v12y2020i21p9092-d438420.html
   My bibliography  Save this article

An LSTM Based Generative Adversarial Architecture for Robotic Calligraphy Learning System

Author

Listed:
  • Fei Chao

    (School of Informatics, Xiamen University, Xiamen 361005, China
    Department of Computer Science, Aberystwyth University, Aberystwyth, Ceredigion SY23 3DB, UK)

  • Gan Lin

    (School of Informatics, Xiamen University, Xiamen 361005, China)

  • Ling Zheng

    (School of Informatics, Xiamen University, Xiamen 361005, China)

  • Xiang Chang

    (Department of Computer Science, Aberystwyth University, Aberystwyth, Ceredigion SY23 3DB, UK)

  • Chih-Min Lin

    (Department of Electrical Engineering, Yuan Ze University, Taoyuan 32003, Taiwan)

  • Longzhi Yang

    (Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne NE1 8ST, UK)

  • Changjing Shang

    (Department of Computer Science, Aberystwyth University, Aberystwyth, Ceredigion SY23 3DB, UK)

Abstract

Robotic calligraphy is a very challenging task for the robotic manipulators, which can sustain industrial manufacturing. The active mechanism of writing robots require a large sized training set including sequence information of the writing trajectory. However, manual labelling work on those training data may cause the time wasting for researchers. This paper proposes a machine calligraphy learning system using a Long Short-Term Memory (LSTM) network and a generative adversarial network (GAN), which enables the robots to learn and generate the sequences of Chinese character stroke (i.e., writing trajectory). In order to reduce the size of the training set, a generative adversarial architecture combining an LSTM network and a discrimination network is established for a robotic manipulator to learn the Chinese calligraphy regarding its strokes. In particular, this learning system converts Chinese character stroke image into the trajectory sequences in the absence of the stroke trajectory writing sequence information. Due to its powerful learning ability in handling motion sequences, the LSTM network is used to explore the trajectory point writing sequences. Each generation process of the generative adversarial architecture contains a number of loops of LSTM. In each loop, the robot continues to write by following a new trajectory point, which is generated by LSTM according to the previously written strokes. The written stroke in an image format is taken as input to the next loop of the LSTM network until the complete stroke is finally written. Then, the final output of the LSTM network is evaluated by the discriminative network. In addition, a policy gradient algorithm based on reinforcement learning is employed to aid the robot to find the best policy. The experimental results show that the proposed learning system can effectively produce a variety of high-quality Chinese stroke writing.

Suggested Citation

  • Fei Chao & Gan Lin & Ling Zheng & Xiang Chang & Chih-Min Lin & Longzhi Yang & Changjing Shang, 2020. "An LSTM Based Generative Adversarial Architecture for Robotic Calligraphy Learning System," Sustainability, MDPI, vol. 12(21), pages 1-11, October.
  • Handle: RePEc:gam:jsusta:v:12:y:2020:i:21:p:9092-:d:438420
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/12/21/9092/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/12/21/9092/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Luca Gualtieri & Ilaria Palomba & Fabio Antonio Merati & Erwin Rauch & Renato Vidoni, 2020. "Design of Human-Centered Collaborative Assembly Workstations for the Improvement of Operators’ Physical Ergonomics and Production Efficiency: A Case Study," Sustainability, MDPI, vol. 12(9), pages 1-23, April.
    2. Francisco A. Pujol & David Tomás, 2020. "Introducing Sustainability in a Robotic Engineering Degree: A Case Study," Sustainability, MDPI, vol. 12(14), pages 1-24, July.
    3. Qi Zhang & Hongyang Li & Xin Wan & Martin Skitmore & Hailin Sun, 2020. "An Intelligent Waste Removal System for Smarter Communities," Sustainability, MDPI, vol. 12(17), pages 1-27, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Agnieszka A. Tubis & Katarzyna Grzybowska, 2022. "In Search of Industry 4.0 and Logistics 4.0 in Small-Medium Enterprises—A State of the Art Review," Energies, MDPI, vol. 15(22), pages 1-26, November.
    2. Leire Guerenabarrena-Cortazar & Jon Olaskoaga-Larrauri & Ernesto Cilleruelo-Carrasco, 2021. "Integration of Sustainability in Engineering and Architectural Studies in Spanish Universities," Sustainability, MDPI, vol. 13(14), pages 1-14, July.
    3. Emilio Rossi & Erminia Attaianese, 2023. "Research Synergies between Sustainability and Human-Centered Design: A Systematic Literature Review," Sustainability, MDPI, vol. 15(17), pages 1-19, August.
    4. Jiongxun Chen & Linxiu Wang & Tiantian Gu & Chenyang Wang & Enyang Hao, 2023. "Demands for Community Services and Associated Factors among Residents in Smart Communities: A Case Study of Xuzhou City," IJERPH, MDPI, vol. 20(4), pages 1-19, February.
    5. Ulfia A. Lenfers & Nima Ahmady-Moghaddam & Daniel Glake & Florian Ocker & Daniel Osterholz & Jonathan Ströbele & Thomas Clemen, 2021. "Improving Model Predictions—Integration of Real-Time Sensor Data into a Running Simulation of an Agent-Based Model," Sustainability, MDPI, vol. 13(13), pages 1-14, June.
    6. Ci-Jyun Liang & Marvin H. Cheng, 2023. "Trends in Robotics Research in Occupational Safety and Health: A Scientometric Analysis and Review," IJERPH, MDPI, vol. 20(10), pages 1-21, May.
    7. Ana Colim & Rita Morgado & Paula Carneiro & Nélson Costa & Carlos Faria & Nuno Sousa & Luís A. Rocha & Pedro Arezes, 2021. "Lean Manufacturing and Ergonomics Integration: Defining Productivity and Wellbeing Indicators in a Human–Robot Workstation," Sustainability, MDPI, vol. 13(4), pages 1-21, February.
    8. Hien Nguyen Ngoc & Ganix Lasa & Ion Iriarte, 2022. "Human-centred design in industry 4.0: case study review and opportunities for future research," Journal of Intelligent Manufacturing, Springer, vol. 33(1), pages 35-76, January.
    9. Davide Gattamelata & Mario Fargnoli, 2022. "Development of a New Procedure for Evaluating Working Postures: An Application in a Manufacturing Company," IJERPH, MDPI, vol. 19(22), pages 1-20, November.
    10. Dominic Loske & Matthias Klumpp & Maria Keil & Thomas Neukirchen, 2021. "Logistics Work, Ergonomics and Social Sustainability: Empirical Musculoskeletal System Strain Assessment in Retail Intralogistics," Logistics, MDPI, vol. 5(4), pages 1-25, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:12:y:2020:i:21:p:9092-:d:438420. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.