IDEAS home Printed from https://ideas.repec.org/h/elg/eechap/21469_9.html
   My bibliography  Save this book chapter

Using plants as biosensors to measure the emotions of jazz musicians

In: Handbook of Social Computing

Author

Listed:
  • Anushka Bhave
  • Fritz K. Renold
  • Peter A. Gloor

Abstract

This chapter proposes a novel non-invasive, and privacy-preserving approach to quantify human emotions by tracking the action potential activations in plants positioned in the vicinity of humans. The production of human electrostatic discharge triggers changes in the electrical action potential values of a Basil plant (Ocimum basilicum) that acts as a highly sensitive movement and sound sensor. We construct a machine learning model to predict human emotions using features extracted from the plant’s electrical signals. The data is collected from a two-hour jazz rehearsal session with an orchestra of 19 musicians. Moreover, the emotions of musicians are also measured with two well-tested systems to collect ground truth. The first is facial emotion recognition using CNNs by obtaining camera-recorded videos of the musicians. The second is smartwatch sensor data of physiological signals like heart rate and body movement. On experimental evaluation, we obtain Pearson correlation values and regression coefficients for group facial emotions and plant Mel Frequency Cepstral Coefficients (MFCCs). Our machine learning approach achieves a training and test accuracy of 69 percent and 64 percent, respectively.

Suggested Citation

  • Anushka Bhave & Fritz K. Renold & Peter A. Gloor, 2024. "Using plants as biosensors to measure the emotions of jazz musicians," Chapters, in: Peter A. Gloor & Francesca Grippa & Andrea Fronzetti Colladon & Aleksandra Przegalinska (ed.), Handbook of Social Computing, chapter 9, pages 173-188, Edward Elgar Publishing.
  • Handle: RePEc:elg:eechap:21469_9
    as

    Download full text from publisher

    File URL: https://www.elgaronline.com/doi/10.4337/9781803921259.00017
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:elg:eechap:21469_9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Darrel McCalla (email available below). General contact details of provider: http://www.e-elgar.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.