IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0223881.html
   My bibliography  Save this article

Real vs. immersive-virtual emotional experience: Analysis of psycho-physiological patterns in a free exploration of an art museum

Author

Listed:
  • Javier Marín-Morales
  • Juan Luis Higuera-Trujillo
  • Alberto Greco
  • Jaime Guixeres
  • Carmen Llinares
  • Claudio Gentili
  • Enzo Pasquale Scilingo
  • Mariano Alcañiz
  • Gaetano Valenza

Abstract

Virtual reality is a powerful tool in human behaviour research. However, few studies compare its capacity to evoke the same emotional responses as in real scenarios. This study investigates psycho-physiological patterns evoked during the free exploration of an art museum and the museum virtualized through a 3D immersive virtual environment (IVE). An exploratory study involving 60 participants was performed, recording electroencephalographic and electrocardiographic signals using wearable devices. The real vs. virtual psychological comparison was performed using self-assessment emotional response tests, whereas the physiological comparison was performed through Support Vector Machine algorithms, endowed with an effective feature selection procedure for a set of state-of-the-art metrics quantifying cardiovascular and brain linear and nonlinear dynamics. We included an initial calibration phase, using standardized 2D and 360° emotional stimuli, to increase the accuracy of the model. The self-assessments of the physical and virtual museum support the use of IVEs in emotion research. The 2-class (high/low) system accuracy was 71.52% and 77.08% along the arousal and valence dimension, respectively, in the physical museum, and 75.00% and 71.08% in the virtual museum. The previously presented 360° stimuli contributed to increasing the accuracy in the virtual museum. Also, the real vs. virtual classifier accuracy was 95.27%, using only EEG mean phase coherency features, which demonstrates the high involvement of brain synchronization in emotional virtual reality processes. These findings provide an important contribution at a methodological level and to scientific knowledge, which will effectively guide future emotion elicitation and recognition systems using virtual reality.

Suggested Citation

  • Javier Marín-Morales & Juan Luis Higuera-Trujillo & Alberto Greco & Jaime Guixeres & Carmen Llinares & Claudio Gentili & Enzo Pasquale Scilingo & Mariano Alcañiz & Gaetano Valenza, 2019. "Real vs. immersive-virtual emotional experience: Analysis of psycho-physiological patterns in a free exploration of an art museum," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-24, October.
  • Handle: RePEc:plo:pone00:0223881
    DOI: 10.1371/journal.pone.0223881
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0223881
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0223881&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0223881?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Leon Glass, 2001. "Synchronization and rhythmic processes in physiology," Nature, Nature, vol. 410(6825), pages 277-284, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ricardo Bioni Liberalquino & Maurizio Monge & Stefano Galatolo & Luigi Marangio, 2018. "Chaotic Itinerancy in Random Dynamical System Related to Associative Memory Models," Mathematics, MDPI, vol. 6(3), pages 1-10, March.
    2. Robert G. Sacco, 2019. "The Predictability of Synchronicity Experience: Results from a Survey of Jungian Analysts," International Journal of Psychological Studies, Canadian Center of Science and Education, vol. 11(3), pages 1-46, September.
    3. Alexey V. Rusakov & Dmitry A. Tikhonov & Nailya I. Nurieva & Alexander B. Medvinsky, 2021. "Emergence of Self-Organized Dynamical Domains in a Ring of Coupled Population Oscillators," Mathematics, MDPI, vol. 9(6), pages 1-13, March.
    4. Meo, Marcos M. & Iaconis, Francisco R. & Del Punta, Jessica A. & Delrieux, Claudio A. & Gasaneo, Gustavo, 2024. "Multifractal information on reading eye tracking data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 638(C).
    5. Reis, A.S. & Brugnago, E.L. & Viana, R.L. & Batista, A.M. & Iarosz, K.C. & Ferrari, F.A.S. & Caldas, I.L., 2023. "The role of the fitness model in the suppression of neuronal synchronous behavior with three-stage switching control in clustered networks," Chaos, Solitons & Fractals, Elsevier, vol. 167(C).
    6. Gois, Sandra R.F.S.M. & Savi, Marcelo A., 2009. "An analysis of heart rhythm dynamics using a three-coupled oscillator model," Chaos, Solitons & Fractals, Elsevier, vol. 41(5), pages 2553-2565.
    7. Ausloos, Marcel & Nedic, Olgica & Dekanski, Aleksandar, 2016. "Day of the week effect in paper submission/acceptance/rejection to/in/by peer review journals," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 456(C), pages 197-203.
    8. Ausloos, Marcel & Nedic, Olgica & Dekanski, Aleksandar & Mrowinski, Maciej J. & Fronczak, Piotr & Fronczak, Agata, 2017. "Day of the week effect in paper submission/acceptance/rejection to/in/by peer review journals. II. An ARCH econometric-like modeling," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 468(C), pages 462-474.
    9. Piassi, V.S.M. & Colli, E. & Tufaile, A. & Sartorelli, J.C., 2009. "Arnold family in acoustically forced air bubble formation," Chaos, Solitons & Fractals, Elsevier, vol. 41(3), pages 1041-1049.
    10. Christopher K Rhea & Tobin A Silver & S Lee Hong & Joong Hyun Ryu & Breanna E Studenka & Charmayne M L Hughes & Jeffrey M Haddad, 2011. "Noise and Complexity in Human Postural Control: Interpreting the Different Estimations of Entropy," PLOS ONE, Public Library of Science, vol. 6(3), pages 1-9, March.
    11. Cazelles, Bernard & Chavez, Mario & Courbage, Maurice, 2012. "Editorial," Chaos, Solitons & Fractals, Elsevier, vol. 45(5), pages 1-1.
    12. Feng-Sheng Tsai & Yi-Li Shih & Chin-Tzong Pang & Sheng-Yi Hsu, 2019. "Formulation of Pruning Maps with Rhythmic Neural Firing," Mathematics, MDPI, vol. 7(12), pages 1-15, December.
    13. Thounaojam, Umeshkanta Singh & Manchanda, Kaustubh, 2023. "Continuous and explosive synchronization of phase oscillators on star network: Effect of degree-frequency correlations and time-delays," Chaos, Solitons & Fractals, Elsevier, vol. 169(C).
    14. Lu, Bo & Gu, Huaguang & Wang, Xianjun & Hua, Hongtao, 2021. "Paradoxical enhancement of neuronal bursting response to negative feedback of autapse and the nonlinear mechanism," Chaos, Solitons & Fractals, Elsevier, vol. 145(C).
    15. Cornejo-Pérez, O. & Solı´s-Perales, G.C. & Arenas-Prado, J.A., 2012. "Synchronization dynamics in a small pacemaker neuronal ensemble via a robust adaptive controller," Chaos, Solitons & Fractals, Elsevier, vol. 45(6), pages 861-868.
    16. Mendola, Naveen Kumar & Thounaojam, Umeshkanta Singh, 2024. "Collective rotation-flips and explosive synchronization in a ring of limit cycle oscillators," Chaos, Solitons & Fractals, Elsevier, vol. 180(C).
    17. Liu, Tianhao, 2021. "A study on day-of-week effect of submission: Based on the data of JSFST," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 563(C).
    18. Hannesson, Erik & Sellers, Jordan & Walker, Ethan & Webb, Benjamin, 2022. "Network specialization: A topological mechanism for the emergence of cluster synchronization," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 600(C).
    19. Koronovskii, Alexey A. & Moskalenko, Olga I. & Ponomarenko, Vladimir I. & Prokhorov, Mikhail D. & Hramov, Alexander E., 2016. "Binary generalized synchronization," Chaos, Solitons & Fractals, Elsevier, vol. 83(C), pages 133-139.
    20. Polynikis, A. & di Bernardo, M. & Hogan, S.J., 2009. "Synchronizability of coupled PWL maps," Chaos, Solitons & Fractals, Elsevier, vol. 41(3), pages 1353-1367.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0223881. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.