IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v546y2020ics0378437119316176.html
   My bibliography  Save this article

Chaos based non-linear cognitive study of different stimulus in the cross-modal perspective

Author

Listed:
  • Roy, Souparno
  • Roy, Chandrima
  • Nag, Sayan
  • Banerjee, Archi
  • Sengupta, Ranjan
  • Ghosh, Dipak

Abstract

The relationship between color and music as part of the complex system consisting of visual and auditory domain has been investigated in this study. As both the stimulus forms are processed in the same part of the human body, i.e., the brain, it will be really interesting to examine whether they share a similarity in perception. Needless to say that color and music both have strong impact on emotion and feelings & also a few studies have been reported in literature to explore causal relationship between color and emotion. This work reports a neuro-cognitive study on response of brain to two different stimulus and their cross-modal associations. In this study the correlation between emotional arousal and the effect of audio and visual stimuli has been studied from a new perspective. 93 participants were asked to hear 6 different music pieces (each of 30 s duration). The type of emotion elicited by different music pieces were identified by the participants from a given collection of possible emotional responses. Then they are asked to assign a color associating the emotion from a given color wheel (structured according to Munsell color system/RGB color space). Each color, associated with a particular music piece, is a mixture of specific Red, Green and Blue values (RGB triplet) and has a specific HEX number (hexadecimal representation), which is recorded for each response. Then, the musical pieces used were further zoomed with the help of fractal technique to identify different emotions related to music in a quantitative approach. Here, to analyze the complexity of the sound signal (which are non-stationary and scale varying in nature), we have used Multifractal detrended fluctuation analysis (MFDFA), which is capable of determining multifractal scaling behavior of non-stationary time series. From the experimental data, it is seen that the visual and emotional response to the auditory stimulus follows a specific trend which is directly related to the stimulus complexity.

Suggested Citation

  • Roy, Souparno & Roy, Chandrima & Nag, Sayan & Banerjee, Archi & Sengupta, Ranjan & Ghosh, Dipak, 2020. "Chaos based non-linear cognitive study of different stimulus in the cross-modal perspective," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 546(C).
    • Handle: RePEc:eee:phsmap:v:546:y:2020:i:c:s0378437119316176
    DOI: 10.1016/j.physa.2019.122842
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437119316176
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000
    File URL: https://libkey.io/10.1016/j.physa.2019.122842?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gu, Rongbao & Chen, Hongtao & Wang, Yudong, 2010. "Multifractal analysis on international crude oil markets based on the multifractal detrended fluctuation analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(14), pages 2805-2815.
    2. Shang, Pengjian & Lu, Yongbo & Kamae, Santi, 2008. "Detecting long-range correlations of traffic time series with multifractal detrended fluctuation analysis," Chaos, Solitons & Fractals, Elsevier, vol. 36(1), pages 82-90.
    3. Ghosh, Dipak & Dutta, Srimonti & Chakraborty, Sayantan, 2014. "Multifractal detrended cross-correlation analysis for epileptic patient in seizure and seizure free status," Chaos, Solitons & Fractals, Elsevier, vol. 67(C), pages 1-10.
    4. Ian D Colley & Roger T Dean, 2019. "Origins of 1/f noise in human music performance from short-range autocorrelations related to rhythmic structures," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-15, May.
    5. Jennings, Heather D & Ivanov, Plamen Ch & M. Martins, Allan de & da Silva, P.C & Viswanathan, G.M, 2004. "Variance fluctuations in nonstationary time series: a comparative study of music genres," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 336(3), pages 585-594.
    6. Kantelhardt, Jan W. & Zschiegner, Stephan A. & Koscielny-Bunde, Eva & Havlin, Shlomo & Bunde, Armin & Stanley, H.Eugene, 2002. "Multifractal detrended fluctuation analysis of nonstationary time series," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 316(1), pages 87-114.
    7. Yuan, Ying & Zhuang, Xin-tian & Jin, Xiu, 2009. "Measuring multifractality of stock price fluctuation using multifractal detrended fluctuation analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 388(11), pages 2189-2197.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dutta, Srimonti & Ghosh, Dipak & Chatterjee, Sucharita, 2016. "Multifractal detrended Cross Correlation Analysis of Foreign Exchange and SENSEX fluctuation in Indian perspective," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 463(C), pages 188-201.
    2. Chatterjee, Sucharita & Ghosh, Dipak, 2021. "Impact of Global Warming on SENSEX fluctuations — A study based on Multifractal detrended cross correlation analysis between the temperature anomalies and the SENSEX fluctuations," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 571(C).
    3. Chatterjee, Sucharita, 2020. "Analysis of the human gait rhythm in Neurodegenerative disease: A multifractal approach using Multifractal detrended cross correlation analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 540(C).
    4. Li, Zhihui & Lu, Xinsheng, 2012. "Cross-correlations between agricultural commodity futures markets in the US and China," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(15), pages 3930-3941.
    5. Wei, Yu & Wang, Yudong & Huang, Dengshi, 2011. "A copula–multifractal volatility hedging model for CSI 300 index futures," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(23), pages 4260-4272.
    6. Lu, Xinsheng & Sun, Xinxin & Ge, Jintian, 2017. "Dynamic relationship between Japanese Yen exchange rates and market anxiety: A new perspective based on MF-DCCA," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 474(C), pages 144-161.
    7. Leonarduzzi, R. & Wendt, H. & Abry, P. & Jaffard, S. & Melot, C. & Roux, S.G. & Torres, M.E., 2016. "p-exponent and p-leaders, Part II: Multifractal analysis. Relations to detrended fluctuation analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 448(C), pages 319-339.
    8. Ruan, Qingsong & Zhou, Mi & Yin, Linsen & Lv, Dayong, 2021. "Hedging effectiveness of Chinese Treasury bond futures: New evidence based on nonlinear analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 565(C).
    9. Ghosh, Dipak & Dutta, Srimonti & Chakraborty, Sayantan, 2014. "Multifractal detrended cross-correlation analysis for epileptic patient in seizure and seizure free status," Chaos, Solitons & Fractals, Elsevier, vol. 67(C), pages 1-10.
    10. Xu, Kaiye & Shang, Pengjian & Feng, Guochen, 2015. "Multifractal time series analysis using the improved 0–1 test model," Chaos, Solitons & Fractals, Elsevier, vol. 70(C), pages 134-143.
    11. Ruan, Qingsong & Bao, Junjie & Zhang, Manqian & Fan, Limin, 2019. "The effects of exchange rate regime reform on RMB markets: A new perspective based on MF-DCCA," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 522(C), pages 122-134.
    12. Shaw, Pankaj Kumar & Saha, Debajyoti & Ghosh, Sabuj & Janaki, M.S. & Iyengar, A.N. Sekar, 2017. "Investigation of multifractal nature of floating potential fluctuations obtained from a dc glow discharge magnetized plasma," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 469(C), pages 363-371.
    13. Pavón-Domínguez, P. & Serrano, S. & Jiménez-Hornero, F.J. & Jiménez-Hornero, J.E. & Gutiérrez de Ravé, E. & Ariza-Villaverde, A.B., 2013. "Multifractal detrended fluctuation analysis of sheep livestock prices in origin," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(19), pages 4466-4476.
    14. Zhou, Weijie & Dang, Yaoguo & Gu, Rongbao, 2013. "Efficiency and multifractality analysis of CSI 300 based on multifractal detrending moving average algorithm," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(6), pages 1429-1438.
    15. He, Xiaoli & Wang, Hongwu & Du, Ziping, 2014. "The complexity and fractal structures of CSI300 before and after the introduction of CSI300IF," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 414(C), pages 76-85.
    16. Ruan, Qingsong & Jiang, Wei & Ma, Guofeng, 2016. "Cross-correlations between price and volume in Chinese gold markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 451(C), pages 10-22.
    17. Saâdaoui, Foued, 2018. "Testing for multifractality of Islamic stock markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 496(C), pages 263-273.
    18. Balkissoon, Sarah & Fox, Neil & Lupo, Anthony, 2020. "Fractal characteristics of tall tower wind speeds in Missouri," Renewable Energy, Elsevier, vol. 154(C), pages 1346-1356.
    19. Ruan, Qingsong & Cui, Hao & Fan, Liming, 2020. "China’s soybean crush spread: Nonlinear analysis based on MF-DCCA," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 554(C).
    20. Wang, Yudong & Wei, Yu & Wu, Chongfeng, 2011. "Detrended fluctuation analysis on spot and futures markets of West Texas Intermediate crude oil," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(5), pages 864-875.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:546:y:2020:i:c:s0378437119316176. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.