IDEAS home Printed from https://ideas.repec.org/p/zbw/glodps/1493.html
   My bibliography  Save this paper

Development and validation of a real-time happiness index using Google TrendsTM

Author

Listed:
  • Greyling, Talita
  • Rossouw, Stephanié

Abstract

It is well-established that a country's economic outcomes, including productivity, future income, and labour market performance, are profoundly influenced by the happiness of its people. Traditionally, survey data have been the primary source for determining people's happiness. However, this approach faces challenges as individuals increasingly experience "survey fatigue"; conducting surveys is costly, data generated from surveys is only available with a significant time lag, and happiness is not a constant state. To address these limitations of survey data, Big Data collected from online sources like Google Trends™ and social media platforms have emerged as a significant and necessary data source to complement traditional survey data. This alternative data source can give policymakers more timely information on people's happiness, well-being or any other issue. In recent years, Google Trends™ data has been leveraged to discern trends in mental health, including depression, anxiety, and loneliness and to construct robust predictors of subjective well-being composite categories. We aim to develop a methodology to construct the first comprehensive, near real-time measure of population-level happiness using information-seeking query data extracted continuously using Google Trends™ in countries. We use a basket of English-language emotion words suggested to capture positive and negative affect based on the literature reviewed. To derive the equation for estimating happiness in a country, we employ machine learning algorithms XGBoost and ElasticNet to determine the most important words and weight the happiness equation, respectively. We use the United Kingdom's ONS (weekly and quarterly) data to demonstrate our methodology. Next, we translate the basket of words into Dutch and apply the same equation to test if the same words and weights can be used in a different country (the Netherlands) to estimate happiness. Lastly, we improve the fit for the Netherlands by incorporating country-specific emotion words. Evaluating the accuracy of our estimated happiness in countries against survey data, we find a very good fit with very low error metrics. If we add country-specific words, we improve the fit statistics. Our suggested methodology shows that emotion words extracted from Google Trends™ can accurately estimate a country's level of happiness.

Suggested Citation

  • Greyling, Talita & Rossouw, Stephanié, 2024. "Development and validation of a real-time happiness index using Google TrendsTM," GLO Discussion Paper Series 1493, Global Labor Organization (GLO).
    • Handle: RePEc:zbw:glodps:1493
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/303150/1/GLO-DP-1493.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. S. M. Iacus & G. Porro & S. Salini & E. Siletti, 2022. "An Italian Composite Subjective Well-Being Index: The Voice of Twitter Users from 2012 to 2017," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 161(2), pages 471-489, June.
    2. Ed Diener & Derrick Wirtz & William Tov & Chu Kim-Prieto & Dong-won Choi & Shigehiro Oishi & Robert Biswas-Diener, 2010. "New Well-being Measures: Short Scales to Assess Flourishing and Positive and Negative Feelings," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 97(2), pages 143-156, June.
    3. Peter Dodds & Christopher Danforth, 2010. "Measuring the Happiness of Large-Scale Written Expression: Songs, Blogs, and Presidents," Journal of Happiness Studies, Springer, vol. 11(4), pages 441-456, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Talita Greyling & Stephanié Rossouw, 2025. "Development and Validation of a Real-Time Happiness Index Using Google Trends™," Journal of Happiness Studies, Springer, vol. 26(3), pages 1-24, March.
    2. Maw–Der Foo & Marilyn A. Uy & Charles Murnieks, 2015. "Beyond Affective Valence: Untangling Valence and Activation Influences on Opportunity Identification," Entrepreneurship Theory and Practice, , vol. 39(2), pages 407-431, March.
    3. Yi-Ching Hsieh & Hung-Chang Chiu & Yun-Chia Tang & Wei-Yun Lin, 2018. "Does Raising Value Co-creation Increase All Customers’ Happiness?," Journal of Business Ethics, Springer, vol. 152(4), pages 1053-1067, November.
    4. Li, Tingting Elle & Chan, Eric Tak Hin, 2017. "Diaspora tourism and well-being: A eudaimonic view," Annals of Tourism Research, Elsevier, vol. 63(C), pages 205-206.
    5. M. Sirgy, 2011. "Theoretical Perspectives Guiding QOL Indicator Projects," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 103(1), pages 1-22, August.
    6. Merrick Powell & Kirk N. Olsen & William Forde Thompson, 2023. "Music, Pleasure, and Meaning: The Hedonic and Eudaimonic Motivations for Music (HEMM) Scale," IJERPH, MDPI, vol. 20(6), pages 1-19, March.
    7. Zuoxian Gan & Tao Feng & Min Yang, 2018. "Exploring the Effects of Car Ownership and Commuting on Subjective Well-Being: A Nationwide Questionnaire Study," Sustainability, MDPI, vol. 11(1), pages 1-20, December.
    8. Nelli Ferenczi & Tara C Marshall, 2013. "Exploring Attachment to the “Homeland” and Its Association with Heritage Culture Identification," PLOS ONE, Public Library of Science, vol. 8(1), pages 1-17, January.
    9. Kwok Kit Tong & Yuan Yuan Wang, 2017. "Validation of the flourishing scale and scale of positive and negative experience in a Chinese community sample," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-10, August.
    10. Yixuan Liu & Liumeng Li & Guomei Miao & Xinyan Yang & Yinghui Wu & Yanling Xu & Yonghong Gao & Yongzhi Zhan & Yiwei Zhong & Shujuan Yang, 2021. "Relationship between Children’s Intergenerational Emotional Support and Subjective Well-Being among Middle-Aged and Elderly People in China: The Mediation Role of the Sense of Social Fairness," IJERPH, MDPI, vol. 19(1), pages 1-12, December.
    11. Sakari Kainulainen, 2020. "Flourishing within the Working-Aged Finnish Population," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 15(1), pages 187-205, March.
    12. Sujit Raghunathrao Jagadale & Himadri Roy‐Chaudhuri & Djavlonbek Kadirov, 2021. "Quality‐of‐life as chronotopefication and futurization: Subsistence consumer experiences in India," Journal of Consumer Affairs, Wiley Blackwell, vol. 55(1), pages 59-86, March.
    13. Erin Percival Carter & Stephanie Welcomer, 2021. "Designing and Distinguishing Meaningful Artisan Food Experiences," Sustainability, MDPI, vol. 13(15), pages 1-13, July.
    14. Annamaria Di Fabio & Maureen E. Kenny, 2018. "Intrapreneurial Self-Capital: A Key Resource for Promoting Well-Being in a Shifting Work Landscape," Sustainability, MDPI, vol. 10(9), pages 1-11, August.
    15. Michael A. Busseri & Mojan Naisani Samani, 2019. "Lay Theories for Life Satisfaction and the Belief that Life Gets Better and Better," Journal of Happiness Studies, Springer, vol. 20(5), pages 1647-1672, June.
    16. Asude Malkoç & Aynur Kesen Mutlu, 2019. "Mediating the Effect of Cognitive Flexibility in the Relationship between Psychological Well-Being and Self-Confidence: A Study on Turkish University Students," International Journal of Higher Education, Sciedu Press, vol. 8(6), pages 278-278, December.
    17. Shafiullah Jan & M. Fahad Siddiqi & Karim Ullah, 2019. "Maqasid al Shariah and Stakeholders’ Wellbeing in Islamic Banks: A Proposed Framework," Business & Economic Review, Institute of Management Sciences, Peshawar, Pakistan, vol. 11(1), pages 83-102, March.
    18. Kamlesh Singh & Mahima Raina, 2020. "Demographic Correlates and Validation of PERMA and WEMWBS Scales in Indian Adolescents," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 13(4), pages 1175-1186, August.
    19. Andrea Chmitorz & Mario Wenzel & Rolf-Dieter Stieglitz & Angela Kunzler & Christiana Bagusat & Isabella Helmreich & Anna Gerlicher & Miriam Kampa & Thomas Kubiak & Raffael Kalisch & Klaus Lieb & Olive, 2018. "Population-based validation of a German version of the Brief Resilience Scale," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-14, February.
    20. Hezhi Chen & Zhijia Zeng, 2023. "Seeking Pleasure is Good, but Avoiding Pain is Bad: Distinguishing Hedonic Approach from Hedonic Avoidance Orientations," Journal of Happiness Studies, Springer, vol. 24(7), pages 2377-2393, October.

    More about this item

    Keywords

    Happiness; Google Trends™; Big Data; XGBoost; machine learning;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • I31 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - General Welfare, Well-Being

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:glodps:1493. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/glabode.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.