IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v58y2024i6d10.1007_s11135-023-01755-z.html
   My bibliography  Save this article

Reinforcement learning for sequential decision making in population research

Author

Listed:
  • Nina Deliu

    (Sapienza Università di Roma
    University of Cambridge)

Abstract

Reinforcement learning (RL) algorithms have been long recognized as powerful tools for optimal sequential decision making. The framework is concerned with a decision maker, the agent, that learns how to behave in an unknown environment by making decisions and seeing their associated outcome. The goal of the RL agent is to infer, through repeated experience, an optimal decision-making policy, i.e., a sequence of action rules that would lead to the highest, typically long-term, expected utility. Today, a wide range of domains, from economics to education and healthcare, have embraced the use of RL to address specific problems. To illustrate, we used an RL-based algorithm to design a text-messaging system that delivers personalized real-time behavioural recommendations to promote physical activity and manage depression. Motivated by the recent call of the UNECE for government-wide actions to adapt to population ageing, in this work, we argue that the RL framework may provide a set of compelling strategies for supporting population research and informing population policies. After introducing the RL framework, we discuss its potential in three population-study applications: international migration, public health, and fertility.

Suggested Citation

  • Nina Deliu, 2024. "Reinforcement learning for sequential decision making in population research," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(6), pages 5057-5080, December.
  • Handle: RePEc:spr:qualqt:v:58:y:2024:i:6:d:10.1007_s11135-023-01755-z
    DOI: 10.1007/s11135-023-01755-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-023-01755-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11135-023-01755-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Athey,Susan,Bergstrom,Katy Ann,Hadad,Vitor,Jamison,Julian C,Ozler,Berk,Parisotto,Luca,Sama,Julius Dohbit, 2021. "Shared Decision-Making : Can Improved Counseling Increase Willingness to Pay for Modern Contraceptives ?," Policy Research Working Paper Series 9777, The World Bank.
    2. Andrea Nigri & Susanna Levantesi & Jose Manuel Aburto, 2022. "Leveraging deep neural networks to estimate age-specific mortality from life expectancy at birth," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 47(8), pages 199-232.
    3. Anna Klabunde & Frans Willekens, 2016. "Decision-Making in Agent-Based Models of Migration: State of the Art and Challenges," European Journal of Population, Springer;European Association for Population Studies, vol. 32(1), pages 73-97, February.
    4. Amelie F. Constant & Klaus F. Zimmermann, 2012. "The Dynamics of Repeat Migration: A Markov Chain Analysis," International Migration Review, Wiley Blackwell, vol. 46(2), pages 362-388, June.
    5. Steven Ruggles, 2014. "Big Microdata for Population Research," Demography, Springer;Population Association of America (PAA), vol. 51(1), pages 287-297, February.
    6. Larry A. Sjaastad, 1970. "The Costs and Returns of Human Migration," Palgrave Macmillan Books, in: Harry W. Richardson (ed.), Regional Economics, chapter 9, pages 115-133, Palgrave Macmillan.
    7. Francesco C. Billari, 2022. "Demography: Fast and Slow," Population and Development Review, The Population Council, Inc., vol. 48(1), pages 9-30, March.
    8. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    9. David A. Sánchez-Páez & José Antonio Ortega, 2018. "Adolescent contraceptive use and its effects on fertility," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 38(45), pages 1359-1388.
    10. Gilboa,Itzhak, 2009. "Theory of Decision under Uncertainty," Cambridge Books, Cambridge University Press, number 9780521741231, January.
    11. Brezzi, Monica & Lai, Tze Leung, 2002. "Optimal learning and experimentation in bandit problems," Journal of Economic Dynamics and Control, Elsevier, vol. 27(1), pages 87-108, November.
    12. Hamsa Bastani & Kimon Drakopoulos & Vishal Gupta & Ioannis Vlachogiannis & Christos Hadjichristodoulou & Pagona Lagiou & Gkikas Magiorkinis & Dimitrios Paraskevis & Sotirios Tsiodras, 2021. "Efficient and targeted COVID-19 border testing via reinforcement learning," Nature, Nature, vol. 599(7883), pages 108-113, November.
    13. Molho, Ian, 1986. "Theories of Migration: A Review," Scottish Journal of Political Economy, Scottish Economic Society, vol. 33(4), pages 396-419, November.
    14. Francesco C. Billari, 2015. "Integrating macro- and micro-level approaches in the explanation of population change," Population Studies, Taylor & Francis Journals, vol. 69(sup1), pages 11-20, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jim Millington, 2000. "Migration and Age: The Effect of Age on Sensitivity to Migration Stimuli," Regional Studies, Taylor & Francis Journals, vol. 34(6), pages 521-533.
    2. Battu, H. & Seaman, P.T & Sloane, P.J., "undated". "Are Married Women Spatially Constrained? A test of gender differentials in labour market outcomes," Working Papers 98-07, Department of Economics, University of Aberdeen.
    3. repec:zbw:rwidps:0020 is not listed on IDEAS
    4. Alasalmi, Juho, 2023. "Self-selection of Job-to-job Migrants on Match Quality," VfS Annual Conference 2023 (Regensburg): Growth and the "sociale Frage" 277633, Verein für Socialpolitik / German Economic Association.
    5. Rosa Weber & Jan Saarela, 2023. "Who Migrates and Who Returns in a Context of Free Mobility? An Analysis of the Reason for Migration, Income and Family Trajectories," European Journal of Population, Springer;European Association for Population Studies, vol. 39(1), pages 1-28, December.
    6. Schmidt, Christoph M. & Haisken-DeNew, John P. & Bauer, Thomas K., 2004. "International Labor Migration, Economic Growth and Labor Markets - The Current State of Affairs," RWI Discussion Papers 20, RWI - Leibniz-Institut für Wirtschaftsforschung.
    7. Jennifer Hunt, 2004. "Are migrants more skilled than non-migrants? Repeat, return, and same-employer migrants," Canadian Journal of Economics, Canadian Economics Association, vol. 37(4), pages 830-849, November.
    8. Diego R. Medina-Muñoz & Rita D. Medina-Muñoz, 2012. "Determinants of Expenditures on Wellness Services: The Case of Gran Canaria," Regional Studies, Taylor & Francis Journals, vol. 46(3), pages 309-319, June.
    9. Annekatrin Niebuhr & Silvia Stiller, 2004. "The impact of Poland’s EU accession on labour supply in the German-Polish border region – What can we expect?," ERSA conference papers ersa04p234, European Regional Science Association.
    10. Antje Mertens & Anette Haas, 2006. "Regionale Arbeitslosigkeit und Arbeitsplatzwechsel in Deutschland – Eine Analyse auf Kreisebene," Review of Regional Research: Jahrbuch für Regionalwissenschaft, Springer;Gesellschaft für Regionalforschung (GfR), vol. 26(2), pages 147-169, October.
    11. Franz, Wolfgang, 1993. "Zur ökonomischen Bedeutung von Wanderungen und den Möglichkeiten und Grenzen einer Einwanderungspolitik," Discussion Papers 3, University of Konstanz, Center for International Labor Economics (CILE).
    12. Richard V. Burkhauser & Markus H. Hahn & Matthew Hall & Nicole Watson, 2016. "Australia Farewell: Predictors of Emigration in the 2000s," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 35(2), pages 197-215, April.
    13. Alessandra Faggian & Jonathan Corcoran & Philip McCann, 2013. "Modelling geographical graduate job search using circular statistics," Papers in Regional Science, Wiley Blackwell, vol. 92(2), pages 329-343, June.
    14. Cindy Biesenbeek, 2022. "The Effect of Unemployment on Interregional Migration in the Netherlands," Working Papers 753, DNB.
    15. Jeroen Smits, 2001. "Career Migration, Self-selection and the Earnings of Married Men and Women in the Netherlands, 1981-93," Urban Studies, Urban Studies Journal Limited, vol. 38(3), pages 541-562, March.
    16. Frans Willekens, 2018. "Towards causal forecasting of international migration," Vienna Yearbook of Population Research, Vienna Institute of Demography (VID) of the Austrian Academy of Sciences in Vienna, vol. 16(1), pages 199-218.
    17. Philippe Lemistre & Marie-Benoit Magrini, 2011. "Job Qualification, Distance between Towns and Geographical Relocation for French Youth," Urban Studies, Urban Studies Journal Limited, vol. 48(10), pages 2141-2161, August.
    18. Sari Pekkala & Hannu Tervo, 2002. "Unemployment and Migration: Does Moving Help?," Scandinavian Journal of Economics, Wiley Blackwell, vol. 104(4), pages 621-639, December.
    19. Peter Brosnan & Jacques Poot, 1987. "Modelling the Determinants of Trans‐Tasman Migration after World War II," The Economic Record, The Economic Society of Australia, vol. 63(4), pages 313-329, December.
    20. Martí Sempere, Mónica & Ródenas Calatayud, Carmen, 2012. "Re-migration in Spain: an approach to its determinants," INVESTIGACIONES REGIONALES - Journal of REGIONAL RESEARCH, Asociación Española de Ciencia Regional, issue 22, pages 105-128.
    21. John P Haisken-DeNew & Christoph M. Schmidt & Thomas Bauer, 2004. "International Labor Migration, Economic Growth and Labor Markets – The Current State of Affairs," RWI Discussion Papers 0020, Rheinisch-Westfälisches Institut für Wirtschaftsforschung.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:58:y:2024:i:6:d:10.1007_s11135-023-01755-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.