IDEAS home Printed from https://ideas.repec.org/a/pal/jorapm/v20y2021i3d10.1057_s41272-021-00314-1.html
   My bibliography  Save this article

A note on the advantage of context in Thompson sampling

Author

Listed:
  • Michael Byrd

    (Yum! Brands)

  • Ross Darrow

Abstract

Personalization has become a focal point of modern revenue management. However, it is often the case that minimal data are available to appropriately make suggestions tailored to each customer. This has led to many products making use of reinforcement learning-based algorithms to explore sets of offerings to find the best suggestions to improve conversion and revenue. Arguably the most popular of these algorithms are built on the foundation of the multi-arm bandit framework, which has shown great success across a variety of use cases. A general multi-arm bandit algorithm aims to trade-off adaptively exploring available, but under observed, recommendations, with the current known best offering. While much success has been achieved with these relatively understandable procedures, much of the airline industry is losing out on better personalized offers by ignoring the context of the transaction, as is the case in the traditional multi-arm bandit setup. Here, we explore a popular exploration heuristic, Thompson sampling, and note implementation details for multi-arm and contextual bandit variants. While the contextual bandit requires greater computational and technical complexity to include contextual features in the decision process, we illustrate the value it brings by the improvement in overall expected

Suggested Citation

  • Michael Byrd & Ross Darrow, 2021. "A note on the advantage of context in Thompson sampling," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 20(3), pages 316-321, June.
    • Handle: RePEc:pal:jorapm:v:20:y:2021:i:3:d:10.1057_s41272-021-00314-1
    DOI: 10.1057/s41272-021-00314-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41272-021-00314-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1057/s41272-021-00314-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ben Vinod & Richard Ratliff & Vikram Jayaram, 2018. "An approach to offer management: maximizing sales with fare products and ancillaries," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 17(2), pages 91-101, April.
    2. Nicholas G. Polson & James G. Scott & Jesse Windle, 2013. "Bayesian Inference for Logistic Models Using Pólya--Gamma Latent Variables," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(504), pages 1339-1349, December.
    3. Paul E. Green & Abba M. Krieger & Yoram Wind, 2001. "Thirty Years of Conjoint Analysis: Reflections and Prospects," Interfaces, INFORMS, vol. 31(3_supplem), pages 56-73, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Buddhavarapu, Prasad & Bansal, Prateek & Prozzi, Jorge A., 2021. "A new spatial count data model with time-varying parameters," Transportation Research Part B: Methodological, Elsevier, vol. 150(C), pages 566-586.
    2. Merja Halme & Kari Linden & Kimmo Kääriä, 2009. "Patients’ Preferences for Generic and Branded Over-the-Counter Medicines," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 2(4), pages 243-255, December.
    3. Niko Hauzenberger & Florian Huber, 2020. "Model instability in predictive exchange rate regressions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(2), pages 168-186, March.
    4. Marianne Bertrand & Dean S. Karlan & Sendhil Mullainathan & Eldar Shafir & Jonathan Zinman, 2005. "What's Psychology Worth? A Field Experiment in the Consumer Credit Market," Working Papers 918, Economic Growth Center, Yale University.
    5. Anindya Bhadra & Arvind Rao & Veerabhadran Baladandayuthapani, 2018. "Inferring network structure in non†normal and mixed discrete†continuous genomic data," Biometrics, The International Biometric Society, vol. 74(1), pages 185-195, March.
    6. Haoying Wang & Guohui Wu, 2022. "Modeling discrete choices with large fine-scale spatial data: opportunities and challenges," Journal of Geographical Systems, Springer, vol. 24(3), pages 325-351, July.
    7. Norbert Bajkó & Zsolt Fülöp & Kinga Nagyné Pércsi, 2022. "Changes in the Innovation- and Marketing-Habits of Family SMEs in the Foodstuffs Industry, Caused by the Coronavirus Pandemic in Hungary," Sustainability, MDPI, vol. 14(5), pages 1-17, March.
    8. John Liechty & Duncan Fong & Eelko Huizingh & Arnaud Bruyn, 2008. "Hierarchical Bayesian conjoint models incorporating measurement uncertainty," Marketing Letters, Springer, vol. 19(2), pages 141-155, June.
    9. Christian P Theurer & Andranik Tumasjan & Isabell M Welpe, 2018. "Contextual work design and employee innovative work behavior: When does autonomy matter?," PLOS ONE, Public Library of Science, vol. 13(10), pages 1-35, October.
    10. Matthew W. Wheeler, 2019. "Bayesian additive adaptive basis tensor product models for modeling high dimensional surfaces: an application to high‐throughput toxicity testing," Biometrics, The International Biometric Society, vol. 75(1), pages 193-201, March.
    11. Kick, Markus & Littich, Martina, 2015. "Brand and Reputation as Quality Signals on Regulated Markets," EconStor Preprints 182503, ZBW - Leibniz Information Centre for Economics.
    12. Ragna Nilssen & Geoff Bick & Russell Abratt, 2019. "Comparing the relative importance of sustainability as a consumer purchase criterion of food and clothing in the retail sector," Journal of Brand Management, Palgrave Macmillan, vol. 26(1), pages 71-83, January.
    13. Olivier Toubia & Duncan I. Simester & John R. Hauser & Ely Dahan, 2003. "Fast Polyhedral Adaptive Conjoint Estimation," Marketing Science, INFORMS, vol. 22(3), pages 273-303.
    14. Bansal, Prateek & Krueger, Rico & Graham, Daniel J., 2021. "Fast Bayesian estimation of spatial count data models," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    15. Daniel V. Holland & Dean A. Shepherd, 2013. "Deciding to Persist: Adversity, Values, and Entrepreneurs’ Decision Policies," Entrepreneurship Theory and Practice, , vol. 37(2), pages 331-358, March.
    16. Michal Sznajder & Richard Ratliff & Cuneyd Kaya, 2023. "A heuristic for incorporating ancillaries into air choice models with personalization (Part 1: estimating preferences using hedonic regression)," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 22(2), pages 122-139, April.
    17. Percy Marquina & Vincent Charles, 2021. "A Bayesian resampling approach to estimate the difference in effect sizes in consumer social responses to CSR initiatives versus corporate abilities," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 28(6), pages 1680-1699, November.
    18. Tamás Krisztin & Philipp Piribauer, 2021. "A Bayesian spatial autoregressive logit model with an empirical application to European regional FDI flows," Empirical Economics, Springer, vol. 61(1), pages 231-257, July.
    19. Xinfang (Jocelyn) Wang & Jeffrey D. Camm & David J. Curry, 2009. "A Branch-and-Price Approach to the Share-of-Choice Product Line Design Problem," Management Science, INFORMS, vol. 55(10), pages 1718-1728, October.
    20. Mishra, Sanjay & Umesh, U. N., 2005. "Determining the quality of conjoint analysis results using violation of a priori signs," Journal of Business Research, Elsevier, vol. 58(3), pages 301-311, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jorapm:v:20:y:2021:i:3:d:10.1057_s41272-021-00314-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.