IDEAS home Printed from https://ideas.repec.org/a/spr/orspec/v40y2018i4d10.1007_s00291-018-0530-6.html
   My bibliography  Save this article

Flexible estimation of time-varying effects for frequently purchased retail goods: a modeling approach based on household panel data

Author

Listed:
  • Bernhard Baumgartner

    (University of Osnabrück)

  • Daniel Guhl

    (Humboldt University Berlin)

  • Thomas Kneib

    (Georg-August-Universität Göttingen)

  • Winfried J. Steiner

    (Clausthal University of Technology)

Abstract

In most previous applications of brand choice models, possible time-varying effects in consumer behavior are ignored by merely imposing constant parameters. However, it is very likely that trends or short-term variations in consumers’ intrinsic brand utilities or sensitivities to marketing instruments occur. For example, preferences for specific brands or price elasticities in product categories such as coffee or chocolate may vary in the run-up to festive occasions like Easter or Christmas. In this paper, we employ flexible multinomial logit models for estimating time-varying effects in brand choice behavior. Time-varying brand intercepts and time-varying effects of covariates are modeled using penalized splines, a flexible, yet parsimonious, nonparametric smoothing technique. The estimation is data driven; the flexible functions, as well as the corresponding degrees of smoothness, are determined simultaneously in a unified approach. Our model further allows for alternative-specific time-varying effects of covariates and can mimic state-space approaches with random walk parameter dynamics. In an empirical application for ground coffee, we compare the performance of the proposed approach to a number of benchmark models regarding in-sample fit, information criteria, and in particular out-of-sample fit. Interestingly, the most complex P-spline model with time-varying brand intercepts and brand-specific time-varying covariate effects outperforms all other specifications both in- and out-of-sample. We further present results from a sensitivity analysis on how the number of knots and other P-spline settings affect the model performance, and we provide guidelines for the model building process about the many options for model specification using P-splines. Finally, the resulting parameter paths provide valuable insights for marketing managers.

Suggested Citation

  • Bernhard Baumgartner & Daniel Guhl & Thomas Kneib & Winfried J. Steiner, 2018. "Flexible estimation of time-varying effects for frequently purchased retail goods: a modeling approach based on household panel data," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 40(4), pages 837-873, October.
  • Handle: RePEc:spr:orspec:v:40:y:2018:i:4:d:10.1007_s00291-018-0530-6
    DOI: 10.1007/s00291-018-0530-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00291-018-0530-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00291-018-0530-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Guhl, Daniel & Baumgartner, Bernhard & Kneib, Thomas & Steiner, Winfried J., 2018. "Estimating time-varying parameters in brand choice models: A semiparametric approach," International Journal of Research in Marketing, Elsevier, vol. 35(3), pages 394-414.
    2. Kamel Jedidi & Carl F. Mela & Sunil Gupta, 1999. "Managing Advertising and Promotion for Long-Run Profitability," Marketing Science, INFORMS, vol. 18(1), pages 1-22.
    3. Oded Netzer & James M. Lattin & V. Srinivasan, 2008. "A Hidden Markov Model of Customer Relationship Dynamics," Marketing Science, INFORMS, vol. 27(2), pages 185-204, 03-04.
    4. Harry Haupt & Kathrin Kagerer & Winfried J. Steiner, 2014. "Smooth Quantile‐Based Modeling Of Brand Sales, Price And Promotional Effects From Retail Scanner Panels," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(6), pages 1007-1028, September.
    5. Abe, Makoto, 1999. "A Generalized Additive Model for Discrete-Choice Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(3), pages 271-284, July.
    6. Jain, Dipak C & Vilcassim, Naufel J & Chintagunta, Pradeep K, 1994. "A Random-Coefficients Logit Brand-Choice Model Applied to Panel Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(3), pages 317-328, July.
    7. Lang, Stefan & Steiner, Winfried J. & Weber, Anett & Wechselberger, Peter, 2015. "Accommodating heterogeneity and nonlinearity in price effects for predicting brand sales and profits," European Journal of Operational Research, Elsevier, vol. 246(1), pages 232-241.
    8. Briesch, Richard A, et al, 1997. "A Comparative Analysis of Reference Price Models," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 24(2), pages 202-214, September.
    9. Sungho Park & Sachin Gupta, 2011. "A Regime-Switching Model of Cyclical Category Buying," Marketing Science, INFORMS, vol. 30(3), pages 469-480, 05-06.
    10. Leeflang, Peter S.H. & Bijmolt, Tammo H.A. & van Doorn, Jenny & Hanssens, Dominique M. & van Heerde, Harald J. & Verhoef, Peter C. & Wieringa, Jaap E., 2009. "Creating lift versus building the base: Current trends in marketing dynamics," International Journal of Research in Marketing, Elsevier, vol. 26(1), pages 13-20.
    11. Kim, Jin Gyo & Menzefricke, Ulrich & Feinberg, Fred M., 2005. "Modeling Parametric Evolution in a Random Utility Framework," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 282-294, July.
    12. Harald J. van Heerde & Peter S. H. Leeflang & Dick R. Wittink, 2004. "Decomposing the Sales Promotion Bump with Store Data," Marketing Science, INFORMS, vol. 23(3), pages 317-334, December.
    13. Bernhard Baumgartner, 2003. "Measuring Changes In Brand Choice Behavior," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 55(3), pages 242-256, July.
    14. David R. Bell & Jeongwen Chiang & V. Padmanabhan, 1999. "The Decomposition of Promotional Response: An Empirical Generalization," Marketing Science, INFORMS, vol. 18(4), pages 504-526.
    15. Brezger, Andreas & Steiner, Winfried J., 2008. "Monotonic Regression Based on Bayesian PSplines: An Application to Estimating Price Response Functions From Store-Level Scanner Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 90-104, January.
    16. Baltas, George & Doyle, Peter, 2001. "Random utility models in marketing research: a survey," Journal of Business Research, Elsevier, vol. 51(2), pages 115-125, February.
    17. Kalyanaram, Gurumurthy & Little, John D C, 1994. "An Empirical Analysis of Latitude of Price Acceptance in Consumer Package Goods," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 21(3), pages 408-418, December.
    18. Umlauf, Nikolaus & Adler, Daniel & Kneib, Thomas & Lang, Stefan & Zeileis, Achim, 2015. "Structured Additive Regression Models: An R Interface to BayesX," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 63(i21).
    19. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521785167, September.
    20. Peter M. Guadagni & John D. C. Little, 1983. "A Logit Model of Brand Choice Calibrated on Scanner Data," Marketing Science, INFORMS, vol. 2(3), pages 203-238.
    21. Anett Weber & Winfried J. Steiner & Stefan Lang, 2017. "A comparison of semiparametric and heterogeneous store sales models for optimal category pricing," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 39(2), pages 403-445, March.
    22. Thomas Kneib & Ludwig Fahrmeir, 2006. "Structured Additive Regression for Categorical Space–Time Data: A Mixed Model Approach," Biometrics, The International Biometric Society, vol. 62(1), pages 109-118, March.
    23. Thomas Kneib & Bernhard Baumgartner & Winfried Steiner, 2007. "Semiparametric multinomial logit models for analysing consumer choice behaviour," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 91(3), pages 225-244, October.
    24. Chandukala, Sandeep R. & Kim, Jaehwan & Otter, Thomas & Rossi, Peter E. & Allenby, Greg M., 2008. "Choice Models in Marketing: Economic Assumptions, Challenges and Trends," Foundations and Trends(R) in Marketing, now publishers, vol. 2(2), pages 97-184, September.
    25. Friederike Paetz & Winfried J. Steiner, 2017. "The benefits of incorporating utility dependencies in finite mixture probit models," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 39(3), pages 793-819, July.
    26. Peter E. Rossi, 2014. "Invited Paper —Even the Rich Can Make Themselves Poor: A Critical Examination of IV Methods in Marketing Applications," Marketing Science, INFORMS, vol. 33(5), pages 655-672, September.
    27. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    28. Gurumurthy Kalyanaram & Russell S. Winer, 1995. "Empirical Generalizations from Reference Price Research," Marketing Science, INFORMS, vol. 14(3_supplem), pages 161-169.
    29. Tülin Erdem & Michael Keane & Baohong Sun, 2008. "The impact of advertising on consumer price sensitivity in experience goods markets," Quantitative Marketing and Economics (QME), Springer, vol. 6(2), pages 139-176, June.
    30. Kopalle, Praveen K. & Kannan, P.K. & Boldt, Lin Bao & Arora, Neeraj, 2012. "The impact of household level heterogeneity in reference price effects on optimal retailer pricing policies," Journal of Retailing, Elsevier, vol. 88(1), pages 102-114.
    31. Mohamed Lachaab & Asim Ansari & Kamel Jedidi & Abdelwahed Trabelsi, 2006. "Modeling preference evolution in discrete choice models: A Bayesian state-space approach," Quantitative Marketing and Economics (QME), Springer, vol. 4(1), pages 57-81, March.
    32. Praveen K. Kopalle & Carl F. Mela & Lawrence Marsh, 1999. "The Dynamic Effect of Discounting on Sales: Empirical Analysis and Normative Pricing Implications," Marketing Science, INFORMS, vol. 18(3), pages 317-332.
    33. Pradeep Chintagunta & Jean-Pierre Dubé & Khim Yong Goh, 2005. "Beyond the Endogeneity Bias: The Effect of Unmeasured Brand Characteristics on Household-Level Brand Choice Models," Management Science, INFORMS, vol. 51(5), pages 832-849, May.
    34. David R. Bell & James M. Lattin, 2000. "Looking for Loss Aversion in Scanner Panel Data: The Confounding Effect of Price Response Heterogeneity," Marketing Science, INFORMS, vol. 19(2), pages 185-200, May.
    35. Winer, Russell S, 1986. "A Reference Price Model of Brand Choice for Frequently Purchased Products," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 13(2), pages 250-256, September.
    36. Ruppert,David & Wand,M. P. & Carroll,R. J., 2003. "Semiparametric Regression," Cambridge Books, Cambridge University Press, number 9780521780506, September.
    37. Oliver J. Rutz & Garrett P. Sonnier, 2011. "The Evolution of Internal Market Structure," Marketing Science, INFORMS, vol. 30(2), pages 274-289, 03-04.
    38. Inyoung Kim & Noah D. Cohen & Raymond J. Carroll, 2003. "Semiparametric Regression Splines in Matched Case-Control Studies," Biometrics, The International Biometric Society, vol. 59(4), pages 1158-1169, December.
    39. J. Miguel Villas-Boas & Russell S. Winer, 1999. "Endogeneity in Brand Choice Models," Management Science, INFORMS, vol. 45(10), pages 1324-1338, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guhl, Daniel & Baumgartner, Bernhard & Kneib, Thomas & Steiner, Winfried J., 2018. "Estimating time-varying parameters in brand choice models: A semiparametric approach," International Journal of Research in Marketing, Elsevier, vol. 35(3), pages 394-414.
    2. Philipp Aschersleben & Winfried J. Steiner, 2022. "A semiparametric approach to estimating reference price effects in sales response models," Journal of Business Economics, Springer, vol. 92(4), pages 591-643, May.
    3. Alexander Hübner & Pedro Amorim & Heinrich Kuhn & Stefan Minner & Tom Woensel, 2018. "Retail operations," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 40(4), pages 831-835, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guhl, Daniel & Baumgartner, Bernhard & Kneib, Thomas & Steiner, Winfried J., 2018. "Estimating time-varying parameters in brand choice models: A semiparametric approach," International Journal of Research in Marketing, Elsevier, vol. 35(3), pages 394-414.
    2. Guhl, Daniel, 2019. "Addressing endogeneity in aggregate logit models with time-varying parameters for optimal retail-pricing," European Journal of Operational Research, Elsevier, vol. 277(2), pages 684-698.
    3. Weber, Anett & Steiner, Winfried J., 2021. "Modeling price response from retail sales: An empirical comparison of models with different representations of heterogeneity," European Journal of Operational Research, Elsevier, vol. 294(3), pages 843-859.
    4. Philipp Aschersleben & Winfried J. Steiner, 2022. "A semiparametric approach to estimating reference price effects in sales response models," Journal of Business Economics, Springer, vol. 92(4), pages 591-643, May.
    5. Moon, Sangkil & Voss, Glenn, 2009. "How do price range shoppers differ from reference price point shoppers?," Journal of Business Research, Elsevier, vol. 62(1), pages 31-38, January.
    6. Kopalle, Praveen K. & Kannan, P.K. & Boldt, Lin Bao & Arora, Neeraj, 2012. "The impact of household level heterogeneity in reference price effects on optimal retailer pricing policies," Journal of Retailing, Elsevier, vol. 88(1), pages 102-114.
    7. Neumann, Nico & Böckenholt, Ulf, 2014. "A Meta-analysis of Loss Aversion in Product Choice," Journal of Retailing, Elsevier, vol. 90(2), pages 182-197.
    8. van Oest, Rutger, 2013. "Why are Consumers Less Loss Averse in Internal than External Reference Prices?," Journal of Retailing, Elsevier, vol. 89(1), pages 62-71.
    9. David R. Bell & James M. Lattin, 2000. "Looking for Loss Aversion in Scanner Panel Data: The Confounding Effect of Price Response Heterogeneity," Marketing Science, INFORMS, vol. 19(2), pages 185-200, May.
    10. Kopalle, Praveen K. & Pauwels, Koen & Akella, Laxminarayana Yashaswy & Gangwar, Manish, 2023. "Dynamic pricing: Definition, implications for managers, and future research directions," Journal of Retailing, Elsevier, vol. 99(4), pages 580-593.
    11. Robert Slonim & Ellen Garbarino, 2009. "Similarities and differences between stockpiling and reference effects," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 30(6), pages 351-371.
    12. Necati Tereyağoğlu & Peter S. Fader & Senthil Veeraraghavan, 2018. "Multiattribute Loss Aversion and Reference Dependence: Evidence from the Performing Arts Industry," Management Science, INFORMS, vol. 64(1), pages 421-436, January.
    13. Hruschka, Harald & Fettes, Werner & Probst, Markus, 2004. "An empirical comparison of the validity of a neural net based multinomial logit choice model to alternative model specifications," European Journal of Operational Research, Elsevier, vol. 159(1), pages 166-180, November.
    14. Çakır, Metin & Balagtas, Joseph V., 2014. "Consumer Response to Package Downsizing: Evidence from the Chicago Ice Cream Market," Journal of Retailing, Elsevier, vol. 90(1), pages 1-12.
    15. Dawes, John G., 2012. "Brand-Pack Size Cannibalization Arising from Temporary Price Promotions," Journal of Retailing, Elsevier, vol. 88(3), pages 343-355.
    16. Elshiewy, Ossama & Peschel, Anne O., 2022. "Internal reference price response across store formats," Journal of Retailing, Elsevier, vol. 98(3), pages 496-509.
    17. Sumanta Adhya & Tathagata Banerjee & Gaurangadeb Chattopadhyay, 2012. "Inference on finite population categorical response: nonparametric regression-based predictive approach," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 96(1), pages 69-98, January.
    18. Nobuhiko Terui & Wirawan Dony Dahana, 2006. "Research Note—Estimating Heterogeneous Price Thresholds," Marketing Science, INFORMS, vol. 25(4), pages 384-391, 07-08.
    19. Nicolau, Juan L., 2011. "Differentiated price loss aversion in destination choice: The effect of tourists’ cultural interest," Tourism Management, Elsevier, vol. 32(5), pages 1186-1195.
    20. Vincenzina Caputo & Jayson L Lusk & Rodolfo M Nayga, 2020. "Am I Getting a Good Deal? Reference‐DependentDecision Making When the Reference Price Is Uncertain," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(1), pages 132-153, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:orspec:v:40:y:2018:i:4:d:10.1007_s00291-018-0530-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.