IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v151y2022icp324-338.html
   My bibliography  Save this article

The usefulness of socio-demographic variables in predicting purchase decisions: Evidence from machine learning procedures

Author

Listed:
  • Islam, Towhidul
  • Meade, Nigel
  • Carson, Richard T.
  • Louviere, Jordan J.
  • Wang, Juan

Abstract

Research has long debated the effectiveness of socio-demographics in understanding purchase behavior, with mixed conclusions. The appeal of socio-demographic data for customer relationship marketing is based on its low acquisition cost and the growing array of variables on which marketers can condition messages and offers. We reinvestigate the value of socio-demographic variables, focusing on the potential of machine learning procedures (MLPs) to extract a stronger and reliable signal than the standard linear-in-parameters (logistic) regression models. We explore how predictive power can be increased through the nonlinearities and interactions identified with MLPs; our experimental set ranges from well-established procedures to newer entrants in this space. We also examine causality vis-à-vis predictability using a propensity scoring approach. Empirics are based on six grocery product categories and more than 7,000 panelists. We find that, relative to logistic regression models, MLPs using demographic variables yield a 20% to 33% improvement in out-of-sample predictive accuracy.

Suggested Citation

  • Islam, Towhidul & Meade, Nigel & Carson, Richard T. & Louviere, Jordan J. & Wang, Juan, 2022. "The usefulness of socio-demographic variables in predicting purchase decisions: Evidence from machine learning procedures," Journal of Business Research, Elsevier, vol. 151(C), pages 324-338.
    • Handle: RePEc:eee:jbrese:v:151:y:2022:i:c:p:324-338
    DOI: 10.1016/j.jbusres.2022.07.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296322006075
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbusres.2022.07.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Vasilis G. Mihalopoulos, 2001. "Greek household consumption of food away from home: a microeconometric approach," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 28(4), pages 421-432, December.
    2. Kar, Arpan Kumar & Dwivedi, Yogesh K., 2020. "Theory building with big data-driven research – Moving away from the “What” towards the “Why”," International Journal of Information Management, Elsevier, vol. 54(C).
    3. Takaya Saito & Marc Rehmsmeier, 2015. "The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-21, March.
    4. Peter E. Rossi & Robert E. McCulloch & Greg M. Allenby, 1996. "The Value of Purchase History Data in Target Marketing," Marketing Science, INFORMS, vol. 15(4), pages 321-340.
    5. Gary D. Thompson & Julia Kidwell, 1998. "Explaining the Choice of Organic Produce: Cosmetic Defects, Prices, and Consumer Preferences," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(2), pages 277-287.
    6. Yash Raj Shrestha & Vivianna Fang He & Phanish Puranam & Georg von Krogh, 2021. "Algorithm Supported Induction for Building Theory: How Can We Use Prediction Models to Theorize?," Organization Science, INFORMS, vol. 32(3), pages 856-880, May.
    7. A. S. C. Ehrenberg, 1995. "Empirical Generalisations, Theory, and Method," Marketing Science, INFORMS, vol. 14(3_supplem), pages 20-28.
    8. Lin, Yi & Jeon, Yongho, 2006. "Random Forests and Adaptive Nearest Neighbors," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 578-590, June.
    9. Lehmann, Donald R., 2020. "The evolving world of research in marketing and the blending of theory and data," International Journal of Research in Marketing, Elsevier, vol. 37(1), pages 27-42.
    10. Sheth, Jagdish & Kellstadt, Charles H., 2021. "Next frontiers of research in data driven marketing: Will techniques keep up with data tsunami?," Journal of Business Research, Elsevier, vol. 125(C), pages 780-784.
    11. Grubinger, Thomas & Zeileis, Achim & Pfeiffer, Karl-Peter, 2014. "evtree: Evolutionary Learning of Globally Optimal Classification and Regression Trees in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 61(i01).
    12. Friedman, Jerome H., 2002. "Stochastic gradient boosting," Computational Statistics & Data Analysis, Elsevier, vol. 38(4), pages 367-378, February.
    13. Prithwiraj Choudhury & Ryan T. Allen & Michael G. Endres, 2021. "Machine learning for pattern discovery in management research," Strategic Management Journal, Wiley Blackwell, vol. 42(1), pages 30-57, January.
    14. Mohd Nadhir Ab Wahab & Samia Nefti-Meziani & Adham Atyabi, 2015. "A Comprehensive Review of Swarm Optimization Algorithms," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-36, May.
    15. Laukkanen, Tommi, 2016. "Consumer adoption versus rejection decisions in seemingly similar service innovations: The case of the Internet and mobile banking," Journal of Business Research, Elsevier, vol. 69(7), pages 2432-2439.
    16. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    17. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    18. Louviere,Jordan J. & Hensher,David A. & Swait,Joffre D. With contributions by-Name:Adamowicz,Wiktor, 2000. "Stated Choice Methods," Cambridge Books, Cambridge University Press, number 9780521788304, October.
    19. Schaeffer, Satu Elisa & Rodriguez Sanchez, Sara Veronica, 2020. "Forecasting client retention — A machine-learning approach," Journal of Retailing and Consumer Services, Elsevier, vol. 52(C).
    20. Eleanor McDonnell Feit & Mark A. Beltramo & Fred M. Feinberg, 2010. "Reality Check: Combining Choice Experiments with Market Data to Estimate the Importance of Product Attributes," Management Science, INFORMS, vol. 56(5), pages 785-800, May.
    21. Lemmens, A. & Croux, C., 2006. "Bagging and boosting classification trees to predict churn," Other publications TiSEM d5cb664d-5859-44db-a621-e, Tilburg University, School of Economics and Management.
    22. Sardianou, E. & Genoudi, P., 2013. "Which factors affect the willingness of consumers to adopt renewable energies?," Renewable Energy, Elsevier, vol. 57(C), pages 1-4.
    23. Hood, Nick & Urquhart, Ryan & Newing, Andy & Heppenstall, Alison, 2020. "Sociodemographic and spatial disaggregation of e-commerce channel use in the grocery market in Great Britain," Journal of Retailing and Consumer Services, Elsevier, vol. 55(C).
    24. Yogesh K. Dwivedi & Nripendra P. Rana & Anand Jeyaraj & Marc Clement & Michael D. Williams, 2019. "Re-examining the Unified Theory of Acceptance and Use of Technology (UTAUT): Towards a Revised Theoretical Model," Information Systems Frontiers, Springer, vol. 21(3), pages 719-734, June.
    25. Jake M. Hofman & Duncan J. Watts & Susan Athey & Filiz Garip & Thomas L. Griffiths & Jon Kleinberg & Helen Margetts & Sendhil Mullainathan & Matthew J. Salganik & Simine Vazire & Alessandro Vespignani, 2021. "Integrating explanation and prediction in computational social science," Nature, Nature, vol. 595(7866), pages 181-188, July.
    26. Thomas Davenport & Abhijit Guha & Dhruv Grewal & Timna Bressgott, 2020. "How artificial intelligence will change the future of marketing," Journal of the Academy of Marketing Science, Springer, vol. 48(1), pages 24-42, January.
    27. Lambert, Zarrel V., 1981. "Profiling demographic characteristics of alienated consumers," Journal of Business Research, Elsevier, vol. 9(1), pages 65-86, March.
    28. Ma, Liye & Sun, Baohong, 2020. "Machine learning and AI in marketing – Connecting computing power to human insights," International Journal of Research in Marketing, Elsevier, vol. 37(3), pages 481-504.
    29. Richard F. J. Haans & Constant Pieters & Zi-Lin He, 2016. "Thinking about U: Theorizing and testing U- and inverted U-shaped relationships in strategy research," Strategic Management Journal, Wiley Blackwell, vol. 37(7), pages 1177-1195, July.
    30. Sheth, Jagdish N., 1977. "Demographics in consumer behavior," Journal of Business Research, Elsevier, vol. 5(2), pages 129-138, June.
    31. Dapeng Cui & David Curry, 2005. "Prediction in Marketing Using the Support Vector Machine," Marketing Science, INFORMS, vol. 24(4), pages 595-615, January.
    32. White, Christopher J. & Tong, Eudora, 2019. "On linking socioeconomic status to consumer loyalty behaviour," Journal of Retailing and Consumer Services, Elsevier, vol. 50(C), pages 60-65.
    33. Qingyuan Zhao & Trevor Hastie, 2021. "Causal Interpretations of Black-Box Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 272-281, January.
    34. Meade, Nigel & Islam, Towhidul, 2006. "Modelling and forecasting the diffusion of innovation - A 25-year review," International Journal of Forecasting, Elsevier, vol. 22(3), pages 519-545.
    35. Palomba, Anthony, 2020. "Consumer personality and lifestyles at the box office and beyond: How demographics, lifestyles and personalities predict movie consumption," Journal of Retailing and Consumer Services, Elsevier, vol. 55(C).
    36. Sun, Baohong & Morwitz, Vicki G., 2010. "Stated intentions and purchase behavior: A unified model," International Journal of Research in Marketing, Elsevier, vol. 27(4), pages 356-366.
    37. Diamantopoulos, Adamantios & Schlegelmilch, Bodo B. & Sinkovics, Rudolf R. & Bohlen, Greg M., 2003. "Can socio-demographics still play a role in profiling green consumers? A review of the evidence and an empirical investigation," Journal of Business Research, Elsevier, vol. 56(6), pages 465-480, June.
    38. Frank M. Bass, 1995. "Empirical Generalizations and Marketing Science: A Personal View," Marketing Science, INFORMS, vol. 14(3_supplem), pages 6-19.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Herhausen, Dennis & Bernritter, Stefan F. & Ngai, Eric W.T. & Kumar, Ajay & Delen, Dursun, 2024. "Machine learning in marketing: Recent progress and future research directions," Journal of Business Research, Elsevier, vol. 170(C).
    2. Ngai, Eric W.T. & Wu, Yuanyuan, 2022. "Machine learning in marketing: A literature review, conceptual framework, and research agenda," Journal of Business Research, Elsevier, vol. 145(C), pages 35-48.
    3. Bond, Craig A. & Thilmany, Dawn D. & Bond, Jennifer Keeling, 2008. "What to Choose? The Value of Label Claims to Fresh Produce Consumers," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 33(3), pages 1-26.
    4. Barzin,Samira & Avner,Paolo & Maruyama Rentschler,Jun Erik & O’Clery,Neave, 2022. "Where Are All the Jobs ? A Machine Learning Approach for High Resolution Urban Employment Prediction inDeveloping Countries," Policy Research Working Paper Series 9979, The World Bank.
    5. Zhang, Han, 2021. "How Using Machine Learning Classification as a Variable in Regression Leads to Attenuation Bias and What to Do About It," SocArXiv 453jk, Center for Open Science.
    6. Bas Bosma & Arjen Witteloostuijn, 2024. "Machine learning in international business," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 55(6), pages 676-702, August.
    7. Stefano Cabras & J. D. Tena, 2023. "Implicit institutional incentives and individual decisions: Causal inference with deep learning models," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 44(6), pages 3739-3754, September.
    8. Mehmet Güney Celbiş & Pui-Hang Wong & Karima Kourtit & Peter Nijkamp, 2021. "Innovativeness, Work Flexibility, and Place Characteristics: A Spatial Econometric and Machine Learning Approach," Sustainability, MDPI, vol. 13(23), pages 1-29, December.
    9. Gallego, Jorge & Rivero, Gonzalo & Martínez, Juan, 2021. "Preventing rather than punishing: An early warning model of malfeasance in public procurement," International Journal of Forecasting, Elsevier, vol. 37(1), pages 360-377.
    10. Schade, Philipp & Schuhmacher, Monika C., 2023. "Predicting entrepreneurial activity using machine learning," Journal of Business Venturing Insights, Elsevier, vol. 19(C).
    11. Peter Ebbes & Oded Netzer, 2022. "Using Social Network Activity Data to Identify and Target Job Seekers," Management Science, INFORMS, vol. 68(4), pages 3026-3046, April.
    12. Thomas R. Cook & Greg Gupton & Zach Modig & Nathan M. Palmer, 2021. "Explaining Machine Learning by Bootstrapping Partial Dependence Functions and Shapley Values," Research Working Paper RWP 21-12, Federal Reserve Bank of Kansas City.
    13. Ming-Hui Huang & Roland T. Rust, 2021. "A strategic framework for artificial intelligence in marketing," Journal of the Academy of Marketing Science, Springer, vol. 49(1), pages 30-50, January.
    14. Uguccioni, James, 2022. "The long-run effects of parental unemployment in childhood," CLEF Working Paper Series 45, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    15. Adam N. Smith & Stephan Seiler & Ishant Aggarwal, 2023. "Optimal Price Targeting," Marketing Science, INFORMS, vol. 42(3), pages 476-499, May.
    16. Julien Chevallier & Dominique Guégan & Stéphane Goutte, 2021. "Is It Possible to Forecast the Price of Bitcoin?," Forecasting, MDPI, vol. 3(2), pages 1-44, May.
    17. James Ming Chen, 2021. "An Introduction to Machine Learning for Panel Data," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 27(1), pages 1-16, February.
    18. Andrea Mauro & Andrea Sestino & Andrea Bacconi, 2022. "Machine learning and artificial intelligence use in marketing: a general taxonomy," Italian Journal of Marketing, Springer, vol. 2022(4), pages 439-457, December.
    19. Mehmet Güney Celbiş, 2021. "A machine learning approach to rural entrepreneurship," Papers in Regional Science, Wiley Blackwell, vol. 100(4), pages 1079-1104, August.
    20. Aurélie Lemmens & Sunil Gupta, 2020. "Managing Churn to Maximize Profits," Marketing Science, INFORMS, vol. 39(5), pages 956-973, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:151:y:2022:i:c:p:324-338. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.