IDEAS home Printed from https://ideas.repec.org/p/amz/wpaper/2023-01.html
   My bibliography  Save this paper

Estimating Very Large Demand Systems

Author

Listed:
  • Lanier, Joshua
  • Large, Jeremy
  • Quah, John

Abstract

We present a discrete choice, random utility model and a new estimation technique for analyzing consumer demand for large numbers of products. We allow the consumer to purchase multiple units of any product and to purchase multiple products at once (think of a consumer selecting a bundle of goods in a supermarket). In our model each product has an associated unobservable vector of attributes from which the consumer derives utility. Our model allows for heterogeneous utility functions across consumers, complex patterns of substitution and complementarity across products, and nonlinear price effects. The dimension of the attribute space is, by assumption, much smaller than the number of products, which effectively reduces the size of the consumption space and simplifies estimation. Nonetheless, because the number of bundles available is massive, a new estimation technique, which is based on the practice of negative sampling in machine learning, is needed to sidestep an intractable likelihood function. We prove consistency of our estimator, validate the consistency result through simulation exercises, and estimate our model using supermarket scanner data.

Suggested Citation

  • Lanier, Joshua & Large, Jeremy & Quah, John, 2022. "Estimating Very Large Demand Systems," INET Oxford Working Papers 2023-01, Institute for New Economic Thinking at the Oxford Martin School, University of Oxford.
  • Handle: RePEc:amz:wpaper:2023-01
    as

    Download full text from publisher

    File URL: https://www.inet.ox.ac.uk/files/LanierLargeQuah2022.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Pierre Dubois & Rachel Griffith & Martin O'Connell, 2020. "How Well Targeted Are Soda Taxes?," American Economic Review, American Economic Association, vol. 110(11), pages 3661-3704, November.
    2. Gourieroux,Christian & Monfort,Alain, 1995. "Statistics and Econometric Models," Cambridge Books, Cambridge University Press, number 9780521471626, October.
    3. Jerry A. Hausman & Whitney K. Newey, 2016. "Individual Heterogeneity and Average Welfare," Econometrica, Econometric Society, vol. 84, pages 1225-1248, May.
    4. Nevo, Aviv, 2001. "Measuring Market Power in the Ready-to-Eat Cereal Industry," Econometrica, Econometric Society, vol. 69(2), pages 307-342, March.
    5. Steven Berry & James Levinsohn & Ariel Pakes, 2004. "Differentiated Products Demand Systems from a Combination of Micro and Macro Data: The New Car Market," Journal of Political Economy, University of Chicago Press, vol. 112(1), pages 68-105, February.
    6. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    7. Arthur Lewbel & Krishna Pendakur, 2009. "Tricks with Hicks: The EASI Demand System," American Economic Review, American Economic Association, vol. 99(3), pages 827-863, June.
    8. repec:hal:spmain:info:hdl:2441/f0uohitsgqh8dhk9820172631 is not listed on IDEAS
    9. Richard Blundell & Jean-Marc Robin, 2000. "Latent Separability: Grouping Goods without Weak Separability," Econometrica, Econometric Society, vol. 68(1), pages 53-84, January.
    10. Richard Blundell & Joel Horowitz & Matthias Parey, 2017. "Nonparametric Estimation of a Nonseparable Demand Function under the Slutsky Inequality Restriction," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 291-304, May.
    11. Igal Hendel, 1999. "Estimating Multiple-Discrete Choice Models: An Application to Computerization Returns," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(2), pages 423-446.
    12. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rachel Griffith & Lars Nesheim & Martin O'Connell, 2018. "Income effects and the welfare consequences of tax in differentiated product oligopoly," Quantitative Economics, Econometric Society, vol. 9(1), pages 305-341, March.
    2. Giovanni Compiani, 2022. "Market counterfactuals and the specification of multiproduct demand: A nonparametric approach," Quantitative Economics, Econometric Society, vol. 13(2), pages 545-591, May.
    3. Nicholas Economides & Katja Seim & V. Brian Viard, 2008. "Quantifying the benefits of entry into local phone service," RAND Journal of Economics, RAND Corporation, vol. 39(3), pages 699-730, September.
    4. Rachel Griffith & Martin O’Connell & Kate Smith, 2022. "Price Floors and Externality Correction," The Economic Journal, Royal Economic Society, vol. 132(646), pages 2273-2289.
    5. Mayer, Thierry & Head, Keith, 2021. "Poor Substitutes? Counterfactual methods in IO and Trade compared," CEPR Discussion Papers 16762, C.E.P.R. Discussion Papers.
    6. Xiao, Wei, 2008. "The Competitive and Welfare Effects of New Product Introduction: The Case of Crystal Pepsi," Research Reports 149938, University of Connecticut, Food Marketing Policy Center.
    7. Claudio A. Agostini, 2007. "The Impact of State Corporate Taxes on FDI Location," Public Finance Review, , vol. 35(3), pages 335-360, May.
    8. Robert Donnelly & Francisco J.R. Ruiz & David Blei & Susan Athey, 2021. "Counterfactual inference for consumer choice across many product categories," Quantitative Marketing and Economics (QME), Springer, vol. 19(3), pages 369-407, December.
    9. Victor Aguirregabiria & Margaret Slade, 2017. "Empirical models of firms and industries," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 50(5), pages 1445-1488, December.
    10. Victor Chernozhukov & Jerry A. Hausman & Whitney K. Newey, 2019. "Demand Analysis with Many Prices," NBER Working Papers 26424, National Bureau of Economic Research, Inc.
    11. Iaria, Alessandro & ,, 2020. "Identification and Estimation of Demand for Bundles," CEPR Discussion Papers 14363, C.E.P.R. Discussion Papers.
    12. Laurens Cherchye & Bram De Rock & Frederic Vermeulen, 2023. "Nonparametric Models in Consumer Behaviour," Working Papers ECARES 2023-04, ULB -- Universite Libre de Bruxelles.
    13. Jessie Handbury, 2019. "Are Poor Cities Cheap for Everyone? Non-Homotheticity and the Cost of Living Across U.S. Cities," NBER Working Papers 26574, National Bureau of Economic Research, Inc.
    14. Sophie-Charlotte Klose & Johannes Lederer, 2020. "A Pipeline for Variable Selection and False Discovery Rate Control With an Application in Labor Economics," Papers 2006.12296, arXiv.org, revised Jun 2020.
    15. Pereira, Pedro & Ribeiro, Tiago, 2011. "The impact on broadband access to the Internet of the dual ownership of telephone and cable networks," International Journal of Industrial Organization, Elsevier, vol. 29(2), pages 283-293, March.
    16. Kyle Colangelo & Ying-Ying Lee, 2019. "Double debiased machine learning nonparametric inference with continuous treatments," CeMMAP working papers CWP72/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    17. Matthew Gentzkow, 2007. "Valuing New Goods in a Model with Complementarity: Online Newspapers," American Economic Review, American Economic Association, vol. 97(3), pages 713-744, June.
    18. Thomas G. Wollmann, 2018. "Trucks without Bailouts: Equilibrium Product Characteristics for Commercial Vehicles," American Economic Review, American Economic Association, vol. 108(6), pages 1364-1406, June.
    19. Ay, Jean-Sauveur & Le Gallo, Julie, 2021. "The Signaling Values of Nested Wine Names," Working Papers 321851, American Association of Wine Economists.
    20. Christopher Conlon & Julie Holland Mortimer, 2021. "Empirical properties of diversion ratios," RAND Journal of Economics, RAND Corporation, vol. 52(4), pages 693-726, December.

    More about this item

    Keywords

    discrete choice; demand estimation; negative sampling; machine learning; scanner data;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C34 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Truncated and Censored Models; Switching Regression Models
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis
    • L20 - Industrial Organization - - Firm Objectives, Organization, and Behavior - - - General
    • L66 - Industrial Organization - - Industry Studies: Manufacturing - - - Food; Beverages; Cosmetics; Tobacco

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:amz:wpaper:2023-01. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: INET Oxford admin team (email available below). General contact details of provider: https://edirc.repec.org/data/inoxfuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.