IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2501.13721.html
   My bibliography  Save this paper

A Non-Parametric Approach to Heterogeneity Analysis

Author

Listed:
  • Avner Seror

Abstract

This paper introduces a network-based method to capture heterogeneity in consumer microdata. We develop a permutation-based approach that repeatedly combines random samples of all agents' decisions, and partitions agents into jointly rational types. Aggregating these partitions yields a network that captures unobserved heterogeneity, where edges measure how often two agents share the same type across partitions. To evaluate how observable characteristics align with the heterogeneity, we implement permutation tests that shuffle covariate labels across network nodes, thereby generating a null distribution of alignment. We show that this test is exact, with asymptotic power of one. We further propose network-based measures that quantify whether nodes with the same observable attributes are disproportionately linked or clustered, along with standardized effect sizes that gauge each covariate's global influence. This yields a flexible, nonparametric measure of the heterogeneity structure. Finally, we apply our method to grocery expenditure data from the Stanford Basket Dataset.

Suggested Citation

  • Avner Seror, 2025. "A Non-Parametric Approach to Heterogeneity Analysis," Papers 2501.13721, arXiv.org, revised Feb 2025.
  • Handle: RePEc:arx:papers:2501.13721
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2501.13721
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Forges, Françoise & Minelli, Enrico, 2009. "Afriat's theorem for general budget sets," Journal of Economic Theory, Elsevier, vol. 144(1), pages 135-145, January.
    2. Varian, H.R., 1991. "Goodness of Fit for Revealed Preference Tests," Papers 13, Michigan - Center for Research on Economic & Social Theory.
    3. Laurens Cherchye & Bram De Rock & Frederic Vermeulen, 2009. "Opening the Black Box of Intrahousehold Decision Making: Theory and Nonparametric Empirical Tests of General Collective Consumption Models," Journal of Political Economy, University of Chicago Press, vol. 117(6), pages 1074-1104, December.
    4. repec:dau:papers:123456789/4099 is not listed on IDEAS
    5. Matthew Shum, 2004. "Does Advertising Overcome Brand Loyalty? Evidence from the Breakfast‐Cereals Market," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 13(2), pages 241-272, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas Demuynck & John Rehbeck, 2023. "Computing revealed preference goodness-of-fit measures with integer programming," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 76(4), pages 1175-1195, November.
    2. Laurens Cherchye & Sam Cosaert & Thomas Demuynck & Bram De Rock, 2020. "Group Consumption with Caring Individuals," The Economic Journal, Royal Economic Society, vol. 130(627), pages 587-622.
    3. Mikhail Freer & Khushboo Surana, 2021. "Marital Stability With Committed Couples: A Revealed Preference Analysis," Papers 2110.10781, arXiv.org, revised Sep 2024.
    4. Smeulders, Bart & Crama, Yves & Spieksma, Frits C.R., 2019. "Revealed preference theory: An algorithmic outlook," European Journal of Operational Research, Elsevier, vol. 272(3), pages 803-815.
    5. Lamia Kandil & Hélène Perivier, 2017. "La division sexuée du travail dans les couples selon le statut marital en France - une étude à partir des enquêtes emploi du temps de 1985-1986, 1998-1999, et 2009-2010," Documents de Travail de l'OFCE 2017-03, Observatoire Francais des Conjonctures Economiques (OFCE).
    6. Alan Beggs, 2021. "Afriat and arbitrage," Economic Theory Bulletin, Springer;Society for the Advancement of Economic Theory (SAET), vol. 9(2), pages 167-176, October.
    7. Jeremy T. Fox, 2010. "Estimating the Employer Switching Costs and Wage Responses of Forward-Looking Engineers," Journal of Labor Economics, University of Chicago Press, vol. 28(2), pages 357-412, April.
    8. Polo, Yolanda & Sese, F. Javier & Verhoef, Peter C., 2011. "The Effect of Pricing and Advertising on Customer Retention in a Liberalizing Market," Journal of Interactive Marketing, Elsevier, vol. 25(4), pages 201-214.
    9. Cherchye, Laurens & Demuynck, Thomas & De Rock, Bram, 2018. "Transitivity of preferences: when does it matter?," Theoretical Economics, Econometric Society, vol. 13(3), September.
    10. Pawel Dziewulski, 2016. "Eliciting the just-noticeable difference," Economics Series Working Papers 798, University of Oxford, Department of Economics.
    11. Cherchye, L.J.H. & Demuynck, T. & de Rock, B., 2009. "Degrees of Cooperation in Household Consumption Models : A Revealed Preference Analysis," Discussion Paper 2009-91, Tilburg University, Center for Economic Research.
    12. Korenok, Oleg & Millner, Edward L. & Razzolini, Laura, 2013. "Impure altruism in dictators' giving," Journal of Public Economics, Elsevier, vol. 97(C), pages 1-8.
    13. Gábor Kézdi & Gergely Csorba, 2013. "Estimating Consumer Lock-In Effects from Firm-Level Data," Journal of Industry, Competition and Trade, Springer, vol. 13(3), pages 431-452, September.
    14. repec:spo:wpecon:info:hdl:2441/5rkqqmvrn4tl22s9mc0o6ctj2 is not listed on IDEAS
    15. Dauphin, Anyck & Fortin, Bernard & Lacroix, Guy, 2015. "How Falsifiable is the Collective Model? A New Test with an Application to Monogamous and Bigamous Households in Burkina Faso," IZA Discussion Papers 9002, Institute of Labor Economics (IZA).
    16. Amedeo Fossati & Rosella Levaggi, 2008. "Delay is not the answer: waiting time in health care & income redistribution," Working Papers 0801, University of Brescia, Department of Economics.
    17. De Rock, Bram & Cherchye, Laurens & Chiappori, Pierre-André & Ringdal, Charlotte & Vermeulen, Frederic, 2021. "Feed the children," CEPR Discussion Papers 16482, C.E.P.R. Discussion Papers.
    18. Halevy, Yoram & Persitz, Dotan & Zrill, Lanny, 2017. "Non-parametric bounds for non-convex preferences," Journal of Economic Behavior & Organization, Elsevier, vol. 137(C), pages 105-112.
    19. repec:dau:papers:123456789/10574 is not listed on IDEAS
    20. Wesley Hartmann & V. Viard, 2008. "Do frequency reward programs create switching costs? A dynamic structural analysis of demand in a reward program," Quantitative Marketing and Economics (QME), Springer, vol. 6(2), pages 109-137, June.
    21. Michael Grubb, 2015. "Failing to Choose the Best Price: Theory, Evidence, and Policy," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 47(3), pages 303-340, November.
    22. Kohei Shiozawa, 2015. "Revealed Preference Test and Shortest Path Problem; Graph Theoretic Structure of the Rationalizability Test," Discussion Papers in Economics and Business 15-17-Rev.2, Osaka University, Graduate School of Economics, revised Aug 2016.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2501.13721. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.