IDEAS home Printed from https://ideas.repec.org/a/wly/emetrp/v89y2021i2p911-953.html
   My bibliography  Save this article

Strategic Sample Selection

Author

Listed:
  • Alfredo Di Tillio
  • Marco Ottaviani
  • Peter Norman Sørensen

Abstract

Are the highest sample realizations selected from a larger presample more or less informative than the same amount of random data? Developing multivariate accuracy for interval dominance ordered preferences, we show that sample selection always benefits (or always harms) a decision maker if the reverse hazard rate of the data distribution is log‐supermodular (or log‐submodular), as in location experiments with normal noise. We find nonpathological conditions under which the information contained in the winning bids of a symmetric auction decreases in the number of bidders. Exploiting extreme value theory, we quantify the limit amount of information revealed when the presample size (number of bidders) goes to infinity. In a model of equilibrium persuasion with costly information, we derive implications for the optimal design of selected experiments when selection is made by an examinee, a biased researcher, or contending sides with the peremptory challenge right to eliminate a number of jurors.

Suggested Citation

  • Alfredo Di Tillio & Marco Ottaviani & Peter Norman Sørensen, 2021. "Strategic Sample Selection," Econometrica, Econometric Society, vol. 89(2), pages 911-953, March.
  • Handle: RePEc:wly:emetrp:v:89:y:2021:i:2:p:911-953
    DOI: 10.3982/ECTA17288
    as

    Download full text from publisher

    File URL: https://doi.org/10.3982/ECTA17288
    Download Restriction: no

    File URL: https://libkey.io/10.3982/ECTA17288?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Paul Milgrom & Ilya Segal, 2002. "Envelope Theorems for Arbitrary Choice Sets," Econometrica, Econometric Society, vol. 70(2), pages 583-601, March.
    2. Dahm, Matthias & González, Paula & Porteiro, Nicolás, 2009. "Trials, tricks and transparency: How disclosure rules affect clinical knowledge," Journal of Health Economics, Elsevier, vol. 28(6), pages 1141-1153, December.
    3. repec:hal:spmain:info:hdl:2441/eu4vqp9ompqllr09iatr74eao is not listed on IDEAS
    4. Mark Bagnoli & Ted Bergstrom, 2006. "Log-concave probability and its applications," Studies in Economic Theory, in: Charalambos D. Aliprantis & Rosa L. Matzkin & Daniel L. McFadden & James C. Moore & Nicholas C. Yann (ed.), Rationality and Equilibrium, pages 217-241, Springer.
    5. Emeric Henry, 2009. "Strategic Disclosure of Research Results: The Cost of Proving Your Honesty," Economic Journal, Royal Economic Society, vol. 119(539), pages 1036-1064, July.
    6. Khaledi, Baha-Eldin & Kochar, Subhash, 2000. "On dispersive ordering between order statistics in one-sample and two-sample problems," Statistics & Probability Letters, Elsevier, vol. 46(3), pages 257-261, February.
    7. Emeric Henry & Marco Ottaviani, 2019. "Research and the Approval Process: The Organization of Persuasion," American Economic Review, American Economic Association, vol. 109(3), pages 911-955, March.
    8. Müller, Samuel & Rufibach, Kaspar, 2008. "On the max-domain of attraction of distributions with log-concave densities," Statistics & Probability Letters, Elsevier, vol. 78(12), pages 1440-1444, September.
    9. John K.-H. Quah & Bruno Strulovici, 2009. "Comparative Statics, Informativeness, and the Interval Dominance Order," Econometrica, Econometric Society, vol. 77(6), pages 1949-1992, November.
    10. Emir Kamenica & Matthew Gentzkow, 2011. "Bayesian Persuasion," American Economic Review, American Economic Association, vol. 101(6), pages 2590-2615, October.
    11. A. Mitchell Polinsky & Steven Shavell, 2012. "Mandatory Versus Voluntary Disclosure of Product Risks," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 28(2), pages 360-379.
    12. Nicola Persico, 2000. "Information Acquisition in Auctions," Econometrica, Econometric Society, vol. 68(1), pages 135-148, January.
    13. Arthur F. Veinott, 1965. "Optimal Policy in a Dynamic, Single Product, Nonstationary Inventory Model with Several Demand Classes," Operations Research, INFORMS, vol. 13(5), pages 761-778, October.
    14. Grossman, Sanford J, 1981. "The Informational Role of Warranties and Private Disclosure about Product Quality," Journal of Law and Economics, University of Chicago Press, vol. 24(3), pages 461-483, December.
    15. Hunt Allcott, 2015. "Site Selection Bias in Program Evaluation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1117-1165.
    16. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    17. Kasy, Maximilian, 2016. "Why Experimenters Might Not Always Want to Randomize, and What They Could Do Instead," Political Analysis, Cambridge University Press, vol. 24(3), pages 324-338, July.
    18. Steven J. Brams & Morton D. Davis, 1978. "Optimal Jury Selection: A Game-Theoretic Model for the Exercise of Peremptory Challenges," Operations Research, INFORMS, vol. 26(6), pages 966-991, December.
    19. Francis X. Flanagan, 2015. "Peremptory Challenges and Jury Selection," Journal of Law and Economics, University of Chicago Press, vol. 58(2), pages 385-416.
    20. Sylvain Chassang & Gerard Padro I Miquel & Erik Snowberg, 2012. "Selective Trials: A Principal-Agent Approach to Randomized Controlled Experiments," American Economic Review, American Economic Association, vol. 102(4), pages 1279-1309, June.
    21. Mike Felgenhauer & Elisabeth Schulte, 2014. "Strategic Private Experimentation," American Economic Journal: Microeconomics, American Economic Association, vol. 6(4), pages 74-105, November.
    22. Steven Matthews & Andrew Postlewaite, 1985. "Quality Testing and Disclosure," RAND Journal of Economics, The RAND Corporation, vol. 16(3), pages 328-340, Autumn.
    23. An, Mark Yuying, 1998. "Logconcavity versus Logconvexity: A Complete Characterization," Journal of Economic Theory, Elsevier, vol. 80(2), pages 350-369, June.
    24. Luis Rayo & Ilya Segal, 2010. "Optimal Information Disclosure," Journal of Political Economy, University of Chicago Press, vol. 118(5), pages 949-987.
    25. Milgrom, Paul R, 1979. "A Convergence Theorem for Competitive Bidding with Differential Information," Econometrica, Econometric Society, vol. 47(3), pages 679-688, May.
    26. Alfredo Di Tillio & Marco Ottaviani & Peter Norman Sørensen, 2017. "Persuasion Bias in Science: Can Economics Help?," Economic Journal, Royal Economic Society, vol. 127(605), pages 266-304, October.
    27. Arthur Roth & Joseph B. Kadane & Morris H. Degroot, 1977. "Optimal Peremptory Challenges in Trials by Juries: A Bilateral Sequential Process," Operations Research, INFORMS, vol. 25(6), pages 901-919, December.
    28. Thomas Noe, 2020. "Comparing the Chosen: Selection Bias When Selection Is Competitive," Journal of Political Economy, University of Chicago Press, vol. 128(1), pages 342-390.
    29. Emeric Henry, 2009. "Disclosure of research results: the cost of proving your honesty," Post-Print hal-01023670, HAL.
    30. Aleksey Tetenov, 2016. "An economic theory of statistical testing," CeMMAP working papers CWP50/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    31. Karlin, Samuel & Rinott, Yosef, 1980. "Classes of orderings of measures and related correlation inequalities. I. Multivariate totally positive distributions," Journal of Multivariate Analysis, Elsevier, vol. 10(4), pages 467-498, December.
    32. Paul R. Milgrom, 1981. "Good News and Bad News: Representation Theorems and Applications," Bell Journal of Economics, The RAND Corporation, vol. 12(2), pages 380-391, Autumn.
    33. Florian Hoffmann & Roman Inderst & Marco Ottaviani, 2020. "Persuasion Through Selective Disclosure: Implications for Marketing, Campaigning, and Privacy Regulation," Management Science, INFORMS, vol. 66(11), pages 4958-4979, November.
    34. Schwartz, Edward P & Schwartz, Warren F, 1996. "The Challenge of Peremptory Challenges," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 12(2), pages 325-360, October.
    35. Michael J. Fishman & Kathleen M. Hagerty, 1990. "The Optimal Amount of Discretion to Allow in Disclosure," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 105(2), pages 427-444.
    36. repec:hal:spmain:info:hdl:2441/1gr6n3t28b94tafji6op8tlqs1 is not listed on IDEAS
    37. Herresthal, C., 2017. "Hidden Testing and Selective Disclosure of Evidence," Cambridge Working Papers in Economics 1712, Faculty of Economics, University of Cambridge.
    38. repec:hal:wpspec:info:hdl:2441/eu4vqp9ompqllr09iatr74eao is not listed on IDEAS
    39. Robert Wilson, 1977. "A Bidding Model of Perfect Competition," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 44(3), pages 511-518.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Arianna Degan & Ming Li & Huan Xie, 2023. "An experimental investigation of persuasion through selective disclosure of evidence," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 56(4), pages 1490-1516, November.
    2. Maximilian Kasy & Jann Spiess, 2022. "Rationalizing Pre-Analysis Plans:Statistical Decisions Subject to Implementability," Economics Series Working Papers 975, University of Oxford, Department of Economics.
    3. Maximilian Kasy & Jann Spiess, 2022. "Optimal Pre-Analysis Plans: Statistical Decisions Subject to Implementability," Papers 2208.09638, arXiv.org, revised Jul 2024.
    4. Kim, Yonggyun, 2023. "Comparing information in general monotone decision problems," Journal of Economic Theory, Elsevier, vol. 211(C).
    5. Ricardo Alonso & Odilon Câmara, 2024. "Organizing Data Analytics," Management Science, INFORMS, vol. 70(5), pages 3123-3143, May.
    6. Herresthal, Claudia, 2022. "Hidden testing and selective disclosure of evidence," Journal of Economic Theory, Elsevier, vol. 200(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Herresthal, Claudia, 2022. "Hidden testing and selective disclosure of evidence," Journal of Economic Theory, Elsevier, vol. 200(C).
    2. Dahm, Matthias & González, Paula & Porteiro, Nicolás, 2018. "The enforcement of mandatory disclosure rules," Journal of Public Economics, Elsevier, vol. 167(C), pages 21-32.
    3. Alfredo Di Tillio & Marco Ottaviani & Peter Norman Sørensen, 2017. "Persuasion Bias in Science: Can Economics Help?," Economic Journal, Royal Economic Society, vol. 127(605), pages 266-304, October.
    4. Florian Hoffmann & Roman Inderst & Marco Ottaviani, 2013. "Hypertargeting, Limited Attention, and Privacy: Implications for Marketing and Campaigning," Working Papers 479, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    5. Arnaud Dellis & Mandar Oak, 2020. "Subpoena power and informational lobbying," Journal of Theoretical Politics, , vol. 32(2), pages 188-234, April.
    6. Felgenhauer, Mike, 2021. "Experimentation and manipulation with preregistration," Games and Economic Behavior, Elsevier, vol. 130(C), pages 400-408.
    7. Florian Hoffmann & Roman Inderst & Marco Ottaviani, 2020. "Persuasion Through Selective Disclosure: Implications for Marketing, Campaigning, and Privacy Regulation," Management Science, INFORMS, vol. 66(11), pages 4958-4979, November.
    8. Tsz-Ning Wong & Lily Ling Yang & Andrey Zhukov, 2024. "Optimal Disclosure Mandate in Supply Chains," CRC TR 224 Discussion Paper Series crctr224_2024_560, University of Bonn and University of Mannheim, Germany.
    9. Levent Celik, 2014. "Information Unraveling Revisited: Disclosure of Horizontal Attributes," Journal of Industrial Economics, Wiley Blackwell, vol. 62(1), pages 113-136, March.
    10. Hedlund, Jonas, 2015. "Persuasion with communication costs," Games and Economic Behavior, Elsevier, vol. 92(C), pages 28-40.
    11. Herresthal, C., 2017. "Hidden Testing and Selective Disclosure of Evidence," Cambridge Working Papers in Economics 1712, Faculty of Economics, University of Cambridge.
    12. Glode, Vincent & Opp, Christian C. & Zhang, Xingtan, 2018. "Voluntary disclosure in bilateral transactions," Journal of Economic Theory, Elsevier, vol. 175(C), pages 652-688.
    13. Gregor Martin, 2015. "To Invite or Not to Invite a Lobby, That Is the Question," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 15(2), pages 143-166, July.
    14. Emeric Henry & Marco Ottaviani, 2019. "Research and the Approval Process: The Organization of Persuasion," American Economic Review, American Economic Association, vol. 109(3), pages 911-955, March.
    15. Claude Fluet & Thomas Lanzi, 2021. "Cross-Examination," Working Papers of BETA 2021-40, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    16. Martin Gregor, 2014. "Receiver's access fee for a single sender," Working Papers IES 2014/17, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised May 2014.
    17. Davide Viviano & Kaspar Wuthrich & Paul Niehaus, 2021. "A model of multiple hypothesis testing," Papers 2104.13367, arXiv.org, revised Apr 2024.
    18. Jeremy Bertomeu & Davide Cianciaruso, 2018. "Verifiable disclosure," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 65(4), pages 1011-1044, June.
    19. Hedlund, Jonas, 2017. "Bayesian persuasion by a privately informed sender," Journal of Economic Theory, Elsevier, vol. 167(C), pages 229-268.
    20. Mensch, Jeffrey, 2021. "Rational inattention and the monotone likelihood ratio property," Journal of Economic Theory, Elsevier, vol. 196(C).

    More about this item

    JEL classification:

    • D82 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Asymmetric and Private Information; Mechanism Design
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:emetrp:v:89:y:2021:i:2:p:911-953. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/essssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.