IDEAS home Printed from https://ideas.repec.org/p/ags/aaea06/21399.html
   My bibliography  Save this paper

Avoiding biases from data-dependent specification search: an application to a tillage choice model

Author

Listed:
  • Sengupta, Sanchita
  • Kurkalova, Lyubov A.
  • Kling, Catherine L.

Abstract

The study evaluates the gains of avoiding data-dependent specification search on an estimation sample in an application to discrete choice models. We incorporate data splitting, the process by which the total available sample is randomly split in two or more sub-samples with the first (specification) sub-sample used for specification search, and the second (estimation) sub-sample used for obtaining clean estimates using the model chosen on the specification sub-sample according to a set criterion. We estimate 14 binary Logit models of the adoption of conservation tillage corresponding to the major sub-watersheds of the Upper Mississippi River Basin. For each of the sub-watershed models, we use the specification sub-sample to choose the explanatory variables that lead to the highest number of correct predictions provided that estimated coefficients are in conformity with economic theory. To evaluate the gains of avoiding specification search on the estimation sub-sample, we follow Gong (1986)[8] and calculate the expected excess error, which is a measure of excess optimism concerning model fit on the specification sample. We find that the excess optimism varies with the sub-watersheds and has a tendency to be larger for the sub-watersheds with smaller samples.

Suggested Citation

  • Sengupta, Sanchita & Kurkalova, Lyubov A. & Kling, Catherine L., 2006. "Avoiding biases from data-dependent specification search: an application to a tillage choice model," 2006 Annual meeting, July 23-26, Long Beach, CA 21399, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    • Handle: RePEc:ags:aaea06:21399
    DOI: 10.22004/ag.econ.21399
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/21399/files/sp06sa05.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.21399?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lyubov Kurkalova & Catherine Kling & Jinhua Zhao, 2006. "Green Subsidies in Agriculture: Estimating the Adoption Costs of Conservation Tillage from Observed Behavior," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 54(2), pages 247-267, June.
    2. Veall, Michael R & Zimmermann, Klaus F, 1996. "Pseudo-R-[superscript 2] Measures for Some Common Limited Dependent Variable Models," Journal of Economic Surveys, Wiley Blackwell, vol. 10(3), pages 241-259, September.
    3. Leamer, Edward E, 1983. "Let's Take the Con Out of Econometrics," American Economic Review, American Economic Association, vol. 73(1), pages 31-43, March.
    4. Veall, Michael R, 1992. "Bootstrapping the Process of Model Selection: An Econometric Example," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(1), pages 93-99, Jan.-Marc.
    5. Bailey Norwood & Matthew C. Roberts & Jayson L. Lusk, 2004. "Ranking Crop Yield Models Using Out-of-Sample Likelihood Functions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(4), pages 1032-1043.
    6. Pötscher, B.M., 1991. "Effects of Model Selection on Inference," Econometric Theory, Cambridge University Press, vol. 7(2), pages 163-185, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sengupta, Sanchita, 2010. "Three Essays in Environmental and Agricultural Issues," ISU General Staff Papers 201001010800002848, Iowa State University, Department of Economics.
    2. McAleer, Michael & Veall, Michael R., 1995. "Data mining and the con in econometrics: the U.S. demand for money revisited," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 39(3), pages 329-333.
    3. Yang, Bijou & Lester, David, 2008. "The deterrent effect of executions: A meta-analysis thirty years after Ehrlich," Journal of Criminal Justice, Elsevier, vol. 36(5), pages 453-460, September.
    4. Robert J. Johnston & Kevin J. Boyle & Wiktor (Vic) Adamowicz & Jeff Bennett & Roy Brouwer & Trudy Ann Cameron & W. Michael Hanemann & Nick Hanley & Mandy Ryan & Riccardo Scarpa & Roger Tourangeau & Ch, 2017. "Contemporary Guidance for Stated Preference Studies," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(2), pages 319-405.
    5. Yang, Haisheng & He, Jie & Chen, Shaoling, 2015. "The fragility of the Environmental Kuznets Curve: Revisiting the hypothesis with Chinese data via an “Extreme Bound Analysis”," Ecological Economics, Elsevier, vol. 109(C), pages 41-58.
    6. Cho, Seo-young & Vadlamannati, Krishna Chaitanya, 2010. "Compliance for big brothers: An empirical analysis on the impact of the anti-trafficking protocol," University of Göttingen Working Papers in Economics 118, University of Goettingen, Department of Economics.
    7. Ho, Ron Yiu-wah & Strange, Roger & Piesse, Jenifer, 2006. "On the conditional pricing effects of beta, size, and book-to-market equity in the Hong Kong market," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 16(3), pages 199-214, July.
    8. Jing Xing, 2011. "Does tax structure affect economic growth? Empirical evidence from OECD countries," Working Papers 1120, Oxford University Centre for Business Taxation.
    9. Ahn T. Le, 2003. "Female Labour Market Participation: Differences Between Primary and Tied Movers," Economics Discussion / Working Papers 03-17, The University of Western Australia, Department of Economics.
    10. Lovejoy, Kristin, 2012. "Mobility Fulfillment Among Low-car Households: Implications for Reducing Auto Dependence in the United States," Institute of Transportation Studies, Working Paper Series qt4v44b5qn, Institute of Transportation Studies, UC Davis.
    11. David Card, 2022. "Design-Based Research in Empirical Microeconomics," American Economic Review, American Economic Association, vol. 112(6), pages 1773-1781, June.
    12. Anne Musson & Damien Rousselière, 2020. "Exploring the effect of crisis on cooperatives: a Bayesian performance analysis of French craftsmen cooperatives," Applied Economics, Taylor & Francis Journals, vol. 52(25), pages 2657-2678, May.
    13. Marc-Olivier Bessette & Mariame Dioubate & Myriane Hébert & Miriam Elsie Kuimi Tchana & Laura Morissette & Jean-Charles Toupin & Raoul Yaro & Maurice Doyon, 2020. "La présence de biais cognitifs en analyse économique : une étude de cas," CIRANO Working Papers 2020s-12, CIRANO.
    14. Nobuhiko Fuwa & Asa Jose U. Sajise, 2009. "Exploring Environmental Services Incentive Policies for the Philippines Rice Sector: The Case of Intra-Species Agrobiodiversity Conservation," Natural Resource Management and Policy, in: Leslie Lipper & Takumi Sakuyama & Randy Stringer & David Zilberman (ed.), Payment for Environmental Services in Agricultural Landscapes, chapter 10, pages 221-238, Springer.
    15. Ahumada, Omar & Rene Villalobos, J. & Nicholas Mason, A., 2012. "Tactical planning of the production and distribution of fresh agricultural products under uncertainty," Agricultural Systems, Elsevier, vol. 112(C), pages 17-26.
    16. Sai Ding & John Knight, 2011. "Why has China Grown So Fast? The Role of Physical and Human Capital Formation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 73(2), pages 141-174, April.
    17. Terrence Hallahan & Robert Faff, 2001. "Induced persistence or reversals in fund performance?: the effect of survivorship bias," Applied Financial Economics, Taylor & Francis Journals, vol. 11(2), pages 119-126.
    18. Christoph Engel, 2006. "The Difficult Reception of Rigorous Descriptive Social Science in the Law," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2006_1, Max Planck Institute for Research on Collective Goods.
    19. Patrick A. Puhani, 2000. "On the Identification of Relative Wage Rigidity Dynamics," William Davidson Institute Working Papers Series 343, William Davidson Institute at the University of Michigan.
    20. Durlauf, Steven N., 2001. "Manifesto for a growth econometrics," Journal of Econometrics, Elsevier, vol. 100(1), pages 65-69, January.

    More about this item

    Keywords

    Research Methods/ Statistical Methods;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:aaea06:21399. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/aaeaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.