IDEAS home Printed from https://ideas.repec.org/a/spr/jecrev/v69y2018i1d10.1111_jere.12175.html
   My bibliography  Save this article

Replicability of Experimental Data and Credibility of Economic Theory

Author

Listed:
  • Michihiro Kandori

    (The University of Tokyo)

Abstract

Finding a data set that supports a theory is not enough for the theory to gain credibility. Credibility of a theory is established only after the initial supporting finding can be replicated by a number of follow-up studies. Economics so far has paid little attention to replicability, presumably because the profession has been overly pessimistic about obtaining a high degree of replicability of non-trivial theoretical predictions. By using a large data set I have collected that involves more than 4,000 subjects, I show that there is hope for economic theory to gain credibility by means of replications of laboratory data.

Suggested Citation

  • Michihiro Kandori, 2018. "Replicability of Experimental Data and Credibility of Economic Theory," The Japanese Economic Review, Springer, vol. 69(1), pages 4-25, March.
    • Handle: RePEc:spr:jecrev:v:69:y:2018:i:1:d:10.1111_jere.12175
    DOI: 10.1111/jere.12175
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1111/jere.12175
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1111/jere.12175?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    2. Goeree, Jacob K. & Holt, Charles A. & Palfrey, Thomas R., 2002. "Quantal Response Equilibrium and Overbidding in Private-Value Auctions," Journal of Economic Theory, Elsevier, vol. 104(1), pages 247-272, May.
    3. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    4. McKelvey, Richard D. & Palfrey, Thomas R. & Weber, Roberto A., 2000. "The effects of payoff magnitude and heterogeneity on behavior in 2 x 2 games with unique mixed strategy equilibria," Journal of Economic Behavior & Organization, Elsevier, vol. 42(4), pages 523-548, August.
    5. Daniel S. Hamermesh, 2013. "Six Decades of Top Economics Publishing: Who and How?," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 162-172, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philip A. Haile & Ali Hortaçsu & Grigory Kosenok, 2008. "On the Empirical Content of Quantal Response Equilibrium," American Economic Review, American Economic Association, vol. 98(1), pages 180-200, March.
    2. Alcocer, Christian Diego & Jeitschko, Thomas D. & Shupp, Robert, 2020. "Naive and sophisticated mixing: Experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 170(C), pages 157-173.
    3. Yi, Kang-Oh, 2005. "Quantal-response equilibrium models of the ultimatum bargaining game," Games and Economic Behavior, Elsevier, vol. 51(2), pages 324-348, May.
    4. Golman, Russell, 2012. "Homogeneity bias in models of discrete choice with bounded rationality," Journal of Economic Behavior & Organization, Elsevier, vol. 82(1), pages 1-11.
    5. Simon P. Anderson & Jacob K. Goeree & Charles A. Holt, 2002. "The Logit Equilibrium: A Perspective on Intuitive Behavioral Anomalies," Southern Economic Journal, John Wiley & Sons, vol. 69(1), pages 21-47, July.
    6. Goeree, Jacob K. & Holt, Charles A. & Palfrey, Thomas R., 2003. "Risk averse behavior in generalized matching pennies games," Games and Economic Behavior, Elsevier, vol. 45(1), pages 97-113, October.
    7. Joshua D. Angrist & Jörn-Steffen Pischke, 2017. "Undergraduate Econometrics Instruction: Through Our Classes, Darkly," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 125-144, Spring.
    8. Llorente-Saguer, Aniol & Sheremeta, Roman M. & Szech, Nora, 2023. "Designing contests between heterogeneous contestants: An experimental study of tie-breaks and bid-caps in all-pay auctions," European Economic Review, Elsevier, vol. 154(C).
    9. David J. Cooper & Hanming Fang, 2008. "Understanding Overbidding in Second Price Auctions: An Experimental Study," Economic Journal, Royal Economic Society, vol. 118(532), pages 1572-1595, October.
    10. W. Bentley MacLeod, 2017. "Viewpoint: The human capital approach to inference," Canadian Journal of Economics, Canadian Economics Association, vol. 50(1), pages 5-39, February.
    11. Vincent P. Crawford & Nagore Iriberri, 2004. "Fatal Attraction: Focality, Naivete, and Sophistication in Experimental Hide-and-Seek Games," Levine's Bibliography 122247000000000345, UCLA Department of Economics.
    12. Zhang, Boyu & Hofbauer, Josef, 2016. "Quantal response methods for equilibrium selection in 2×2 coordination games," Games and Economic Behavior, Elsevier, vol. 97(C), pages 19-31.
    13. Sheremeta, Roman M., 2010. "Experimental comparison of multi-stage and one-stage contests," Games and Economic Behavior, Elsevier, vol. 68(2), pages 731-747, March.
    14. Isabelle Brocas & Juan D. Carrillo, 2022. "The development of randomization and deceptive behavior in mixed strategy games," Quantitative Economics, Econometric Society, vol. 13(2), pages 825-862, May.
    15. Albano, Gian Luigi & Cipollone, Angela & Paolo, Roberto Di & Ponti, Giovanni & Sparro, Marco, 2024. "Scoring rules in experimental procurement," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 108(C).
    16. Alan Kirman & François Laisney & Paul Pezanis-Christou, 2023. "Relaxing the symmetry assumption in participation games: a specification test for cluster-heterogeneity," Experimental Economics, Springer;Economic Science Association, vol. 26(4), pages 850-878, September.
    17. Breitmoser, Yves & Schweighofer-Kodritsch, Sebastian, 2019. "Obviousness around the clock," Discussion Papers, Research Unit: Market Behavior SP II 2019-203, WZB Berlin Social Science Center.
    18. Smith, Angela M., 2011. "An experimental study of exclusive contracts," International Journal of Industrial Organization, Elsevier, vol. 29(1), pages 4-13, January.
    19. Erlei Mathias & Schenk-Mathes Heike, 2017. "Bounded Rationality in Principal-Agent Relationships," German Economic Review, De Gruyter, vol. 18(4), pages 411-443, December.
    20. Evan M. Calford & Anujit Chakraborty, 2022. "Higher-order Beliefs in a Sequential Social Dilemma," ANU Working Papers in Economics and Econometrics 2022-681, Australian National University, College of Business and Economics, School of Economics.

    More about this item

    Keywords

    A11; B41; C72; C92;
    All these keywords.

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jecrev:v:69:y:2018:i:1:d:10.1111_jere.12175. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.