IDEAS home Printed from https://ideas.repec.org/a/aea/aecrev/v114y2024i5p1488-1514.html
   My bibliography  Save this article

On Binscatter

Author

Listed:
  • Matias D. Cattaneo
  • Richard K. Crump
  • Max H. Farrell
  • Yingjie Feng

Abstract

Binscatter is a popular method for visualizing bivariate relationships and conducting informal specification testing. We study the properties of this method formally and develop enhanced visualization and econometric binscatter tools. These include estimating conditional means with optimal binning and quantifying uncertainty. We also highlight a methodological problem related to covariate adjustment that can yield incorrect conclusions. We revisit two applications using our methodology and find substantially different results relative to those obtained using prior informal binscatter methods. General purpose software in Python, R, and Stata is provided. Our technical work is of independent interest for the nonparametric partition-based estimation literature.

Suggested Citation

  • Matias D. Cattaneo & Richard K. Crump & Max H. Farrell & Yingjie Feng, 2024. "On Binscatter," American Economic Review, American Economic Association, vol. 114(5), pages 1488-1514, May.
    • Handle: RePEc:aea:aecrev:v:114:y:2024:i:5:p:1488-1514
    DOI: 10.1257/aer.20221576
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/doi/10.1257/aer.20221576
    Download Restriction: no
    File URL: https://doi.org/10.3886/E195103V1
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/aer.20221576.appx
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/aer.20221576.ds
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.
    File URL: https://libkey.io/10.1257/aer.20221576?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sebastian Calonico & Matias D. Cattaneo & Max H. Farrell, 2018. "On the Effect of Bias Estimation on Coverage Accuracy in Nonparametric Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 767-779, April.
    2. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    3. Victor Chernozhukov & Sokbae Lee & Adam M. Rosen, 2013. "Intersection Bounds: Estimation and Inference," Econometrica, Econometric Society, vol. 81(2), pages 667-737, March.
    4. Raj Chetty & John N. Friedman & Tore Olsen & Luigi Pistaferri, 2011. "Adjustment Costs, Firm Responses, and Micro vs. Macro Labor Supply Elasticities: Evidence from Danish Tax Records," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(2), pages 749-804.
    5. Belloni, Alexandre & Chernozhukov, Victor & Chetverikov, Denis & Kato, Kengo, 2015. "Some new asymptotic theory for least squares series: Pointwise and uniform results," Journal of Econometrics, Elsevier, vol. 186(2), pages 345-366.
    6. Belloni, Alexandre & Chernozhukov, Victor & Chetverikov, Denis & Fernández-Val, Iván, 2019. "Conditional quantile processes based on series or many regressors," Journal of Econometrics, Elsevier, vol. 213(1), pages 4-29.
    7. Cattaneo, Matias D. & Jansson, Michael & Newey, Whitney K., 2018. "Alternative Asymptotics And The Partially Linear Model With Many Regressors," Econometric Theory, Cambridge University Press, vol. 34(2), pages 277-301, April.
    8. Raj Chetty & Adam Looney & Kory Kroft, 2009. "Salience and Taxation: Theory and Evidence," American Economic Review, American Economic Association, vol. 99(4), pages 1145-1177, September.
    9. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    10. Matias D. Cattaneo & Richard K. Crump & Max H. Farrell & Ernst Schaumburg, 2020. "Characteristic-Sorted Portfolios: Estimation and Inference," The Review of Economics and Statistics, MIT Press, vol. 102(3), pages 531-551, July.
    11. Michael Stepner, 2014. "Binned Scatterplots: introducing -binscatter- and exploring its applications," 2014 Stata Conference 4, Stata Users Group.
    12. Sebastian Calonico & Matias D. Cattaneo & Rocío Titiunik, 2015. "Optimal Data-Driven Regression Discontinuity Plots," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1753-1769, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matias D. Cattaneo & Richard K. Crump & Max H. Farrell & Yingjie Feng, 2019. "Binscatter Regressions," Papers 1902.09615, arXiv.org, revised Jul 2024.
    2. Matias D. Cattaneo & Max H. Farrell & Yingjie Feng, 2018. "Large Sample Properties of Partitioning-Based Series Estimators," Papers 1804.04916, arXiv.org, revised Jun 2019.
    3. Belloni, Alexandre & Chernozhukov, Victor & Chetverikov, Denis & Fernández-Val, Iván, 2019. "Conditional quantile processes based on series or many regressors," Journal of Econometrics, Elsevier, vol. 213(1), pages 4-29.
    4. Cattaneo, Matias D. & Jansson, Michael & Ma, Xinwei, 2024. "Local regression distribution estimators," Journal of Econometrics, Elsevier, vol. 240(2).
    5. Matias D Cattaneo & Michael Jansson & Xinwei Ma, 2019. "Two-Step Estimation and Inference with Possibly Many Included Covariates," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(3), pages 1095-1122.
    6. Byunghoon Kang, 2019. "Inference in Nonparametric Series Estimation with Specification Searches for the Number of Series Terms," Papers 1909.12162, arXiv.org, revised Feb 2020.
    7. Daniel Borbely & Jonathan Norris & Agnese Romiti, 2023. "Peer Gender and Schooling: Evidence from Ethiopia," Journal of Human Capital, University of Chicago Press, vol. 17(2), pages 207-249.
    8. Derek Messacar, 2022. "Loss-Averse Tax Manipulation and Tax-Preferred Savings," Cahiers de recherche / Working Papers 8, Institut sur la retraite et l'épargne / Retirement and Savings Institute.
    9. Rebecca Diamond & Petra Persson, 2016. "The Long-term Consequences of Teacher Discretion in Grading of High-stakes Tests," NBER Working Papers 22207, National Bureau of Economic Research, Inc.
    10. Zheng Fang & Juwon Seo, 2021. "A Projection Framework for Testing Shape Restrictions That Form Convex Cones," Econometrica, Econometric Society, vol. 89(5), pages 2439-2458, September.
    11. Zheng Fang, 2021. "A Unifying Framework for Testing Shape Restrictions," Papers 2107.12494, arXiv.org, revised Aug 2021.
    12. Zheng Fang & Juwon Seo, 2019. "A Projection Framework for Testing Shape Restrictions That Form Convex Cones," Papers 1910.07689, arXiv.org, revised Sep 2021.
    13. Andreas R. Kostøl & Andreas S. Myhre, 2021. "Labor Supply Responses to Learning the Tax and Benefit Schedule," American Economic Review, American Economic Association, vol. 111(11), pages 3733-3766, November.
    14. Blundell, Richard & Francesconi, Marco & van der Klaauw, Wilbert, 2011. "Anatomy of Welfare Reform Evaluation: Announcement and Implementation Effects," IZA Discussion Papers 6050, Institute of Labor Economics (IZA).
    15. Chernozhukov, Victor & Fernández-Val, Iván & Hoderlein, Stefan & Holzmann, Hajo & Newey, Whitney, 2015. "Nonparametric identification in panels using quantiles," Journal of Econometrics, Elsevier, vol. 188(2), pages 378-392.
    16. Stephen B. Billings & Mark Hoekstra, 2019. "Schools, Neighborhoods, and the Long-Run Effect of Crime-Prone Peers," NBER Working Papers 25730, National Bureau of Economic Research, Inc.
    17. Annette Alstadsæter & Wojciech Kopczuk & Kjetil Telle, 2019. "Social networks and tax avoidance: evidence from a well-defined Norwegian tax shelter," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 26(6), pages 1291-1328, December.
    18. Peter Leopold S. Bergman & Eric W. Chan & Adam Kapor, 2020. "Housing Search Frictions: Evidence from Detailed Search Data and a Field Experiment," CESifo Working Paper Series 8080, CESifo.
    19. M. Caridad Araujo & Mariano Bosch & Norbert Schady, 2017. "Can Cash Transfers Help Households Escape an Intergenerational Poverty Trap?," NBER Chapters, in: The Economics of Poverty Traps, pages 357-382, National Bureau of Economic Research, Inc.
    20. Mellace, Giovanni & Ventura, Marco, 2019. "Intended and unintended effects of public incentives for innovation. Quasi-experimental evidence from Italy," Discussion Papers on Economics 9/2019, University of Southern Denmark, Department of Economics.

    More about this item

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • R32 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Real Estate Markets, Spatial Production Analysis, and Firm Location - - - Other Spatial Production and Pricing Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:aecrev:v:114:y:2024:i:5:p:1488-1514. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.