IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2411.10959.html
   My bibliography  Save this paper

Program Evaluation with Remotely Sensed Outcomes

Author

Listed:
  • Ashesh Rambachan
  • Rahul Singh
  • Davide Viviano

Abstract

Economists often estimate treatment effects in experiments using remotely sensed variables (RSVs), e.g. satellite images or mobile phone activity, in place of directly measured economic outcomes. A common practice is to use an observational sample to train a predictor of the economic outcome from the RSV, and then to use its predictions as the outcomes in the experiment. We show that this method is biased whenever the RSV is post-outcome, i.e. if variation in the economic outcome causes variation in the RSV. In program evaluation, changes in poverty or environmental quality cause changes in satellite images, but not vice versa. As our main result, we nonparametrically identify the treatment effect by formalizing the intuition that underlies common practice: the conditional distribution of the RSV given the outcome and treatment is stable across the samples.Based on our identifying formula, we find that the efficient representation of RSVs for causal inference requires three predictions rather than one. Valid inference does not require any rate conditions on RSV predictions, justifying the use of complex deep learning algorithms with unknown statistical properties. We re-analyze the effect of an anti-poverty program in India using satellite images.

Suggested Citation

  • Ashesh Rambachan & Rahul Singh & Davide Viviano, 2024. "Program Evaluation with Remotely Sensed Outcomes," Papers 2411.10959, arXiv.org, revised Apr 2025.
  • Handle: RePEc:arx:papers:2411.10959
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2411.10959
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dennis Egger & Johannes Haushofer & Edward Miguel & Paul Niehaus & Michael Walker, 2022. "General Equilibrium Effects of Cash Transfers: Experimental Evidence From Kenya," Econometrica, Econometric Society, vol. 90(6), pages 2603-2643, November.
    2. Chamberlain, Gary, 1987. "Asymptotic efficiency in estimation with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 34(3), pages 305-334, March.
    3. Guido Imbens & Nathan Kallus & Xiaojie Mao & Yuhao Wang, 2022. "Long-term Causal Inference Under Persistent Confounding via Data Combination," Papers 2202.07234, arXiv.org, revised Aug 2024.
    4. Molinari, Francesca, 2008. "Partial identification of probability distributions with misclassified data," Journal of Econometrics, Elsevier, vol. 144(1), pages 81-117, May.
    5. Esther Rolf & Jonathan Proctor & Tamma Carleton & Ian Bolliger & Vaishaal Shankar & Miyabi Ishihara & Benjamin Recht & Solomon Hsiang, 2021. "A generalizable and accessible approach to machine learning with global satellite imagery," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    6. Susan Athey & Guido W. Imbens & Stefan Wager, 2018. "Approximate residual balancing: debiased inference of average treatment effects in high dimensions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 80(4), pages 597-623, September.
    7. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, July.
    8. Hu, Yingyao, 2008. "Identification and estimation of nonlinear models with misclassification error using instrumental variables: A general solution," Journal of Econometrics, Elsevier, vol. 144(1), pages 27-61, May.
    9. Donald, Stephen G. & Imbens, Guido W. & Newey, Whitney K., 2003. "Empirical likelihood estimation and consistent tests with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 117(1), pages 55-93, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Iman Modarressi & Jann Spiess & Amar Venugopal, 2025. "Causal Inference on Outcomes Learned from Text," Papers 2503.00725, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Davide Viviano & Jelena Bradic, 2019. "Synthetic learner: model-free inference on treatments over time," Papers 1904.01490, arXiv.org, revised Aug 2022.
    2. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    3. Whitney K. Newey & Frank Windmeijer, 2005. "GMM with many weak moment conditions," CeMMAP working papers CWP18/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Bernard, Tanguy & Dercon, Stefan & Orkin, Kate & Schinaia, Giulio & Seyoum Taffesse, Alemayehu, 2023. "The Future in Mind: Aspirations and Long-term Outcomes in Rural Ethiopia," CEPR Discussion Papers 18492, C.E.P.R. Discussion Papers.
    5. Hu, Yingyao, 2021. "Identification of Causal Models with Unobservables: A Self-Report Approach," Economics Working Paper Archive 64330, The Johns Hopkins University,Department of Economics.
    6. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    7. Gospodinov, Nikolay & Otsu, Taisuke, 2012. "Local GMM estimation of time series models with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 170(2), pages 476-490.
    8. Battistin, Erich & Chesher, Andrew, 2014. "Treatment effect estimation with covariate measurement error," Journal of Econometrics, Elsevier, vol. 178(2), pages 707-715.
    9. Wang, Xuexin, 2015. "A Note on Consistent Conditional Moment Tests," MPRA Paper 69005, University Library of Munich, Germany.
    10. Undral Byambadalai, 2022. "Identification and Inference for Welfare Gains without Unconfoundedness," Papers 2207.04314, arXiv.org.
    11. Sviták, Jan & Tichem, Jan & Haasbeek, Stefan, 2021. "Price effects of search advertising restrictions," International Journal of Industrial Organization, Elsevier, vol. 77(C).
    12. Fu, Lianyan & Gao, Wei & Shi, Ning-Zhong, 2011. "Estimation of relative average treatment effects with misclassification," Economics Letters, Elsevier, vol. 111(1), pages 95-98, April.
    13. Francis J. DiTraglia & Camilo García-Jimeno, 2017. "Mis-classified, Binary, Endogenous Regressors: Identification and Inference," NBER Working Papers 23814, National Bureau of Economic Research, Inc.
    14. repec:hal:spmain:info:hdl:2441/75dbbb2hc596np6q8flqf6i79k is not listed on IDEAS
    15. Molinari, Francesca, 2020. "Microeconometrics with partial identification," Handbook of Econometrics, in: Steven N. Durlauf & Lars Peter Hansen & James J. Heckman & Rosa L. Matzkin (ed.), Handbook of Econometrics, edition 1, volume 7, chapter 0, pages 355-486, Elsevier.
    16. Battistin, Erich & De Nadai, Michele & Vuri, Daniela, 2017. "Counting rotten apples: Student achievement and score manipulation in Italian elementary Schools," Journal of Econometrics, Elsevier, vol. 200(2), pages 344-362.
    17. Guido W. Imbens, 2022. "Causality in Econometrics: Choice vs Chance," Econometrica, Econometric Society, vol. 90(6), pages 2541-2566, November.
    18. Battistin, Erich & De Nadai, Michele & Sianesi, Barbara, 2014. "Misreported schooling, multiple measures and returns to educational qualifications," Journal of Econometrics, Elsevier, vol. 181(2), pages 136-150.
    19. Michael C Knaus, 2022. "Double machine learning-based programme evaluation under unconfoundedness [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 602-627.
    20. Antoine, Bertille & Bonnal, Helene & Renault, Eric, 2007. "On the efficient use of the informational content of estimating equations: Implied probabilities and Euclidean empirical likelihood," Journal of Econometrics, Elsevier, vol. 138(2), pages 461-487, June.
    21. Koen Jochmans, 2017. "Two-Way Models for Gravity," The Review of Economics and Statistics, MIT Press, vol. 99(3), pages 478-485, July.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2411.10959. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.