IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1908.02166.html
   My bibliography  Save this paper

Semiparametric Wavelet-based JPEG IV Estimator for endogenously truncated data

Author

Listed:
  • Nir Billfeld
  • Moshe Kim

Abstract

A new and an enriched JPEG algorithm is provided for identifying redundancies in a sequence of irregular noisy data points which also accommodates a reference-free criterion function. Our main contribution is by formulating analytically (instead of approximating) the inverse of the transpose of JPEGwavelet transform without involving matrices which are computationally cumbersome. The algorithm is suitable for the widely-spread situations where the original data distribution is unobservable such as in cases where there is deficient representation of the entire population in the training data (in machine learning) and thus the covariate shift assumption is violated. The proposed estimator corrects for both biases, the one generated by endogenous truncation and the one generated by endogenous covariates. Results from utilizing 2,000,000 different distribution functions verify the applicability and high accuracy of our procedure to cases in which the disturbances are neither jointly nor marginally normally distributed.

Suggested Citation

  • Nir Billfeld & Moshe Kim, 2019. "Semiparametric Wavelet-based JPEG IV Estimator for endogenously truncated data," Papers 1908.02166, arXiv.org.
    • Handle: RePEc:arx:papers:1908.02166
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1908.02166
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    2. Lewbel, Arthur & Schennach, Susanne M., 2007. "A simple ordered data estimator for inverse density weighted expectations," Journal of Econometrics, Elsevier, vol. 136(1), pages 189-211, January.
    3. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    4. Arthur Lewbel & Oliver Linton, 2007. "Nonparametric Matching and Efficient Estimators of Homothetically Separable Functions," Econometrica, Econometric Society, vol. 75(4), pages 1209-1227, July.
    5. Whitney K. Newey, 2009. "Two-step series estimation of sample selection models," Econometrics Journal, Royal Economic Society, vol. 12(s1), pages 217-229, January.
    6. Hsiao,Cheng & Morimune,Kimio & Powell,James L. (ed.), 2001. "Nonlinear Statistical Modeling," Cambridge Books, Cambridge University Press, number 9780521662468, September.
    7. Hofert, Marius, 2008. "Sampling Archimedean copulas," Computational Statistics & Data Analysis, Elsevier, vol. 52(12), pages 5163-5174, August.
    8. Nir Billfeld & Moshe Kim, 2019. "Semiparametric correction for endogenous truncation bias with Vox Populi based participation decision," Papers 1902.06286, arXiv.org.
    9. Horowitz, Joel L., 2014. "Adaptive nonparametric instrumental variables estimation: Empirical choice of the regularization parameter," Journal of Econometrics, Elsevier, vol. 180(2), pages 158-173.
    10. V. Delouille & J. Simoens & R. von Sachs, 2004. "Smooth Design-Adapted Wavelets for Nonparametric Stochastic Regression," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 643-658, January.
    11. Joshua D. Angrist & Guido M. Kuersteiner, 2004. "Semiparametric Causality Tests Using the Policy Propensity Score," NBER Working Papers 10975, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Ruixuan & Yu, Zhengfei, 2022. "Sample selection models with monotone control functions," Journal of Econometrics, Elsevier, vol. 226(2), pages 321-342.
    2. Ruoyao Shi, 2021. "An Averaging Estimator for Two Step M Estimation in Semiparametric Models," Working Papers 202105, University of California at Riverside, Department of Economics.
    3. Xiaohong Chen & Andres Santos, 2018. "Overidentification in Regular Models," Econometrica, Econometric Society, vol. 86(5), pages 1771-1817, September.
    4. repec:hal:wpspec:info:hdl:2441/3vl5fe4i569nbr005tctlc8ll5 is not listed on IDEAS
    5. Gayle, George-Levi & Viauroux, Christelle, 2007. "Root-N consistent semiparametric estimators of a dynamic panel-sample-selection model," Journal of Econometrics, Elsevier, vol. 141(1), pages 179-212, November.
    6. Jochmans, Koen, 2015. "Multiplicative-error models with sample selection," Journal of Econometrics, Elsevier, vol. 184(2), pages 315-327.
    7. Yu, Ping & Phillips, Peter C.B., 2018. "Threshold regression with endogeneity," Journal of Econometrics, Elsevier, vol. 203(1), pages 50-68.
    8. Hans Ophem & Jacopo Mazza, 2024. "Educational choice, initial wage and wage growth," Empirical Economics, Springer, vol. 67(3), pages 1235-1274, September.
    9. repec:hal:spmain:info:hdl:2441/3vl5fe4i569nbr005tctlc8ll5 is not listed on IDEAS
    10. Katrin Hussinger, 2008. "R&D and subsidies at the firm level: an application of parametric and semiparametric two-step selection models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(6), pages 729-747.
    11. Zhewen Pan, 2023. "On semiparametric estimation of the intercept of the sample selection model: a kernel approach," Papers 2302.05089, arXiv.org.
    12. repec:spo:wpmain:info:hdl:2441/3vl5fe4i569nbr005tctlc8ll5 is not listed on IDEAS
    13. Nir Billfeld & Moshe Kim, 2019. "Semiparametric correction for endogenous truncation bias with Vox Populi based participation decision," Papers 1902.06286, arXiv.org.
    14. repec:spo:wpecon:info:hdl:2441/3vl5fe4i569nbr005tctlc8ll5 is not listed on IDEAS
    15. Giuseppe De Luca & Franco Peracchi, 2007. "A sample selection model for unit and item nonresponse in cross-sectional surveys," CEIS Research Paper 95, Tor Vergata University, CEIS.
    16. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    17. Töpfer, Marina, 2017. "Detailed RIF decomposition with selection: The gender pay gap in Italy," Hohenheim Discussion Papers in Business, Economics and Social Sciences 26-2017, University of Hohenheim, Faculty of Business, Economics and Social Sciences.
    18. Patrick Saart & Jiti Gao & Nam Hyun Kim, 2014. "Semiparametric methods in nonlinear time series analysis: a selective review," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(1), pages 141-169, March.
    19. Asma Hyder & Barry Reilly, 2005. "The Public and Private Sector Pay Gap in Pakistan: A Quantile Regression Analysis," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 44(3), pages 271-306.
    20. Chen, Xiaohong & Pouzo, Demian, 2009. "Efficient estimation of semiparametric conditional moment models with possibly nonsmooth residuals," Journal of Econometrics, Elsevier, vol. 152(1), pages 46-60, September.
    21. S. I. Dolgikh & B. S. Potanin, 2023. "The Impact of Public Administration on the Efficiency of Russian Firms," Studies on Russian Economic Development, Springer, vol. 34(1), pages 59-67, February.
    22. Takahiro Hoshino & Yuya Shimizu, 2019. "Doubly Robust-type Estimation of Population Moments and Parameters in Biased Sampling," Keio-IES Discussion Paper Series 2019-006, Institute for Economics Studies, Keio University.
    23. Denis Cogneau & Yannick Dupraz, 2014. "Questionable Inference on the Power of Pre-Colonial Institutions in Africa," PSE Working Papers halshs-01018548, HAL.
    24. Barrios, Javier A., 2004. "Generalized sample selection bias correction under RUM," Economics Letters, Elsevier, vol. 85(1), pages 129-132, October.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1908.02166. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.