IDEAS home Printed from https://ideas.repec.org/p/cir/cirwor/2001s-56.html
   My bibliography  Save this paper

Exact Nonparametric Two-Sample Homogeneity Tests for Possibly Discrete Distributions

Author

Listed:
  • Jean-Marie Dufour
  • Abdeljelil Farhat

Abstract

In this paper, we study several tests for the equality of two unknown distributions. Two are based on empirical distribution functions, three others on nonparametric probability density estimates, and the last ones on differences between sample moments. We suggest controlling the size of such tests (under nonparametric assumptions) by using permutational versions of the tests jointly with the method of Monte Carlo tests properly adjusted to deal with discrete distributions. We also propose a combined test procedure, whose level is again perfectly controlled through the Monte Carlo test technique and has better power properties than the individual tests which are combined. Finally, in a simulation experiment, we show that the technique suggested provides perfect control of test size and that the new tests proposed can yield sizeable power improvements. Dans ce texte, nous étudions plusieurs tests pour l'egalité de deux distributions inconnues. Deux de ces tests sont basés sur des fonctions de distribution empiriques, trois autres sur des estimateurs non-paramétriques de fonctions de densité, et les trois derniers sur des moments empiriques. Nous proposons de contrôler la taille des tests (sous des hypothèses non-paramétriques) en employant des versions permutationnelles de ces tests conjointement avec la méthode des tests de Monte Carlo ajustée pour tenir compte de la possibilité de distributions discontinues. Nous proposons aussi une méthode pour combiner plusieurs de ces tests, le niveau de ces procédures étant aussi contrôlé par la technique des tests de Monte Carlo, laquelle possède de meilleures propriétés de puissance que les tests individuels combinés. Finalement, nous montrons dans une étude de simulation que la technique suggérée contrôle parfaitement la taille des différents tests considérés et que les nouveaux tests proposés peuvent fournir de notables améliorations de puissance.

Suggested Citation

  • Jean-Marie Dufour & Abdeljelil Farhat, 2001. "Exact Nonparametric Two-Sample Homogeneity Tests for Possibly Discrete Distributions," CIRANO Working Papers 2001s-56, CIRANO.
  • Handle: RePEc:cir:cirwor:2001s-56
    as

    Download full text from publisher

    File URL: https://cirano.qc.ca/files/publications/2001s-56.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kiviet, Jan F. & Dufour, Jean-Marie, 1997. "Exact tests in single equation autoregressive distributed lag models," Journal of Econometrics, Elsevier, vol. 80(2), pages 325-353, October.
    2. Dufour, Jean-Marie, 1989. "Nonlinear Hypotheses, Inequality Restrictions, and Non-nested Hypotheses: Exact Simultaneous Tests in Linear Regressions," Econometrica, Econometric Society, vol. 57(2), pages 335-355, March.
    3. Dufour, Jean-Marie & Torres, Olivier, 2000. "Markovian processes, two-sided autoregressions and finite-sample inference for stationary and nonstationary autoregressive processes," Journal of Econometrics, Elsevier, vol. 99(2), pages 255-289, December.
    4. Jean-Marie Dufour & Jan F. Kiviet, 1998. "Exact Inference Methods for First-Order Autoregressive Distributed Lag Models," Econometrica, Econometric Society, vol. 66(1), pages 79-104, January.
    5. Dufour, Jean-Marie, 2006. "Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics," Journal of Econometrics, Elsevier, vol. 133(2), pages 443-477, August.
    6. G. Noether, 1963. "Note on the kolmogorov statistic in the discrete case," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 7(1), pages 115-116, December.
    7. Jean-Marie Dufour & Abdeljelil Farhat & Lucien Gardiol & Lynda Khalaf, 1998. "Simulation-based finite sample normality tests in linear regressions," Econometrics Journal, Royal Economic Society, vol. 1(Conferenc), pages 154-173.
    8. Dufour, Jean-Marie, 1990. "Exact Tests and Confidence Sets in Linear Regressions with Autocorrelated Errors," Econometrica, Econometric Society, vol. 58(2), pages 475-494, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kidd, Willis V. & Brorsen, B. Wade, 2004. "Why have the returns to technical analysis decreased?," Journal of Economics and Business, Elsevier, vol. 56(3), pages 159-176.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dufour, Jean-Marie & Khalaf, Lynda, 2002. "Exact tests for contemporaneous correlation of disturbances in seemingly unrelated regressions," Journal of Econometrics, Elsevier, vol. 106(1), pages 143-170, January.
    2. Dufour, Jean-Marie, 2006. "Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics," Journal of Econometrics, Elsevier, vol. 133(2), pages 443-477, August.
    3. Beaulieu, Marie-Claude & Dufour, Jean-Marie & Khalaf, Lynda, 2014. "Exact confidence sets and goodness-of-fit methods for stable distributions," Journal of Econometrics, Elsevier, vol. 181(1), pages 3-14.
    4. Dufour, Jean-Marie & Khalaf, Lynda & Bernard, Jean-Thomas & Genest, Ian, 2004. "Simulation-based finite-sample tests for heteroskedasticity and ARCH effects," Journal of Econometrics, Elsevier, vol. 122(2), pages 317-347, October.
    5. Marie-Claude Beaulieu & Jean-Marie Dufour & Lynda Khalaf, 2005. "Exact Multivariate Tests of Asset Pricing Models with Stable Asymmetric Distributions," Springer Books, in: Michèle Breton & Hatem Ben-Ameur (ed.), Numerical Methods in Finance, chapter 0, pages 173-191, Springer.
    6. Touhami Abdelkhalek & Jean-Marie Dufour, 1998. "Statistical Inference For Computable General Equilibrium Models, With Application To A Model Of The Moroccan Economy," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 520-534, November.
    7. Jean-Marie Dufour & Lynda Khalaf & Marie-Claude Beaulieu, 2010. "Multivariate residual-based finite-sample tests for serial dependence and ARCH effects with applications to asset pricing models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(2), pages 263-285.
    8. Dufour, Jean-Marie & Khalaf, Lynda, 2002. "Simulation based finite and large sample tests in multivariate regressions," Journal of Econometrics, Elsevier, vol. 111(2), pages 303-322, December.
    9. Jean-Thomas Bernard & Nadhem Idoudi & Lynda Khalaf & Clément Yélou, 2007. "Finite sample inference methods for dynamic energy demand models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(7), pages 1211-1226.
    10. Dufour, Jean-Marie & Torres, Olivier, 2000. "Markovian processes, two-sided autoregressions and finite-sample inference for stationary and nonstationary autoregressive processes," Journal of Econometrics, Elsevier, vol. 99(2), pages 255-289, December.
    11. DUFOUR, Jean-Marie & KHALAF, Lynda & BEAULIEU, Marie-Claude, 2003. "Finite-Sample Diagnostics for Multivariate Regressions with Applications to Linear Asset Pricing Models," Cahiers de recherche 2003-08, Universite de Montreal, Departement de sciences economiques.
    12. Tuvaandorj, Purevdorj, 2020. "Regression discontinuity designs, white noise models, and minimax," Journal of Econometrics, Elsevier, vol. 218(2), pages 587-608.
    13. Dufour, Jean-Marie & Khalaf, Lynda, 2001. "Finite-Sample Simulation-Based Tests in Seemingly Unrelated Regressions," Cahiers de recherche 0105, GREEN.
    14. Chesher, Andrew & Dhaene, Geert & Gouriéroux, Christian & Scaillet, Olivier, 1999. "Bartlett Identities Tests," LIDAM Discussion Papers IRES 1999019, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES).
    15. Jean‐Marie Dufour & Lynda Khalaf & Marie‐Claude Beaulieu, 2003. "Exact Skewness–Kurtosis Tests for Multivariate Normality and Goodness‐of‐Fit in Multivariate Regressions with Application to Asset Pricing Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(s1), pages 891-906, December.
    16. Kiviet, Jan F. & Dufour, Jean-Marie, 1997. "Exact tests in single equation autoregressive distributed lag models," Journal of Econometrics, Elsevier, vol. 80(2), pages 325-353, October.
    17. Marie-Claude BEAULIEU & Jean-Marie DUFOUR & Lynda KHALAF, 2002. "Testing Mean-Variance Efficiency In Capm With Possibly Non-Gaussian Errors : An Exact Simulation-Based Approach," Cahiers de recherche 17-2002, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    18. Luger, Richard, 2003. "Exact non-parametric tests for a random walk with unknown drift under conditional heteroscedasticity," Journal of Econometrics, Elsevier, vol. 115(2), pages 259-276, August.
    19. Sermin Gungor & Richard Luger, 2016. "Multivariate Tests of Mean-Variance Efficiency and Spanning With a Large Number of Assets and Time-Varying Covariances," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(2), pages 161-175, April.
    20. Jean‐Marie Dufour, 2003. "Identification, weak instruments, and statistical inference in econometrics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 36(4), pages 767-808, November.

    More about this item

    Keywords

    Nonparametric methods; two-sample problem; discrete distribution; discontinuous distribution; goodness-of-fit test; Kolmogorov-Smirnov test; Cramér-von Mises; kernel density estimator; exact test; permutation test; Monte Carlo test; bootstrap; combined test procedure; induced test; Méthodes non-paramétriques; problème des deux échantillons; distribution discrète; distribution discontinue; test d'ajustement; test de Kolmogorov-Smirnov; estimateur à noyau pour une densité; test exact; test de permutations; test de Monte Carlo; bootstrap; test combiné; test induit;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C50 - Mathematical and Quantitative Methods - - Econometric Modeling - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cir:cirwor:2001s-56. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Webmaster (email available below). General contact details of provider: https://edirc.repec.org/data/ciranca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.