IDEAS home Printed from https://ideas.repec.org/p/zbw/sfb475/200551.html
   My bibliography  Save this paper

Computing the Least Quartile Difference Estimator in the Plane

Author

Listed:
  • Bernholt, Thorsten
  • Nunkesser, Robin
  • Schettlinger, Karen

Abstract

A common problem in linear regression is that largely aberrant values can strongly influence the results. The least quartile difference (LQD) regression estimator is highly robust, since it can resist up to almost 50% largely deviant data values without becoming extremely biased. Additionally, it shows good behavior on Gaussian data – in contrast to many other robust regression methods. However, the LQD is not widely used yet due to the high computational effort needed when using common algorithms, e.g. the subset algorithm of Rousseeuw and Leroy. For computing the LQD estimator for n data points in the plane, we propose a randomized algorithm with expected running time O(n2 log2 n) and an approximation algorithm with a running time of roughly O(n2 log n). It can be expected that the practical relevance of the LQD estimator will strongly increase thereby.

Suggested Citation

  • Bernholt, Thorsten & Nunkesser, Robin & Schettlinger, Karen, 2005. "Computing the Least Quartile Difference Estimator in the Plane," Technical Reports 2005,51, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    • Handle: RePEc:zbw:sfb475:200551
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/22644/1/tr51-05.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ian L. Dryden & Gary Walker, 1999. "Highly Resistant Regression and Object Matching," Biometrics, The International Biometric Society, vol. 55(3), pages 820-825, September.
    2. Struyf, Anja J. & Rousseeuw, Peter J., 1999. "Halfspace Depth and Regression Depth Characterize the Empirical Distribution," Journal of Multivariate Analysis, Elsevier, vol. 69(1), pages 135-153, April.
    3. Hossjer, O. & Croux, C. & Rousseeuw, P. J., 1994. "Asymptotics of Generalized S-Estimators," Journal of Multivariate Analysis, Elsevier, vol. 51(1), pages 148-177, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bernholt, Thorsten & Nunkesser, Robin & Schettlinger, Karen, 2007. "Computing the least quartile difference estimator in the plane," Computational Statistics & Data Analysis, Elsevier, vol. 52(2), pages 763-772, October.
    2. Mia Hubert & Peter Rousseeuw & Pieter Segaert, 2015. "Multivariate functional outlier detection," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(2), pages 177-202, July.
    3. Stanislav Nagy, 2021. "Halfspace depth does not characterize probability distributions," Statistical Papers, Springer, vol. 62(3), pages 1135-1139, June.
    4. W. Ip & Ying Yang & P. Kwan & Y. Kwan, 2003. "Strong convergence rate of the least median absolute estimator in linear regression models," Statistical Papers, Springer, vol. 44(2), pages 183-201, April.
    5. Nunkesser, Robin & Morell, Oliver, 2010. "An evolutionary algorithm for robust regression," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3242-3248, December.
    6. Gather, Ursula & Fried, Roland & Lanius, Vivian, 2005. "Robust detail-preserving signal extraction," Technical Reports 2005,54, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    7. Yi He & John H. J. Einmahl, 2017. "Estimation of extreme depth-based quantile regions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(2), pages 449-461, March.
    8. Jonas Baillien & Irène Gijbels & Anneleen Verhasselt, 2023. "Flexible asymmetric multivariate distributions based on two-piece univariate distributions," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(1), pages 159-200, February.
    9. Roelant, E. & Van Aelst, S. & Croux, C., 2009. "Multivariate generalized S-estimators," Journal of Multivariate Analysis, Elsevier, vol. 100(5), pages 876-887, May.
    10. Cerioli, Andrea & Farcomeni, Alessio & Riani, Marco, 2014. "Strong consistency and robustness of the Forward Search estimator of multivariate location and scatter," Journal of Multivariate Analysis, Elsevier, vol. 126(C), pages 167-183.
    11. Xiaohui Liu & Karl Mosler & Pavlo Mozharovskyi, 2017. "Fast computation of Tukey trimmed regions and median in dimension p > 2," Working Papers 2017-71, Center for Research in Economics and Statistics.
    12. Hassairi, Abdelhamid & Regaieg, Ons, 2008. "On the Tukey depth of a continuous probability distribution," Statistics & Probability Letters, Elsevier, vol. 78(15), pages 2308-2313, October.
    13. Nunkesser, Robin & Morell, Oliver, 2008. "Evolutionary algorithms for robust methods," Technical Reports 2008,29, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    14. Christmann, Andreas & Steinwart, Ingo & Hubert, Mia, 2006. "Robust Learning from Bites for Data Mining," Technical Reports 2006,03, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    15. Christmann, Andreas & Steinwart, Ingo, 2003. "On robustness properties of convex risk minimization methods for pattern recognition," Technical Reports 2003,15, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    16. Christmann, Andreas, 2004. "Regression depth and support vector machine," Technical Reports 2004,54, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    17. Petra Laketa & Stanislav Nagy, 2022. "Halfspace depth for general measures: the ray basis theorem and its consequences," Statistical Papers, Springer, vol. 63(3), pages 849-883, June.
    18. Berrendero, José R. & Zamar, Ruben H., 1999. "Global robustness of location and dispersion estimates," Statistics & Probability Letters, Elsevier, vol. 44(1), pages 63-72, August.
    19. Kong, Linglong & Zuo, Yijun, 2010. "Smooth depth contours characterize the underlying distribution," Journal of Multivariate Analysis, Elsevier, vol. 101(9), pages 2222-2226, October.
    20. Farnè, Matteo & Vouldis, Angelos T., 2018. "A methodology for automised outlier detection in high-dimensional datasets: an application to euro area banks' supervisory data," Working Paper Series 2171, European Central Bank.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:sfb475:200551. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/isdorde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.