IDEAS home Printed from https://ideas.repec.org/a/spr/joptap/v149y2011i2d10.1007_s10957-010-9791-1.html
   My bibliography  Save this article

Searching for a Best Least Absolute Deviations Solution of an Overdetermined System of Linear Equations Motivated by Searching for a Best Least Absolute Deviations Hyperplane on the Basis of Given Data

Author

Listed:
  • Kristian Sabo

    (University of Osijek)

  • Rudolf Scitovski

    (University of Osijek)

  • Ivan Vazler

    (University of Osijek)

Abstract

We consider the problem of searching for a best LAD-solution of an overdetermined system of linear equations Xa=z, X∈ℝm×n, m≥n, $\mathbf{a}\in \mathbb{R}^{n}, \mathbf {z}\in\mathbb{R}^{m}$ . This problem is equivalent to the problem of determining a best LAD-hyperplane x↦a T x, x∈ℝ n on the basis of given data $(\mathbf{x}_{i},z_{i}), \mathbf{x}_{i}= (x_{1}^{(i)},\ldots,x_{n}^{(i)})^{T}\in \mathbb{R}^{n}, z_{i}\in\mathbb{R}, i=1,\ldots,m$ , whereby the minimizing functional is of the form $$F(\mathbf{a})=\|\mathbf{z}-\mathbf{Xa}\|_1=\sum_{i=1}^m|z_i-\mathbf {a}^T\mathbf{x}_i|.$$ An iterative procedure is constructed as a sequence of weighted median problems, which gives the solution in finitely many steps. A criterion of optimality follows from the fact that the minimizing functional F is convex, and therefore the point a ∗∈ℝ n is the point of a global minimum of the functional F if and only if 0∈∂F(a ∗). Motivation for the construction of the algorithm was found in a geometrically visible algorithm for determining a best LAD-plane (x,y)↦αx+βy, passing through the origin of the coordinate system, on the basis of the data (x i ,y i ,z i ),i=1,…,m.

Suggested Citation

  • Kristian Sabo & Rudolf Scitovski & Ivan Vazler, 2011. "Searching for a Best Least Absolute Deviations Solution of an Overdetermined System of Linear Equations Motivated by Searching for a Best Least Absolute Deviations Hyperplane on the Basis of Given Dat," Journal of Optimization Theory and Applications, Springer, vol. 149(2), pages 293-314, May.
  • Handle: RePEc:spr:joptap:v:149:y:2011:i:2:d:10.1007_s10957-010-9791-1
    DOI: 10.1007/s10957-010-9791-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10957-010-9791-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10957-010-9791-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Castillo, Enrique & Minguez, Roberto & Castillo, Carmen & Cofino, Antonio S., 2008. "Dealing with the multiplicity of solutions of the l1 and l[infinity] regression models," European Journal of Operational Research, Elsevier, vol. 188(2), pages 460-484, July.
    2. Dasgupta, Madhuchhanda & Mishra, SK, 2004. "Least absolute deviation estimation of linear econometric models: A literature review," MPRA Paper 1781, University Library of Munich, Germany.
    3. F. Plastria & E. Carrizosa, 2001. "Gauge Distances and Median Hyperplanes," Journal of Optimization Theory and Applications, Springer, vol. 110(1), pages 173-182, July.
    4. Dodge, Yadolah, 1987. "An introduction to L1-norm based statistical data analysis," Computational Statistics & Data Analysis, Elsevier, vol. 5(4), pages 239-253, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laniado Rodas, Henry, 2017. "Multivariate outlier detection based on a robust Mahalanobis distance with shrinkage estimators," DES - Working Papers. Statistics and Econometrics. WS 24613, Universidad Carlos III de Madrid. Departamento de Estadística.
    2. Thomas Brenner & Matthias Duschl, 2018. "Modeling Firm and Market Dynamics: A Flexible Model Reproducing Existing Stylized Facts on Firm Growth," Computational Economics, Springer;Society for Computational Economics, vol. 52(3), pages 745-772, October.
    3. Thomas Gries & Wim Naudé & Marianne Matthee, 2009. "The Optimal Distance To Port For Exporting Firms," Journal of Regional Science, Wiley Blackwell, vol. 49(3), pages 513-528, August.
    4. Thomas Brenner & Matthias Duschl, 2015. "Causal dynamic effects in regional systems of technological activities: a SVAR approach," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 55(1), pages 103-130, October.
    5. Jack Brimberg & Henrik Juel & Mark-Christoph Körner & Anita Schöbel, 2014. "Locating an axis-parallel rectangle on a Manhattan plane," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(1), pages 185-207, April.
    6. Oliveira, Aurelio R. L. & Nascimento, Mario A. & Lyra, Christiano, 2000. "Efficient implementation and benchmark of interior point methods for the polynomial L1 fitting problem," Computational Statistics & Data Analysis, Elsevier, vol. 35(2), pages 119-135, December.
    7. Diaz-Banez, J. M. & Mesa, J. A. & Schobel, A., 2004. "Continuous location of dimensional structures," European Journal of Operational Research, Elsevier, vol. 152(1), pages 22-44, January.
    8. Baldomero-Naranjo, Marta & Martínez-Merino, Luisa I. & Rodríguez-Chía, Antonio M., 2020. "Tightening big Ms in integer programming formulations for support vector machines with ramp loss," European Journal of Operational Research, Elsevier, vol. 286(1), pages 84-100.
    9. Emilio Carrizosa & Frank Plastria, 2008. "Optimal Expected-Distance Separating Halfspace," Mathematics of Operations Research, INFORMS, vol. 33(3), pages 662-677, August.
    10. Frank Plastria & Steven De Bruyne & Emilio Carrizosa, 2010. "Alternating local search based VNS for linear classification," Annals of Operations Research, Springer, vol. 174(1), pages 121-134, February.
    11. Alessio Moneta & Doris Entner & Patrik O. Hoyer & Alex Coad, 2013. "Causal Inference by Independent Component Analysis: Theory and Applications," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(5), pages 705-730, October.
    12. S K Mishra, 2007. "Globalization and Structural Changes in the Indian Industrial Sector: An Analysis of Production Functions," The IUP Journal of Managerial Economics, IUP Publications, vol. 0(4), pages 56-81, November.
    13. Jack Brimberg & Robert Schieweck & Anita Schöbel, 2015. "Locating a median line with partial coverage distance," Journal of Global Optimization, Springer, vol. 62(2), pages 371-389, June.
    14. Pedro Duarte Silva, A., 2017. "Optimization approaches to Supervised Classification," European Journal of Operational Research, Elsevier, vol. 261(2), pages 772-788.
    15. Nikolai Krivulin, 2020. "Using Parameter Elimination to Solve Discrete Linear Chebyshev Approximation Problems," Mathematics, MDPI, vol. 8(12), pages 1-16, December.
    16. Sönke Behrends & Anita Schöbel, 2020. "Generating Valid Linear Inequalities for Nonlinear Programs via Sums of Squares," Journal of Optimization Theory and Applications, Springer, vol. 186(3), pages 911-935, September.
    17. Dragutin Vincek & Gordana Kralik & Goran Kušec & Kristian Sabo & Rudolf Scitovski, 2012. "Application of growth functions in the prediction of live weight of domestic animals," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 20(4), pages 719-733, December.
    18. Marc Ciligot-Travain & Sado Traoré, 2014. "On a robustness property in single-facility location in continuous space," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(1), pages 321-330, April.
    19. Guillaume Lecué & Mathieu Lerasle, 2017. "Robust machine learning by median-of-means : theory and practice," Working Papers 2017-32, Center for Research in Economics and Statistics.
    20. Stephen Satchell & Wei Xia, 2005. "Estimation of the Risk Attitude of the Representative UK Pension Fund Investor," Birkbeck Working Papers in Economics and Finance 0509, Birkbeck, Department of Economics, Mathematics & Statistics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joptap:v:149:y:2011:i:2:d:10.1007_s10957-010-9791-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.