IDEAS home Printed from https://ideas.repec.org/a/spr/jglopt/v82y2022i4d10.1007_s10898-021-01042-x.html
   My bibliography  Save this article

A binary search algorithm for univariate data approximation and estimation of extrema by piecewise monotonic constraints

Author

Listed:
  • Ioannis C. Demetriou

    (National and Kapodistrian University of Athens)

Abstract

The piecewise monotonic approximation problem makes the least changes to n univariate noisy data so that the piecewise linear interpolant to the new values is composed of at most k monotonic sections. The term “least changes” is defined in the sense of a global sum of strictly convex functions of changes. The main difficulty in this calculation is that the extrema of the interpolant have to be found automatically, but the number of all possible combinations of extrema can be $${\mathcal {O}}(n^{k-1})$$ O ( n k - 1 ) , which makes not practicable to test each one separately. It is known that the case $$k=1$$ k = 1 is straightforward, and that the case $$k>1$$ k > 1 reduces to partitioning the data into at most k disjoint sets of adjacent data and solving a $$k=1$$ k = 1 problem for each set. Some ordering relations of the extrema are studied that establish three quite efficient algorithms by using a binary search method for partitioning the data. In the least squares case the total work is only $${\mathcal {O}}(n \sigma +k\sigma \log _2\sigma )$$ O ( n σ + k σ log 2 σ ) computer operations when $$k \ge 3$$ k ≥ 3 and is only $${\mathcal {O}}(n)$$ O ( n ) when $$k=1$$ k = 1 or 2, where $$\sigma -2$$ σ - 2 is the number of sign changes in the sequence of the first differences of the data. Fortran software has been written for this case and the numerical results indicate superior performance to existing algorithms. Some examples with real data illustrate the method. Many applications of the method arise from bioinformatics, energy, geophysics, medical imaging, and peak finding in spectroscopy, for instance.

Suggested Citation

  • Ioannis C. Demetriou, 2022. "A binary search algorithm for univariate data approximation and estimation of extrema by piecewise monotonic constraints," Journal of Global Optimization, Springer, vol. 82(4), pages 691-726, April.
  • Handle: RePEc:spr:jglopt:v:82:y:2022:i:4:d:10.1007_s10898-021-01042-x
    DOI: 10.1007/s10898-021-01042-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10898-021-01042-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10898-021-01042-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ioannis C. Demetriou, 2019. "A Decomposition Theorem for the Least Squares Piecewise Monotonic Data Approximation Problem," Springer Optimization and Its Applications, in: Ioannis C. Demetriou & Panos M. Pardalos (ed.), Approximation and Optimization, pages 119-134, Springer.
    2. Nelson, Charles R. & Plosser, Charles I., 1982. "Trends and random walks in macroeconmic time series : Some evidence and implications," Journal of Monetary Economics, Elsevier, vol. 10(2), pages 139-162.
    3. Davies, Laurie & Höhenrieder, Christian & Krämer, Walter, 2012. "Recursive computation of piecewise constant volatilities," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3623-3631.
    4. Wenyu Sun & Ya-Xiang Yuan, 2006. "Optimization Theory and Methods," Springer Optimization and Its Applications, Springer, number 978-0-387-24976-6, June.
    5. Vassiliou, E. & Demetriou, I.C., 2005. "An adaptive algorithm for least squares piecewise monotonic data fitting," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 591-609, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Seiler, Volker, 2024. "The relationship between Chinese and FOB prices of rare earth elements – Evidence in the time and frequency domain," The Quarterly Review of Economics and Finance, Elsevier, vol. 95(C), pages 160-179.
    2. John Barkoulas & Christopher Baum & Mustafa Caglayan, 1999. "Fractional monetary dynamics," Applied Economics, Taylor & Francis Journals, vol. 31(11), pages 1393-1400.
    3. Heinemann, Friedrich, 1994. "Central Europe and European monetary integration: a strategy for catching up," ZEW Discussion Papers 94-21, ZEW - Leibniz Centre for European Economic Research.
    4. Froyen, Richard T & Waud, Roger N, 1988. "Real Business Cycles and the Lucas Paradigm," Economic Inquiry, Western Economic Association International, vol. 26(2), pages 183-201, April.
    5. Apostolos Serletis & Ricardo Rangel-Ruiz, 2007. "Testing for Common Features in North American Energy Markets," World Scientific Book Chapters, in: Quantitative And Empirical Analysis Of Energy Markets, chapter 14, pages 172-187, World Scientific Publishing Co. Pte. Ltd..
    6. Rocha, Roberto de Rezende, 1991. "Inflation and stabilization in Yugoslavia," Policy Research Working Paper Series 752, The World Bank.
    7. Michelacci, Claudio & Zaffaroni, Paolo, 2000. "(Fractional) beta convergence," Journal of Monetary Economics, Elsevier, vol. 45(1), pages 129-153, February.
    8. Yong Glasure & Aie-Rie Lee & James Norris, 1999. "Level of economic development and political democracy revisited," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 5(4), pages 466-477, November.
    9. repec:cte:wsrepe:ws1506 is not listed on IDEAS
    10. Ramey, Garey & Ramey, Valerie A, 1995. "Cross-Country Evidence on the Link between Volatility and Growth," American Economic Review, American Economic Association, vol. 85(5), pages 1138-1151, December.
    11. Carl E. Walsh, 1987. "Monetary targeting and inflation: 1976-1984," Economic Review, Federal Reserve Bank of San Francisco, issue Win, pages 5-16.
    12. Klaus Reiner Schenk-Hopp�, "undated". "Economic Growth and Business Cycles: A Critical Comment on Detrending Time Series (Revised Version)," IEW - Working Papers 054, Institute for Empirical Research in Economics - University of Zurich.
    13. Tony Caporale & Barbara McKiernan, 1998. "The Fischer Black Hypothesis: Some Time‐Series Evidence," Southern Economic Journal, John Wiley & Sons, vol. 64(3), pages 765-771, January.
    14. Gahn, Santiago José, 2021. "On the adjustment of capacity utilisation to aggregate demand: Revisiting an old Sraffian critique to the Neo-Kaleckian model," Structural Change and Economic Dynamics, Elsevier, vol. 58(C), pages 325-360.
    15. Entorf, Horst, 1997. "Random walks with drifts: Nonsense regression and spurious fixed-effect estimation," Journal of Econometrics, Elsevier, vol. 80(2), pages 287-296, October.
    16. Giorgio Fagiolo & Mauro Napoletano & Andrea Roventini, 2008. "Are output growth-rate distributions fat-tailed? some evidence from OECD countries," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(5), pages 639-669.
    17. Ilias Lekkos, 2003. "Cross‐sectional Restrictions on the Spot and Forward Term Structures of Interest Rates and Panel Unit Root Tests," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 30(5‐6), pages 799-828, June.
    18. Beaulieu, Anne & Patry, Michel & Raynauld, Jacques, 1989. "L’analyse de la productivité des transporteurs aériens canadiens dans les années soixante-dix : pour un autre plan de vol," L'Actualité Economique, Société Canadienne de Science Economique, vol. 65(2), pages 183-207, juin.
    19. Myroslav Pidkuyko, 2014. "Dynamics of Consumption and Dividends over the Business Cycle," CERGE-EI Working Papers wp522, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    20. Quah, Danny, 1992. "The Relative Importance of Permanent and Transitory Components: Identification and Some Theoretical Bounds," Econometrica, Econometric Society, vol. 60(1), pages 107-118, January.
    21. Marcelo Resende, 2004. "Gibrat's Law and the Growth of Cities in Brazil: A Panel Data Investigation," Urban Studies, Urban Studies Journal Limited, vol. 41(8), pages 1537-1549, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jglopt:v:82:y:2022:i:4:d:10.1007_s10898-021-01042-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.