IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v534y2019ics0378437119304224.html
   My bibliography  Save this article

Benefits of noise in M-estimators: Optimal noise level and probability density

Author

Listed:
  • Pan, Yan
  • Duan, Fabing
  • Xu, Liyan
  • Chapeau-Blondeau, François

Abstract

For the robust estimation of a location parameter, we consider a parallel array of maximum likelihood type estimators (M-estimators). We investigate the possibility of added noise as a design variable of the M-estimators, and characterize a nonzero optimal amount of added noise maximizing the efficiency for estimation. The added noise shows its benefits to the asymptotic efficiency of the M-estimator when the noise level and the noise probability density are optimally tuned. The optimal noise level can be theoretically derived by maximizing the asymptotic efficiency as the probability density of added noise is given. Based on the Parzen-window density estimation technique, we approximate the infinite-dimensional non-convex optimization of the optimal probability density of added noise as a simpler optimization problem with respect to a finite-dimensional vector under certain constraints. This approximate solution for the optimal probability density of added noise shows its feasibility for various M-estimators with an arbitrary array size, which is also validated by simulation results.

Suggested Citation

  • Pan, Yan & Duan, Fabing & Xu, Liyan & Chapeau-Blondeau, François, 2019. "Benefits of noise in M-estimators: Optimal noise level and probability density," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 534(C).
    • Handle: RePEc:eee:phsmap:v:534:y:2019:i:c:s0378437119304224
    DOI: 10.1016/j.physa.2019.04.071
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437119304224
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000
    File URL: https://libkey.io/10.1016/j.physa.2019.04.071?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zeng, Lingzao & Xu, Bohou, 2010. "Effects of asymmetric Lévy noise in parameter-induced aperiodic stochastic resonance," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(22), pages 5128-5136.
    2. Singh, R.K., 2017. "Noise enhanced stability of a metastable state containing coupled Brownian particles," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 473(C), pages 445-450.
    3. Peng Ding, 2014. "Three Occurrences of the Hyperbolic-Secant Distribution," The American Statistician, Taylor & Francis Journals, vol. 68(1), pages 32-35, February.
    4. Gudyma, Iurii & Maksymov, Artur, 2017. "Stochastic resonance in photo-switchable spin-crossover solids," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 477(C), pages 34-41.
    5. Willard I. Zangwill, 1967. "Non-Linear Programming Via Penalty Functions," Management Science, INFORMS, vol. 13(5), pages 344-358, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang, Ting & Liu, Shujun & Liu, Hongqing & Zhang, Kui & Guo, Zhiwei & Yang, Shiju & Li, Yu, 2023. "Stochastic resonance in Bayesian estimation and CRLB for nonlinear system," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 609(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pan, Yan & Ren, Yuhao & Duan, Fabing, 2018. "Noise benefits to robust M-estimation of location in dependent observations," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 505(C), pages 144-152.
    2. Ellen H. Fukuda & L. M. Graña Drummond & Fernanda M. P. Raupp, 2016. "An external penalty-type method for multicriteria," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(2), pages 493-513, July.
    3. D.P. Bertsekas & A.E. Ozdaglar, 2002. "Pseudonormality and a Lagrange Multiplier Theory for Constrained Optimization," Journal of Optimization Theory and Applications, Springer, vol. 114(2), pages 287-343, August.
    4. Chen, Ru-Yin & Tong, Lu-Mei & Nie, Lin-Ru & Wang, Chaojie & Pan, Wanli, 2017. "Anomalous transports in a time-delayed system subjected to anomalous diffusion," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 468(C), pages 532-539.
    5. Duan Yaqiong & Lian Shujun, 2016. "Smoothing Approximation to the Square-Root Exact Penalty Function," Journal of Systems Science and Information, De Gruyter, vol. 4(1), pages 87-96, February.
    6. Kaiwen Meng & Xiaoqi Yang, 2015. "First- and Second-Order Necessary Conditions Via Exact Penalty Functions," Journal of Optimization Theory and Applications, Springer, vol. 165(3), pages 720-752, June.
    7. T. Antczak, 2013. "A Lower Bound for the Penalty Parameter in the Exact Minimax Penalty Function Method for Solving Nondifferentiable Extremum Problems," Journal of Optimization Theory and Applications, Springer, vol. 159(2), pages 437-453, November.
    8. Juan Baz & Diego García-Zamora & Irene Díaz & Susana Montes & Luis Martínez, 2024. "Flexible-dimensional L-statistic for mean estimation of symmetric distributions," Statistical Papers, Springer, vol. 65(7), pages 4001-4024, September.
    9. Rao, K.S. Rama & Sunderan, T. & Adiris, M. Ref'at, 2017. "Performance and design optimization of two model based wave energy permanent magnet linear generators," Renewable Energy, Elsevier, vol. 101(C), pages 196-203.
    10. Tadeusz Antczak & Najeeb Abdulaleem, 2023. "On the exactness and the convergence of the $$l_{1}$$ l 1 exact penalty E-function method for E-differentiable optimization problems," OPSEARCH, Springer;Operational Research Society of India, vol. 60(3), pages 1331-1359, September.
    11. Marco Corazza & Giovanni Fasano & Riccardo Gusso, 2011. "Particle Swarm Optimization with non-smooth penalty reformulation for a complex portfolio selection problem," Working Papers 2011_10, Department of Economics, University of Venice "Ca' Foscari".
    12. Giorgio Giorgi & Bienvenido Jiménez & Vicente Novo, 2014. "Some Notes on Approximate Optimality Conditions in Scalar and Vector Optimization Problems," DEM Working Papers Series 095, University of Pavia, Department of Economics and Management.
    13. M. V. Dolgopolik, 2018. "A Unified Approach to the Global Exactness of Penalty and Augmented Lagrangian Functions I: Parametric Exactness," Journal of Optimization Theory and Applications, Springer, vol. 176(3), pages 728-744, March.
    14. Chen, Xi & Luo, Maokang & Zhong, Yangfan & Zhang, Lu, 2022. "Collective dynamic behaviors of a general adjacent coupled chain in both unconfined and confined spaces," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 605(C).
    15. X. Q. Yang & Y. Y. Zhou, 2010. "Second-Order Analysis of Penalty Function," Journal of Optimization Theory and Applications, Springer, vol. 146(2), pages 445-461, August.
    16. Amaioua, Nadir & Audet, Charles & Conn, Andrew R. & Le Digabel, Sébastien, 2018. "Efficient solution of quadratically constrained quadratic subproblems within the mesh adaptive direct search algorithm," European Journal of Operational Research, Elsevier, vol. 268(1), pages 13-24.
    17. Marco Corazza & Stefania Funari & Riccardo Gusso, 2012. "An evolutionary approach to preference disaggregation in a MURAME-based credit scoring problem," Working Papers 5, Venice School of Management - Department of Management, Università Ca' Foscari Venezia.
    18. Xinhua Mao & Jianwei Wang & Changwei Yuan & Wei Yu & Jiahua Gan, 2018. "A Dynamic Traffic Assignment Model for the Sustainability of Pavement Performance," Sustainability, MDPI, vol. 11(1), pages 1-19, December.
    19. Emilio Gómez-Déniz & Barry C. Arnold & José M. Sarabia & Héctor W. Gómez, 2021. "Properties and Applications of a New Family of Skew Distributions," Mathematics, MDPI, vol. 9(1), pages 1-18, January.
    20. Antczak, Tadeusz, 2009. "Exact penalty functions method for mathematical programming problems involving invex functions," European Journal of Operational Research, Elsevier, vol. 198(1), pages 29-36, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:534:y:2019:i:c:s0378437119304224. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.