IDEAS home Printed from https://ideas.repec.org/p/trn/utwprg/2020-9.html
   My bibliography  Save this paper

On discriminating between lognormal and Pareto tail: A mixture-based approach

Author

Listed:
  • Marco Bee

Abstract

A large literature deals with the problem of testing for a Pareto tail and estimating the parameters of the Pareto distribution. We first review the most widely used statistical tools and identify their weaknesses. Then we develop a methodology that exploits all the available information by taking into account the data generating process of the entire population. Accordingly, we estimate a lognormal-Pareto mixture via the EM algorithm and the maximization of the profile likelihood function. Simulation experiments and an empirical application to the size of the US metropolitan areas confirm that the proposed method works well and outperforms two commonly used techniques.

Suggested Citation

  • Marco Bee, 2020. "On discriminating between lognormal and Pareto tail: A mixture-based approach," DEM Working Papers 2020/9, Department of Economics and Management.
    • Handle: RePEc:trn:utwprg:2020/9
    as

    Download full text from publisher

    File URL: https://www.economia.unitn.it/alfresco/download/workspace/SpacesStore/06b9cd83-9754-4b9e-8e7c-7954d43395b7/DEM2020_09.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jan Eeckhout, 2004. "Gibrat's Law for (All) Cities," American Economic Review, American Economic Association, vol. 94(5), pages 1429-1451, December.
    2. Y. Malevergne & V. Pisarenko & D. Sornette, 2009. "Gibrat’s law for cities: uniformly most powerful unbiased test of the Pareto against the lognormal," Swiss Finance Institute Research Paper Series 09-40, Swiss Finance Institute.
    3. Hisano, Ryohei & Mizuno, Takayuki, 2011. "Sales distribution of consumer electronics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(2), pages 309-318.
    4. Hernán D. Rozenfeld & Diego Rybski & Xavier Gabaix & Hernán A. Makse, 2011. "The Area and Population of Cities: New Insights from a Different Perspective on Cities," American Economic Review, American Economic Association, vol. 101(5), pages 2205-2225, August.
    5. Reed, William J., 2001. "The Pareto, Zipf and other power laws," Economics Letters, Elsevier, vol. 74(1), pages 15-19, December.
    6. Xavier Gabaix & Rustam Ibragimov, 2011. "Rank - 1 / 2: A Simple Way to Improve the OLS Estimation of Tail Exponents," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 24-39, January.
    7. Ioannides, Yannis & Skouras, Spyros, 2013. "US city size distribution: Robustly Pareto, but only in the tail," Journal of Urban Economics, Elsevier, vol. 73(1), pages 18-29.
    8. Jan Eeckhout, 2009. "Gibrat's Law for (All) Cities: Reply," American Economic Review, American Economic Association, vol. 99(4), pages 1676-1683, September.
    9. Wen‐Tai Hsu, 2012. "Central Place Theory and City Size Distribution," Economic Journal, Royal Economic Society, vol. 122(563), pages 903-932, September.
    10. Rafael González-Val & Arturo Ramos & Fernando Sanz-Gracia & María Vera-Cabello, 2015. "Size distributions for all cities: Which one is best?," Papers in Regional Science, Wiley Blackwell, vol. 94(1), pages 177-196, March.
    11. Xavier Gabaix, 2009. "Power Laws in Economics and Finance," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 255-294, May.
    12. Wu, Ximing, 2003. "Calculation of maximum entropy densities with application to income distribution," Journal of Econometrics, Elsevier, vol. 115(2), pages 347-354, August.
    13. Giorgio Fazio & Marco Modica, 2015. "Pareto Or Log-Normal? Best Fit And Truncation In The Distribution Of All Cities," Journal of Regional Science, Wiley Blackwell, vol. 55(5), pages 736-756, November.
    14. Marco Bee & Massimo Riccaboni & Stefano Schiavo, 2011. "Pareto versus lognormal: a maximum entropy test," Department of Economics Working Papers 1102, Department of Economics, University of Trento, Italia.
    15. Moshe Levy, 2009. "Gibrat's Law for (All) Cities: Comment," American Economic Review, American Economic Association, vol. 99(4), pages 1672-1675, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marco Bee, 2024. "On discriminating between lognormal and Pareto tail: an unsupervised mixture-based approach," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 18(2), pages 251-269, June.
    2. Rafael González-Val, 2019. "US city-size distribution and space," Spatial Economic Analysis, Taylor & Francis Journals, vol. 14(3), pages 283-300, July.
    3. Ramos, Arturo & Sanz-Gracia, Fernando & González-Val, Rafael, 2013. "A new framework for the US city size distribution: Empirical evidence and theory," MPRA Paper 52190, University Library of Munich, Germany.
    4. Arshad, Sidra & Hu, Shougeng & Ashraf, Badar Nadeem, 2019. "Zipf’s law, the coherence of the urban system and city size distribution: Evidence from Pakistan," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 513(C), pages 87-103.
    5. Bee, Marco & Riccaboni, Massimo & Schiavo, Stefano, 2013. "The size distribution of US cities: Not Pareto, even in the tail," Economics Letters, Elsevier, vol. 120(2), pages 232-237.
    6. Giesen, Kristian & Suedekum, Jens, 2014. "City age and city size," European Economic Review, Elsevier, vol. 71(C), pages 193-208.
    7. Rafael González‐Val, 2019. "Historical urban growth in Europe (1300–1800)," Papers in Regional Science, Wiley Blackwell, vol. 98(2), pages 1115-1136, April.
    8. Kristian Giesen & Jens Suedekum, 2012. "The size distribution across all “cities”: a unifying approach," Working Papers 2012/2, Institut d'Economia de Barcelona (IEB).
    9. Jakub Growiec & Fabio Pammolli & Massimo Riccaboni, 2020. "Innovation and Corporate Dynamics: A Theoretical Framework," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 12(1), pages 1-45, March.
    10. Josic Hrvoje & Bašić Maja, 2018. "Reconsidering Zipf’s law for regional development: The case of settlements and cities in Croatia," Miscellanea Geographica. Regional Studies on Development, Sciendo, vol. 22(1), pages 22-30, March.
    11. Luckstead, Jeff & Devadoss, Stephen & Danforth, Diana, 2017. "The size distributions of all Indian cities," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 474(C), pages 237-249.
    12. Ramos, Arturo, 2015. "Log-growth distributions of US city sizes and non-Lévy processes," MPRA Paper 66561, University Library of Munich, Germany.
    13. Arturo, Ramos, 2019. "Have the log-population processes stationary and independent increments? Empirical evidence for Italy, Spain and the USA along more than a century," MPRA Paper 93562, University Library of Munich, Germany.
    14. Ramos, Arturo & Sanz-Gracia, Fernando, 2015. "US city size distribution revisited: Theory and empirical evidence," MPRA Paper 64051, University Library of Munich, Germany.
    15. Gualandi, Stefano & Toscani, Giuseppe, 2019. "Size distribution of cities: A kinetic explanation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 524(C), pages 221-234.
    16. Christian Düben & Melanie Krause, 2021. "Population, light, and the size distribution of cities," Journal of Regional Science, Wiley Blackwell, vol. 61(1), pages 189-211, January.
    17. Giorgio Fazio & Marco Modica, 2015. "Pareto Or Log-Normal? Best Fit And Truncation In The Distribution Of All Cities," Journal of Regional Science, Wiley Blackwell, vol. 55(5), pages 736-756, November.
    18. Christian Schluter, 2021. "On Zipf’s law and the bias of Zipf regressions," Empirical Economics, Springer, vol. 61(2), pages 529-548, August.
    19. Ramos, Arturo, 2015. "Are the log-growth rates of city sizes normally distributed? Empirical evidence for the US," MPRA Paper 65584, University Library of Munich, Germany.
    20. Rafael González-Val, 2021. "The Spanish spatial city size distribution," Environment and Planning B, , vol. 48(6), pages 1609-1631, July.

    More about this item

    Keywords

    Mixture distributions; EM algorithm; lognormal distribution; Pareto distribution;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:trn:utwprg:2020/9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: roberto.gabriele@unitn.it (email available below). General contact details of provider: https://edirc.repec.org/data/detreit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.