IDEAS home Printed from https://ideas.repec.org/a/spr/aodasc/v4y2017i3d10.1007_s40745-017-0113-4.html
   My bibliography  Save this article

Flexible Heavy Tailed Distributions for Big Data

Author

Listed:
  • Yuanyuan Zhang

    (University of Manchester)

  • Saralees Nadarajah

    (University of Manchester)

Abstract

The Pareto type I distribution (also known as the power law distribution and Zipf’s law) appears to be the main distribution used to model heavy tailed phenomena in the big data literature. The Pareto type I distribution being one of the oldest heavy tailed distributions is not very flexible. Here, we show flexibility of four other heavy tailed distributions for modeling four big data sets in social networks. The Pareto type I distribution is shown not to provide the best or even an adequate fit for any of the data sets.

Suggested Citation

  • Yuanyuan Zhang & Saralees Nadarajah, 2017. "Flexible Heavy Tailed Distributions for Big Data," Annals of Data Science, Springer, vol. 4(3), pages 421-432, September.
    • Handle: RePEc:spr:aodasc:v:4:y:2017:i:3:d:10.1007_s40745-017-0113-4
    DOI: 10.1007/s40745-017-0113-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40745-017-0113-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40745-017-0113-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Barry C. Arnold, 2008. "Pareto and Generalized Pareto Distributions," Economic Studies in Inequality, Social Exclusion, and Well-Being, in: Duangkamon Chotikapanich (ed.), Modeling Income Distributions and Lorenz Curves, chapter 7, pages 119-145, Springer.
    2. Godfrey, Leslie G, 1978. "Testing against General Autoregressive and Moving Average Error Models When the Regressors Include Lagged Dependent Variables," Econometrica, Econometric Society, vol. 46(6), pages 1293-1301, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chu, Jeffrey & Zhang, Yuanyuan & Chan, Stephen & Nadarajah, Saralees, 2020. "Bias reduction in the population size estimation of large data sets," Computational Statistics & Data Analysis, Elsevier, vol. 145(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zia-Ur- Rahman, 2019. "Influence of Excessive Expenditure of the Government in Perspective of Interest Rate and Money Circulation Which in Turn Affects the Growing Process in Pakistan," Asian Journal of Economics and Empirical Research, Asian Online Journal Publishing Group, vol. 6(2), pages 120-129.
    2. David F. Hendry & Hans-Martin Krolzig, 2005. "The Properties of Automatic "GETS" Modelling," Economic Journal, Royal Economic Society, vol. 115(502), pages 32-61, March.
    3. repec:lic:licosd:42821 is not listed on IDEAS
    4. Foellmi, Reto & Martínez, Isabel Z., 2014. "Volatile Top Income Shares in Switzerland? Reassessing the Evolution Between 1981 and 2009," CEPR Discussion Papers 10006, C.E.P.R. Discussion Papers.
    5. Bel, K. & Paap, R., 2013. "Modeling the impact of forecast-based regime switches on macroeconomic time series," Econometric Institute Research Papers EI 2013-25, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. repec:wyi:journl:002087 is not listed on IDEAS
    7. Sollis, Robert, 2011. "Spurious regression: A higher-order problem," Economics Letters, Elsevier, vol. 111(2), pages 141-143, May.
    8. Kwabena Asomanin Anaman & Gbensuglo Alidu Bukari, 2019. "Political Economy Analysis of the Macroeconomic Impact of National Elections in Ghana During the Fourth Republican Era, 1992 to 2016," Applied Economics and Finance, Redfame publishing, vol. 6(3), pages 28-44, May.
    9. Mansoor Rashid Malik & Devendra Kumar, 2019. "Generalized Pareto Distribution Based On Generalized Order Statistics And Associated Inference," Statistics in Transition New Series, Polish Statistical Association, vol. 20(3), pages 57-79, September.
    10. Busch, Thomas & Christensen, Bent Jesper & Nielsen, Morten Ørregaard, 2011. "The role of implied volatility in forecasting future realized volatility and jumps in foreign exchange, stock, and bond markets," Journal of Econometrics, Elsevier, vol. 160(1), pages 48-57, January.
    11. Jonas Hirz & Uwe Schmock & Pavel V. Shevchenko, 2017. "Actuarial Applications and Estimation of Extended CreditRisk+," Risks, MDPI, vol. 5(2), pages 1-29, March.
    12. Jin-Guan Lin & Li-Xing Zhu & Chun-Zheng Cao & Yong Li, 2011. "Tests of heteroscedasticity and correlation in multivariate t regression models with AR and ARMA errors," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(7), pages 1509-1531, August.
    13. Giorgio Canarella & Luis A. Gil-Alana & Rangan Gupta & Stephen M. Miller, 2020. "Modeling US historical time-series prices and inflation using alternative long-memory approaches," Empirical Economics, Springer, vol. 58(4), pages 1491-1511, April.
    14. Valizadeh, Pourya & Karali, Berna & Ferreira, Susana, 2017. "Ripple effects of the 2011 Japan earthquake on international stock markets," Research in International Business and Finance, Elsevier, vol. 41(C), pages 556-576.
    15. Grzegorz Rybak & Edward Kozłowski & Krzysztof Król & Tomasz Rymarczyk & Agnieszka Sulimierska & Artur Dmowski & Piotr Bednarczuk, 2023. "Algorithms for Optimizing Energy Consumption for Fermentation Processes in Biogas Production," Energies, MDPI, vol. 16(24), pages 1-17, December.
    16. Ansgar Belke & Robert Czudaj, 2010. "Is Euro Area Money Demand (Still) Stable? Cointegrated VAR Versus Single Equation Techniques," Applied Economics Quarterly (formerly: Konjunkturpolitik), Duncker & Humblot, Berlin, vol. 56(4), pages 285-315.
    17. Jennifer Castle & Takamitsu Kurita, 2019. "Modelling and forecasting the dollar-pound exchange rate in the presence of structural breaks," Economics Series Working Papers 866, University of Oxford, Department of Economics.
    18. David F. Hendry, 2013. "Econometric Modelling: The ‘Consumption Function’ In Retrospect," Scottish Journal of Political Economy, Scottish Economic Society, vol. 60(5), pages 495-522, November.
    19. L.A. Gil-Alanaa, 2007. "Testing The Existence of Multiple Cycles in Financial and Economic Time Series," Annals of Economics and Finance, Society for AEF, vol. 8(1), pages 1-20, May.
    20. Ansgar Belke & Robert Czudaj, 2010. "Is Euro Area Money Demand (Still) Stable? – Cointegrated VAR versus Single Equation Techniques," Ruhr Economic Papers 0171, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
    21. Eckhard Hein & Christian Schoder, 2011. "Interest rates, distribution and capital accumulation -- A post-Kaleckian perspective on the US and Germany," International Review of Applied Economics, Taylor & Francis Journals, vol. 25(6), pages 693-723, November.
    22. Marc Lavoie & Gabriel Rodriguez & Mario Seccareccia, 2004. "Similitudes and Discrepancies in Post-Keynesian and Marxist Theories of Investment: A Theoretical and Empirical Investigation," International Review of Applied Economics, Taylor & Francis Journals, vol. 18(2), pages 127-149.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aodasc:v:4:y:2017:i:3:d:10.1007_s40745-017-0113-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.