IDEAS home Printed from https://ideas.repec.org/a/spr/ijsaem/v13y2022i3d10.1007_s13198-021-01424-0.html
   My bibliography  Save this article

Stratified linear systematic sampling based clustering approach for detection of financial risk group by mining of big data

Author

Listed:
  • Kamlesh Kumar Pandey

    (Dr. Hari singh Gour Vishwavidyalaya)

  • Diwakar Shukla

    (Dr. Hari singh Gour Vishwavidyalaya)

Abstract

Risk analysis is one of the most essential business activities because it discovers unknown risks such as financial risk, recovery risk, investment risk, operational risk, credit risk, debit risk, and so on. Clustering is a data mining technique that uses data behavior and nature to discover unexpected risks in business data. In a big data setup, clustering algorithms encounter execution time and cluster quality-related challenges due to the primary attribute of big data. This study suggests a Stratified Systematic Sampling Extension (SSE) approach for risk analysis in big data mining using a single machine execution by clustering methodology. Sampling is a data reduction technique that saves computation time and improves cluster quality, scalability, and speed of the clustering algorithm. The proposed sampling plan first formulates the stratum by selecting the minimum variance dimension and then selects samples from each stratum using random linear systematic sampling. The clustering algorithm produces robust clusters in terms of risk and non-risk group with the help of sample data and extends the sample-based clustering results to final clustering results utilizing Euclidean distance. The performance of the SSE-based clustering algorithm has been compared to existing K-means and K-means ++ algorithms using Davies Bouldin score, Silhouette coefficient, Scattering Density between clusters Validity, Scattering Distance Validity and CPU time validation metrics on financial risk datasets. The experimental results demonstrate that the SSE-based clustering algorithm achieved better clustering objectives in terms of cluster compaction, separation, density, and variance while minimizing iterations, distance computation, data comparison, and computational time. The statistical analysis reveals that the proposed sampling plan attained statistical significance by employing the Friedman test.

Suggested Citation

  • Kamlesh Kumar Pandey & Diwakar Shukla, 2022. "Stratified linear systematic sampling based clustering approach for detection of financial risk group by mining of big data," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 13(3), pages 1239-1253, June.
  • Handle: RePEc:spr:ijsaem:v:13:y:2022:i:3:d:10.1007_s13198-021-01424-0
    DOI: 10.1007/s13198-021-01424-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s13198-021-01424-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s13198-021-01424-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shields, Michael D. & Teferra, Kirubel & Hapij, Adam & Daddazio, Raymond P., 2015. "Refined Stratified Sampling for efficient Monte Carlo based uncertainty quantification," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 310-325.
    2. Sumit Maheshwari & Prerna Gautam & Chandra K. Jaggi, 2021. "Role of Big Data Analytics in supply chain management: current trends and future perspectives," International Journal of Production Research, Taylor & Francis Journals, vol. 59(6), pages 1875-1900, March.
    3. Pierre Étoré & Benjamin Jourdain, 2010. "Adaptive Optimal Allocation in Stratified Sampling Methods," Methodology and Computing in Applied Probability, Springer, vol. 12(3), pages 335-360, September.
    4. Daniel Aloise & Claudio Contardo, 2018. "A sampling-based exact algorithm for the solution of the minimax diameter clustering problem," Journal of Global Optimization, Springer, vol. 71(3), pages 613-630, July.
    5. Zhang, Haixiang & Wang, HaiYing, 2021. "Distributed subdata selection for big data via sampling-based approach," Computational Statistics & Data Analysis, Elsevier, vol. 153(C).
    6. Wei-Chang Yeh & Chyh-Ming Lai, 2015. "Accelerated Simplified Swarm Optimization with Exploitation Search Scheme for Data Clustering," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-19, September.
    7. Marle, Franck & Vidal, Ludovic-Alexandre & Bocquet, Jean-Claude, 2013. "Interactions-based risk clustering methodologies and algorithms for complex project management," International Journal of Production Economics, Elsevier, vol. 142(2), pages 225-234.
    8. Jae Kwang Kim & Zhonglei Wang, 2019. "Sampling Techniques for Big Data Analysis," International Statistical Review, International Statistical Institute, vol. 87(S1), pages 177-191, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ellinas, Christos & Allan, Neil & Johansson, Anders, 2016. "Project systemic risk: Application examples of a network model," International Journal of Production Economics, Elsevier, vol. 182(C), pages 50-62.
    2. Garcia Maria del Mar Rueda, 2023. "Book Review: Silvia Biffignandi and Jelke Bethlehem. Handbook of Web Surveys, 2nd edition. 2021 Wiley, ISBN: 978-1-119-37168-7, 624 pps," Journal of Official Statistics, Sciendo, vol. 39(4), pages 591-595, December.
    3. Vicente Rodríguez Montequín & Joaquín Villanueva Balsera & Sonia María Cousillas Fernández & Francisco Ortega Fernández, 2018. "Exploring Project Complexity through Project Failure Factors: Analysis of Cluster Patterns Using Self-Organizing Maps," Complexity, Hindawi, vol. 2018, pages 1-17, May.
    4. Chien-Min Huang & F. Jay Breidt, 2023. "A dual-frame approach for estimation with respondent-driven samples," METRON, Springer;Sapienza Università di Roma, vol. 81(1), pages 65-81, April.
    5. Zahoor, Nadia & Khan, Zaheer & Shenkar, Oded, 2023. "International vertical alliances within the international business field: A systematic literature review and future research agenda," Journal of World Business, Elsevier, vol. 58(1).
    6. Thalles Vitelli Garcez & Helder Tenório Cavalcanti & Adiel Teixeira de Almeida, 2021. "A hybrid decision support model using Grey Relational Analysis and the Additive-Veto Model for solving multicriteria decision-making problems: an approach to supplier selection," Annals of Operations Research, Springer, vol. 304(1), pages 199-231, September.
    7. J. N. K. Rao, 2021. "On Making Valid Inferences by Integrating Data from Surveys and Other Sources," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(1), pages 242-272, May.
    8. Casado, Ramon Swell Gomes Rodrigues & Alencar, Marcelo Hazin & de Almeida, Adiel Teixeira, 2022. "Combining a multidimensional risk evaluation with an implicit enumeration algorithm to tackle the portfolio selection problem of a natural gas pipeline," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    9. Dingeç, Kemal Dinçer & Hörmann, Wolfgang, 2013. "Control variates and conditional Monte Carlo for basket and Asian options," Insurance: Mathematics and Economics, Elsevier, vol. 52(3), pages 421-434.
    10. Shields, Michael D. & Zhang, Jiaxin, 2016. "The generalization of Latin hypercube sampling," Reliability Engineering and System Safety, Elsevier, vol. 148(C), pages 96-108.
    11. Ehsan Najafnejhad & Mahdieh Tavassoli Roodsari & Somayeh Sepahrom & Mojtaba Jenabzadeh, 2021. "A mathematical inventory model for a single-vendor multi-retailer supply chain based on the Vendor Management Inventory Policy," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 12(3), pages 579-586, June.
    12. Schoenherr, Tobias, 2023. "Supply chain management professionals’ proficiency in big data analytics: Antecedents and impact on performance," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 169(C).
    13. Daniele Cuntrera & Vincenzo Falco & Ornella Giambalvo, 2022. "On the Sampling Size for Inverse Sampling," Stats, MDPI, vol. 5(4), pages 1-15, November.
    14. Corlay Sylvain & Pagès Gilles, 2015. "Functional quantization-based stratified sampling methods," Monte Carlo Methods and Applications, De Gruyter, vol. 21(1), pages 1-32, March.
    15. Sak, Halis & Başoğlu, İsmail, 2017. "Efficient randomized quasi-Monte Carlo methods for portfolio market risk," Insurance: Mathematics and Economics, Elsevier, vol. 76(C), pages 87-94.
    16. Franck Marle & Hadi Jaber & Catherine Pointurier, 2019. "Organizing Project Actors for Collective Decision-Making about Interdependent Risks," Complexity, Hindawi, vol. 2019, pages 1-18, March.
    17. Almohri, Haidar & Chinnam, Ratna Babu & Colosimo, Mark, 2019. "Data-driven analytics for benchmarking and optimizing the performance of automotive dealerships," International Journal of Production Economics, Elsevier, vol. 213(C), pages 69-80.
    18. Ludovic-Alexandre Vidal & Franck Marle & Mathieu Dernis, 2021. "Modeling and Estimating Host Country Values in International Projects to Facilitate In-Country Value Creation," Sustainability, MDPI, vol. 13(10), pages 1-21, May.
    19. María del Mar Rueda & Sergio Martínez-Puertas & Luis Castro-Martín, 2022. "Methods to Counter Self-Selection Bias in Estimations of the Distribution Function and Quantiles," Mathematics, MDPI, vol. 10(24), pages 1-19, December.
    20. Zhao, Guoqing & Xie, Xiaotian & Wang, Yi & Liu, Shaofeng & Jones, Paul & Lopez, Carmen, 2024. "Barrier analysis to improve big data analytics capability of the maritime industry: A mixed-method approach," Technological Forecasting and Social Change, Elsevier, vol. 203(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:ijsaem:v:13:y:2022:i:3:d:10.1007_s13198-021-01424-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.