IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0207596.html
   My bibliography  Save this article

Application-aware deadline constraint job scheduling mechanism on large-scale computational grid

Author

Listed:
  • Xiaoyong Tang
  • Xiaoyi Liao

Abstract

Recently, computational Grids have proven to be a good solution for processing large-scale, computation intensive problems. However, the heterogeneity, dynamics of resources and diversity of applications requirements have always been important factors affecting their performance. In response to these challenges, this work first builds a Grid job scheduling architecture that can dynamically monitor Grid computing center resources and make corresponding scheduling decisions. Second, a Grid job model is proposed to describe the application requirements. Third, this paper studies the characteristics of commercial interconnection networks used in Grids and forecast job transmission time. Fourth, this paper proposes an application-aware job scheduling mechanism (AJSM) that includes periodic scheduling flow and a heuristic application-aware deadline constraint job scheduling algorithm. The rigorous performance evaluation results clearly demonstrate that the proposed application-aware job scheduling mechanism can successful schedule more Grid jobs than the existing algorithms. For successful scheduled jobs, our proposed AJSM method is the best algorithm for job average processing time and makespan.

Suggested Citation

  • Xiaoyong Tang & Xiaoyi Liao, 2018. "Application-aware deadline constraint job scheduling mechanism on large-scale computational grid," PLOS ONE, Public Library of Science, vol. 13(11), pages 1-19, November.
    • Handle: RePEc:plo:pone00:0207596
    DOI: 10.1371/journal.pone.0207596
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0207596
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0207596&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0207596?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Tang, Jinjun & Yang, Yifan & Qi, Yong, 2018. "A hybrid algorithm for Urban transit schedule optimization," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 512(C), pages 745-755.
    2. Tang, Jinjun & Liang, Jian & Zhang, Shen & Huang, Helai & Liu, Fang, 2018. "Inferring driving trajectories based on probabilistic model from large scale taxi GPS data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 506(C), pages 566-577.
    3. Yajie Zou & John E. Ash & Byung-Jung Park & Dominique Lord & Lingtao Wu, 2018. "Empirical Bayes estimates of finite mixture of negative binomial regression models and its application to highway safety," Journal of Applied Statistics, Taylor & Francis Journals, vol. 45(9), pages 1652-1669, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alaa A. Abdallat & Arwa I. Alahmad & Duaa A. AlSahebAlT amimi & Jaber A. AlWidian, 2019. "Hadoop MapReduce Job Scheduling Algorithms Survey and Use Cases," Modern Applied Science, Canadian Center of Science and Education, vol. 13(7), pages 1-38, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruone Zhang & Xin Ye & Ke Wang & Dongjin Li & Jiayu Zhu, 2019. "Development of Commute Mode Choice Model by Integrating Actively and Passively Collected Travel Data," Sustainability, MDPI, vol. 11(10), pages 1-15, May.
    2. Chen Xu & Decun Dong & Dongxiu Ou & Changxi Ma, 2019. "Time-of-Day Control Double-Order Optimization of Traffic Safety and Data-Driven Intersections," IJERPH, MDPI, vol. 16(5), pages 1-18, March.
    3. Gao, Yuhong & Qu, Zhaowei & Song, Xianmin & Yun, Zhenyu & Xia, Yingji, 2021. "A novel relationship model between signal timing, queue length and travel speed," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 583(C).
    4. Tang, Jinjun & Chen, Xinqiang & Hu, Zheng & Zong, Fang & Han, Chunyang & Li, Leixiao, 2019. "Traffic flow prediction based on combination of support vector machine and data denoising schemes," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 534(C).
    5. Xin Guan & Xin Ye & Cheng Shi & Yajie Zou, 2019. "A Multivariate Modeling Analysis of Commuters’ Non-Work Activity Allocations in Xiaoshan District of Hangzhou, China," Sustainability, MDPI, vol. 11(20), pages 1-19, October.
    6. Wang, Chao & Ma, Changxi & Xu, Xuecai(Daniel), 2020. "Multi-objective optimization of real-time customized bus routes based on two-stage method," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 537(C).
    7. Zong, Fang & Yu, Ping & Tang, Jinjun & Sun, Xiao, 2019. "Understanding parking decisions with structural equation modeling," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 523(C), pages 408-417.
    8. Tang, Jinjun & Hu, Jin & Hao, Wei & Chen, Xinqiang & Qi, Yong, 2020. "Markov Chains based route travel time estimation considering link spatio-temporal correlation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    9. Jingjing Xu & Behram Wali & Xiaobing Li & Jiaqi Yang, 2019. "Injury Severity and Contributing Driver Actions in Passenger Vehicle–Truck Collisions," IJERPH, MDPI, vol. 16(19), pages 1-16, September.
    10. Helai Huang & Jialing Wu & Fang Liu & Yiwei Wang, 2020. "Measuring Accessibility Based on Improved Impedance and Attractive Functions Using Taxi Trajectory Data," Sustainability, MDPI, vol. 13(1), pages 1-23, December.
    11. Lukuman Wahab & Haobin Jiang, 2019. "A comparative study on machine learning based algorithms for prediction of motorcycle crash severity," PLOS ONE, Public Library of Science, vol. 14(4), pages 1-17, April.
    12. Qian Duan & Xin Ye & Jian Li & Ke Wang, 2020. "Empirical Modeling Analysis of Potential Commute Demand for Carsharing in Shanghai, China," Sustainability, MDPI, vol. 12(2), pages 1-18, January.
    13. Changxi Ma & Dong Yang & Jibiao Zhou & Zhongxiang Feng & Quan Yuan, 2019. "Risk Riding Behaviors of Urban E-Bikes: A Literature Review," IJERPH, MDPI, vol. 16(13), pages 1-18, June.
    14. Muhammad Wisal Khattak & Hans De Backer & Pieter De Winne & Tom Brijs & Ali Pirdavani, 2024. "Comparative Evaluation of Crash Hotspot Identification Methods: Empirical Bayes vs. Potential for Safety Improvement Using Variants of Negative Binomial Models," Sustainability, MDPI, vol. 16(4), pages 1-22, February.
    15. Hu, Beibei & Xia, Xuanxuan & Sun, Huijun & Dong, Xianlei, 2019. "Understanding the imbalance of the taxi market: From the high-quality customer’s perspective," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 535(C).
    16. Zhang, Shen & Liu, Xin & Tang, Jinjun & Cheng, Shaowu & Qi, Yong & Wang, Yinhai, 2018. "Spatio-temporal modeling of destination choice behavior through the Bayesian hierarchical approach," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 512(C), pages 537-551.
    17. Tang, Jinjun & Bi, Wei & Liu, Fang & Zhang, Wenhui, 2021. "Exploring urban travel patterns using density-based clustering with multi-attributes from large-scaled vehicle trajectories," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 561(C).
    18. Dong, Bing & Liu, Yapan & Fontenot, Hannah & Ouf, Mohamed & Osman, Mohamed & Chong, Adrian & Qin, Shuxu & Salim, Flora & Xue, Hao & Yan, Da & Jin, Yuan & Han, Mengjie & Zhang, Xingxing & Azar, Elie & , 2021. "Occupant behavior modeling methods for resilient building design, operation and policy at urban scale: A review," Applied Energy, Elsevier, vol. 293(C).
    19. Büchel, Beda & Corman, Francesco, 2022. "Modeling conditional dependencies for bus travel time estimation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 592(C).
    20. Lingyu Zheng & Hao Ma & Zhongyu Wang, 2024. "Travel Time Estimation for Urban Arterials Based on the Multi-Source Data," Sustainability, MDPI, vol. 16(17), pages 1-15, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0207596. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.