A heuristic scheduling approach to hybrid Makepsan problem for data intensive computing

Wei Liang, Yonghua Xiong, Min Wu, Qun Jin

    研究成果: Conference contribution

    1 引用 (Scopus)

    抜粋

    Data intensive computing (DIC) offers an attractive option for business to remotely execute applications and load the computing resources from cloud in a streaming way. A key challenge in such environment is to increase the utilization of cloud cluster for the high throughput processing. One way of achieving this goal is to optimize the execution of computing jobs on the cluster. We observe that the order in which these jobs are executed can have a significant impact on their overall completion time (makespan). Our goal is to design a job scheduler that minimizes the makespan. In this study, a new formalization is introduced to present each job as a pair of disk processing and network transmitting two-stage durations. Due to the streaming processing feature, the two-stage operations are executed in an overlap manner and may lead to both one-stage and two-stage scheduling situations. A novel heuristic scheduling strategy is proposed for this hybrid scheduling problem, and the performance of the method is confirmed by the experimental evaluation.

    元の言語English
    ホスト出版物のタイトルProceedings - 2015 IEEE International Conference on Smart City, SmartCity 2015, Held Jointly with 8th IEEE International Conference on Social Computing and Networking, SocialCom 2015, 5th IEEE International Conference on Sustainable Computing and Communications, SustainCom 2015, 2015 International Conference on Big Data Intelligence and Computing, DataCom 2015, 5th International Symposium on Cloud and Service Computing, SC2 2015
    出版者Institute of Electrical and Electronics Engineers Inc.
    ページ932-937
    ページ数6
    ISBN(電子版)9781509018932
    DOI
    出版物ステータスPublished - 2016 5 2
    イベントIEEE International Conference on Smart City, SmartCity 2015 - Chengdu, China
    継続期間: 2015 12 192015 12 21

    Other

    OtherIEEE International Conference on Smart City, SmartCity 2015
    China
    Chengdu
    期間15/12/1915/12/21

      フィンガープリント

    ASJC Scopus subject areas

    • Information Systems
    • Media Technology
    • Computer Science Applications
    • Signal Processing
    • Computer Networks and Communications
    • Modelling and Simulation
    • Sociology and Political Science
    • Urban Studies

    これを引用

    Liang, W., Xiong, Y., Wu, M., & Jin, Q. (2016). A heuristic scheduling approach to hybrid Makepsan problem for data intensive computing. : Proceedings - 2015 IEEE International Conference on Smart City, SmartCity 2015, Held Jointly with 8th IEEE International Conference on Social Computing and Networking, SocialCom 2015, 5th IEEE International Conference on Sustainable Computing and Communications, SustainCom 2015, 2015 International Conference on Big Data Intelligence and Computing, DataCom 2015, 5th International Symposium on Cloud and Service Computing, SC2 2015 (pp. 932-937). [7463845] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SmartCity.2015.190