Task Scheduling in Big Data - Review, Research Challenges, and Prospects. Govindarajan, K., Kamburugamuve, S., Wickramasinghe, P., Abeykoon, V., & Fox, G. In 2017 9th International Conference on Advanced Computing, ICoAC 2017, pages 165-173, 8, 2018. Institute of Electrical and Electronics Engineers Inc..
Task Scheduling in Big Data - Review, Research Challenges, and Prospects [pdf]Paper  doi  abstract   bibtex   1 download  
—In a Big data computing, the processing of data requires a large amount of CPU cycles and network bandwidth and disk I/O. Dataflow is a programming model for processing Big data which consists of tasks organized in a graph structure. Scheduling these tasks is one of the key active research areas which mainly aims to place the tasks on available resources. It is essential to effectively schedule the tasks, in a manner that minimizes task completion time and increases utilization of resources. In recent years, various researchers have discussed and presented different task scheduling algorithms. In this research study, we have investigated the state-of-art of various types of task scheduling algorithms, scheduling considerations for batch and streaming processing, and task scheduling algorithms in the well-known open-source big data platforms. Furthermore, this study proposes a new task scheduling system to alleviate the problems persists in the existing task scheduling for big data.

Downloads: 1