A Survey on Task Scheduling of CPU-GPU Heterogeneous Cluster

Abstract: This paper reviews task scheduling frameworks, methods, and evaluation metrics of central processing unit-graphics processing unit (CPU-GPU) heterogeneous clusters. Task scheduling of CPU-GPU heterogeneous clusters can be carried out on the system-level, node-level, and device-level. Most task-scheduling technologies are heuristic based on the experts’ experience, while some technologies are based on statistic methods using machine learning, deep learning, or reinforcement learning. Many metrics have been adopted to evaluate and compare different task scheduling technologies that try to optimize different goals of task scheduling. Although statistic task scheduling has reached fewer research achievements than heuristic task scheduling, the statistic task scheduling still has significant research potential.

Keywords: CPU-GPU heterogeneous cluster; task scheduling; heuristic task scheduling; statistic task scheduling; parallelization