GWpilot: Enabling multi-level scheduling in distributed infrastructures with GridWay and pilot jobs


Downloads per month over past year




Downloads per month over past year

Huedo Cuesta, Eduardo and Rubio-Montero, A. J. and Castejón, F. and Mayo-García, R. (2015) GWpilot: Enabling multi-level scheduling in distributed infrastructures with GridWay and pilot jobs. Future Generation Computer Systems, 45 . pp. 25-52. ISSN 0167-739X

[thumbnail of GWpilot Enabling multi-level scheduling-preprint.pdf]

Official URL:


Current systems based on pilot jobs are not exploiting all the scheduling advantages that the technique offers, or they lack compatibility or adaptability. To overcome the limitations or drawbacks in existing approaches, this study presents a different general-purpose pilot system, GWpilot. This system provides individual users or institutions with a more easy-to-use, easy-toinstall, scalable, extendable, flexible and adjustable framework to efficiently run legacy applications. The framework is based on the GridWay meta-scheduler and incorporates the powerful features of this system, such as standard interfaces, fair-share policies, ranking, migration, accounting and compatibility with diverse infrastructures. GWpilot goes beyond establishing simple network overlays to overcome the waiting times in remote queues or to improve the reliability in task production. It properly tackles the characterisation problem in current infrastructures, allowing users to arbitrarily incorporate customised monitoring of resources and their running applications into the system. This functionality allows the new framework to implement innovative scheduling algorithms that accomplish the computational needs of a wide range of calculations faster and more efficiently. The system can also be easily stacked under other software layers, such as self-schedulers. The advanced techniques included by default in the framework result in significant performance improvements even when very short tasks are scheduled.

Item Type:Article
Additional Information:

DOI: 10.1016/j.future.2014.10.003

Uncontrolled Keywords:Grid scheduling, Pilot jobs, Resource characterization, Resource management, Application compatibility
Subjects:Sciences > Computer science > Computer programming
Sciences > Computer science > Computer networks
ID Code:42844
Deposited On:22 May 2017 11:43
Last Modified:22 May 2017 14:21

Origin of downloads

Repository Staff Only: item control page