Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published December 2006 | Published
Book Section - Chapter Open

DIANA Scheduling Hierarchies for Optimizing Bulk Job Scheduling

Abstract

The use of meta-schedulers for resource management in large-scale distributed systems often leads to a hierarchy of schedulers. In this paper, we discuss why existing meta-scheduling hierarchies are sometimes not sufficient for Grid systems due to their inability to re-organise jobs already scheduled locally. Such a job re-organisation is required to adapt to evolving loads which are common in heavily used Grid infrastructures. We propose a peer-topeer scheduling model and evaluate it using case studies and mathematical modelling. We detail the DIANA (Data Intensive and Network Aware) scheduling algorithm and its queue management system for coping with the load distribution and for supporting bulk job scheduling. We demonstrate that such a system is beneficial for dynamic, distributed and self-organizing resource management and can assist in optimizing load or job distribution in complex Grid infrastructures.

Additional Information

© 2006 IEEE.

Attached Files

Published - 04031062.pdf

Files

04031062.pdf
Files (348.3 kB)
Name Size Download all
md5:4a1c645d9ef711097377636dea122271
348.3 kB Preview Download

Additional details

Created:
August 19, 2023
Modified:
October 25, 2023